2024-09-07T03:24:59.686 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-07T03:24:59.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-07T03:24:59.797 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412 branch: wip-rgw-meta-handlers description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7893412' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 5c120bb86a547030eb0946833002675f49ccd220 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5c120bb86a547030eb0946833002675f49ccd220 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: 5c120bb86a547030eb0946833002675f49ccd220 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 594 sha1: 5c120bb86a547030eb0946833002675f49ccd220 sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_5c120bb86a547030eb0946833002675f49ccd220/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 5c120bb86a547030eb0946833002675f49ccd220 targets: smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqHFUJqw6U449BbjzkrfPGV6RfHlZAWNojsv9BYjEDrGIlzbOmU/Mick/DPT0zghbKuJIEjqSVGK48EWTMkbBo= smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKOrb3mlnEA4HaeUTfrzDPK6NCPlio4WzW5P2Z9HOxgTJ+0dD4QmK9ymEIofP1n0EdfpBn8KKgXoCaPzcT3/bjg= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-07_03:10:16 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-07T03:24:59.797 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_5c120bb86a547030eb0946833002675f49ccd220/qa; will attempt to use it 2024-09-07T03:24:59.798 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_5c120bb86a547030eb0946833002675f49ccd220/qa/tasks 2024-09-07T03:24:59.798 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-07T03:24:59.799 INFO:teuthology.task.internal:Checking packages... 2024-09-07T03:24:59.820 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5c120bb86a547030eb0946833002675f49ccd220' 2024-09-07T03:24:59.820 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-07T03:24:59.820 INFO:teuthology.packaging:ref: None 2024-09-07T03:24:59.820 INFO:teuthology.packaging:tag: None 2024-09-07T03:24:59.820 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-07T03:24:59.821 INFO:teuthology.packaging:sha1: 5c120bb86a547030eb0946833002675f49ccd220 2024-09-07T03:24:59.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-07T03:24:59.989 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4759.g5c120bb8 2024-09-07T03:24:59.991 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-07T03:24:59.997 INFO:teuthology.task.internal:no buildpackages task found 2024-09-07T03:24:59.997 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-07T03:25:00.005 INFO:teuthology.task.internal:Saving configuration 2024-09-07T03:25:00.026 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-07T03:25:00.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-07T03:25:00.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-07 03:20:05.789707', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqHFUJqw6U449BbjzkrfPGV6RfHlZAWNojsv9BYjEDrGIlzbOmU/Mick/DPT0zghbKuJIEjqSVGK48EWTMkbBo='} 2024-09-07T03:25:00.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-07 03:20:05.791736', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKOrb3mlnEA4HaeUTfrzDPK6NCPlio4WzW5P2Z9HOxgTJ+0dD4QmK9ymEIofP1n0EdfpBn8KKgXoCaPzcT3/bjg='} 2024-09-07T03:25:00.085 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-07T03:25:00.091 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-07T03:25:00.091 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-07T03:25:00.091 INFO:teuthology.run_tasks:Running task console_log... 2024-09-07T03:25:00.161 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feda183fac0>, signals=[15]) 2024-09-07T03:25:00.161 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-07T03:25:00.167 INFO:teuthology.task.internal:Opening connections... 2024-09-07T03:25:00.167 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-09-07T03:25:00.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-07T03:25:00.252 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-09-07T03:25:00.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-07T03:25:00.337 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-07T03:25:00.343 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-09-07T03:25:00.361 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-09-07T03:25:00.362 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-09-07T03:25:00.419 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-09-07T03:25:00.420 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-07T03:25:00.421 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-07T03:25:00.421 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-07T03:25:00.421 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-09-07T03:25:00.451 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-09-07T03:25:00.470 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-09-07T03:25:00.470 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-09-07T03:25:00.528 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-09-07T03:25:00.528 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-09-07T03:25:00.528 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-09-07T03:25:00.528 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-09-07T03:25:00.528 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-09-07T03:25:00.529 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-09-07T03:25:00.529 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-07T03:25:00.529 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-09-07T03:25:00.529 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-09-07T03:25:00.529 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-07T03:25:00.529 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-09-07T03:25:00.529 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-07T03:25:00.529 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-07T03:25:00.529 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-07T03:25:00.530 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-09-07T03:25:00.560 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-07T03:25:00.570 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-07T03:25:00.577 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-07T03:25:00.578 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-09-07T03:25:00.580 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-09-07T03:25:00.597 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-07T03:25:00.602 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-07T03:25:00.602 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-09-07T03:25:00.638 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-09-07T03:25:00.720 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-07T03:25:00.779 INFO:teuthology.run_tasks:Running task kernel... 2024-09-07T03:25:00.793 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-07T03:25:00.793 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-07T03:25:00.794 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-07T03:25:00.794 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-07T03:25:00.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-07T03:25:00.811 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-07T03:25:00.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-07T03:25:00.812 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-09-07T03:25:00.868 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-503.el9.x86_64 2024-09-07T03:25:00.868 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.14.0-503.el9.x86_64 2024-09-07T03:25:00.869 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2024-09-07T03:25:00.870 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-503.el9.x86_64 2024-09-07T03:25:00.870 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.14.0-503.el9.x86_64 2024-09-07T03:25:00.870 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2024-09-07T03:25:03.149 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-07T03:25:04.376 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-07T03:25:04.920 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-07T03:25:09.168 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 20 MB 00:03 2024-09-07T03:25:09.393 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-07T03:25:11.010 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-07T03:25:12.056 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-07T03:25:13.552 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-07T03:25:14.952 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-07T03:25:16.064 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-07T03:25:17.546 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-07T03:25:19.544 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-07T03:25:19.544 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-07T03:25:19.634 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:25:19.635 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:25:19.635 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:25:19.748 DEBUG:teuthology.orchestra.run.smithi120:> echo no | sudo yum reinstall kernel || true 2024-09-07T03:25:20.288 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:03 ago on Sat 07 Sep 2024 03:25:17 AM UTC. 2024-09-07T03:25:20.435 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout:Reinstalling: 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:25:20.445 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 1.9 M 2024-09-07T03:25:20.446 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 0 2024-09-07T03:25:20.446 INFO:teuthology.orchestra.run.smithi120.stderr:Operation aborted. 2024-09-07T03:25:20.510 INFO:teuthology.orchestra.run.smithi120.stdout:Is this ok [y/N]: 2024-09-07T03:25:20.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum reinstall -y kernel || true 2024-09-07T03:25:21.045 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:04 ago on Sat 07 Sep 2024 03:25:17 AM UTC. 2024-09-07T03:25:21.170 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:25:21.171 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:25:21.171 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-07T03:25:21.171 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:25:21.172 INFO:teuthology.orchestra.run.smithi120.stdout:Reinstalling: 2024-09-07T03:25:21.172 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-07T03:25:21.172 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:25:21.172 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:25:21.172 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:25:21.172 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:25:21.172 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 1.9 M 2024-09-07T03:25:21.172 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 0 2024-09-07T03:25:21.172 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:25:21.470 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-07T03:25:22.490 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-503.el9.x86_64.rpm 1.8 MB/s | 1.9 MB 00:01 2024-09-07T03:25:22.490 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:25:22.490 INFO:teuthology.orchestra.run.smithi120.stdout:Total 1.4 MB/s | 1.9 MB 00:01 2024-09-07T03:25:22.520 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:25:22.758 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:25:22.759 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:25:22.788 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:25:22.789 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:25:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:25:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-07T03:25:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-07T03:25:23.451 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-07T03:25:23.451 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-07T03:25:23.543 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:25:23.544 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:25:23.544 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:25:23.658 DEBUG:teuthology.orchestra.run.smithi104:> echo no | sudo yum reinstall kernel || true 2024-09-07T03:25:23.868 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-09-07T03:25:23.868 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-07T03:25:24.197 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:03 ago on Sat 07 Sep 2024 03:25:21 AM UTC. 2024-09-07T03:25:24.335 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:25:24.340 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:25:24.341 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-09-07T03:25:24.341 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:25:24.341 INFO:teuthology.orchestra.run.smithi104.stdout:Reinstalling: 2024-09-07T03:25:24.341 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-07T03:25:24.341 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:25:24.341 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:25:24.341 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:25:24.341 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:25:24.342 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 1.9 M 2024-09-07T03:25:24.342 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 0 2024-09-07T03:25:24.342 INFO:teuthology.orchestra.run.smithi104.stderr:Operation aborted. 2024-09-07T03:25:24.406 INFO:teuthology.orchestra.run.smithi104.stdout:Is this ok [y/N]: 2024-09-07T03:25:24.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum reinstall -y kernel || true 2024-09-07T03:25:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-07T03:25:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:25:24.563 INFO:teuthology.orchestra.run.smithi120.stdout:Reinstalled: 2024-09-07T03:25:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-5.14.0-503.el9.x86_64 2024-09-07T03:25:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:25:24.563 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:25:24.786 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-09-07T03:25:24.888 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-503.el9.x86_64 2024-09-07T03:25:24.889 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-09-07T03:25:24.889 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-09-07T03:25:24.889 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-07T03:25:24.889 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-07T03:25:24.917 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-09-07T03:25:24.938 DEBUG:teuthology.parallel:result is None 2024-09-07T03:25:24.943 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:03 ago on Sat 07 Sep 2024 03:25:21 AM UTC. 2024-09-07T03:25:25.069 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:25:25.070 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:25:25.070 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-09-07T03:25:25.070 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:25:25.070 INFO:teuthology.orchestra.run.smithi104.stdout:Reinstalling: 2024-09-07T03:25:25.070 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-07T03:25:25.070 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:25:25.070 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:25:25.071 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:25:25.071 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:25:25.071 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 1.9 M 2024-09-07T03:25:25.071 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 0 2024-09-07T03:25:25.071 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:25:26.063 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-503.el9.x86_64.rpm 2.2 MB/s | 1.9 MB 00:00 2024-09-07T03:25:26.064 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:25:26.064 INFO:teuthology.orchestra.run.smithi104.stdout:Total 1.9 MB/s | 1.9 MB 00:00 2024-09-07T03:25:26.101 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:25:26.339 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:25:26.340 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:25:26.370 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:25:26.370 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:25:26.545 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:25:26.657 INFO:teuthology.orchestra.run.smithi104.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-07T03:25:26.657 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-07T03:25:27.331 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-09-07T03:25:27.331 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-07T03:25:28.073 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-07T03:25:28.074 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:25:28.074 INFO:teuthology.orchestra.run.smithi104.stdout:Reinstalled: 2024-09-07T03:25:28.074 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-5.14.0-503.el9.x86_64 2024-09-07T03:25:28.074 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:25:28.074 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:25:28.269 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-09-07T03:25:28.328 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-503.el9.x86_64 2024-09-07T03:25:28.328 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-09-07T03:25:28.328 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-09-07T03:25:28.328 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-07T03:25:28.329 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-07T03:25:28.361 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2024-09-07T03:25:28.385 DEBUG:teuthology.parallel:result is None 2024-09-07T03:25:28.385 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-07T03:25:28.392 INFO:teuthology.task.internal:Creating test directory... 2024-09-07T03:25:28.392 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-07T03:25:28.428 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-07T03:25:28.446 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-07T03:25:28.452 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-07T03:25:28.547 INFO:teuthology.task.internal:Creating archive directory... 2024-09-07T03:25:28.548 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-07T03:25:28.550 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-07T03:25:28.843 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-07T03:25:28.850 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-07T03:25:28.850 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-07T03:25:28.853 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-07T03:25:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-07T03:25:28.909 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-07T03:25:28.915 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-07T03:25:28.919 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-07T03:25:28.921 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-07T03:25:28.932 INFO:teuthology.task.internal:Configuring sudo... 2024-09-07T03:25:28.932 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-07T03:25:28.935 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-07T03:25:28.964 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-07T03:25:28.973 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-07T03:25:28.973 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-07T03:25:29.002 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-07T03:25:29.021 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-07T03:25:29.103 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-07T03:25:29.154 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-07T03:25:29.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-07T03:25:29.278 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:25:29.279 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-07T03:25:29.343 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-07T03:25:29.389 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-07T03:25:29.445 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-07T03:25:29.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-07T03:25:29.573 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:25:29.573 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-07T03:25:29.640 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-09-07T03:25:29.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-09-07T03:25:29.672 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-07T03:25:29.722 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-07T03:25:30.198 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-07T03:25:30.208 INFO:teuthology.task.internal:Starting timer... 2024-09-07T03:25:30.209 INFO:teuthology.run_tasks:Running task pcp... 2024-09-07T03:25:30.220 INFO:teuthology.run_tasks:Running task selinux... 2024-09-07T03:25:30.228 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-09-07T03:25:30.279 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-09-07T03:25:30.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-09-07T03:25:30.336 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-09-07T03:25:30.338 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-07T03:25:30.338 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-09-07T03:25:30.377 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-09-07T03:25:30.378 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-09-07T03:25:30.398 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-09-07T03:25:30.398 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi104.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi120.front.sepia.ceph.com': 'permissive'} 2024-09-07T03:25:30.399 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-07T03:25:30.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-07T03:25:30.443 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-07T03:25:30.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-07T03:25:30.470 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-07T03:25:30.470 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-09-07T03:25:30.524 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-09-07T03:25:30.555 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-07T03:25:30.564 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-07T03:25:30.574 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-07T03:25:30.575 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi104.front.sepia.ceph.com,smithi120.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-07T03:29:13.640 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi104.front.sepia.ceph.com'), Remote(name='ubuntu@smithi120.front.sepia.ceph.com')] 2024-09-07T03:29:13.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-07T03:29:13.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-07T03:29:13.729 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-09-07T03:29:13.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-07T03:29:13.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-07T03:29:13.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-07T03:29:13.903 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-07T03:29:13.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-07T03:29:13.984 INFO:teuthology.run_tasks:Running task clock... 2024-09-07T03:29:13.994 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-07T03:29:13.994 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-07T03:29:13.995 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-07T03:29:13.997 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-07T03:29:13.997 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-07T03:29:14.023 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-07T03:29:14.038 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-07T03:29:14.052 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-07T03:29:14.062 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-09-07T03:29:14.066 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-07T03:29:14.073 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-09-07T03:29:14.087 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-07T03:29:14.090 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-09-07T03:29:14.101 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-07T03:29:14.101 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-09-07T03:29:14.115 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-07T03:29:14.129 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-07T03:29:14.155 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-09-07T03:29:14.158 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-07T03:29:14.158 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-09-07T03:29:14.158 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:29:14.159 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:29:14.159 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:29:14.159 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:29:14.184 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-07T03:29:14.187 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-07T03:29:14.188 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-07T03:29:14.188 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:29:14.188 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:29:14.188 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:29:14.188 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:29:14.189 INFO:teuthology.run_tasks:Running task install... 2024-09-07T03:29:14.197 DEBUG:teuthology.task.install:project ceph 2024-09-07T03:29:14.197 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5c120bb86a547030eb0946833002675f49ccd220'}} 2024-09-07T03:29:14.197 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '5c120bb86a547030eb0946833002675f49ccd220'} 2024-09-07T03:29:14.197 INFO:teuthology.task.install:Using flavor: default 2024-09-07T03:29:14.202 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-07T03:29:14.202 INFO:teuthology.task.install:extra packages: [] 2024-09-07T03:29:14.203 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5c120bb86a547030eb0946833002675f49ccd220', 'tag': None, 'wait_for_package': False} 2024-09-07T03:29:14.203 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c120bb86a547030eb0946833002675f49ccd220 2024-09-07T03:29:14.206 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5c120bb86a547030eb0946833002675f49ccd220', 'tag': None, 'wait_for_package': False} 2024-09-07T03:29:14.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c120bb86a547030eb0946833002675f49ccd220 2024-09-07T03:29:14.366 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/5c120bb86a547030eb0946833002675f49ccd220/centos/9/flavors/default/ 2024-09-07T03:29:14.366 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4759.g5c120bb8 2024-09-07T03:29:14.381 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/5c120bb86a547030eb0946833002675f49ccd220/centos/9/flavors/default/ 2024-09-07T03:29:14.382 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4759.g5c120bb8 2024-09-07T03:29:14.487 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/5c120bb86a547030eb0946833002675f49ccd220/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/5c120bb86a547030eb0946833002675f49ccd220/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/5c120bb86a547030eb0946833002675f49ccd220/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-07T03:29:14.488 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:29:14.488 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-07T03:29:14.498 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/5c120bb86a547030eb0946833002675f49ccd220/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/5c120bb86a547030eb0946833002675f49ccd220/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/5c120bb86a547030eb0946833002675f49ccd220/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-07T03:29:14.498 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:29:14.498 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-07T03:29:14.514 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-07T03:29:14.514 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5c120bb86a547030eb0946833002675f49ccd220/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-07T03:29:14.525 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-07T03:29:14.525 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5c120bb86a547030eb0946833002675f49ccd220/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-07T03:29:14.579 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-07T03:29:14.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-07T03:29:14.654 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-07T03:29:14.666 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-07T03:29:14.718 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-09-07T03:29:14.720 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-09-07T03:29:14.730 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-09-07T03:29:14.731 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-09-07T03:29:14.942 INFO:teuthology.orchestra.run.smithi104.stdout:45 files removed 2024-09-07T03:29:14.957 INFO:teuthology.orchestra.run.smithi120.stdout:45 files removed 2024-09-07T03:29:14.969 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw 2024-09-07T03:29:14.984 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw 2024-09-07T03:29:15.504 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 339 kB/s | 84 kB 00:00 2024-09-07T03:29:15.506 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-07T03:29:15.782 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-07T03:29:15.796 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-07T03:29:16.057 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-07T03:29:16.071 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-07T03:29:16.649 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-07T03:29:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.2 MB 00:01 2024-09-07T03:29:20.567 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-07T03:29:21.873 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-07T03:29:24.917 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-07T03:29:26.359 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-07T03:29:27.489 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-07T03:29:29.248 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.5 MB 00:03 2024-09-07T03:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-07T03:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-07T03:29:32.919 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-07T03:29:35.220 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:29:35.222 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:29:35.222 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 11 M 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 3.5 M 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 3.2 M 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 5.5 M 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 22 M 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 25 k 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-07T03:29:35.223 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 755 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 508 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 5.5 M 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-07T03:29:35.224 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 45 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 143 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 161 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 321 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 305 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 100 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:29:35.225 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:29:35.226 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:29:35.226 INFO:teuthology.orchestra.run.smithi104.stdout:Install 30 Packages 2024-09-07T03:29:35.226 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 2 Packages 2024-09-07T03:29:35.226 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:29:35.226 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 61 M 2024-09-07T03:29:35.226 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:29:36.329 INFO:teuthology.orchestra.run.smithi104.stdout:(1/32): ceph-radosgw-19.3.0-4759.g5c120bb8.el9. 13 MB/s | 11 MB 00:00 2024-09-07T03:29:36.403 INFO:teuthology.orchestra.run.smithi104.stdout:(2/32): ceph-base-19.3.0-4759.g5c120bb8.el9.x86 6.2 MB/s | 5.5 MB 00:00 2024-09-07T03:29:36.429 INFO:teuthology.orchestra.run.smithi104.stdout:(3/32): ceph-selinux-19.3.0-4759.g5c120bb8.el9. 252 kB/s | 25 kB 00:00 2024-09-07T03:29:36.462 INFO:teuthology.orchestra.run.smithi104.stdout:(4/32): libcephfs2-19.3.0-4759.g5c120bb8.el9.x8 13 MB/s | 755 kB 00:00 2024-09-07T03:29:36.504 INFO:teuthology.orchestra.run.smithi104.stdout:(5/32): libradosstriper1-19.3.0-4759.g5c120bb8. 6.6 MB/s | 508 kB 00:00 2024-09-07T03:29:36.571 INFO:teuthology.orchestra.run.smithi104.stdout:(6/32): python3-ceph-argparse-19.3.0-4759.g5c12 675 kB/s | 45 kB 00:00 2024-09-07T03:29:36.647 INFO:teuthology.orchestra.run.smithi104.stdout:(7/32): python3-ceph-common-19.3.0-4759.g5c120b 1.9 MB/s | 143 kB 00:00 2024-09-07T03:29:36.839 INFO:teuthology.orchestra.run.smithi104.stdout:(8/32): ceph-common-19.3.0-4759.g5c120bb8.el9.x 16 MB/s | 22 MB 00:01 2024-09-07T03:29:36.864 INFO:teuthology.orchestra.run.smithi104.stdout:(9/32): python3-cephfs-19.3.0-4759.g5c120bb8.el 745 kB/s | 161 kB 00:00 2024-09-07T03:29:36.939 INFO:teuthology.orchestra.run.smithi104.stdout:(10/32): librgw2-19.3.0-4759.g5c120bb8.el9.x86_ 12 MB/s | 5.5 MB 00:00 2024-09-07T03:29:36.964 INFO:teuthology.orchestra.run.smithi104.stdout:(11/32): python3-rados-19.3.0-4759.g5c120bb8.el 2.5 MB/s | 321 kB 00:00 2024-09-07T03:29:36.990 INFO:teuthology.orchestra.run.smithi104.stdout:(12/32): python3-rbd-19.3.0-4759.g5c120bb8.el9. 2.4 MB/s | 305 kB 00:00 2024-09-07T03:29:37.014 INFO:teuthology.orchestra.run.smithi104.stdout:(13/32): python3-rgw-19.3.0-4759.g5c120bb8.el9. 1.9 MB/s | 100 kB 00:00 2024-09-07T03:29:37.082 INFO:teuthology.orchestra.run.smithi104.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 677 kB/s | 45 kB 00:00 2024-09-07T03:29:37.107 INFO:teuthology.orchestra.run.smithi104.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 750 kB/s | 107 kB 00:00 2024-09-07T03:29:37.141 INFO:teuthology.orchestra.run.smithi104.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-07T03:29:37.216 INFO:teuthology.orchestra.run.smithi104.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-07T03:29:37.234 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-07T03:29:37.241 INFO:teuthology.orchestra.run.smithi104.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 422 kB/s | 42 kB 00:00 2024-09-07T03:29:37.266 INFO:teuthology.orchestra.run.smithi104.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-07T03:29:37.317 INFO:teuthology.orchestra.run.smithi104.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 476 kB/s | 36 kB 00:00 2024-09-07T03:29:37.342 INFO:teuthology.orchestra.run.smithi104.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-07T03:29:37.384 INFO:teuthology.orchestra.run.smithi104.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.3 MB/s | 221 kB 00:00 2024-09-07T03:29:37.451 INFO:teuthology.orchestra.run.smithi104.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.3 MB/s | 309 kB 00:00 2024-09-07T03:29:37.476 INFO:teuthology.orchestra.run.smithi104.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-07T03:29:37.501 INFO:teuthology.orchestra.run.smithi104.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 254 kB/s | 26 kB 00:00 2024-09-07T03:29:37.535 INFO:teuthology.orchestra.run.smithi104.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-07T03:29:37.560 INFO:teuthology.orchestra.run.smithi104.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2024-09-07T03:29:37.610 INFO:teuthology.orchestra.run.smithi104.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-07T03:29:37.653 INFO:teuthology.orchestra.run.smithi104.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-07T03:29:37.736 INFO:teuthology.orchestra.run.smithi104.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-07T03:29:37.845 INFO:teuthology.orchestra.run.smithi104.stdout:(31/32): librados2-19.3.0-4759.g5c120bb8.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-07T03:29:37.937 INFO:teuthology.orchestra.run.smithi104.stdout:(32/32): librbd1-19.3.0-4759.g5c120bb8.el9.x86_ 11 MB/s | 3.2 MB 00:00 2024-09-07T03:29:37.942 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:29:37.942 INFO:teuthology.orchestra.run.smithi104.stdout:Total 23 MB/s | 61 MB 00:02 2024-09-07T03:29:38.044 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:29:38.080 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:29:38.080 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:29:38.557 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:29:38.557 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:29:39.517 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:29:39.519 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 11 M 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 3.5 M 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 3.2 M 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 5.5 M 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 22 M 2024-09-07T03:29:39.520 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 25 k 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 755 k 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 508 k 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 5.5 M 2024-09-07T03:29:39.521 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 45 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 143 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 161 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 321 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 305 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 100 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-07T03:29:39.522 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-09-07T03:29:39.523 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-07T03:29:39.523 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:29:39.523 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:29:39.523 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:29:39.523 INFO:teuthology.orchestra.run.smithi120.stdout:Install 30 Packages 2024-09-07T03:29:39.523 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 2 Packages 2024-09-07T03:29:39.523 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:29:39.524 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 61 M 2024-09-07T03:29:39.524 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:29:40.046 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:29:40.129 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-07T03:29:40.157 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-07T03:29:40.183 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-07T03:29:40.206 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-07T03:29:40.234 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-07T03:29:40.252 INFO:teuthology.orchestra.run.smithi120.stdout:(1/32): ceph-base-19.3.0-4759.g5c120bb8.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-07T03:29:40.319 INFO:teuthology.orchestra.run.smithi120.stdout:(2/32): ceph-selinux-19.3.0-4759.g5c120bb8.el9. 378 kB/s | 25 kB 00:00 2024-09-07T03:29:40.403 INFO:teuthology.orchestra.run.smithi120.stdout:(3/32): libcephfs2-19.3.0-4759.g5c120bb8.el9.x8 8.8 MB/s | 755 kB 00:00 2024-09-07T03:29:40.424 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-07T03:29:40.477 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-07T03:29:40.494 INFO:teuthology.orchestra.run.smithi120.stdout:(4/32): libradosstriper1-19.3.0-4759.g5c120bb8. 5.4 MB/s | 508 kB 00:00 2024-09-07T03:29:40.720 INFO:teuthology.orchestra.run.smithi120.stdout:(5/32): ceph-radosgw-19.3.0-4759.g5c120bb8.el9. 12 MB/s | 11 MB 00:00 2024-09-07T03:29:40.814 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-07T03:29:40.820 INFO:teuthology.orchestra.run.smithi120.stdout:(6/32): librgw2-19.3.0-4759.g5c120bb8.el9.x86_6 17 MB/s | 5.5 MB 00:00 2024-09-07T03:29:40.846 INFO:teuthology.orchestra.run.smithi120.stdout:(7/32): python3-ceph-argparse-19.3.0-4759.g5c12 360 kB/s | 45 kB 00:00 2024-09-07T03:29:40.871 INFO:teuthology.orchestra.run.smithi120.stdout:(8/32): python3-ceph-common-19.3.0-4759.g5c120b 2.8 MB/s | 143 kB 00:00 2024-09-07T03:29:40.896 INFO:teuthology.orchestra.run.smithi120.stdout:(9/32): python3-cephfs-19.3.0-4759.g5c120bb8.el 3.1 MB/s | 161 kB 00:00 2024-09-07T03:29:40.918 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 7/34 2024-09-07T03:29:40.922 INFO:teuthology.orchestra.run.smithi120.stdout:(10/32): python3-rados-19.3.0-4759.g5c120bb8.el 6.2 MB/s | 321 kB 00:00 2024-09-07T03:29:40.947 INFO:teuthology.orchestra.run.smithi120.stdout:(11/32): python3-rbd-19.3.0-4759.g5c120bb8.el9. 5.9 MB/s | 305 kB 00:00 2024-09-07T03:29:40.972 INFO:teuthology.orchestra.run.smithi120.stdout:(12/32): python3-rgw-19.3.0-4759.g5c120bb8.el9. 1.9 MB/s | 100 kB 00:00 2024-09-07T03:29:41.018 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 7/34 2024-09-07T03:29:41.110 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:19.3.0-4759.g5c120bb8.el9.x86_64 8/34 2024-09-07T03:29:41.136 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 9/34 2024-09-07T03:29:41.198 INFO:teuthology.orchestra.run.smithi120.stdout:(13/32): ceph-common-19.3.0-4759.g5c120bb8.el9. 16 MB/s | 22 MB 00:01 2024-09-07T03:29:41.198 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 9/34 2024-09-07T03:29:41.227 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-07T03:29:41.271 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:19.3.0-4759.g5c120bb8.el9. 11/34 2024-09-07T03:29:41.306 INFO:teuthology.orchestra.run.smithi120.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 419 kB/s | 45 kB 00:00 2024-09-07T03:29:41.331 INFO:teuthology.orchestra.run.smithi120.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 278 kB/s | 107 kB 00:00 2024-09-07T03:29:41.354 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:19.3.0-4759.g5c120bb8.el9.x86_64 12/34 2024-09-07T03:29:41.357 INFO:teuthology.orchestra.run.smithi120.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 417 kB/s | 160 kB 00:00 2024-09-07T03:29:41.388 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:19.3.0-4759.g5c120bb8.el9.x86_6 13/34 2024-09-07T03:29:41.407 INFO:teuthology.orchestra.run.smithi120.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 843 kB/s | 42 kB 00:00 2024-09-07T03:29:41.441 INFO:teuthology.orchestra.run.smithi120.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-07T03:29:41.452 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4759.g5c120bb8.el9.x86_6 13/34 2024-09-07T03:29:41.466 INFO:teuthology.orchestra.run.smithi120.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-07T03:29:41.491 INFO:teuthology.orchestra.run.smithi120.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 717 kB/s | 36 kB 00:00 2024-09-07T03:29:41.494 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-07T03:29:41.517 INFO:teuthology.orchestra.run.smithi120.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-07T03:29:41.542 INFO:teuthology.orchestra.run.smithi120.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-07T03:29:41.609 INFO:teuthology.orchestra.run.smithi120.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.6 MB/s | 309 kB 00:00 2024-09-07T03:29:41.610 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-07T03:29:41.634 INFO:teuthology.orchestra.run.smithi120.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-07T03:29:41.645 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-07T03:29:41.659 INFO:teuthology.orchestra.run.smithi120.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 254 kB/s | 26 kB 00:00 2024-09-07T03:29:41.684 INFO:teuthology.orchestra.run.smithi120.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-07T03:29:41.685 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-07T03:29:41.710 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-07T03:29:41.754 INFO:teuthology.orchestra.run.smithi120.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-07T03:29:41.754 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-07T03:29:41.768 INFO:teuthology.orchestra.run.smithi120.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-07T03:29:41.772 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-07T03:29:41.810 INFO:teuthology.orchestra.run.smithi120.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-07T03:29:41.903 INFO:teuthology.orchestra.run.smithi120.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-07T03:29:41.994 INFO:teuthology.orchestra.run.smithi120.stdout:(31/32): librados2-19.3.0-4759.g5c120bb8.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-07T03:29:42.053 INFO:teuthology.orchestra.run.smithi120.stdout:(32/32): librbd1-19.3.0-4759.g5c120bb8.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-07T03:29:42.057 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:29:42.057 INFO:teuthology.orchestra.run.smithi120.stdout:Total 24 MB/s | 61 MB 00:02 2024-09-07T03:29:42.094 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-07T03:29:42.143 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 22/34 2024-09-07T03:29:42.151 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:29:42.187 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:29:42.187 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:29:42.235 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 22/34 2024-09-07T03:29:42.265 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 23/34 2024-09-07T03:29:42.300 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-07T03:29:42.661 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:29:42.662 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:29:42.793 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-07T03:29:42.829 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:19.3.0-4759.g5c120bb8.el9.x86_64 26/34 2024-09-07T03:29:42.901 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:19.3.0-4759.g5c120bb8.el9.x86_64 26/34 2024-09-07T03:29:42.987 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 27/34 2024-09-07T03:29:43.023 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:19.3.0-4759.g5c120bb8.el9.x8 28/34 2024-09-07T03:29:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:29:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-07T03:29:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-07T03:29:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-07T03:29:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-07T03:29:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-07T03:29:44.533 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-07T03:29:44.585 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-07T03:29:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-07T03:29:45.035 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 7/34 2024-09-07T03:29:45.118 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 7/34 2024-09-07T03:29:45.206 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:19.3.0-4759.g5c120bb8.el9.x86_64 8/34 2024-09-07T03:29:45.237 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 9/34 2024-09-07T03:29:45.300 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 9/34 2024-09-07T03:29:45.311 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 29/34 2024-09-07T03:29:45.329 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-07T03:29:45.372 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:19.3.0-4759.g5c120bb8.el9. 11/34 2024-09-07T03:29:45.436 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 29/34 2024-09-07T03:29:45.441 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:19.3.0-4759.g5c120bb8.el9.x86_64 12/34 2024-09-07T03:29:45.464 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:19.3.0-4759.g5c120bb8.el9.x86_6 13/34 2024-09-07T03:29:45.529 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4759.g5c120bb8.el9.x86_6 13/34 2024-09-07T03:29:45.563 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-07T03:29:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-07T03:29:45.714 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-07T03:29:45.755 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-07T03:29:45.788 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-07T03:29:45.817 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-07T03:29:45.850 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-07T03:29:45.991 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 29/34 2024-09-07T03:29:46.031 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 30/34 2024-09-07T03:29:46.150 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 30/34 2024-09-07T03:29:46.150 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-07T03:29:46.150 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-07T03:29:46.151 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:29:46.182 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:19.3.0-4759.g5c120bb8.el9.x86_64 31/34 2024-09-07T03:29:46.185 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-07T03:29:46.230 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 22/34 2024-09-07T03:29:46.321 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 22/34 2024-09-07T03:29:46.351 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 23/34 2024-09-07T03:29:46.393 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-07T03:29:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-07T03:29:46.930 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:19.3.0-4759.g5c120bb8.el9.x86_64 26/34 2024-09-07T03:29:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:19.3.0-4759.g5c120bb8.el9.x86_64 26/34 2024-09-07T03:29:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 27/34 2024-09-07T03:29:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:19.3.0-4759.g5c120bb8.el9.x8 28/34 2024-09-07T03:29:49.439 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 29/34 2024-09-07T03:29:49.471 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 29/34 2024-09-07T03:29:50.023 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 29/34 2024-09-07T03:29:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 30/34 2024-09-07T03:29:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 30/34 2024-09-07T03:29:50.142 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-07T03:29:50.142 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-07T03:29:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:29:50.176 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:19.3.0-4759.g5c120bb8.el9.x86_64 31/34 2024-09-07T03:29:56.263 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4759.g5c120bb8.el9.x86_64 31/34 2024-09-07T03:29:56.263 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-09-07T03:29:56.263 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-09-07T03:29:56.263 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-09-07T03:29:56.263 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-09-07T03:29:56.264 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-09-07T03:29:56.264 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2024-09-07T03:29:56.264 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-09-07T03:29:56.264 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:29:57.237 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 32/34 2024-09-07T03:29:57.263 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 32/34 2024-09-07T03:29:57.263 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:29:57.263 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-07T03:29:57.263 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-07T03:29:57.263 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-07T03:29:57.264 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:29:57.265 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-07T03:29:57.356 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-07T03:29:57.356 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-07T03:29:58.545 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 3/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:19.3.0-4759.g5c120bb8.el9.x86_64 4/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 5/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:19.3.0-4759.g5c120bb8.el9.x86_6 6/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:19.3.0-4759.g5c120bb8.el9.x86_64 7/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4759.g5c120bb8.el9. 8/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:19.3.0-4759.g5c120bb8.el9.x8 9/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:19.3.0-4759.g5c120bb8.el9.x86_64 10/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:19.3.0-4759.g5c120bb8.el9.x86_64 11/34 2024-09-07T03:29:58.546 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 12/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 13/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-07T03:29:58.547 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-07T03:29:58.548 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-07T03:29:58.548 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-07T03:29:58.548 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-07T03:29:58.548 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-07T03:29:58.548 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 31/34 2024-09-07T03:29:58.548 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-07T03:29:58.548 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 33/34 2024-09-07T03:29:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-07T03:29:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:29:59.713 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-09-07T03:29:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.713 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-07T03:29:59.714 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.715 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.716 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:29:59.716 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-07T03:29:59.716 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-07T03:29:59.716 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-07T03:29:59.716 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-20.el9.x86_64 2024-09-07T03:29:59.716 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-07T03:29:59.716 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:29:59.716 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:00.056 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-test 2024-09-07T03:30:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4759.g5c120bb8.el9.x86_64 31/34 2024-09-07T03:30:00.143 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-09-07T03:30:00.143 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-09-07T03:30:00.143 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-09-07T03:30:00.143 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-09-07T03:30:00.143 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-09-07T03:30:00.143 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-09-07T03:30:00.143 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-09-07T03:30:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:00.608 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:28 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:00.739 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:00.739 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:00.739 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:30:00.739 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:00.739 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:30:00.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 45 M 2024-09-07T03:30:00.740 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-07T03:30:00.740 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 162 k 2024-09-07T03:30:00.740 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-07T03:30:00.740 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-07T03:30:00.740 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:00.740 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:30:00.740 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:00.740 INFO:teuthology.orchestra.run.smithi104.stdout:Install 4 Packages 2024-09-07T03:30:00.740 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:00.741 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 46 M 2024-09-07T03:30:00.741 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 201 M 2024-09-07T03:30:00.741 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:30:01.135 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 32/34 2024-09-07T03:30:01.162 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 32/34 2024-09-07T03:30:01.162 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:01.162 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-07T03:30:01.162 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-07T03:30:01.162 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-07T03:30:01.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:01.164 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-07T03:30:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-07T03:30:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-07T03:30:01.265 INFO:teuthology.orchestra.run.smithi104.stdout:(1/4): libcephsqlite-19.3.0-4759.g5c120bb8.el9. 612 kB/s | 162 kB 00:00 2024-09-07T03:30:01.774 INFO:teuthology.orchestra.run.smithi104.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 394 kB/s | 304 kB 00:00 2024-09-07T03:30:01.874 INFO:teuthology.orchestra.run.smithi104.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 105 kB/s | 64 kB 00:00 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/34 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/34 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 3/34 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:19.3.0-4759.g5c120bb8.el9.x86_64 4/34 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 5/34 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:19.3.0-4759.g5c120bb8.el9.x86_6 6/34 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:19.3.0-4759.g5c120bb8.el9.x86_64 7/34 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4759.g5c120bb8.el9. 8/34 2024-09-07T03:30:02.453 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:19.3.0-4759.g5c120bb8.el9.x8 9/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:19.3.0-4759.g5c120bb8.el9.x86_64 10/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:19.3.0-4759.g5c120bb8.el9.x86_64 11/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 12/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 13/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-07T03:30:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-07T03:30:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-07T03:30:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-07T03:30:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-07T03:30:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-07T03:30:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-07T03:30:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-07T03:30:02.456 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-07T03:30:02.456 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 31/34 2024-09-07T03:30:02.456 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-07T03:30:02.456 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 33/34 2024-09-07T03:30:02.716 INFO:teuthology.orchestra.run.smithi104.stdout:(4/4): ceph-test-19.3.0-4759.g5c120bb8.el9.x86_ 27 MB/s | 45 MB 00:01 2024-09-07T03:30:02.718 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:02.719 INFO:teuthology.orchestra.run.smithi104.stdout:Total 23 MB/s | 46 MB 00:01 2024-09-07T03:30:02.746 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:30:02.766 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:30:02.766 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:30:03.117 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:30:03.117 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:30:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-07T03:30:03.398 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-07T03:30:03.399 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:03.400 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-07T03:30:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-07T03:30:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-07T03:30:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: re2-1:20211101-20.el9.x86_64 2024-09-07T03:30:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-07T03:30:03.401 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:03.401 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:03.624 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:30:03.700 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-07T03:30:03.749 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-07T03:30:03.776 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:19.3.0-4759.g5c120bb8.el9.x86_64 3/4 2024-09-07T03:30:03.777 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-test 2024-09-07T03:30:04.328 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:27 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:04.460 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:04.461 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:04.461 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:30:04.461 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:04.461 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:30:04.461 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 45 M 2024-09-07T03:30:04.461 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-07T03:30:04.461 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 162 k 2024-09-07T03:30:04.461 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-07T03:30:04.461 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-07T03:30:04.462 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:04.462 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:30:04.462 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:04.462 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-09-07T03:30:04.462 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:04.462 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 46 M 2024-09-07T03:30:04.462 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 201 M 2024-09-07T03:30:04.462 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:30:04.790 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): libcephsqlite-19.3.0-4759.g5c120bb8.el9. 726 kB/s | 162 kB 00:00 2024-09-07T03:30:04.815 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-07T03:30:04.949 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 402 kB/s | 64 kB 00:00 2024-09-07T03:30:06.007 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): ceph-test-19.3.0-4759.g5c120bb8.el9.x86_ 32 MB/s | 45 MB 00:01 2024-09-07T03:30:06.009 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:06.009 INFO:teuthology.orchestra.run.smithi120.stdout:Total 30 MB/s | 46 MB 00:01 2024-09-07T03:30:06.036 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:30:06.056 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:30:06.057 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:30:06.405 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:30:06.405 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:30:06.914 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:30:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-07T03:30:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-07T03:30:07.076 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:19.3.0-4759.g5c120bb8.el9.x86_64 3/4 2024-09-07T03:30:08.070 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4759.g5c120bb8.el9.x86_64 3/4 2024-09-07T03:30:08.139 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:19.3.0-4759.g5c120bb8.el9.x86_64 4/4 2024-09-07T03:30:10.475 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-test-2:19.3.0-4759.g5c120bb8.el9.x86_64 4/4 2024-09-07T03:30:10.476 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/4 2024-09-07T03:30:10.476 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/4 2024-09-07T03:30:10.476 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-07T03:30:10.770 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-07T03:30:10.770 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:10.770 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:30:10.770 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:10.770 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:10.770 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-07T03:30:10.770 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-07T03:30:10.771 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:10.771 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:11.032 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph 2024-09-07T03:30:11.333 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4759.g5c120bb8.el9.x86_64 3/4 2024-09-07T03:30:11.430 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:19.3.0-4759.g5c120bb8.el9.x86_64 4/4 2024-09-07T03:30:11.594 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:39 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:11.736 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:11.739 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:11.739 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:30:11.739 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:11.739 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:30:11.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 6.6 k 2024-09-07T03:30:11.739 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 2.4 M 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 1.5 M 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 291 k 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 4.8 M 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 17 M 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-07T03:30:11.740 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-07T03:30:11.741 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-07T03:30:11.742 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-07T03:30:11.744 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-07T03:30:11.744 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-07T03:30:11.744 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-07T03:30:11.744 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-07T03:30:11.744 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-07T03:30:11.744 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-07T03:30:11.744 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-07T03:30:11.744 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-07T03:30:11.745 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-07T03:30:11.745 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-07T03:30:11.745 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:11.745 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:30:11.745 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:11.745 INFO:teuthology.orchestra.run.smithi104.stdout:Install 37 Packages 2024-09-07T03:30:11.745 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:11.746 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 31 M 2024-09-07T03:30:11.746 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 109 M 2024-09-07T03:30:11.746 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:30:12.332 INFO:teuthology.orchestra.run.smithi104.stdout:(1/37): ceph-19.3.0-4759.g5c120bb8.el9.x86_64.r 49 kB/s | 6.6 kB 00:00 2024-09-07T03:30:12.516 INFO:teuthology.orchestra.run.smithi104.stdout:(2/37): ceph-mgr-19.3.0-4759.g5c120bb8.el9.x86_ 4.8 MB/s | 1.5 MB 00:00 2024-09-07T03:30:12.566 INFO:teuthology.orchestra.run.smithi104.stdout:(3/37): ceph-mds-19.3.0-4759.g5c120bb8.el9.x86_ 6.4 MB/s | 2.4 MB 00:00 2024-09-07T03:30:12.658 INFO:teuthology.orchestra.run.smithi104.stdout:(4/37): ceph-mon-19.3.0-4759.g5c120bb8.el9.x86_ 15 MB/s | 4.8 MB 00:00 2024-09-07T03:30:12.683 INFO:teuthology.orchestra.run.smithi104.stdout:(5/37): ceph-mgr-modules-core-19.3.0-4759.g5c12 2.4 MB/s | 291 kB 00:00 2024-09-07T03:30:12.801 INFO:teuthology.orchestra.run.smithi104.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-07T03:30:12.842 INFO:teuthology.orchestra.run.smithi104.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-07T03:30:12.885 INFO:teuthology.orchestra.run.smithi104.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 6.1 MB/s | 1.2 MB 00:00 2024-09-07T03:30:12.910 INFO:teuthology.orchestra.run.smithi104.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-07T03:30:12.935 INFO:teuthology.orchestra.run.smithi104.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-07T03:30:12.960 INFO:teuthology.orchestra.run.smithi104.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-07T03:30:13.153 INFO:teuthology.orchestra.run.smithi104.stdout:(12/37): ceph-osd-19.3.0-4759.g5c120bb8.el9.x86 27 MB/s | 17 MB 00:00 2024-09-07T03:30:13.261 INFO:teuthology.orchestra.run.smithi104.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 321 kB/s | 35 kB 00:00 2024-09-07T03:30:13.328 INFO:teuthology.orchestra.run.smithi104.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 480 kB/s | 188 kB 00:00 2024-09-07T03:30:13.361 INFO:teuthology.orchestra.run.smithi104.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 430 kB/s | 172 kB 00:00 2024-09-07T03:30:13.378 INFO:teuthology.orchestra.run.smithi104.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-07T03:30:13.404 INFO:teuthology.orchestra.run.smithi104.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 542 kB/s | 77 kB 00:00 2024-09-07T03:30:13.429 INFO:teuthology.orchestra.run.smithi104.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 620 kB/s | 42 kB 00:00 2024-09-07T03:30:13.471 INFO:teuthology.orchestra.run.smithi104.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-07T03:30:13.488 INFO:teuthology.orchestra.run.smithi104.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 764 kB/s | 43 kB 00:00 2024-09-07T03:30:13.513 INFO:teuthology.orchestra.run.smithi104.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 4.2 MB/s | 172 kB 00:00 2024-09-07T03:30:13.538 INFO:teuthology.orchestra.run.smithi104.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-09-07T03:30:13.555 INFO:teuthology.orchestra.run.smithi104.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-07T03:30:13.572 INFO:teuthology.orchestra.run.smithi104.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 1.4 MB/s | 23 kB 00:00 2024-09-07T03:30:13.606 INFO:teuthology.orchestra.run.smithi104.stdout:(25/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.0 MB/s | 358 kB 00:00 2024-09-07T03:30:13.623 INFO:teuthology.orchestra.run.smithi104.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-07T03:30:13.640 INFO:teuthology.orchestra.run.smithi104.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 588 kB/s | 20 kB 00:00 2024-09-07T03:30:13.665 INFO:teuthology.orchestra.run.smithi104.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-09-07T03:30:13.699 INFO:teuthology.orchestra.run.smithi104.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-07T03:30:13.715 INFO:teuthology.orchestra.run.smithi104.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 1.0 MB/s | 16 kB 00:00 2024-09-07T03:30:13.740 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-test-2:19.3.0-4759.g5c120bb8.el9.x86_64 4/4 2024-09-07T03:30:13.740 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/4 2024-09-07T03:30:13.741 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/4 2024-09-07T03:30:13.741 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-07T03:30:13.741 INFO:teuthology.orchestra.run.smithi104.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-07T03:30:13.774 INFO:teuthology.orchestra.run.smithi104.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-07T03:30:13.800 INFO:teuthology.orchestra.run.smithi104.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-07T03:30:13.833 INFO:teuthology.orchestra.run.smithi104.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-09-07T03:30:13.858 INFO:teuthology.orchestra.run.smithi104.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 799 kB/s | 20 kB 00:00 2024-09-07T03:30:13.892 INFO:teuthology.orchestra.run.smithi104.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-09-07T03:30:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-07T03:30:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:14.025 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:30:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-07T03:30:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-07T03:30:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:14.025 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:14.034 INFO:teuthology.orchestra.run.smithi104.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2024-09-07T03:30:14.039 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:14.039 INFO:teuthology.orchestra.run.smithi104.stdout:Total 13 MB/s | 31 MB 00:02 2024-09-07T03:30:14.194 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:30:14.234 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:30:14.234 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:30:14.306 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph 2024-09-07T03:30:14.535 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:30:14.537 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:30:14.856 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:37 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:14.996 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:14.998 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:14.998 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:30:14.998 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:14.998 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:30:14.998 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 6.6 k 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 2.4 M 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 1.5 M 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 291 k 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 4.8 M 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 17 M 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-07T03:30:14.999 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-07T03:30:15.000 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:15.001 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:30:15.002 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:15.002 INFO:teuthology.orchestra.run.smithi120.stdout:Install 37 Packages 2024-09-07T03:30:15.002 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:15.002 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 31 M 2024-09-07T03:30:15.002 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 109 M 2024-09-07T03:30:15.003 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:30:15.481 INFO:teuthology.orchestra.run.smithi120.stdout:(1/37): ceph-19.3.0-4759.g5c120bb8.el9.x86_64.r 51 kB/s | 6.6 kB 00:00 2024-09-07T03:30:15.698 INFO:teuthology.orchestra.run.smithi120.stdout:(2/37): ceph-mds-19.3.0-4759.g5c120bb8.el9.x86_ 6.8 MB/s | 2.4 MB 00:00 2024-09-07T03:30:15.731 INFO:teuthology.orchestra.run.smithi120.stdout:(3/37): ceph-mgr-19.3.0-4759.g5c120bb8.el9.x86_ 4.0 MB/s | 1.5 MB 00:00 2024-09-07T03:30:15.848 INFO:teuthology.orchestra.run.smithi120.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4759.g5c12 2.4 MB/s | 291 kB 00:00 2024-09-07T03:30:15.900 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:30:15.916 INFO:teuthology.orchestra.run.smithi120.stdout:(5/37): ceph-mon-19.3.0-4759.g5c120bb8.el9.x86_ 11 MB/s | 4.8 MB 00:00 2024-09-07T03:30:15.970 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-07T03:30:16.002 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-07T03:30:16.016 INFO:teuthology.orchestra.run.smithi120.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-07T03:30:16.030 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-07T03:30:16.077 INFO:teuthology.orchestra.run.smithi120.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 106 kB 00:00 2024-09-07T03:30:16.110 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-07T03:30:16.116 INFO:teuthology.orchestra.run.smithi120.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 6.1 MB/s | 1.2 MB 00:00 2024-09-07T03:30:16.142 INFO:teuthology.orchestra.run.smithi120.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-07T03:30:16.155 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-07T03:30:16.167 INFO:teuthology.orchestra.run.smithi120.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-07T03:30:16.187 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-07T03:30:16.192 INFO:teuthology.orchestra.run.smithi120.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-07T03:30:16.279 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-07T03:30:16.350 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-07T03:30:16.368 INFO:teuthology.orchestra.run.smithi120.stdout:(12/37): ceph-osd-19.3.0-4759.g5c120bb8.el9.x86 26 MB/s | 17 MB 00:00 2024-09-07T03:30:16.407 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-07T03:30:16.441 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-07T03:30:16.443 INFO:teuthology.orchestra.run.smithi120.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 684 kB/s | 188 kB 00:00 2024-09-07T03:30:16.460 INFO:teuthology.orchestra.run.smithi120.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 379 kB/s | 35 kB 00:00 2024-09-07T03:30:16.471 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-07T03:30:16.491 INFO:teuthology.orchestra.run.smithi120.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 577 kB/s | 172 kB 00:00 2024-09-07T03:30:16.506 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-07T03:30:16.516 INFO:teuthology.orchestra.run.smithi120.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-07T03:30:16.539 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-07T03:30:16.541 INFO:teuthology.orchestra.run.smithi120.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 626 kB/s | 51 kB 00:00 2024-09-07T03:30:16.567 INFO:teuthology.orchestra.run.smithi120.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-07T03:30:16.580 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-07T03:30:16.592 INFO:teuthology.orchestra.run.smithi120.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2024-09-07T03:30:16.615 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-07T03:30:16.643 INFO:teuthology.orchestra.run.smithi120.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-07T03:30:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-07T03:30:16.668 INFO:teuthology.orchestra.run.smithi120.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-07T03:30:16.693 INFO:teuthology.orchestra.run.smithi120.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 428 kB/s | 11 kB 00:00 2024-09-07T03:30:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-07T03:30:16.710 INFO:teuthology.orchestra.run.smithi120.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-07T03:30:16.729 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-07T03:30:16.735 INFO:teuthology.orchestra.run.smithi120.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-07T03:30:16.761 INFO:teuthology.orchestra.run.smithi120.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-07T03:30:16.778 INFO:teuthology.orchestra.run.smithi120.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 463 kB/s | 19 kB 00:00 2024-09-07T03:30:16.795 INFO:teuthology.orchestra.run.smithi120.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 586 kB/s | 20 kB 00:00 2024-09-07T03:30:16.804 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-07T03:30:16.820 INFO:teuthology.orchestra.run.smithi120.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-09-07T03:30:16.845 INFO:teuthology.orchestra.run.smithi120.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-09-07T03:30:16.870 INFO:teuthology.orchestra.run.smithi120.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-07T03:30:16.896 INFO:teuthology.orchestra.run.smithi120.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-07T03:30:16.921 INFO:teuthology.orchestra.run.smithi120.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-07T03:30:16.947 INFO:teuthology.orchestra.run.smithi120.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-07T03:30:16.951 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-07T03:30:16.974 INFO:teuthology.orchestra.run.smithi120.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-07T03:30:16.999 INFO:teuthology.orchestra.run.smithi120.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-07T03:30:17.024 INFO:teuthology.orchestra.run.smithi120.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-07T03:30:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-07T03:30:17.058 INFO:teuthology.orchestra.run.smithi120.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-07T03:30:17.062 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:17.062 INFO:teuthology.orchestra.run.smithi120.stdout:Total 15 MB/s | 31 MB 00:02 2024-09-07T03:30:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-07T03:30:17.129 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-07T03:30:17.185 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-07T03:30:17.213 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:30:17.242 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-07T03:30:17.252 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:30:17.252 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:30:17.438 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-07T03:30:17.483 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-07T03:30:17.553 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:30:17.553 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:30:17.560 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-07T03:30:17.649 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-07T03:30:17.706 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-07T03:30:17.843 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-07T03:30:18.013 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4759.g5c120bb8.el9. 32/37 2024-09-07T03:30:18.042 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 33/37 2024-09-07T03:30:18.068 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 33/37 2024-09-07T03:30:18.068 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:18.068 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-07T03:30:18.068 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-07T03:30:18.068 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-07T03:30:18.068 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:18.912 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:30:18.977 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-07T03:30:19.010 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-07T03:30:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-07T03:30:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-07T03:30:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-07T03:30:19.180 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-07T03:30:19.270 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-07T03:30:19.350 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-07T03:30:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-07T03:30:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-07T03:30:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-07T03:30:19.506 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-07T03:30:19.517 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:19.3.0-4759.g5c120bb8.el9.x86_64 34/37 2024-09-07T03:30:19.539 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-07T03:30:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:19.3.0-4759.g5c120bb8.el9.x86_64 34/37 2024-09-07T03:30:19.545 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:19.545 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-07T03:30:19.545 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-07T03:30:19.545 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-07T03:30:19.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:19.580 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-07T03:30:19.623 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-07T03:30:19.650 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-07T03:30:19.698 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-07T03:30:19.730 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-07T03:30:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-07T03:30:19.943 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-07T03:30:20.002 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:19.3.0-4759.g5c120bb8.el9.x86_64 35/37 2024-09-07T03:30:20.023 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-07T03:30:20.025 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:19.3.0-4759.g5c120bb8.el9.x86_64 35/37 2024-09-07T03:30:20.025 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:20.025 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-07T03:30:20.025 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-07T03:30:20.026 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-07T03:30:20.026 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:20.075 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-07T03:30:20.122 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-07T03:30:20.179 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-07T03:30:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-07T03:30:20.244 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:19.3.0-4759.g5c120bb8.el9.x86_64 36/37 2024-09-07T03:30:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:19.3.0-4759.g5c120bb8.el9.x86_64 36/37 2024-09-07T03:30:20.268 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:20.268 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-07T03:30:20.268 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-07T03:30:20.268 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-07T03:30:20.268 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:20.330 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:19.3.0-4759.g5c120bb8.el9.x86_64 37/37 2024-09-07T03:30:20.422 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-07T03:30:20.485 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-07T03:30:20.563 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-07T03:30:20.661 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-07T03:30:20.701 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-07T03:30:20.831 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-07T03:30:20.991 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4759.g5c120bb8.el9. 32/37 2024-09-07T03:30:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 33/37 2024-09-07T03:30:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 33/37 2024-09-07T03:30:21.045 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:21.046 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-07T03:30:21.046 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-07T03:30:21.046 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-07T03:30:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:22.190 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-2:19.3.0-4759.g5c120bb8.el9.x86_64 37/37 2024-09-07T03:30:22.190 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/37 2024-09-07T03:30:22.190 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 3/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:19.3.0-4759.g5c120bb8.el9.x86_64 4/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:19.3.0-4759.g5c120bb8.el9.x86_64 5/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4759.g5c120bb8.el9. 6/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-07T03:30:22.191 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-07T03:30:22.192 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-07T03:30:22.192 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-07T03:30:22.192 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-07T03:30:22.192 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-07T03:30:22.192 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-07T03:30:22.192 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-07T03:30:22.192 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-07T03:30:22.192 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-07T03:30:22.192 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-07T03:30:22.193 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-07T03:30:22.194 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-07T03:30:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:19.3.0-4759.g5c120bb8.el9.x86_64 34/37 2024-09-07T03:30:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:19.3.0-4759.g5c120bb8.el9.x86_64 34/37 2024-09-07T03:30:22.532 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:22.532 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-07T03:30:22.532 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-07T03:30:22.532 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-07T03:30:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:19.3.0-4759.g5c120bb8.el9.x86_64 35/37 2024-09-07T03:30:23.121 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:19.3.0-4759.g5c120bb8.el9.x86_64 35/37 2024-09-07T03:30:23.121 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:23.121 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-07T03:30:23.121 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-07T03:30:23.121 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-07T03:30:23.121 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:23.140 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-07T03:30:23.140 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:23.140 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:30:23.140 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:23.140 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:23.140 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:23.140 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: lua-5.4.4-4.el9.x86_64 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-07T03:30:23.141 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-07T03:30:23.142 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-07T03:30:23.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-07T03:30:23.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-07T03:30:23.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-07T03:30:23.143 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-07T03:30:23.143 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:23.143 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:23.348 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:19.3.0-4759.g5c120bb8.el9.x86_64 36/37 2024-09-07T03:30:23.372 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:19.3.0-4759.g5c120bb8.el9.x86_64 36/37 2024-09-07T03:30:23.372 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:23.372 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-07T03:30:23.372 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-07T03:30:23.372 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-07T03:30:23.372 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:23.436 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:19.3.0-4759.g5c120bb8.el9.x86_64 37/37 2024-09-07T03:30:23.568 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-base 2024-09-07T03:30:24.127 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:52 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:24.216 INFO:teuthology.orchestra.run.smithi104.stdout:Package ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:30:24.257 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:24.259 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:30:24.259 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:24.332 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install cephadm 2024-09-07T03:30:24.881 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:52 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:25.012 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:25.013 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:25.013 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:30:25.013 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:25.013 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:30:25.014 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 783 k 2024-09-07T03:30:25.014 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:25.014 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:30:25.014 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:25.014 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-07T03:30:25.014 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:25.014 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 783 k 2024-09-07T03:30:25.014 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 789 k 2024-09-07T03:30:25.014 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:30:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-2:19.3.0-4759.g5c120bb8.el9.x86_64 37/37 2024-09-07T03:30:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/37 2024-09-07T03:30:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/37 2024-09-07T03:30:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 3/37 2024-09-07T03:30:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:19.3.0-4759.g5c120bb8.el9.x86_64 4/37 2024-09-07T03:30:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:19.3.0-4759.g5c120bb8.el9.x86_64 5/37 2024-09-07T03:30:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4759.g5c120bb8.el9. 6/37 2024-09-07T03:30:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-07T03:30:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-07T03:30:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-07T03:30:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-07T03:30:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-07T03:30:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-07T03:30:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-07T03:30:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-07T03:30:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-07T03:30:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-07T03:30:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-07T03:30:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-07T03:30:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-07T03:30:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-07T03:30:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-07T03:30:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-07T03:30:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-07T03:30:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-07T03:30:25.470 INFO:teuthology.orchestra.run.smithi104.stdout:cephadm-19.3.0-4759.g5c120bb8.el9.noarch.rpm 1.7 MB/s | 783 kB 00:00 2024-09-07T03:30:25.470 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:25.470 INFO:teuthology.orchestra.run.smithi104.stdout:Total 1.7 MB/s | 783 kB 00:00 2024-09-07T03:30:25.471 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:30:25.476 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:30:25.476 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:30:25.482 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:30:25.482 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:30:25.551 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:30:26.010 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-07T03:30:26.010 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:26.010 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:30:26.010 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:26.010 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: lua-5.4.4-4.el9.x86_64 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-07T03:30:26.011 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-07T03:30:26.012 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-07T03:30:26.013 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:26.014 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:26.040 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:30:26.139 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:30:26.403 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-base 2024-09-07T03:30:26.494 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:30:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:30:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:26.720 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:30:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:26.720 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:26.720 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:26.950 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-immutable-object-cache 2024-09-07T03:30:26.955 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:49 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:27.044 INFO:teuthology.orchestra.run.smithi120.stdout:Package ceph-base-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:30:27.086 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:27.087 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:30:27.087 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:27.163 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install cephadm 2024-09-07T03:30:27.520 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:55 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:27.657 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:27.658 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:27.658 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-09-07T03:30:27.658 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:27.658 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:30:27.658 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 145 k 2024-09-07T03:30:27.659 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:27.659 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:30:27.659 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:27.659 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-07T03:30:27.659 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:27.659 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 145 k 2024-09-07T03:30:27.659 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 432 k 2024-09-07T03:30:27.659 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:30:27.721 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:50 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:27.850 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-immutable-object-cache-19.3.0-4759.g5c120b 761 kB/s | 145 kB 00:00 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 783 k 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:27.920 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-07T03:30:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:27.921 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 783 k 2024-09-07T03:30:27.921 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 789 k 2024-09-07T03:30:27.921 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:30:27.921 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:27.921 INFO:teuthology.orchestra.run.smithi104.stdout:Total 754 kB/s | 145 kB 00:00 2024-09-07T03:30:27.921 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:30:27.921 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:30:27.921 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:30:27.922 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:30:27.922 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:30:28.052 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:30:28.109 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4759.g5c120bb8. 1/1 2024-09-07T03:30:28.125 INFO:teuthology.orchestra.run.smithi120.stdout:cephadm-19.3.0-4759.g5c120bb8.el9.noarch.rpm 2.8 MB/s | 783 kB 00:00 2024-09-07T03:30:28.125 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:28.126 INFO:teuthology.orchestra.run.smithi120.stdout:Total 2.8 MB/s | 783 kB 00:00 2024-09-07T03:30:28.126 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:30:28.131 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:30:28.131 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:30:28.134 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4759.g5c120bb8. 1/1 2024-09-07T03:30:28.134 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:28.134 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-07T03:30:28.134 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:28.136 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:30:28.137 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:30:28.206 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:30:28.687 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:30:28.777 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:30:29.049 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4759.g5c120bb8. 1/1 2024-09-07T03:30:29.049 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:29.049 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:30:29.049 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:29.050 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:29.050 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:29.141 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:30:29.287 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr 2024-09-07T03:30:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:30:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:29.382 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:30:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:29.382 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:29.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-immutable-object-cache 2024-09-07T03:30:29.854 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:57 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:29.946 INFO:teuthology.orchestra.run.smithi104.stdout:Package ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:30:29.989 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:29.989 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:30:29.990 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:30.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-dashboard 2024-09-07T03:30:30.144 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:53 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:30.280 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:30.281 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-09-07T03:30:30.281 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:30.281 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:30:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 145 k 2024-09-07T03:30:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:30.282 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:30:30.282 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:30.282 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-07T03:30:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:30.282 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 145 k 2024-09-07T03:30:30.282 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 432 k 2024-09-07T03:30:30.282 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:30:30.465 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-immutable-object-cache-19.3.0-4759.g5c120b 792 kB/s | 145 kB 00:00 2024-09-07T03:30:30.466 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:30.466 INFO:teuthology.orchestra.run.smithi120.stdout:Total 786 kB/s | 145 kB 00:00 2024-09-07T03:30:30.466 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:30:30.474 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:30:30.474 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:30:30.530 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:30:30.531 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:30:30.607 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:00:58 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:30:30.737 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:30.738 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:30.738 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 14 M 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 34 k 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 16 k 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-07T03:30:30.739 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-07T03:30:30.740 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-07T03:30:30.740 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-07T03:30:30.740 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-07T03:30:30.740 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:30.740 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:30:30.740 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:30.740 INFO:teuthology.orchestra.run.smithi104.stdout:Install 12 Packages 2024-09-07T03:30:30.740 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:30.741 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 19 M 2024-09-07T03:30:30.741 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 159 M 2024-09-07T03:30:30.741 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:30:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4759.g5c120bb8. 1/1 2024-09-07T03:30:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4759.g5c120bb8. 1/1 2024-09-07T03:30:30.766 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:30:30.766 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-07T03:30:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:31.445 INFO:teuthology.orchestra.run.smithi104.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4759.g5c1 102 kB/s | 16 kB 00:00 2024-09-07T03:30:31.470 INFO:teuthology.orchestra.run.smithi104.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4759.g5c 183 kB/s | 34 kB 00:00 2024-09-07T03:30:31.646 INFO:teuthology.orchestra.run.smithi104.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 269 kB 00:00 2024-09-07T03:30:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4759.g5c120bb8. 1/1 2024-09-07T03:30:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:31.649 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:30:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:30:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:31.649 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:31.704 INFO:teuthology.orchestra.run.smithi104.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-09-07T03:30:31.755 INFO:teuthology.orchestra.run.smithi104.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-07T03:30:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-07T03:30:31.878 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr 2024-09-07T03:30:31.930 INFO:teuthology.orchestra.run.smithi104.stdout:(7/12): ceph-mgr-dashboard-19.3.0-4759.g5c120bb 22 MB/s | 14 MB 00:00 2024-09-07T03:30:31.972 INFO:teuthology.orchestra.run.smithi104.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.6 MB/s | 863 kB 00:00 2024-09-07T03:30:32.006 INFO:teuthology.orchestra.run.smithi104.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.9 MB/s | 144 kB 00:00 2024-09-07T03:30:32.023 INFO:teuthology.orchestra.run.smithi104.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 635 kB/s | 31 kB 00:00 2024-09-07T03:30:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 4.6 MB/s | 188 kB 00:00 2024-09-07T03:30:32.098 INFO:teuthology.orchestra.run.smithi104.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.3 MB/s | 2.0 MB 00:00 2024-09-07T03:30:32.102 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:32.102 INFO:teuthology.orchestra.run.smithi104.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-07T03:30:32.152 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:30:32.169 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:30:32.169 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:30:32.394 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:30:32.394 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:30:32.438 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:55 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:32.531 INFO:teuthology.orchestra.run.smithi120.stdout:Package ceph-mgr-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:30:32.575 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:32.575 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:30:32.576 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:32.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-dashboard 2024-09-07T03:30:32.980 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:30:33.073 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-07T03:30:33.109 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-07T03:30:33.155 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-07T03:30:33.203 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-07T03:30:33.206 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:00:56 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:33.279 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-07T03:30:33.337 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:33.338 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:33.338 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:30:33.338 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:33.338 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 14 M 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 34 k 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 16 k 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-07T03:30:33.339 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:33.340 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:30:33.340 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:33.340 INFO:teuthology.orchestra.run.smithi120.stdout:Install 12 Packages 2024-09-07T03:30:33.340 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:33.340 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 19 M 2024-09-07T03:30:33.340 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 159 M 2024-09-07T03:30:33.341 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:30:33.421 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-07T03:30:33.513 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-07T03:30:33.557 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-07T03:30:33.594 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-07T03:30:33.626 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4759.g5c120bb8.el9 10/12 2024-09-07T03:30:33.712 INFO:teuthology.orchestra.run.smithi120.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4759.g5c1 105 kB/s | 16 kB 00:00 2024-09-07T03:30:33.737 INFO:teuthology.orchestra.run.smithi120.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4759.g5c 187 kB/s | 34 kB 00:00 2024-09-07T03:30:34.204 INFO:teuthology.orchestra.run.smithi120.stdout:(3/12): ceph-mgr-dashboard-19.3.0-4759.g5c120bb 22 MB/s | 14 MB 00:00 2024-09-07T03:30:34.604 INFO:teuthology.orchestra.run.smithi120.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 311 kB/s | 269 kB 00:00 2024-09-07T03:30:34.655 INFO:teuthology.orchestra.run.smithi120.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-07T03:30:34.680 INFO:teuthology.orchestra.run.smithi120.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-07T03:30:34.755 INFO:teuthology.orchestra.run.smithi120.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-07T03:30:34.789 INFO:teuthology.orchestra.run.smithi120.stdout:(8/12): protobuf-3.14.0-13.el9.x86_64.rpm 959 kB/s | 1.0 MB 00:01 2024-09-07T03:30:34.823 INFO:teuthology.orchestra.run.smithi120.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-07T03:30:34.848 INFO:teuthology.orchestra.run.smithi120.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 525 kB/s | 31 kB 00:00 2024-09-07T03:30:34.882 INFO:teuthology.orchestra.run.smithi120.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.2 MB/s | 188 kB 00:00 2024-09-07T03:30:34.907 INFO:teuthology.orchestra.run.smithi120.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.2 MB/s | 863 kB 00:00 2024-09-07T03:30:34.911 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:34.911 INFO:teuthology.orchestra.run.smithi120.stdout:Total 12 MB/s | 19 MB 00:01 2024-09-07T03:30:34.960 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:30:34.979 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:30:34.979 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:30:35.202 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:30:35.202 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:30:35.823 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:30:35.899 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-07T03:30:35.938 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-07T03:30:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-07T03:30:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-07T03:30:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-07T03:30:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-07T03:30:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-07T03:30:36.342 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-07T03:30:36.371 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-07T03:30:36.403 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4759.g5c120bb8.el9 10/12 2024-09-07T03:30:36.821 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4759.g5c120bb8.el 11/12 2024-09-07T03:30:36.873 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4759.g5c120bb8.el9.noa 12/12 2024-09-07T03:30:38.799 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4759.g5c120bb8.el9.noa 12/12 2024-09-07T03:30:38.799 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4759.g5c120bb8.el 1/12 2024-09-07T03:30:38.799 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4759.g5c120bb8.el9.noa 2/12 2024-09-07T03:30:38.800 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4759.g5c120bb8.el9 3/12 2024-09-07T03:30:38.800 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-07T03:30:38.800 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-07T03:30:38.800 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-07T03:30:38.800 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-07T03:30:38.800 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-07T03:30:38.800 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-07T03:30:38.800 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-07T03:30:38.800 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-07T03:30:39.118 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-07T03:30:39.118 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:39.118 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:30:39.118 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-07T03:30:39.118 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:39.119 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:39.365 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-07T03:30:39.590 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4759.g5c120bb8.el 11/12 2024-09-07T03:30:39.650 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4759.g5c120bb8.el9.noa 12/12 2024-09-07T03:30:39.910 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:07 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:40.042 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 7.4 M 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-07T03:30:40.043 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout:Install 12 Packages 2024-09-07T03:30:40.044 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:40.045 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 38 M 2024-09-07T03:30:40.045 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 212 M 2024-09-07T03:30:40.045 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:30:40.596 INFO:teuthology.orchestra.run.smithi104.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 955 kB/s | 191 kB 00:00 2024-09-07T03:30:40.688 INFO:teuthology.orchestra.run.smithi104.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-07T03:30:40.721 INFO:teuthology.orchestra.run.smithi104.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-07T03:30:40.896 INFO:teuthology.orchestra.run.smithi104.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-47 15 MB/s | 7.4 MB 00:00 2024-09-07T03:30:40.921 INFO:teuthology.orchestra.run.smithi104.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 91 kB/s | 18 kB 00:00 2024-09-07T03:30:41.030 INFO:teuthology.orchestra.run.smithi104.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 289 kB/s | 38 kB 00:00 2024-09-07T03:30:41.122 INFO:teuthology.orchestra.run.smithi104.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-07T03:30:41.272 INFO:teuthology.orchestra.run.smithi104.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-07T03:30:41.339 INFO:teuthology.orchestra.run.smithi104.stdout:(9/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.6 MB/s | 3.0 MB 00:00 2024-09-07T03:30:41.364 INFO:teuthology.orchestra.run.smithi104.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-07T03:30:41.440 INFO:teuthology.orchestra.run.smithi104.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-07T03:30:41.584 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4759.g5c120bb8.el9.noa 12/12 2024-09-07T03:30:41.584 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4759.g5c120bb8.el 1/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4759.g5c120bb8.el9.noa 2/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4759.g5c120bb8.el9 3/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-07T03:30:41.585 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-07T03:30:41.905 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-07T03:30:41.905 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-07T03:30:41.906 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:41.907 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:41.965 INFO:teuthology.orchestra.run.smithi104.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-07T03:30:41.966 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:41.966 INFO:teuthology.orchestra.run.smithi104.stdout:Total 20 MB/s | 38 MB 00:01 2024-09-07T03:30:42.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-07T03:30:42.318 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:30:42.344 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:30:42.344 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:30:42.738 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:05 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:42.755 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:30:42.755 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:30:42.870 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:42.871 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-09-07T03:30:42.871 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:30:42.871 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-09-07T03:30:42.871 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:30:42.872 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 7.4 M 2024-09-07T03:30:42.872 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-07T03:30:42.872 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-07T03:30:42.872 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-07T03:30:42.872 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-07T03:30:42.872 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-07T03:30:42.873 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-07T03:30:42.873 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-07T03:30:42.873 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-07T03:30:42.873 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-07T03:30:42.874 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-07T03:30:42.874 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-07T03:30:42.874 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-07T03:30:42.874 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:42.874 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:30:42.875 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-09-07T03:30:42.875 INFO:teuthology.orchestra.run.smithi120.stdout:Install 12 Packages 2024-09-07T03:30:42.875 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:42.876 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 38 M 2024-09-07T03:30:42.876 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 212 M 2024-09-07T03:30:42.876 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:30:43.175 INFO:teuthology.orchestra.run.smithi120.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-07T03:30:43.300 INFO:teuthology.orchestra.run.smithi120.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-07T03:30:43.400 INFO:teuthology.orchestra.run.smithi120.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 801 kB 00:00 2024-09-07T03:30:43.509 INFO:teuthology.orchestra.run.smithi120.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-47 14 MB/s | 7.4 MB 00:00 2024-09-07T03:30:43.513 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:30:43.577 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-07T03:30:43.584 INFO:teuthology.orchestra.run.smithi120.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 99 kB/s | 18 kB 00:00 2024-09-07T03:30:43.610 INFO:teuthology.orchestra.run.smithi120.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-07T03:30:43.646 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-07T03:30:43.735 INFO:teuthology.orchestra.run.smithi120.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.9 MB/s | 3.0 MB 00:00 2024-09-07T03:30:43.745 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-07T03:30:43.760 INFO:teuthology.orchestra.run.smithi120.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-07T03:30:43.781 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-07T03:30:43.844 INFO:teuthology.orchestra.run.smithi120.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-07T03:30:43.961 INFO:teuthology.orchestra.run.smithi120.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 13 MB/s | 4.9 MB 00:00 2024-09-07T03:30:43.964 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-07T03:30:44.005 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-07T03:30:44.080 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-07T03:30:44.094 INFO:teuthology.orchestra.run.smithi120.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-07T03:30:44.286 INFO:teuthology.orchestra.run.smithi120.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-07T03:30:44.287 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:44.288 INFO:teuthology.orchestra.run.smithi120.stdout:Total 27 MB/s | 38 MB 00:01 2024-09-07T03:30:44.637 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:30:44.663 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:30:44.663 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:30:44.722 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-07T03:30:44.834 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-07T03:30:45.072 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:30:45.072 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:30:45.827 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:30:45.900 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-07T03:30:45.942 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-07T03:30:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-07T03:30:46.045 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-07T03:30:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-07T03:30:46.270 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-07T03:30:46.302 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-07T03:30:46.378 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-07T03:30:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-07T03:30:47.071 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-07T03:30:47.111 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4759.g5c120 12/12 2024-09-07T03:30:47.131 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-07T03:30:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-07T03:30:49.366 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-07T03:30:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4759.g5c120 12/12 2024-09-07T03:30:49.698 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4759.g5c120 12/12 2024-09-07T03:30:49.698 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4759.g5c120 1/12 2024-09-07T03:30:49.698 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-07T03:30:49.699 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-07T03:30:49.699 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-07T03:30:49.699 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-07T03:30:49.699 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-07T03:30:49.699 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-07T03:30:49.699 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-07T03:30:49.699 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-07T03:30:49.699 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-07T03:30:49.699 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-07T03:30:50.153 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-07T03:30:50.154 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-07T03:30:50.155 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:50.155 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:50.606 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-rook 2024-09-07T03:30:51.174 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:19 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:51.305 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:51.306 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:51.306 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:30:51.306 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:51.306 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 49 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-07T03:30:51.307 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-07T03:30:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:51.308 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:30:51.308 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:51.308 INFO:teuthology.orchestra.run.smithi104.stdout:Install 13 Packages 2024-09-07T03:30:51.308 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:51.308 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 2.2 M 2024-09-07T03:30:51.309 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 26 M 2024-09-07T03:30:51.309 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:30:51.770 INFO:teuthology.orchestra.run.smithi104.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 260 kB/s | 19 kB 00:00 2024-09-07T03:30:51.795 INFO:teuthology.orchestra.run.smithi104.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 259 kB/s | 26 kB 00:00 2024-09-07T03:30:51.854 INFO:teuthology.orchestra.run.smithi104.stdout:(3/13): ceph-mgr-rook-19.3.0-4759.g5c120bb8.el9 312 kB/s | 49 kB 00:00 2024-09-07T03:30:51.879 INFO:teuthology.orchestra.run.smithi104.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-07T03:30:51.912 INFO:teuthology.orchestra.run.smithi104.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-07T03:30:51.938 INFO:teuthology.orchestra.run.smithi104.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 919 kB/s | 54 kB 00:00 2024-09-07T03:30:51.980 INFO:teuthology.orchestra.run.smithi104.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-07T03:30:52.005 INFO:teuthology.orchestra.run.smithi104.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-07T03:30:52.031 INFO:teuthology.orchestra.run.smithi104.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-07T03:30:52.032 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4759.g5c120 12/12 2024-09-07T03:30:52.032 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4759.g5c120 1/12 2024-09-07T03:30:52.032 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-07T03:30:52.032 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-07T03:30:52.032 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-07T03:30:52.032 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-07T03:30:52.032 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-07T03:30:52.032 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-07T03:30:52.033 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-07T03:30:52.033 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-07T03:30:52.033 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-07T03:30:52.033 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-07T03:30:52.064 INFO:teuthology.orchestra.run.smithi104.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-07T03:30:52.098 INFO:teuthology.orchestra.run.smithi104.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.3 MB/s | 90 kB 00:00 2024-09-07T03:30:52.139 INFO:teuthology.orchestra.run.smithi104.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-07T03:30:52.165 INFO:teuthology.orchestra.run.smithi104.stdout:(13/13): python3-rsa-4.9-2.el9.noarch.rpm 442 kB/s | 59 kB 00:00 2024-09-07T03:30:52.168 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:52.168 INFO:teuthology.orchestra.run.smithi104.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-07T03:30:52.236 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:30:52.252 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:30:52.252 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:30:52.338 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:30:52.340 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:30:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-07T03:30:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-07T03:30:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-07T03:30:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:52.468 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:52.840 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:30:52.851 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-rook 2024-09-07T03:30:53.011 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-07T03:30:53.074 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-07T03:30:53.129 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-07T03:30:53.175 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-07T03:30:53.225 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-07T03:30:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-07T03:30:53.420 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:16 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:53.428 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-07T03:30:53.484 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-07T03:30:53.550 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 49 k 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-07T03:30:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout:Install 13 Packages 2024-09-07T03:30:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:53.554 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 2.2 M 2024-09-07T03:30:53.554 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 26 M 2024-09-07T03:30:53.554 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:30:53.748 INFO:teuthology.orchestra.run.smithi120.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 157 kB/s | 19 kB 00:00 2024-09-07T03:30:53.765 INFO:teuthology.orchestra.run.smithi120.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 184 kB/s | 26 kB 00:00 2024-09-07T03:30:53.782 INFO:teuthology.orchestra.run.smithi120.stdout:(3/13): ceph-mgr-rook-19.3.0-4759.g5c120bb8.el9 315 kB/s | 49 kB 00:00 2024-09-07T03:30:53.891 INFO:teuthology.orchestra.run.smithi120.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-07T03:30:53.916 INFO:teuthology.orchestra.run.smithi120.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-09-07T03:30:53.941 INFO:teuthology.orchestra.run.smithi120.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-07T03:30:53.967 INFO:teuthology.orchestra.run.smithi120.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 639 kB/s | 32 kB 00:00 2024-09-07T03:30:54.000 INFO:teuthology.orchestra.run.smithi120.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-07T03:30:54.017 INFO:teuthology.orchestra.run.smithi120.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 191 kB/s | 14 kB 00:00 2024-09-07T03:30:54.051 INFO:teuthology.orchestra.run.smithi120.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-07T03:30:54.076 INFO:teuthology.orchestra.run.smithi120.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-07T03:30:54.093 INFO:teuthology.orchestra.run.smithi120.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-09-07T03:30:54.127 INFO:teuthology.orchestra.run.smithi120.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-07T03:30:54.129 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:54.129 INFO:teuthology.orchestra.run.smithi120.stdout:Total 3.8 MB/s | 2.2 MB 00:00 2024-09-07T03:30:54.192 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:30:54.192 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-07T03:30:54.206 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:30:54.207 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:30:54.248 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-07T03:30:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-07T03:30:54.290 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:30:54.291 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:30:54.330 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-07T03:30:54.352 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:19.3.0-4759.g5c120bb8.el9.noarch 13/13 2024-09-07T03:30:54.797 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:30:54.964 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-07T03:30:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-07T03:30:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4759.g5c120bb8.el9.noarch 13/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4759.g5c120bb8.el9.noarch 1/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-07T03:30:55.105 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-07T03:30:55.106 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-07T03:30:55.106 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-07T03:30:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-07T03:30:55.163 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-07T03:30:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-07T03:30:55.365 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-07T03:30:55.414 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-07T03:30:55.440 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-07T03:30:55.440 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:55.440 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:30:55.440 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:55.440 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-07T03:30:55.440 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-07T03:30:55.440 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:55.441 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:30:55.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-mgr-cephadm 2024-09-07T03:30:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-07T03:30:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-07T03:30:56.230 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-07T03:30:56.264 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:24 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:30:56.277 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-07T03:30:56.299 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:19.3.0-4759.g5c120bb8.el9.noarch 13/13 2024-09-07T03:30:56.397 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:30:56.397 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:56.397 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:30:56.397 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 154 k 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout:Install 6 Packages 2024-09-07T03:30:56.398 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:30:56.399 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 7.0 M 2024-09-07T03:30:56.399 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 33 M 2024-09-07T03:30:56.399 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:30:56.767 INFO:teuthology.orchestra.run.smithi104.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4759.g5c120bb8.e 718 kB/s | 154 kB 00:00 2024-09-07T03:30:56.858 INFO:teuthology.orchestra.run.smithi104.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.3 MB/s | 548 kB 00:00 2024-09-07T03:30:56.884 INFO:teuthology.orchestra.run.smithi104.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-07T03:30:56.917 INFO:teuthology.orchestra.run.smithi104.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-07T03:30:57.001 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4759.g5c120bb8.el9.noarch 13/13 2024-09-07T03:30:57.001 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4759.g5c120bb8.el9.noarch 1/13 2024-09-07T03:30:57.001 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-07T03:30:57.001 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-07T03:30:57.001 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-07T03:30:57.001 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-07T03:30:57.001 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-07T03:30:57.001 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-07T03:30:57.001 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-07T03:30:57.002 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-07T03:30:57.002 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-07T03:30:57.002 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-07T03:30:57.002 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-07T03:30:57.317 INFO:teuthology.orchestra.run.smithi104.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 324 kB/s | 248 kB 00:00 2024-09-07T03:30:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-07T03:30:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:57.321 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:30:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:30:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-07T03:30:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-07T03:30:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-07T03:30:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:57.322 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:30:57.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-mgr-cephadm 2024-09-07T03:30:57.692 INFO:teuthology.orchestra.run.smithi104.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-07T03:30:57.695 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:57.695 INFO:teuthology.orchestra.run.smithi104.stdout:Total 5.4 MB/s | 7.0 MB 00:01 2024-09-07T03:30:57.766 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:30:57.777 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:30:57.778 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:30:57.877 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:30:57.878 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:30:58.140 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:21 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:30:58.198 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:30:58.270 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:30:58.271 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:30:58.271 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:58.271 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:30:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 154 k 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout:Install 6 Packages 2024-09-07T03:30:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:30:58.273 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 7.0 M 2024-09-07T03:30:58.273 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 33 M 2024-09-07T03:30:58.273 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:30:58.365 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-07T03:30:58.419 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-07T03:30:58.565 INFO:teuthology.orchestra.run.smithi120.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-07T03:30:58.615 INFO:teuthology.orchestra.run.smithi120.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-07T03:30:58.641 INFO:teuthology.orchestra.run.smithi120.stdout:(3/6): ceph-mgr-cephadm-19.3.0-4759.g5c120bb8.e 700 kB/s | 154 kB 00:00 2024-09-07T03:30:58.666 INFO:teuthology.orchestra.run.smithi120.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-07T03:30:58.708 INFO:teuthology.orchestra.run.smithi120.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-07T03:30:58.957 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-07T03:30:59.046 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-07T03:30:59.066 INFO:teuthology.orchestra.run.smithi120.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.2 MB/s | 6.0 MB 00:00 2024-09-07T03:30:59.069 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:30:59.069 INFO:teuthology.orchestra.run.smithi120.stdout:Total 8.8 MB/s | 7.0 MB 00:00 2024-09-07T03:30:59.114 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-07T03:30:59.139 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:30:59.148 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 6/6 2024-09-07T03:30:59.150 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:30:59.150 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:30:59.249 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:30:59.249 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:30:59.554 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:30:59.715 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-07T03:30:59.768 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-07T03:30:59.876 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 6/6 2024-09-07T03:30:59.876 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/6 2024-09-07T03:30:59.876 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-07T03:30:59.876 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-07T03:30:59.876 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-07T03:30:59.877 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-07T03:31:00.148 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:00.149 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:00.284 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-07T03:31:00.372 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-07T03:31:00.411 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-fuse 2024-09-07T03:31:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-07T03:31:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 6/6 2024-09-07T03:31:00.967 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:28 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:01.100 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 899 k 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout:Install 2 Packages 2024-09-07T03:31:01.101 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:01.102 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 979 k 2024-09-07T03:31:01.102 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 2.9 M 2024-09-07T03:31:01.102 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:31:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 6/6 2024-09-07T03:31:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 1/6 2024-09-07T03:31:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-07T03:31:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-07T03:31:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-07T03:31:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-07T03:31:01.402 INFO:teuthology.orchestra.run.smithi104.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 555 kB/s | 80 kB 00:00 2024-09-07T03:31:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:01.511 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:01.561 INFO:teuthology.orchestra.run.smithi104.stdout:(2/2): ceph-fuse-19.3.0-4759.g5c120bb8.el9.x86_ 2.9 MB/s | 899 kB 00:00 2024-09-07T03:31:01.561 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:01.561 INFO:teuthology.orchestra.run.smithi104.stdout:Total 2.1 MB/s | 979 kB 00:00 2024-09-07T03:31:01.573 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:31:01.596 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:31:01.596 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:31:01.677 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:31:01.677 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:31:01.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-fuse 2024-09-07T03:31:01.862 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:31:01.997 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-07T03:31:02.075 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/2 2024-09-07T03:31:02.323 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:25 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:02.454 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:02.454 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:02.454 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 899 k 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout:Install 2 Packages 2024-09-07T03:31:02.455 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:02.456 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 979 k 2024-09-07T03:31:02.456 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 2.9 M 2024-09-07T03:31:02.456 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:31:02.702 INFO:teuthology.orchestra.run.smithi120.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 539 kB/s | 80 kB 00:00 2024-09-07T03:31:02.768 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/2 2024-09-07T03:31:02.769 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/2 2024-09-07T03:31:02.844 INFO:teuthology.orchestra.run.smithi120.stdout:(2/2): ceph-fuse-19.3.0-4759.g5c120bb8.el9.x86_ 3.0 MB/s | 899 kB 00:00 2024-09-07T03:31:02.845 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:02.845 INFO:teuthology.orchestra.run.smithi120.stdout:Total 2.5 MB/s | 979 kB 00:00 2024-09-07T03:31:02.857 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:31:02.878 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:31:02.878 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:31:02.957 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:31:02.957 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:31:03.023 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-07T03:31:03.024 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:03.024 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:31:03.024 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-07T03:31:03.024 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:03.024 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:03.147 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:31:03.297 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-07T03:31:03.309 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-volume 2024-09-07T03:31:03.368 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/2 2024-09-07T03:31:03.880 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:31 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 2/2 2024-09-07T03:31:04.003 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/2 2024-09-07T03:31:04.019 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:04.019 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:04.019 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-07T03:31:04.019 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:04.020 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:31:04.020 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 285 k 2024-09-07T03:31:04.020 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:04.020 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:31:04.020 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:04.020 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-07T03:31:04.020 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:04.021 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 285 k 2024-09-07T03:31:04.021 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 1.3 M 2024-09-07T03:31:04.021 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:31:04.238 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-07T03:31:04.238 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:04.238 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:31:04.238 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-07T03:31:04.238 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:04.238 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:04.248 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-volume-19.3.0-4759.g5c120bb8.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-07T03:31:04.249 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:04.249 INFO:teuthology.orchestra.run.smithi104.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-07T03:31:04.249 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:31:04.257 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:31:04.257 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:31:04.280 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:31:04.280 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:31:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:31:04.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-volume 2024-09-07T03:31:04.566 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:31:04.583 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:31:04.583 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:31:04.583 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-07T03:31:04.583 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:05.113 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:28 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:05.247 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:05.247 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume noarch 2:19.3.0-4759.g5c120bb8.el9 ceph-noarch 285 k 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 285 k 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 1.3 M 2024-09-07T03:31:05.248 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:31:05.459 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-volume-19.3.0-4759.g5c120bb8.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-07T03:31:05.459 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:05.460 INFO:teuthology.orchestra.run.smithi120.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-07T03:31:05.460 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:31:05.468 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:31:05.468 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:31:05.491 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:31:05.491 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:31:05.522 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:31:05.523 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:05.523 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:31:05.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:31:05.523 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:05.523 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:05.706 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:31:05.796 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install librados-devel 2024-09-07T03:31:05.803 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-volume-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-volume-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-07T03:31:05.820 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:06.355 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:34 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:06.486 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:06.487 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:06.487 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-09-07T03:31:06.487 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:06.487 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:31:06.487 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 127 k 2024-09-07T03:31:06.487 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:06.487 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:31:06.487 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:06.488 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-07T03:31:06.488 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:06.488 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 127 k 2024-09-07T03:31:06.488 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 456 k 2024-09-07T03:31:06.488 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:31:06.678 INFO:teuthology.orchestra.run.smithi104.stdout:librados-devel-19.3.0-4759.g5c120bb8.el9.x86_64 667 kB/s | 127 kB 00:00 2024-09-07T03:31:06.679 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:06.679 INFO:teuthology.orchestra.run.smithi104.stdout:Total 660 kB/s | 127 kB 00:00 2024-09-07T03:31:06.680 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:31:06.685 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:31:06.685 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:31:06.748 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:31:06.748 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:31:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-volume-2:19.3.0-4759.g5c120bb8.el9.noarch 1/1 2024-09-07T03:31:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:06.752 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:31:06.752 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume-2:19.3.0-4759.g5c120bb8.el9.noarch 2024-09-07T03:31:06.753 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:06.753 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:06.903 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:31:07.032 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:07.073 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librados-devel 2024-09-07T03:31:07.402 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:07.636 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:30 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:07.685 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:31:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:07.685 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:07.773 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:07.774 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-09-07T03:31:07.774 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:07.774 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:31:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 127 k 2024-09-07T03:31:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:07.774 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:31:07.774 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:07.774 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-07T03:31:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:07.775 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 127 k 2024-09-07T03:31:07.775 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 456 k 2024-09-07T03:31:07.775 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:31:07.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install libcephfs2 2024-09-07T03:31:07.965 INFO:teuthology.orchestra.run.smithi120.stdout:librados-devel-19.3.0-4759.g5c120bb8.el9.x86_64 665 kB/s | 127 kB 00:00 2024-09-07T03:31:07.966 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:07.966 INFO:teuthology.orchestra.run.smithi120.stdout:Total 659 kB/s | 127 kB 00:00 2024-09-07T03:31:07.966 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:31:07.972 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:31:07.972 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:31:08.035 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:31:08.035 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:31:08.187 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:31:08.303 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:08.518 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:36 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:08.609 INFO:teuthology.orchestra.run.smithi104.stdout:Package libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:08.653 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:08.654 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:31:08.654 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:08.738 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:08.754 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install libcephfs-devel 2024-09-07T03:31:08.977 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:08.977 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:08.977 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:31:08.977 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:08.977 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:08.977 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:09.234 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install libcephfs2 2024-09-07T03:31:09.312 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:37 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:09.443 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 32 k 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-07T03:31:09.444 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:09.445 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 32 k 2024-09-07T03:31:09.445 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 142 k 2024-09-07T03:31:09.445 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:31:09.590 INFO:teuthology.orchestra.run.smithi104.stdout:libcephfs-devel-19.3.0-4759.g5c120bb8.el9.x86_6 220 kB/s | 32 kB 00:00 2024-09-07T03:31:09.590 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:09.590 INFO:teuthology.orchestra.run.smithi104.stdout:Total 217 kB/s | 32 kB 00:00 2024-09-07T03:31:09.591 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:31:09.594 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:31:09.594 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:31:09.598 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:31:09.598 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:31:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:31:09.794 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:09.803 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:32 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:09.895 INFO:teuthology.orchestra.run.smithi120.stdout:Package libcephfs2-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:09.941 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:09.942 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:31:09.942 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:10.023 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install libcephfs-devel 2024-09-07T03:31:10.144 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:10.361 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:10.361 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:10.361 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:31:10.361 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:10.362 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:10.362 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:10.546 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install librados2 2024-09-07T03:31:10.576 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:33 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:10.708 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 32 k 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-07T03:31:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:10.710 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 32 k 2024-09-07T03:31:10.710 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 142 k 2024-09-07T03:31:10.710 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:31:10.870 INFO:teuthology.orchestra.run.smithi120.stdout:libcephfs-devel-19.3.0-4759.g5c120bb8.el9.x86_6 198 kB/s | 32 kB 00:00 2024-09-07T03:31:10.873 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:10.873 INFO:teuthology.orchestra.run.smithi120.stdout:Total 196 kB/s | 32 kB 00:00 2024-09-07T03:31:10.873 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:31:10.874 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:31:10.874 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:31:10.878 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:31:10.878 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:31:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:31:11.098 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:39 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:11.188 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:11.230 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:11.231 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:31:11.231 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:11.300 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install librbd1 2024-09-07T03:31:11.434 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:11.668 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:31:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:11.668 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:11.855 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:39 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:11.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librados2 2024-09-07T03:31:11.944 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:11.987 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:11.988 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:31:11.988 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:12.058 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-rados 2024-09-07T03:31:12.414 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:35 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:12.502 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:12.545 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:12.546 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:31:12.546 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:12.610 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:40 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:12.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install librbd1 2024-09-07T03:31:12.699 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-rados-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:12.742 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:12.742 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:31:12.743 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:12.818 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-rgw 2024-09-07T03:31:13.179 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:36 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:13.269 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:13.311 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:13.312 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:31:13.312 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:13.374 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:41 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:13.388 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rados 2024-09-07T03:31:13.462 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-rgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:13.505 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:13.506 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:31:13.506 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:13.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-cephfs 2024-09-07T03:31:13.941 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:36 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:14.030 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rados-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:14.074 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:14.075 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:31:14.075 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:14.124 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:42 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:14.151 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rgw 2024-09-07T03:31:14.213 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-cephfs-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:14.255 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:14.256 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:31:14.257 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:14.325 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install python3-rbd 2024-09-07T03:31:14.701 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:37 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:14.790 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rgw-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:14.833 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:14.834 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:31:14.834 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:14.879 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:42 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:14.910 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-cephfs 2024-09-07T03:31:14.968 INFO:teuthology.orchestra.run.smithi104.stdout:Package python3-rbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:15.011 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:15.012 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-09-07T03:31:15.012 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:15.080 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install rbd-fuse 2024-09-07T03:31:15.461 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:38 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:15.550 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-cephfs-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:15.593 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:15.594 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:31:15.594 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:15.637 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:43 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:15.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install python3-rbd 2024-09-07T03:31:15.771 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 85 k 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 85 k 2024-09-07T03:31:15.772 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 231 k 2024-09-07T03:31:15.773 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:31:15.967 INFO:teuthology.orchestra.run.smithi104.stdout:rbd-fuse-19.3.0-4759.g5c120bb8.el9.x86_64.rpm 437 kB/s | 85 kB 00:00 2024-09-07T03:31:15.968 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:15.968 INFO:teuthology.orchestra.run.smithi104.stdout:Total 434 kB/s | 85 kB 00:00 2024-09-07T03:31:15.968 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:31:15.975 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:31:15.975 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:31:16.039 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:31:16.039 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:31:16.179 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:31:16.219 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:39 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:16.280 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:16.307 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-rbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 is already installed. 2024-09-07T03:31:16.350 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:16.351 INFO:teuthology.orchestra.run.smithi120.stdout:Nothing to do. 2024-09-07T03:31:16.351 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:16.427 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-fuse 2024-09-07T03:31:16.629 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:16.871 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:31:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:16.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:16.871 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:16.979 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:39 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:17.111 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:17.111 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 85 k 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 85 k 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 231 k 2024-09-07T03:31:17.112 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:31:17.147 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install rbd-mirror 2024-09-07T03:31:17.299 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-fuse-19.3.0-4759.g5c120bb8.el9.x86_64.rpm 457 kB/s | 85 kB 00:00 2024-09-07T03:31:17.300 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:17.300 INFO:teuthology.orchestra.run.smithi120.stdout:Total 453 kB/s | 85 kB 00:00 2024-09-07T03:31:17.300 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:31:17.306 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:31:17.307 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:31:17.370 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:31:17.370 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:31:17.532 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:31:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:17.726 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:45 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:17.868 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:17.868 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repo Size 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 3.2 M 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 3.2 M 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 14 M 2024-09-07T03:31:17.869 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:31:18.001 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:18.212 INFO:teuthology.orchestra.run.smithi104.stdout:rbd-mirror-19.3.0-4759.g5c120bb8.el9.x86_64.rpm 9.3 MB/s | 3.2 MB 00:00 2024-09-07T03:31:18.213 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:18.213 INFO:teuthology.orchestra.run.smithi104.stdout:Total 9.2 MB/s | 3.2 MB 00:00 2024-09-07T03:31:18.213 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:31:18.222 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:31:18.222 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:31:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:18.259 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:31:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:18.259 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:18.304 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:31:18.304 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:31:18.525 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-mirror 2024-09-07T03:31:18.755 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:31:18.838 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:18.865 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:18.865 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:31:18.866 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-07T03:31:18.866 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-07T03:31:18.866 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-07T03:31:18.866 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:19.088 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:42 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:19.222 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:19.223 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:19.223 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repo Size 2024-09-07T03:31:19.223 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:19.223 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:31:19.223 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 3.2 M 2024-09-07T03:31:19.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:19.224 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:31:19.224 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:19.224 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-07T03:31:19.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:19.224 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 3.2 M 2024-09-07T03:31:19.224 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 14 M 2024-09-07T03:31:19.224 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:31:19.570 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-mirror-19.3.0-4759.g5c120bb8.el9.x86_64.rpm 9.2 MB/s | 3.2 MB 00:00 2024-09-07T03:31:19.570 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:19.571 INFO:teuthology.orchestra.run.smithi120.stdout:Total 9.1 MB/s | 3.2 MB 00:00 2024-09-07T03:31:19.571 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:31:19.580 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:31:19.580 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:31:19.665 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:31:19.666 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:31:19.945 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:19.945 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:19.945 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:31:19.945 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:19.945 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:19.945 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:20.123 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:31:20.173 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install rbd-nbd 2024-09-07T03:31:20.196 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:20.223 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-07T03:31:20.223 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-07T03:31:20.223 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-07T03:31:20.223 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-07T03:31:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:20.747 INFO:teuthology.orchestra.run.smithi104.stdout:Last metadata expiration check: 0:01:48 ago on Sat 07 Sep 2024 03:29:32 AM UTC. 2024-09-07T03:31:20.885 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 170 k 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout:Install 1 Package 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:20.886 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 170 k 2024-09-07T03:31:20.887 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 490 k 2024-09-07T03:31:20.887 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-07T03:31:21.099 INFO:teuthology.orchestra.run.smithi104.stdout:rbd-nbd-19.3.0-4759.g5c120bb8.el9.x86_64.rpm 802 kB/s | 170 kB 00:00 2024-09-07T03:31:21.100 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:21.100 INFO:teuthology.orchestra.run.smithi104.stdout:Total 797 kB/s | 170 kB 00:00 2024-09-07T03:31:21.100 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-07T03:31:21.107 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-07T03:31:21.108 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-07T03:31:21.171 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-07T03:31:21.171 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-07T03:31:21.320 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-07T03:31:21.411 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:21.442 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:31:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:21.442 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:21.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install rbd-nbd 2024-09-07T03:31:21.815 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:22.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:22.081 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:22.081 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-07T03:31:22.081 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:22.081 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:22.081 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-07T03:31:22.257 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:01:45 ago on Sat 07 Sep 2024 03:29:37 AM UTC. 2024-09-07T03:31:22.335 DEBUG:teuthology.parallel:result is None 2024-09-07T03:31:22.390 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:19.3.0-4759.g5c120bb8.el9 ceph 170 k 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout:Install 1 Package 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:22.391 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 170 k 2024-09-07T03:31:22.392 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 490 k 2024-09-07T03:31:22.392 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-07T03:31:22.602 INFO:teuthology.orchestra.run.smithi120.stdout:rbd-nbd-19.3.0-4759.g5c120bb8.el9.x86_64.rpm 810 kB/s | 170 kB 00:00 2024-09-07T03:31:22.603 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-07T03:31:22.603 INFO:teuthology.orchestra.run.smithi120.stdout:Total 804 kB/s | 170 kB 00:00 2024-09-07T03:31:22.603 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-07T03:31:22.611 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-07T03:31:22.611 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-07T03:31:22.675 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-07T03:31:22.675 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-07T03:31:22.832 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-07T03:31:22.939 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:23.342 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 1/1 2024-09-07T03:31:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:23.609 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-07T03:31:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:19.3.0-4759.g5c120bb8.el9.x86_64 2024-09-07T03:31:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:23.609 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-07T03:31:23.855 DEBUG:teuthology.parallel:result is None 2024-09-07T03:31:23.856 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c120bb86a547030eb0946833002675f49ccd220 2024-09-07T03:31:24.006 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-07T03:31:24.032 INFO:teuthology.orchestra.run.smithi104.stdout:19.3.0-4759.g5c120bb8.el9 2024-09-07T03:31:24.033 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4759.g5c120bb8.el9 2024-09-07T03:31:24.033 INFO:teuthology.task.install:The correct ceph version 19.3.0-4759.g5c120bb8 is installed. 2024-09-07T03:31:24.035 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c120bb86a547030eb0946833002675f49ccd220 2024-09-07T03:31:24.185 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-07T03:31:24.206 INFO:teuthology.orchestra.run.smithi120.stdout:19.3.0-4759.g5c120bb8.el9 2024-09-07T03:31:24.206 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4759.g5c120bb8.el9 2024-09-07T03:31:24.206 INFO:teuthology.task.install:The correct ceph version 19.3.0-4759.g5c120bb8 is installed. 2024-09-07T03:31:24.208 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-07T03:31:24.209 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:24.209 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-07T03:31:24.239 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:24.240 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-07T03:31:24.271 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-07T03:31:24.272 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:24.272 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-09-07T03:31:24.309 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-07T03:31:24.377 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:24.377 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-09-07T03:31:24.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-07T03:31:24.467 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-07T03:31:24.468 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:24.468 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-07T03:31:24.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-07T03:31:24.563 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:24.564 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-07T03:31:24.590 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-07T03:31:24.655 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-07T03:31:24.656 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:24.656 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-09-07T03:31:24.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-07T03:31:24.750 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:24.751 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-09-07T03:31:24.775 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-07T03:31:24.839 INFO:teuthology.run_tasks:Running task ceph... 2024-09-07T03:31:24.919 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-07T03:31:24.919 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-09-07T03:31:24.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-09-07T03:31:24.948 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-07T03:31:24.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-07T03:31:24.991 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-07T03:31:25.016 INFO:tasks.ceph:Creating extra log directories... 2024-09-07T03:31:25.017 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-07T03:31:25.059 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-07T03:31:25.091 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-07T03:31:25.091 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-07T03:31:25.092 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7893412', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '5c120bb86a547030eb0946833002675f49ccd220'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5c120bb86a547030eb0946833002675f49ccd220'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': '5c120bb86a547030eb0946833002675f49ccd220'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 594, 'sha1': '5c120bb86a547030eb0946833002675f49ccd220', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_5c120bb86a547030eb0946833002675f49ccd220/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '5c120bb86a547030eb0946833002675f49ccd220', 'targets': {'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqHFUJqw6U449BbjzkrfPGV6RfHlZAWNojsv9BYjEDrGIlzbOmU/Mick/DPT0zghbKuJIEjqSVGK48EWTMkbBo=', 'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKOrb3mlnEA4HaeUTfrzDPK6NCPlio4WzW5P2Z9HOxgTJ+0dD4QmK9ymEIofP1n0EdfpBn8KKgXoCaPzcT3/bjg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '5c120bb86a547030eb0946833002675f49ccd220', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-07_03:10:16', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-07T03:31:25.092 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-07T03:31:25.126 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-07T03:31:25.141 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-09-07T03:31:25.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-09-07T03:31:25.208 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:25.208 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-09-07T03:31:25.262 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-07T03:31:25.263 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-09-07T03:31:25.318 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-07T03:31:25.319 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-07T03:31:25.319 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-07T03:31:25.319 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-07T03:31:25.319 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-07T03:31:25.319 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-07 03:31:19.106375610 +0000 2024-09-07T03:31:25.319 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-07 03:28:54.849202093 +0000 2024-09-07T03:31:25.319 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-07 03:28:54.849202093 +0000 2024-09-07T03:31:25.319 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-07 03:28:54.849202093 +0000 2024-09-07T03:31:25.319 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-07T03:31:25.383 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-07T03:31:25.383 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-07T03:31:25.383 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000263998 s, 1.9 MB/s 2024-09-07T03:31:25.384 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-07T03:31:25.441 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-09-07T03:31:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-07T03:31:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-07T03:31:25.497 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-07T03:31:25.497 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-07T03:31:25.497 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-07T03:31:25.497 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-07 03:31:19.106375610 +0000 2024-09-07T03:31:25.497 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-07 03:28:55.186198453 +0000 2024-09-07T03:31:25.497 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-07 03:28:55.186198453 +0000 2024-09-07T03:31:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-07 03:28:55.186198453 +0000 2024-09-07T03:31:25.498 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-07T03:31:25.560 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-07T03:31:25.560 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-07T03:31:25.560 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000205907 s, 2.5 MB/s 2024-09-07T03:31:25.561 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-07T03:31:25.618 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-09-07T03:31:25.673 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-07T03:31:25.673 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-07T03:31:25.673 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-07T03:31:25.674 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-07T03:31:25.674 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-07T03:31:25.674 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-07 03:31:19.107375600 +0000 2024-09-07T03:31:25.674 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-07 03:28:55.511194943 +0000 2024-09-07T03:31:25.674 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-07 03:28:55.511194943 +0000 2024-09-07T03:31:25.674 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-07 03:28:55.511194943 +0000 2024-09-07T03:31:25.674 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-07T03:31:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-07T03:31:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-07T03:31:25.737 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000169327 s, 3.0 MB/s 2024-09-07T03:31:25.738 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-07T03:31:25.795 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-09-07T03:31:25.851 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-07T03:31:25.851 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-07T03:31:25.852 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-07T03:31:25.852 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-07T03:31:25.852 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-07T03:31:25.852 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-07 03:31:19.107375600 +0000 2024-09-07T03:31:25.852 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-07 03:28:55.840191389 +0000 2024-09-07T03:31:25.852 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-07 03:28:55.840191389 +0000 2024-09-07T03:31:25.853 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-07 03:28:55.840191389 +0000 2024-09-07T03:31:25.853 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-07T03:31:25.914 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-07T03:31:25.914 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-07T03:31:25.914 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000280457 s, 1.8 MB/s 2024-09-07T03:31:25.915 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-07T03:31:25.972 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-07T03:31:25.973 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:25.973 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-09-07T03:31:25.991 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-07T03:31:25.991 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-09-07T03:31:26.050 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-07T03:31:26.050 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-07T03:31:26.050 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-07T03:31:26.051 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-07T03:31:26.051 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-07T03:31:26.051 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-07 03:31:20.507816198 +0000 2024-09-07T03:31:26.051 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-07 03:28:46.420768944 +0000 2024-09-07T03:31:26.051 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-07 03:28:46.420768944 +0000 2024-09-07T03:31:26.051 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-07 03:28:46.420768944 +0000 2024-09-07T03:31:26.051 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-07T03:31:26.118 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-07T03:31:26.118 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-07T03:31:26.118 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000300783 s, 1.7 MB/s 2024-09-07T03:31:26.119 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-07T03:31:26.177 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-09-07T03:31:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-07T03:31:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-07T03:31:26.236 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-07T03:31:26.236 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-07T03:31:26.236 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-07T03:31:26.236 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-07 03:31:20.507816198 +0000 2024-09-07T03:31:26.236 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-07 03:28:46.755761038 +0000 2024-09-07T03:31:26.236 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-07 03:28:46.755761038 +0000 2024-09-07T03:31:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-07 03:28:46.755761038 +0000 2024-09-07T03:31:26.236 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-07T03:31:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-07T03:31:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-07T03:31:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000214626 s, 2.4 MB/s 2024-09-07T03:31:26.305 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-07T03:31:26.364 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-09-07T03:31:26.421 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-07T03:31:26.421 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-07T03:31:26.421 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-07T03:31:26.422 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-07T03:31:26.422 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-07T03:31:26.422 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-07 03:31:20.507816198 +0000 2024-09-07T03:31:26.422 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-07 03:28:47.072753557 +0000 2024-09-07T03:31:26.422 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-07 03:28:47.072753557 +0000 2024-09-07T03:31:26.422 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-07 03:28:47.072753557 +0000 2024-09-07T03:31:26.422 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-07T03:31:26.488 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-07T03:31:26.488 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-07T03:31:26.488 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000258746 s, 2.0 MB/s 2024-09-07T03:31:26.489 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-07T03:31:26.546 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-09-07T03:31:26.604 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-07T03:31:26.604 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-07T03:31:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-07T03:31:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-07T03:31:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-07T03:31:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-07 03:31:20.508816174 +0000 2024-09-07T03:31:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-07 03:28:47.385746170 +0000 2024-09-07T03:31:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-07 03:28:47.385746170 +0000 2024-09-07T03:31:26.605 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-07 03:28:47.385746170 +0000 2024-09-07T03:31:26.605 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-07T03:31:26.669 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-07T03:31:26.669 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-07T03:31:26.669 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000221765 s, 2.3 MB/s 2024-09-07T03:31:26.670 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-07T03:31:26.728 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-07T03:31:26.728 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-07T03:31:26.729 INFO:tasks.ceph:Generating config... 2024-09-07T03:31:26.730 INFO:tasks.ceph:[client] debug ms = 1 2024-09-07T03:31:26.730 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-07T03:31:26.730 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-07T03:31:26.730 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-07T03:31:26.730 INFO:tasks.ceph:[client] setuser = ceph 2024-09-07T03:31:26.730 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-07T03:31:26.730 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-07T03:31:26.730 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-07T03:31:26.730 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-07T03:31:26.730 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-07T03:31:26.730 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-07T03:31:26.731 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-07T03:31:26.731 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-07T03:31:26.731 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-07T03:31:26.731 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-07T03:31:26.732 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-07T03:31:26.732 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-07T03:31:26.732 INFO:tasks.ceph:Setting up mon.a... 2024-09-07T03:31:26.732 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-07T03:31:26.782 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.keyring 2024-09-07T03:31:26.785 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-07T03:31:26.830 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-07T03:31:26.855 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.104')] 2024-09-07T03:31:26.855 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.104'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-07T03:31:26.856 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:26.856 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-07T03:31:26.911 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.104 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-07T03:31:26.992 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:31:26.992 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:31:26.993 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-07T03:31:26.993 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: generated fsid ccd99612-983c-4850-93dd-2abdd870e9cd 2024-09-07T03:31:26.993 INFO:teuthology.orchestra.run.smithi104.stdout:setting min_mon_release = quincy 2024-09-07T03:31:26.993 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 0 2024-09-07T03:31:26.993 INFO:teuthology.orchestra.run.smithi104.stdout:fsid ccd99612-983c-4850-93dd-2abdd870e9cd 2024-09-07T03:31:26.993 INFO:teuthology.orchestra.run.smithi104.stdout:last_changed 2024-09-07T03:31:26.992954+0000 2024-09-07T03:31:26.993 INFO:teuthology.orchestra.run.smithi104.stdout:created 2024-09-07T03:31:26.992954+0000 2024-09-07T03:31:26.994 INFO:teuthology.orchestra.run.smithi104.stdout:min_mon_release 17 (quincy) 2024-09-07T03:31:26.994 INFO:teuthology.orchestra.run.smithi104.stdout:election_strategy: 1 2024-09-07T03:31:26.994 INFO:teuthology.orchestra.run.smithi104.stdout:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-09-07T03:31:26.994 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-07T03:31:26.995 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-07T03:31:27.050 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ccd99612-983c-4850-93dd-2abdd870e9cd... 2024-09-07T03:31:27.051 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-07T03:31:27.093 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-07T03:31:27.133 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-09-07T03:31:27.133 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-09-07T03:31:27.134 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-09-07T03:31:27.135 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-09-07T03:31:27.136 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = 172.21.15.104 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = ccd99612-983c-4850-93dd-2abdd870e9cd 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-09-07T03:31:27.137 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug trim objects = true 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.138 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: debug objclass = 20 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: bdev async discard = True 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: bdev enable discard = True 2024-09-07T03:31:27.139 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore allocator = bitmap 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 1/20 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 1/20 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 4/10 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.140 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-09-07T03:31:27.141 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-07T03:31:27.142 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: rgw gc obj min wait = 15 2024-09-07T03:31:27.143 INFO:teuthology.orchestra.run.smithi104.stdout: debug rgw = 20 2024-09-07T03:31:27.144 INFO:teuthology.orchestra.run.smithi104.stdout: setgroup = ceph 2024-09-07T03:31:27.144 INFO:teuthology.orchestra.run.smithi104.stdout: setuser = ceph 2024-09-07T03:31:27.144 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-09-07T03:31:27.144 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-09-07T03:31:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-09-07T03:31:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-07T03:31:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-09-07T03:31:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.144 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-09-07T03:31:27.145 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-07T03:31:27.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = 172.21.15.104 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = ccd99612-983c-4850-93dd-2abdd870e9cd 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-09-07T03:31:27.147 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-09-07T03:31:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: debug objclass = 20 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2024-09-07T03:31:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-09-07T03:31:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-07T03:31:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-09-07T03:31:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-07T03:31:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-07T03:31:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-07T03:31:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: rgw gc obj min wait = 15 2024-09-07T03:31:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: debug rgw = 20 2024-09-07T03:31:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: setgroup = ceph 2024-09-07T03:31:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: setuser = ceph 2024-09-07T03:31:27.154 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-09-07T03:31:27.155 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-07T03:31:27.156 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-07T03:31:27.250 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-07T03:31:27.250 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:27.250 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-07T03:31:27.265 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:27.265 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-07T03:31:27.320 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-09-07T03:31:27.320 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:27.320 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-07T03:31:27.320 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-07T03:31:27.394 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:27.395 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-07T03:31:27.450 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-09-07T03:31:27.450 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:27.450 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-07T03:31:27.450 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-07T03:31:27.492 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:27.492 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-07T03:31:27.550 INFO:tasks.ceph:Setting up mon nodes... 2024-09-07T03:31:27.550 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-07T03:31:27.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-07T03:31:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-07T03:31:27.660 INFO:tasks.ceph:Setting up mds nodes... 2024-09-07T03:31:27.660 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-07T03:31:27.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-07T03:31:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-07T03:31:27.716 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-07T03:31:27.716 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-07T03:31:27.716 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-07T03:31:27.741 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-07T03:31:27.741 INFO:tasks.ceph:role: osd.0 2024-09-07T03:31:27.741 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-07T03:31:27.741 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-07T03:31:27.813 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-07T03:31:27.813 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-07T03:31:27.813 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-07T03:31:27.813 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-07T03:31:27.813 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-07T03:31:27.814 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-07T03:31:27.814 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-07T03:31:27.814 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-07T03:31:27.814 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-07T03:31:27.814 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-07T03:31:28.327 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-07T03:31:28.329 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-07T03:31:28.329 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-07T03:31:28.458 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-07T03:31:28.491 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-07T03:31:28.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:28.582+0000 7f367f60c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-07T03:31:28.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:28.583+0000 7f367f60c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-07T03:31:28.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:28.584+0000 7f367f60c640 -1 bdev(0x55b267b77800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-07T03:31:28.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:28.584+0000 7f367f60c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-07T03:31:31.528 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-07T03:31:31.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-07T03:31:31.587 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-07T03:31:31.587 INFO:tasks.ceph:role: osd.1 2024-09-07T03:31:31.588 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-07T03:31:31.588 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-07T03:31:31.664 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-07T03:31:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-07T03:31:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-07T03:31:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-07T03:31:31.664 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-07T03:31:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-07T03:31:31.664 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-07T03:31:31.664 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-07T03:31:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-07T03:31:31.665 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-07T03:31:32.182 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-07T03:31:32.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-07T03:31:32.185 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-07T03:31:32.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-07T03:31:32.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-07T03:31:32.435 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-07T03:31:32.436 INFO:tasks.ceph:role: osd.2 2024-09-07T03:31:32.436 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-07T03:31:32.436 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-07T03:31:32.510 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-07T03:31:32.510 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-07T03:31:32.510 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-07T03:31:32.510 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-07T03:31:32.511 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-07T03:31:32.511 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-07T03:31:32.511 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-07T03:31:32.511 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-07T03:31:32.511 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-07T03:31:32.511 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-07T03:31:32.969 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-07T03:31:32.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-07T03:31:32.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-07T03:31:33.074 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-07T03:31:33.103 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-07T03:31:33.169 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-07T03:31:33.169 INFO:tasks.ceph:role: osd.3 2024-09-07T03:31:33.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-07T03:31:33.169 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-07T03:31:33.241 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-07T03:31:33.242 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-07T03:31:33.242 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-07T03:31:33.242 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-07T03:31:33.242 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-07T03:31:33.242 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-07T03:31:33.242 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-07T03:31:33.242 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-07T03:31:33.242 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-07T03:31:33.242 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-07T03:31:33.734 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-07T03:31:33.736 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-07T03:31:33.736 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-07T03:31:33.844 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-07T03:31:33.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-07T03:31:33.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:33.969+0000 7fd1c5bdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-07T03:31:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:33.973+0000 7fd1c5bdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-07T03:31:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:33.974+0000 7fd1c5bdd640 -1 bdev(0x5570e8657800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-07T03:31:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:33.974+0000 7fd1c5bdd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-07T03:31:36.894 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-07T03:31:36.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-07T03:31:37.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:37.013+0000 7f549a3b9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-07T03:31:37.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:37.013+0000 7f549a3b9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-07T03:31:37.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:37.013+0000 7f549a3b9640 -1 bdev(0x55e60c637800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-07T03:31:37.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:37.014+0000 7f549a3b9640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-07T03:31:40.689 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-07T03:31:40.718 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-07T03:31:40.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:40.806+0000 7f5daea13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-07T03:31:40.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:40.807+0000 7f5daea13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-07T03:31:40.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:40.807+0000 7f5daea13640 -1 bdev(0x555afcbab800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-07T03:31:40.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:40.807+0000 7f5daea13640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-07T03:31:43.977 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-07T03:31:44.003 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-07T03:31:44.003 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:44.003 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-07T03:31:44.034 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:44.034 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-07T03:31:44.068 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:44.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-07T03:31:44.132 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:44.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-07T03:31:44.197 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:44.197 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-07T03:31:44.261 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:44.261 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-07T03:31:44.316 INFO:tasks.ceph:Adding keys to all mons... 2024-09-07T03:31:44.316 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-07T03:31:44.344 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAQydtmSgHIIhAABFymPIFHtr4wA/5SeeM6WQ== 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAPydtmZ7ooJxAAb/8XaM8rsqcreA5OgMRohQ== 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAVydtmoKDRORAANqq6olw5mQOJb2maCxp9Gw== 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAZydtmp3TdABAAYMeqR/iij26M8l1QBG09IQ== 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAcydtmoKolMBAAOonJzTyGPwh2SZjVuatdNQ== 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-07T03:31:44.345 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQAPydtmvGzmKRAAomZDmoUrTuMoYts2QU5HGg== 2024-09-07T03:31:44.346 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-07T03:31:44.445 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-07T03:31:44.499 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-07T03:31:44.551 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-07T03:31:44.602 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-07T03:31:44.704 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-07T03:31:44.757 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-07T03:31:44.757 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-07T03:31:44.782 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-07T03:31:44.881 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-07T03:31:44.905 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-07T03:31:44.961 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-07T03:31:44.961 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-07T03:31:44.962 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-07T03:31:45.003 INFO:tasks.ceph.mon.a:Started 2024-09-07T03:31:45.003 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-07T03:31:45.003 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-07T03:31:45.004 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-07T03:31:45.006 INFO:tasks.ceph.mgr.x:Started 2024-09-07T03:31:45.006 DEBUG:tasks.ceph:set 0 configs 2024-09-07T03:31:45.006 INFO:tasks.ceph:Setting crush tunables to default 2024-09-07T03:31:45.007 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd crush tunables default 2024-09-07T03:31:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.102+0000 7f0ba33ab640 1 Processor -- start 2024-09-07T03:31:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.102+0000 7f0ba33ab640 1 -- start start 2024-09-07T03:31:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.102+0000 7f0ba33ab640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0b9c09a680 0x7f0b9c134700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.103+0000 7f0ba33ab640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9c09bd30 con 0x7f0b9c12f420 2024-09-07T03:31:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.103+0000 7f0ba33ab640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f0b9c09ae70 con 0x7f0b9c09a680 2024-09-07T03:31:45.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.103+0000 7f0ba0946640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0b9c09a680 0x7f0b9c134700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.103+0000 7f0ba0946640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0b9c09a680 0x7f0b9c134700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48484/0 (socket says 172.21.15.104:48484) 2024-09-07T03:31:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.103+0000 7f0ba1147640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f0b9c12f420 0x7f0b9c12f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56372/0 (socket says 172.21.15.104:56372) 2024-09-07T03:31:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.103+0000 7f0ba0946640 1 -- 172.21.15.104:0/3936269571 learned_addr learned my addr 172.21.15.104:0/3936269571 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:31:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.103+0000 7f0ba0946640 1 -- 172.21.15.104:0/3936269571 >> v1:172.21.15.104:6789/0 conn(0x7f0b9c12f420 legacy=0x7f0b9c12f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.103+0000 7f0ba0946640 1 -- 172.21.15.104:0/3936269571 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c12ff10 con 0x7f0b9c09a680 2024-09-07T03:31:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.105+0000 7f0ba0946640 1 --2- 172.21.15.104:0/3936269571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 0x7f0b9c134700 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0097f0 tx=0x7f0b8c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d148cd96c04319d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.105+0000 7f0b93fff640 1 -- 172.21.15.104:0/3936269571 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b8c037070 con 0x7f0b9c09a680 2024-09-07T03:31:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.105+0000 7f0b93fff640 1 -- 172.21.15.104:0/3936269571 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b8c032440 con 0x7f0b9c09a680 2024-09-07T03:31:45.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.105+0000 7f0b93fff640 1 -- 172.21.15.104:0/3936269571 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b8c02ae60 con 0x7f0b9c09a680 2024-09-07T03:31:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.105+0000 7f0ba33ab640 1 -- 172.21.15.104:0/3936269571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 msgr2=0x7f0b9c134700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.105+0000 7f0ba33ab640 1 --2- 172.21.15.104:0/3936269571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 0x7f0b9c134700 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0097f0 tx=0x7f0b8c02a1e0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.105+0000 7f0ba33ab640 1 -- 172.21.15.104:0/3936269571 shutdown_connections 2024-09-07T03:31:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.105+0000 7f0ba33ab640 1 --2- 172.21.15.104:0/3936269571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 0x7f0b9c134700 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.105+0000 7f0ba33ab640 1 -- 172.21.15.104:0/3936269571 >> 172.21.15.104:0/3936269571 conn(0x7f0b9c0a0000 msgr2=0x7f0b9c0a03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.106+0000 7f0ba33ab640 1 -- 172.21.15.104:0/3936269571 shutdown_connections 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.106+0000 7f0ba33ab640 1 -- 172.21.15.104:0/3936269571 wait complete. 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.106+0000 7f0ba33ab640 1 Processor -- start 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.106+0000 7f0ba33ab640 1 -- start start 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0ba33ab640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 0x7f0b9c1271c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0ba33ab640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c134fd0 con 0x7f0b9c09a680 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0ba1147640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 0x7f0b9c1271c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0ba1147640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 0x7f0b9c1271c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48500/0 (socket says 172.21.15.104:48500) 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0ba1147640 1 -- 172.21.15.104:0/376119428 learned_addr learned my addr 172.21.15.104:0/376119428 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0ba1147640 1 -- 172.21.15.104:0/376119428 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c129ca0 con 0x7f0b9c09a680 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0ba1147640 1 --2- 172.21.15.104:0/376119428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 0x7f0b9c1271c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800c450 tx=0x7f0b9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0b91ffb640 1 -- 172.21.15.104:0/376119428 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b98007410 con 0x7f0b9c09a680 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0b91ffb640 1 -- 172.21.15.104:0/376119428 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b980075b0 con 0x7f0b9c09a680 2024-09-07T03:31:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0ba33ab640 1 -- 172.21.15.104:0/376119428 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9c073ce0 con 0x7f0b9c09a680 2024-09-07T03:31:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.107+0000 7f0b91ffb640 1 -- 172.21.15.104:0/376119428 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b98004950 con 0x7f0b9c09a680 2024-09-07T03:31:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.108+0000 7f0b91ffb640 1 -- 172.21.15.104:0/376119428 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0b98004af0 con 0x7f0b9c09a680 2024-09-07T03:31:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.108+0000 7f0ba33ab640 1 -- 172.21.15.104:0/376119428 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9c1290e0 con 0x7f0b9c09a680 2024-09-07T03:31:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.108+0000 7f0b91ffb640 1 -- 172.21.15.104:0/376119428 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0b980123f0 con 0x7f0b9c09a680 2024-09-07T03:31:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.108+0000 7f0ba33ab640 1 -- 172.21.15.104:0/376119428 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9c068da0 con 0x7f0b9c09a680 2024-09-07T03:31:45.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.111+0000 7f0b91ffb640 1 -- 172.21.15.104:0/376119428 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0b98021070 con 0x7f0b9c09a680 2024-09-07T03:31:45.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.174+0000 7f0ba33ab640 1 -- 172.21.15.104:0/376119428 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0b9c129770 con 0x7f0b9c09a680 2024-09-07T03:31:45.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.175+0000 7f0b91ffb640 1 -- 172.21.15.104:0/376119428 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0b980126d0 con 0x7f0b9c09a680 2024-09-07T03:31:45.176 INFO:teuthology.orchestra.run.smithi104.stderr:adjusted tunables profile to default 2024-09-07T03:31:45.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.176+0000 7f0ba33ab640 1 -- 172.21.15.104:0/376119428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 msgr2=0x7f0b9c1271c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.176+0000 7f0ba33ab640 1 --2- 172.21.15.104:0/376119428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 0x7f0b9c1271c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800c450 tx=0x7f0b9800c910 comp rx=0 tx=0).stop 2024-09-07T03:31:45.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.176+0000 7f0ba33ab640 1 -- 172.21.15.104:0/376119428 shutdown_connections 2024-09-07T03:31:45.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.176+0000 7f0ba33ab640 1 --2- 172.21.15.104:0/376119428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9c09a680 0x7f0b9c1271c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.176+0000 7f0ba33ab640 1 -- 172.21.15.104:0/376119428 >> 172.21.15.104:0/376119428 conn(0x7f0b9c0a0000 msgr2=0x7f0b9c132db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:45.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.176+0000 7f0ba33ab640 1 -- 172.21.15.104:0/376119428 shutdown_connections 2024-09-07T03:31:45.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:45.176+0000 7f0ba33ab640 1 -- 172.21.15.104:0/376119428 wait complete. 2024-09-07T03:31:45.187 INFO:tasks.ceph:check_enable_crimson: False 2024-09-07T03:31:45.187 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-07T03:31:45.187 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-07T03:31:45.187 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-07T03:31:45.212 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:45.212 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-07T03:31:45.237 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:45.237 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-07T03:31:45.302 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-07T03:31:45.302 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-07T03:31:45.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 49009fa6-ab2b-4a54-839c-a8e81abf5b1f 0 2024-09-07T03:31:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.502+0000 7fa337850640 1 Processor -- start 2024-09-07T03:31:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.502+0000 7fa337850640 1 -- start start 2024-09-07T03:31:45.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.503+0000 7fa337850640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa33006ffb0 0x7fa33006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:45.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.503+0000 7fa337850640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33006ed40 con 0x7fa33006e8d0 2024-09-07T03:31:45.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.503+0000 7fa337850640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fa33006ef10 con 0x7fa33006ffb0 2024-09-07T03:31:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.503+0000 7fa3355ec640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa33006ffb0 0x7fa33006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.504+0000 7fa334deb640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa33006e8d0 0x7fa33011d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:47860/0 (socket says 172.21.15.120:47860) 2024-09-07T03:31:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.504+0000 7fa334deb640 1 -- 172.21.15.120:0/3598514638 learned_addr learned my addr 172.21.15.120:0/3598514638 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.504+0000 7fa3355ec640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa33006ffb0 0x7fa33006e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:50476/0 (socket says 172.21.15.120:50476) 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.504+0000 7fa3355ec640 1 -- 172.21.15.120:0/3598514638 >> v1:172.21.15.104:6789/0 conn(0x7fa33006e8d0 legacy=0x7fa33011d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.504+0000 7fa3355ec640 1 -- 172.21.15.120:0/3598514638 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33006f0c0 con 0x7fa33006ffb0 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa3355ec640 1 --2- 172.21.15.120:0/3598514638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006ffb0 0x7fa33006e390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009720 tx=0x7fa32c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d0ae8795a276d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa327fff640 1 -- 172.21.15.120:0/3598514638 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa32c037070 con 0x7fa33006ffb0 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa327fff640 1 -- 172.21.15.120:0/3598514638 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32c02ad90 con 0x7fa33006ffb0 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa327fff640 1 -- 172.21.15.120:0/3598514638 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa32c032590 con 0x7fa33006ffb0 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa337850640 1 -- 172.21.15.120:0/3598514638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006ffb0 msgr2=0x7fa33006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa337850640 1 --2- 172.21.15.120:0/3598514638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006ffb0 0x7fa33006e390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009720 tx=0x7fa32c02a110 comp rx=0 tx=0).stop 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa337850640 1 -- 172.21.15.120:0/3598514638 shutdown_connections 2024-09-07T03:31:45.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa337850640 1 --2- 172.21.15.120:0/3598514638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006ffb0 0x7fa33006e390 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa337850640 1 -- 172.21.15.120:0/3598514638 >> 172.21.15.120:0/3598514638 conn(0x7fa330071d90 msgr2=0x7fa3300741b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:45.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa337850640 1 -- 172.21.15.120:0/3598514638 shutdown_connections 2024-09-07T03:31:45.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.505+0000 7fa337850640 1 -- 172.21.15.120:0/3598514638 wait complete. 2024-09-07T03:31:45.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.506+0000 7fa337850640 1 Processor -- start 2024-09-07T03:31:45.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.506+0000 7fa337850640 1 -- start start 2024-09-07T03:31:45.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.506+0000 7fa337850640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006e8d0 0x7fa3301a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:45.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.506+0000 7fa337850640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa33011ed70 con 0x7fa33006e8d0 2024-09-07T03:31:45.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa3355ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006e8d0 0x7fa3301a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:45.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa3355ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006e8d0 0x7fa3301a77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:50484/0 (socket says 172.21.15.120:50484) 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa3355ec640 1 -- 172.21.15.120:0/960165862 learned_addr learned my addr 172.21.15.120:0/960165862 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa3355ec640 1 -- 172.21.15.120:0/960165862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3301a7d70 con 0x7fa33006e8d0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa3355ec640 1 --2- 172.21.15.120:0/960165862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006e8d0 0x7fa3301a77a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009720 tx=0x7fa32c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa325ffb640 1 -- 172.21.15.120:0/960165862 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa32c041070 con 0x7fa33006e8d0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa325ffb640 1 -- 172.21.15.120:0/960165862 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32c03c460 con 0x7fa33006e8d0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa337850640 1 -- 172.21.15.120:0/960165862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3301a8000 con 0x7fa33006e8d0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa325ffb640 1 -- 172.21.15.120:0/960165862 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa32c037040 con 0x7fa33006e8d0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.507+0000 7fa337850640 1 -- 172.21.15.120:0/960165862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3301acfd0 con 0x7fa33006e8d0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.508+0000 7fa325ffb640 1 -- 172.21.15.120:0/960165862 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa32c044070 con 0x7fa33006e8d0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.508+0000 7fa325ffb640 1 -- 172.21.15.120:0/960165862 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa32c046a50 con 0x7fa33006e8d0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.508+0000 7fa337850640 1 -- 172.21.15.120:0/960165862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa33006e410 con 0x7fa33006e8d0 2024-09-07T03:31:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.510+0000 7fa325ffb640 1 -- 172.21.15.120:0/960165862 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa32c03c740 con 0x7fa33006e8d0 2024-09-07T03:31:45.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.581+0000 7fa337850640 1 -- 172.21.15.120:0/960165862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49009fa6-ab2b-4a54-839c-a8e81abf5b1f", "id": 0} v 0) -- 0x7fa33006ffb0 con 0x7fa33006e8d0 2024-09-07T03:31:45.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.582+0000 7fa325ffb640 1 -- 172.21.15.120:0/960165862 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49009fa6-ab2b-4a54-839c-a8e81abf5b1f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa32c03c920 con 0x7fa33006e8d0 2024-09-07T03:31:45.583 INFO:teuthology.orchestra.run.smithi120.stdout:0 2024-09-07T03:31:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.583+0000 7fa337850640 1 -- 172.21.15.120:0/960165862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006e8d0 msgr2=0x7fa3301a77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.583+0000 7fa337850640 1 --2- 172.21.15.120:0/960165862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006e8d0 0x7fa3301a77a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009720 tx=0x7fa32c0046c0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.583+0000 7fa337850640 1 -- 172.21.15.120:0/960165862 shutdown_connections 2024-09-07T03:31:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.583+0000 7fa337850640 1 --2- 172.21.15.120:0/960165862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa33006e8d0 0x7fa3301a77a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.583+0000 7fa337850640 1 -- 172.21.15.120:0/960165862 >> 172.21.15.120:0/960165862 conn(0x7fa330071d90 msgr2=0x7fa33011a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.583+0000 7fa337850640 1 -- 172.21.15.120:0/960165862 shutdown_connections 2024-09-07T03:31:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.583+0000 7fa337850640 1 -- 172.21.15.120:0/960165862 wait complete. 2024-09-07T03:31:45.594 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 797a0187-6388-4317-a7ba-79a25f6c7f5b 1 2024-09-07T03:31:45.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.690+0000 7f4394ce4640 1 Processor -- start 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.690+0000 7f4394ce4640 1 -- start start 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.690+0000 7f4394ce4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4390113070 0x7f4390113450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.690+0000 7f4394ce4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4390113b70 con 0x7f4390116670 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.690+0000 7f4394ce4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f43901171f0 con 0x7f4390113070 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.691+0000 7f438dd9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4390116670 0x7f4390116ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:47870/0 (socket says 172.21.15.120:47870) 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.691+0000 7f438e59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4390113070 0x7f4390113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.691+0000 7f438dd9b640 1 -- 172.21.15.120:0/2836598924 learned_addr learned my addr 172.21.15.120:0/2836598924 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.691+0000 7f438e59c640 1 -- 172.21.15.120:0/2836598924 >> v1:172.21.15.104:6789/0 conn(0x7f4390116670 legacy=0x7f4390116ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.691+0000 7f438d59a640 1 -- 172.21.15.120:0/2836598924 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184309130 0 0) 0x7f4390113b70 con 0x7f4390116670 2024-09-07T03:31:45.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.691+0000 7f438e59c640 1 -- 172.21.15.120:0/2836598924 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43901173a0 con 0x7f4390113070 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.692+0000 7f438e59c640 1 --2- 172.21.15.120:0/2836598924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 0x7f4390113450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4380009720 tx=0x7f438002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70c187b5a09b346 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.692+0000 7f438d59a640 1 -- 172.21.15.120:0/2836598924 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4380037070 con 0x7f4390113070 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.692+0000 7f438d59a640 1 -- 172.21.15.120:0/2836598924 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438002ad90 con 0x7f4390113070 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.692+0000 7f438d59a640 1 -- 172.21.15.120:0/2836598924 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4380032590 con 0x7f4390113070 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.693+0000 7f4394ce4640 1 -- 172.21.15.120:0/2836598924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 msgr2=0x7f4390113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.693+0000 7f4394ce4640 1 --2- 172.21.15.120:0/2836598924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 0x7f4390113450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4380009720 tx=0x7f438002a110 comp rx=0 tx=0).stop 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.693+0000 7f4394ce4640 1 -- 172.21.15.120:0/2836598924 shutdown_connections 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.693+0000 7f4394ce4640 1 --2- 172.21.15.120:0/2836598924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 0x7f4390113450 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.693+0000 7f4394ce4640 1 -- 172.21.15.120:0/2836598924 >> 172.21.15.120:0/2836598924 conn(0x7f439006f330 msgr2=0x7f439006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.693+0000 7f4394ce4640 1 -- 172.21.15.120:0/2836598924 shutdown_connections 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.693+0000 7f4394ce4640 1 -- 172.21.15.120:0/2836598924 wait complete. 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.694+0000 7f4394ce4640 1 Processor -- start 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.694+0000 7f4394ce4640 1 -- start start 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.694+0000 7f4394ce4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 0x7f43901a7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.694+0000 7f4394ce4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f439011edd0 con 0x7f4390113070 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.694+0000 7f438e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 0x7f43901a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.694+0000 7f438e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 0x7f43901a7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:50510/0 (socket says 172.21.15.120:50510) 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.694+0000 7f438e59c640 1 -- 172.21.15.120:0/802026384 learned_addr learned my addr 172.21.15.120:0/802026384 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.694+0000 7f438e59c640 1 -- 172.21.15.120:0/802026384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43901a7b50 con 0x7f4390113070 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.695+0000 7f438e59c640 1 --2- 172.21.15.120:0/802026384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 0x7f43901a7580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4380009720 tx=0x7f43800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.695+0000 7f437effd640 1 -- 172.21.15.120:0/802026384 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4380041070 con 0x7f4390113070 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.695+0000 7f437effd640 1 -- 172.21.15.120:0/802026384 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438003c460 con 0x7f4390113070 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.695+0000 7f4394ce4640 1 -- 172.21.15.120:0/802026384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43901a7de0 con 0x7f4390113070 2024-09-07T03:31:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.695+0000 7f437effd640 1 -- 172.21.15.120:0/802026384 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4380037040 con 0x7f4390113070 2024-09-07T03:31:45.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.695+0000 7f4394ce4640 1 -- 172.21.15.120:0/802026384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43901acdb0 con 0x7f4390113070 2024-09-07T03:31:45.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.695+0000 7f437effd640 1 -- 172.21.15.120:0/802026384 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4380044070 con 0x7f4390113070 2024-09-07T03:31:45.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.695+0000 7f437effd640 1 -- 172.21.15.120:0/802026384 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f4380046ac0 con 0x7f4390113070 2024-09-07T03:31:45.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.696+0000 7f4394ce4640 1 -- 172.21.15.120:0/802026384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43901134d0 con 0x7f4390113070 2024-09-07T03:31:45.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.698+0000 7f437effd640 1 -- 172.21.15.120:0/802026384 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f438003c740 con 0x7f4390113070 2024-09-07T03:31:45.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.768+0000 7f4394ce4640 1 -- 172.21.15.120:0/802026384 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "797a0187-6388-4317-a7ba-79a25f6c7f5b", "id": 1} v 0) -- 0x7f4390116670 con 0x7f4390113070 2024-09-07T03:31:45.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.769+0000 7f437effd640 1 -- 172.21.15.120:0/802026384 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "797a0187-6388-4317-a7ba-79a25f6c7f5b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f438003c920 con 0x7f4390113070 2024-09-07T03:31:45.770 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-09-07T03:31:45.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.770+0000 7f4394ce4640 1 -- 172.21.15.120:0/802026384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 msgr2=0x7f43901a7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.770+0000 7f4394ce4640 1 --2- 172.21.15.120:0/802026384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 0x7f43901a7580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4380009720 tx=0x7f43800046c0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.770+0000 7f4394ce4640 1 -- 172.21.15.120:0/802026384 shutdown_connections 2024-09-07T03:31:45.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.770+0000 7f4394ce4640 1 --2- 172.21.15.120:0/802026384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4390113070 0x7f43901a7580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.770+0000 7f4394ce4640 1 -- 172.21.15.120:0/802026384 >> 172.21.15.120:0/802026384 conn(0x7f439006f330 msgr2=0x7f4390111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:45.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.770+0000 7f4394ce4640 1 -- 172.21.15.120:0/802026384 shutdown_connections 2024-09-07T03:31:45.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.770+0000 7f4394ce4640 1 -- 172.21.15.120:0/802026384 wait complete. 2024-09-07T03:31:45.781 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e 2 2024-09-07T03:31:45.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.879+0000 7f2386764640 1 Processor -- start 2024-09-07T03:31:45.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.879+0000 7f2386764640 1 -- start start 2024-09-07T03:31:45.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.879+0000 7f2386764640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f238011b900 0x7f238011dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:45.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.879+0000 7f2386764640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238011e230 con 0x7f2380113070 2024-09-07T03:31:45.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.879+0000 7f2386764640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f238011f430 con 0x7f238011b900 2024-09-07T03:31:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.879+0000 7f237f7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f238011b900 0x7f238011dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.879+0000 7f237ffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2380113070 0x7f2380113450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:47882/0 (socket says 172.21.15.120:47882) 2024-09-07T03:31:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.879+0000 7f237ffff640 1 -- 172.21.15.120:0/3008443557 learned_addr learned my addr 172.21.15.120:0/3008443557 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:31:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.880+0000 7f237f7fe640 1 -- 172.21.15.120:0/3008443557 >> v1:172.21.15.104:6789/0 conn(0x7f2380113070 legacy=0x7f2380113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.880+0000 7f237f7fe640 1 -- 172.21.15.120:0/3008443557 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238011f5e0 con 0x7f238011b900 2024-09-07T03:31:45.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.880+0000 7f237effd640 1 -- 172.21.15.120:0/3008443557 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715614188 0 0) 0x7f238011e230 con 0x7f2380113070 2024-09-07T03:31:45.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.880+0000 7f237f7fe640 1 --2- 172.21.15.120:0/3008443557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f238011b900 0x7f238011dcf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2374009720 tx=0x7f237402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78e0ba21f05fbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:45.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.880+0000 7f237effd640 1 -- 172.21.15.120:0/3008443557 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2374037070 con 0x7f238011b900 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.881+0000 7f237effd640 1 -- 172.21.15.120:0/3008443557 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237402ad90 con 0x7f238011b900 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.881+0000 7f237effd640 1 -- 172.21.15.120:0/3008443557 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2374032590 con 0x7f238011b900 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.881+0000 7f2386764640 1 -- 172.21.15.120:0/3008443557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f238011b900 msgr2=0x7f238011dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.881+0000 7f2386764640 1 --2- 172.21.15.120:0/3008443557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f238011b900 0x7f238011dcf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2374009720 tx=0x7f237402a110 comp rx=0 tx=0).stop 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.881+0000 7f2386764640 1 -- 172.21.15.120:0/3008443557 shutdown_connections 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.881+0000 7f2386764640 1 --2- 172.21.15.120:0/3008443557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f238011b900 0x7f238011dcf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.881+0000 7f2386764640 1 -- 172.21.15.120:0/3008443557 >> 172.21.15.120:0/3008443557 conn(0x7f238006f330 msgr2=0x7f238006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.881+0000 7f2386764640 1 -- 172.21.15.120:0/3008443557 shutdown_connections 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.881+0000 7f2386764640 1 -- 172.21.15.120:0/3008443557 wait complete. 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.882+0000 7f2386764640 1 Processor -- start 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.882+0000 7f2386764640 1 -- start start 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.882+0000 7f2386764640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2380113070 0x7f23801a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.882+0000 7f2386764640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f238011e8e0 con 0x7f2380113070 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.882+0000 7f237ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2380113070 0x7f23801a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.882+0000 7f237ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2380113070 0x7f23801a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:50516/0 (socket says 172.21.15.120:50516) 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.882+0000 7f237ffff640 1 -- 172.21.15.120:0/3991048919 learned_addr learned my addr 172.21.15.120:0/3991048919 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.883+0000 7f237ffff640 1 -- 172.21.15.120:0/3991048919 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23801a7bd0 con 0x7f2380113070 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.883+0000 7f237ffff640 1 --2- 172.21.15.120:0/3991048919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2380113070 0x7f23801a7600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f237000c3d0 tx=0x7f237000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.883+0000 7f237cff9640 1 -- 172.21.15.120:0/3991048919 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23700074d0 con 0x7f2380113070 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.883+0000 7f237cff9640 1 -- 172.21.15.120:0/3991048919 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23700047e0 con 0x7f2380113070 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.883+0000 7f2386764640 1 -- 172.21.15.120:0/3991048919 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23801a7ec0 con 0x7f2380113070 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.883+0000 7f237cff9640 1 -- 172.21.15.120:0/3991048919 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2370007670 con 0x7f2380113070 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.883+0000 7f2386764640 1 -- 172.21.15.120:0/3991048919 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23801ad010 con 0x7f2380113070 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.883+0000 7f237cff9640 1 -- 172.21.15.120:0/3991048919 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2370011070 con 0x7f2380113070 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.883+0000 7f237cff9640 1 -- 172.21.15.120:0/3991048919 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f237001d3f0 con 0x7f2380113070 2024-09-07T03:31:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.884+0000 7f2386764640 1 -- 172.21.15.120:0/3991048919 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23801a8200 con 0x7f2380113070 2024-09-07T03:31:45.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.886+0000 7f237cff9640 1 -- 172.21.15.120:0/3991048919 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f237001d710 con 0x7f2380113070 2024-09-07T03:31:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.956+0000 7f2386764640 1 -- 172.21.15.120:0/3991048919 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e", "id": 2} v 0) -- 0x7f238011ef60 con 0x7f2380113070 2024-09-07T03:31:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.958+0000 7f237cff9640 1 -- 172.21.15.120:0/3991048919 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f237001de20 con 0x7f2380113070 2024-09-07T03:31:45.959 INFO:teuthology.orchestra.run.smithi120.stdout:2 2024-09-07T03:31:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.958+0000 7f2386764640 1 -- 172.21.15.120:0/3991048919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2380113070 msgr2=0x7f23801a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.958+0000 7f2386764640 1 --2- 172.21.15.120:0/3991048919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2380113070 0x7f23801a7600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f237000c3d0 tx=0x7f237000c890 comp rx=0 tx=0).stop 2024-09-07T03:31:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.959+0000 7f2386764640 1 -- 172.21.15.120:0/3991048919 shutdown_connections 2024-09-07T03:31:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.959+0000 7f2386764640 1 --2- 172.21.15.120:0/3991048919 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2380113070 0x7f23801a7600 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.959+0000 7f2386764640 1 -- 172.21.15.120:0/3991048919 >> 172.21.15.120:0/3991048919 conn(0x7f238006f330 msgr2=0x7f238010fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.959+0000 7f2386764640 1 -- 172.21.15.120:0/3991048919 shutdown_connections 2024-09-07T03:31:45.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:45.959+0000 7f2386764640 1 -- 172.21.15.120:0/3991048919 wait complete. 2024-09-07T03:31:45.970 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 582a1603-a3e0-4712-ab2e-e3233e9a1d60 3 2024-09-07T03:31:46.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.065+0000 7f8d23d3d640 1 Processor -- start 2024-09-07T03:31:46.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.066+0000 7f8d23d3d640 1 -- start start 2024-09-07T03:31:46.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.066+0000 7f8d23d3d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d1c113070 0x7f8d1c113450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:46.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.066+0000 7f8d23d3d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1c113b70 con 0x7f8d1c116670 2024-09-07T03:31:46.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.066+0000 7f8d23d3d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f8d1c1171f0 con 0x7f8d1c113070 2024-09-07T03:31:46.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.066+0000 7f8d21ad9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d1c113070 0x7f8d1c113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:46.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.066+0000 7f8d21ad9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d1c113070 0x7f8d1c113450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:50532/0 (socket says 172.21.15.120:50532) 2024-09-07T03:31:46.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.066+0000 7f8d212d8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8d1c116670 0x7f8d1c116ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:47884/0 (socket says 172.21.15.120:47884) 2024-09-07T03:31:46.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.066+0000 7f8d21ad9640 1 -- 172.21.15.120:0/1866122293 learned_addr learned my addr 172.21.15.120:0/1866122293 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:31:46.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.067+0000 7f8d21ad9640 1 -- 172.21.15.120:0/1866122293 >> v1:172.21.15.104:6789/0 conn(0x7f8d1c116670 legacy=0x7f8d1c116ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:46.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.067+0000 7f8d21ad9640 1 -- 172.21.15.120:0/1866122293 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c1173a0 con 0x7f8d1c113070 2024-09-07T03:31:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.067+0000 7f8d21ad9640 1 --2- 172.21.15.120:0/1866122293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 0x7f8d1c113450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d180097f0 tx=0x7f8d1802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c870d0ad2b683719 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.067+0000 7f8d20ad7640 1 -- 172.21.15.120:0/1866122293 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d18037070 con 0x7f8d1c113070 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.068+0000 7f8d20ad7640 1 -- 172.21.15.120:0/1866122293 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d18032440 con 0x7f8d1c113070 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.068+0000 7f8d20ad7640 1 -- 172.21.15.120:0/1866122293 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d1802ae60 con 0x7f8d1c113070 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.068+0000 7f8d23d3d640 1 -- 172.21.15.120:0/1866122293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 msgr2=0x7f8d1c113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.068+0000 7f8d23d3d640 1 --2- 172.21.15.120:0/1866122293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 0x7f8d1c113450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d180097f0 tx=0x7f8d1802a1e0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.068+0000 7f8d23d3d640 1 -- 172.21.15.120:0/1866122293 shutdown_connections 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.068+0000 7f8d23d3d640 1 --2- 172.21.15.120:0/1866122293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 0x7f8d1c113450 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.068+0000 7f8d23d3d640 1 -- 172.21.15.120:0/1866122293 >> 172.21.15.120:0/1866122293 conn(0x7f8d1c06f330 msgr2=0x7f8d1c06f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.068+0000 7f8d23d3d640 1 -- 172.21.15.120:0/1866122293 shutdown_connections 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.068+0000 7f8d23d3d640 1 -- 172.21.15.120:0/1866122293 wait complete. 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.069+0000 7f8d23d3d640 1 Processor -- start 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.069+0000 7f8d23d3d640 1 -- start start 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.069+0000 7f8d23d3d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 0x7f8d1c1a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.069+0000 7f8d23d3d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c11edd0 con 0x7f8d1c113070 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.069+0000 7f8d21ad9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 0x7f8d1c1a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.069+0000 7f8d21ad9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 0x7f8d1c1a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:50548/0 (socket says 172.21.15.120:50548) 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.069+0000 7f8d21ad9640 1 -- 172.21.15.120:0/313405171 learned_addr learned my addr 172.21.15.120:0/313405171 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.070+0000 7f8d21ad9640 1 -- 172.21.15.120:0/313405171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c1a7d10 con 0x7f8d1c113070 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.070+0000 7f8d21ad9640 1 --2- 172.21.15.120:0/313405171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 0x7f8d1c1a7740 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8d18035040 tx=0x7f8d180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.070+0000 7f8d127fc640 1 -- 172.21.15.120:0/313405171 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d18041070 con 0x7f8d1c113070 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.070+0000 7f8d127fc640 1 -- 172.21.15.120:0/313405171 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1803c7a0 con 0x7f8d1c113070 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.070+0000 7f8d23d3d640 1 -- 172.21.15.120:0/313405171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c1a7fa0 con 0x7f8d1c113070 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.070+0000 7f8d127fc640 1 -- 172.21.15.120:0/313405171 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d18037040 con 0x7f8d1c113070 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.070+0000 7f8d23d3d640 1 -- 172.21.15.120:0/313405171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c1acf70 con 0x7f8d1c113070 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.070+0000 7f8d127fc640 1 -- 172.21.15.120:0/313405171 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d18044070 con 0x7f8d1c113070 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.070+0000 7f8d127fc640 1 -- 172.21.15.120:0/313405171 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8d1803d3f0 con 0x7f8d1c113070 2024-09-07T03:31:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.071+0000 7f8d23d3d640 1 -- 172.21.15.120:0/313405171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1c1134d0 con 0x7f8d1c113070 2024-09-07T03:31:46.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.073+0000 7f8d127fc640 1 -- 172.21.15.120:0/313405171 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8d18046450 con 0x7f8d1c113070 2024-09-07T03:31:46.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.142+0000 7f8d23d3d640 1 -- 172.21.15.120:0/313405171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd new", "uuid": "582a1603-a3e0-4712-ab2e-e3233e9a1d60", "id": 3} v 0) -- 0x7f8d1c116670 con 0x7f8d1c113070 2024-09-07T03:31:46.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.143+0000 7f8d127fc640 1 -- 172.21.15.120:0/313405171 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "582a1603-a3e0-4712-ab2e-e3233e9a1d60", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8d1803caa0 con 0x7f8d1c113070 2024-09-07T03:31:46.144 INFO:teuthology.orchestra.run.smithi120.stdout:3 2024-09-07T03:31:46.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.144+0000 7f8d23d3d640 1 -- 172.21.15.120:0/313405171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 msgr2=0x7f8d1c1a7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.144+0000 7f8d23d3d640 1 --2- 172.21.15.120:0/313405171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 0x7f8d1c1a7740 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8d18035040 tx=0x7f8d180046c0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.144+0000 7f8d23d3d640 1 -- 172.21.15.120:0/313405171 shutdown_connections 2024-09-07T03:31:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.144+0000 7f8d23d3d640 1 --2- 172.21.15.120:0/313405171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1c113070 0x7f8d1c1a7740 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.144+0000 7f8d23d3d640 1 -- 172.21.15.120:0/313405171 >> 172.21.15.120:0/313405171 conn(0x7f8d1c06f330 msgr2=0x7f8d1c114d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.144+0000 7f8d23d3d640 1 -- 172.21.15.120:0/313405171 shutdown_connections 2024-09-07T03:31:46.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:31:46.144+0000 7f8d23d3d640 1 -- 172.21.15.120:0/313405171 wait complete. 2024-09-07T03:31:46.155 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-07T03:31:46.156 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-07T03:31:46.158 INFO:tasks.ceph.osd.0:Started 2024-09-07T03:31:46.158 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-07T03:31:46.158 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-07T03:31:46.160 INFO:tasks.ceph.osd.1:Started 2024-09-07T03:31:46.161 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-07T03:31:46.161 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-07T03:31:46.163 INFO:tasks.ceph.osd.2:Started 2024-09-07T03:31:46.163 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-07T03:31:46.163 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-07T03:31:46.165 INFO:tasks.ceph.osd.3:Started 2024-09-07T03:31:46.165 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-07T03:31:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.269+0000 7fc237910640 1 Processor -- start 2024-09-07T03:31:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.269+0000 7fc237910640 1 -- start start 2024-09-07T03:31:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc237910640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc230129d80 0x7fc23012a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc237910640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23006dc00 con 0x7fc23012a6a0 2024-09-07T03:31:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc237910640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fc2301299c0 con 0x7fc230129d80 2024-09-07T03:31:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc2356ac640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc230129d80 0x7fc23012a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc2356ac640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc230129d80 0x7fc23012a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48510/0 (socket says 172.21.15.104:48510) 2024-09-07T03:31:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc2356ac640 1 -- 172.21.15.104:0/3223216159 learned_addr learned my addr 172.21.15.104:0/3223216159 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:31:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc234eab640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc23012a6a0 0x7fc230110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56398/0 (socket says 172.21.15.104:56398) 2024-09-07T03:31:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc2356ac640 1 -- 172.21.15.104:0/3223216159 >> v1:172.21.15.104:6789/0 conn(0x7fc23012a6a0 legacy=0x7fc230110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc227fff640 1 -- 172.21.15.104:0/3223216159 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3389355863 0 0) 0x7fc23006dc00 con 0x7fc23012a6a0 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.270+0000 7fc2356ac640 1 -- 172.21.15.104:0/3223216159 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc230114d20 con 0x7fc230129d80 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.271+0000 7fc2356ac640 1 --2- 172.21.15.104:0/3223216159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 0x7fc23012a160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0097f0 tx=0x7fc22c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c870a68495c94de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.271+0000 7fc227fff640 1 -- 172.21.15.104:0/3223216159 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c037070 con 0x7fc230129d80 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.271+0000 7fc227fff640 1 -- 172.21.15.104:0/3223216159 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c032440 con 0x7fc230129d80 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.271+0000 7fc227fff640 1 -- 172.21.15.104:0/3223216159 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c02ae60 con 0x7fc230129d80 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.272+0000 7fc237910640 1 -- 172.21.15.104:0/3223216159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 msgr2=0x7fc23012a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.272+0000 7fc237910640 1 --2- 172.21.15.104:0/3223216159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 0x7fc23012a160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0097f0 tx=0x7fc22c02a1e0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.272+0000 7fc237910640 1 -- 172.21.15.104:0/3223216159 shutdown_connections 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.272+0000 7fc237910640 1 --2- 172.21.15.104:0/3223216159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 0x7fc23012a160 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.272+0000 7fc237910640 1 -- 172.21.15.104:0/3223216159 >> 172.21.15.104:0/3223216159 conn(0x7fc230070850 msgr2=0x7fc230072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.272+0000 7fc237910640 1 -- 172.21.15.104:0/3223216159 shutdown_connections 2024-09-07T03:31:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.272+0000 7fc237910640 1 -- 172.21.15.104:0/3223216159 wait complete. 2024-09-07T03:31:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.273+0000 7fc237910640 1 Processor -- start 2024-09-07T03:31:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.273+0000 7fc237910640 1 -- start start 2024-09-07T03:31:46.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.273+0000 7fc237910640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 0x7fc2301c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:46.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.273+0000 7fc237910640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc230114940 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.273+0000 7fc2356ac640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 0x7fc2301c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.273+0000 7fc2356ac640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 0x7fc2301c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48520/0 (socket says 172.21.15.104:48520) 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.273+0000 7fc2356ac640 1 -- 172.21.15.104:0/77728597 learned_addr learned my addr 172.21.15.104:0/77728597 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.273+0000 7fc2356ac640 1 -- 172.21.15.104:0/77728597 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2301140c0 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.273+0000 7fc2356ac640 1 --2- 172.21.15.104:0/77728597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 0x7fc2301c3f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc22c035040 tx=0x7fc22c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.274+0000 7fc225ffb640 1 -- 172.21.15.104:0/77728597 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c041070 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.274+0000 7fc225ffb640 1 -- 172.21.15.104:0/77728597 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c03c7a0 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.274+0000 7fc237910640 1 -- 172.21.15.104:0/77728597 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc230120970 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.274+0000 7fc225ffb640 1 -- 172.21.15.104:0/77728597 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c037040 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.274+0000 7fc237910640 1 -- 172.21.15.104:0/77728597 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2301c4460 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.274+0000 7fc225ffb640 1 -- 172.21.15.104:0/77728597 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc22c044070 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.274+0000 7fc225ffb640 1 -- 172.21.15.104:0/77728597 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc22c03d3f0 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.275+0000 7fc237910640 1 -- 172.21.15.104:0/77728597 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc230071150 con 0x7fc230129d80 2024-09-07T03:31:46.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.277+0000 7fc225ffb640 1 -- 172.21.15.104:0/77728597 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc230071150 con 0x7fc230129d80 2024-09-07T03:31:46.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.334+0000 7fc237910640 1 -- 172.21.15.104:0/77728597 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc230070f50 con 0x7fc230129d80 2024-09-07T03:31:46.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.335+0000 7fc225ffb640 1 -- 172.21.15.104:0/77728597 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fc230070f50 con 0x7fc230129d80 2024-09-07T03:31:46.336 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:31:46.336 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":6,"fsid":"ccd99612-983c-4850-93dd-2abdd870e9cd","created":"2024-09-07T03:31:45.098670+0000","modified":"2024-09-07T03:31:46.143995+0000","last_up_change":"0.000000","last_in_change":"2024-09-07T03:31:46.143995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49009fa6-ab2b-4a54-839c-a8e81abf5b1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"797a0187-6388-4317-a7ba-79a25f6c7f5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"582a1603-a3e0-4712-ab2e-e3233e9a1d60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-07T03:31:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.335+0000 7fc237910640 1 -- 172.21.15.104:0/77728597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 msgr2=0x7fc2301c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.335+0000 7fc237910640 1 --2- 172.21.15.104:0/77728597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 0x7fc2301c3f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc22c035040 tx=0x7fc22c0046c0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.335+0000 7fc237910640 1 -- 172.21.15.104:0/77728597 shutdown_connections 2024-09-07T03:31:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.335+0000 7fc237910640 1 --2- 172.21.15.104:0/77728597 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc230129d80 0x7fc2301c3f20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.335+0000 7fc237910640 1 -- 172.21.15.104:0/77728597 >> 172.21.15.104:0/77728597 conn(0x7fc230070850 msgr2=0x7fc230126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.335+0000 7fc237910640 1 -- 172.21.15.104:0/77728597 shutdown_connections 2024-09-07T03:31:46.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:31:46.335+0000 7fc237910640 1 -- 172.21.15.104:0/77728597 wait complete. 2024-09-07T03:31:46.347 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-07T03:31:46.347 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-07T03:31:46.749 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-07T03:31:46.842 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.840+0000 7f9179608640 1 Processor -- start 2024-09-07T03:31:46.842 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.840+0000 7f9179608640 1 -- start start 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f9179608640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f917412c140 0x7f917412c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f9179608640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9174116650 con 0x7f91741151a0 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f9179608640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f9174116f90 con 0x7f917412c140 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f9172ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f917412c140 0x7f917412c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f9172ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f917412c140 0x7f917412c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48536/0 (socket says 172.21.15.104:48536) 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f9172ffd640 1 -- 172.21.15.104:0/3055519608 learned_addr learned my addr 172.21.15.104:0/3055519608 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f91727fc640 1 --1- 172.21.15.104:0/3055519608 >> v1:172.21.15.104:6789/0 conn(0x7f91741151a0 0x7f91741155d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56408/0 (socket says 172.21.15.104:56408) 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f9172ffd640 1 -- 172.21.15.104:0/3055519608 >> v1:172.21.15.104:6789/0 conn(0x7f91741151a0 legacy=0x7f91741155d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f9172ffd640 1 -- 172.21.15.104:0/3055519608 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917412be20 con 0x7f917412c140 2024-09-07T03:31:46.843 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.841+0000 7f9171ffb640 1 -- 172.21.15.104:0/3055519608 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599321262 0 0) 0x7f9174116650 con 0x7f91741151a0 2024-09-07T03:31:46.844 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.842+0000 7f9172ffd640 1 --2- 172.21.15.104:0/3055519608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917412c140 0x7f917412c520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9164009e50 tx=0x7f916402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b5c0ccd632f50d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.842+0000 7f9171ffb640 1 -- 172.21.15.104:0/3055519608 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9164036070 con 0x7f917412c140 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.842+0000 7f9171ffb640 1 -- 172.21.15.104:0/3055519608 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9164031400 con 0x7f917412c140 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.842+0000 7f9171ffb640 1 -- 172.21.15.104:0/3055519608 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91640315d0 con 0x7f917412c140 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.842+0000 7f9179608640 1 -- 172.21.15.104:0/3055519608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917412c140 msgr2=0x7f917412c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.842+0000 7f9179608640 1 --2- 172.21.15.104:0/3055519608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917412c140 0x7f917412c520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9164009e50 tx=0x7f916402a730 comp rx=0 tx=0).stop 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.843+0000 7f9179608640 1 -- 172.21.15.104:0/3055519608 shutdown_connections 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.843+0000 7f9179608640 1 --2- 172.21.15.104:0/3055519608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917412c140 0x7f917412c520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.843+0000 7f9179608640 1 -- 172.21.15.104:0/3055519608 >> 172.21.15.104:0/3055519608 conn(0x7f91740705c0 msgr2=0x7f91740729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.843+0000 7f9179608640 1 -- 172.21.15.104:0/3055519608 shutdown_connections 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.843+0000 7f9179608640 1 -- 172.21.15.104:0/3055519608 wait complete. 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.844+0000 7f9179608640 1 Processor -- start 2024-09-07T03:31:46.845 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.844+0000 7f9179608640 1 -- start start 2024-09-07T03:31:46.847 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.844+0000 7f9179608640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91741151a0 0x7f91741198e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:46.847 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.844+0000 7f9179608640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9174116c60 con 0x7f91741151a0 2024-09-07T03:31:46.847 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.844+0000 7f9172ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91741151a0 0x7f91741198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:46.847 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.844+0000 7f9172ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91741151a0 0x7f91741198e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48544/0 (socket says 172.21.15.104:48544) 2024-09-07T03:31:46.847 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.844+0000 7f9172ffd640 1 -- 172.21.15.104:0/2834739414 learned_addr learned my addr 172.21.15.104:0/2834739414 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.844+0000 7f9172ffd640 1 -- 172.21.15.104:0/2834739414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9174125df0 con 0x7f91741151a0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.844+0000 7f9172ffd640 1 --2- 172.21.15.104:0/2834739414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91741151a0 0x7f91741198e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9164034040 tx=0x7f9164004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.845+0000 7f916b7fe640 1 -- 172.21.15.104:0/2834739414 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9164041030 con 0x7f91741151a0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.845+0000 7f916b7fe640 1 -- 172.21.15.104:0/2834739414 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f916403c470 con 0x7f91741151a0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.845+0000 7f9179608640 1 -- 172.21.15.104:0/2834739414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9174126080 con 0x7f91741151a0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.845+0000 7f916b7fe640 1 -- 172.21.15.104:0/2834739414 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9164036040 con 0x7f91741151a0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.845+0000 7f9179608640 1 -- 172.21.15.104:0/2834739414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917411c4b0 con 0x7f91741151a0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.845+0000 7f916b7fe640 1 -- 172.21.15.104:0/2834739414 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9164044070 con 0x7f91741151a0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.845+0000 7f916b7fe640 1 -- 172.21.15.104:0/2834739414 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9164042070 con 0x7f91741151a0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.845+0000 7f9179608640 1 -- 172.21.15.104:0/2834739414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f917411be80 con 0x7f91741151a0 2024-09-07T03:31:46.848 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.847+0000 7f916b7fe640 1 -- 172.21.15.104:0/2834739414 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f916404b070 con 0x7f91741151a0 2024-09-07T03:31:46.905 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.904+0000 7f9179608640 1 -- 172.21.15.104:0/2834739414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f917411cdb0 con 0x7f91741151a0 2024-09-07T03:31:46.906 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.905+0000 7f916b7fe640 1 -- 172.21.15.104:0/2834739414 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f917411cdb0 con 0x7f91741151a0 2024-09-07T03:31:46.906 INFO:teuthology.misc.health.smithi104.stdout: 2024-09-07T03:31:46.907 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":6,"fsid":"ccd99612-983c-4850-93dd-2abdd870e9cd","created":"2024-09-07T03:31:45.098670+0000","modified":"2024-09-07T03:31:46.143995+0000","last_up_change":"0.000000","last_in_change":"2024-09-07T03:31:46.143995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49009fa6-ab2b-4a54-839c-a8e81abf5b1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"797a0187-6388-4317-a7ba-79a25f6c7f5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"582a1603-a3e0-4712-ab2e-e3233e9a1d60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-07T03:31:46.907 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.906+0000 7f9179608640 1 -- 172.21.15.104:0/2834739414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91741151a0 msgr2=0x7f91741198e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:46.907 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.906+0000 7f9179608640 1 --2- 172.21.15.104:0/2834739414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91741151a0 0x7f91741198e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9164034040 tx=0x7f9164004a40 comp rx=0 tx=0).stop 2024-09-07T03:31:46.907 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.906+0000 7f9179608640 1 -- 172.21.15.104:0/2834739414 shutdown_connections 2024-09-07T03:31:46.907 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.906+0000 7f9179608640 1 --2- 172.21.15.104:0/2834739414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91741151a0 0x7f91741198e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:46.908 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.906+0000 7f9179608640 1 -- 172.21.15.104:0/2834739414 >> 172.21.15.104:0/2834739414 conn(0x7f91740705c0 msgr2=0x7f917412ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:46.908 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.906+0000 7f9179608640 1 -- 172.21.15.104:0/2834739414 shutdown_connections 2024-09-07T03:31:46.908 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:46.906+0000 7f9179608640 1 -- 172.21.15.104:0/2834739414 wait complete. 2024-09-07T03:31:46.916 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-07T03:31:47.327 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-07T03:31:47.326+0000 7f904ee2a640 -1 Falling back to public interface 2024-09-07T03:31:47.394 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-07T03:31:47.392+0000 7fb224644640 -1 Falling back to public interface 2024-09-07T03:31:47.647 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-07T03:31:47.645+0000 7fad04e85640 -1 Falling back to public interface 2024-09-07T03:31:47.647 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-07T03:31:47.645+0000 7fe1d181e640 -1 Falling back to public interface 2024-09-07T03:31:47.647 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-07T03:31:47.645+0000 7fe1d0277640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-09-07T03:31:50.199 INFO:tasks.ceph.mgr.x.smithi120.stderr:2024-09-07T03:31:50.197+0000 7f835aea7640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-07T03:31:51.163 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-07T03:31:51.162+0000 7fad04e85640 -1 osd.1 0 log_to_monitors true 2024-09-07T03:31:51.269 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-07T03:31:51.268+0000 7fb224644640 -1 osd.3 0 log_to_monitors true 2024-09-07T03:31:51.319 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-07T03:31:51.318+0000 7f904ee2a640 -1 osd.0 0 log_to_monitors true 2024-09-07T03:31:51.532 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-07T03:31:51.531+0000 7fe1d181e640 -1 osd.2 0 log_to_monitors true 2024-09-07T03:31:53.057 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-07T03:31:53.056+0000 7fad00e14640 -1 osd.1 0 waiting for initial osdmap 2024-09-07T03:31:53.070 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-07T03:31:53.069+0000 7facf8c33640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-07T03:31:53.320 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-07T03:31:53.411 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.408+0000 7f1e51414640 1 Processor -- start 2024-09-07T03:31:53.411 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.408+0000 7f1e51414640 1 -- start start 2024-09-07T03:31:53.411 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.408+0000 7f1e51414640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1e4c132600 0x7f1e4c1349f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:53.411 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.408+0000 7f1e51414640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4c1301d0 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.411 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.408+0000 7f1e51414640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f1e4c116520 con 0x7f1e4c132600 2024-09-07T03:31:53.411 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.408+0000 7f1e4a7fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1e4c132600 0x7f1e4c1349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:53.411 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.408+0000 7f1e4affd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1e4c12f6e0 0x7f1e4c12fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:56420/0 (socket says 172.21.15.104:56420) 2024-09-07T03:31:53.412 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.409+0000 7f1e4affd640 1 -- 172.21.15.104:0/1735491034 learned_addr learned my addr 172.21.15.104:0/1735491034 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:31:53.412 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.409+0000 7f1e4a7fc640 1 -- 172.21.15.104:0/1735491034 >> v1:172.21.15.104:6789/0 conn(0x7f1e4c12f6e0 legacy=0x7f1e4c12fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:53.412 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.409+0000 7f1e4a7fc640 1 -- 172.21.15.104:0/1735491034 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c116300 con 0x7f1e4c132600 2024-09-07T03:31:53.412 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.409+0000 7f1e49ffb640 1 -- 172.21.15.104:0/1735491034 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155235171 0 0) 0x7f1e4c1301d0 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.413 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.410+0000 7f1e4a7fc640 1 --2- 172.21.15.104:0/1735491034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c132600 0x7f1e4c1349f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009720 tx=0x7f1e4002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f3fa917dc23c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:53.413 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.410+0000 7f1e49ffb640 1 -- 172.21.15.104:0/1735491034 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40037070 con 0x7f1e4c132600 2024-09-07T03:31:53.413 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.410+0000 7f1e49ffb640 1 -- 172.21.15.104:0/1735491034 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4002ad90 con 0x7f1e4c132600 2024-09-07T03:31:53.413 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.410+0000 7f1e49ffb640 1 -- 172.21.15.104:0/1735491034 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40032590 con 0x7f1e4c132600 2024-09-07T03:31:53.413 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.411+0000 7f1e51414640 1 -- 172.21.15.104:0/1735491034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c132600 msgr2=0x7f1e4c1349f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:53.413 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.411+0000 7f1e51414640 1 --2- 172.21.15.104:0/1735491034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c132600 0x7f1e4c1349f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009720 tx=0x7f1e4002a110 comp rx=0 tx=0).stop 2024-09-07T03:31:53.414 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.411+0000 7f1e51414640 1 -- 172.21.15.104:0/1735491034 shutdown_connections 2024-09-07T03:31:53.414 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.411+0000 7f1e51414640 1 --2- 172.21.15.104:0/1735491034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c132600 0x7f1e4c1349f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:53.414 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.411+0000 7f1e51414640 1 -- 172.21.15.104:0/1735491034 >> 172.21.15.104:0/1735491034 conn(0x7f1e4c070460 msgr2=0x7f1e4c072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:53.414 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.411+0000 7f1e51414640 1 -- 172.21.15.104:0/1735491034 shutdown_connections 2024-09-07T03:31:53.414 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.411+0000 7f1e51414640 1 -- 172.21.15.104:0/1735491034 wait complete. 2024-09-07T03:31:53.415 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.412+0000 7f1e51414640 1 Processor -- start 2024-09-07T03:31:53.415 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.412+0000 7f1e51414640 1 -- start start 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e51414640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c12f6e0 0x7f1e4c124be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e51414640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0736c0 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e4affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c12f6e0 0x7f1e4c124be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e4affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c12f6e0 0x7f1e4c124be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48562/0 (socket says 172.21.15.104:48562) 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e4affd640 1 -- 172.21.15.104:0/716587065 learned_addr learned my addr 172.21.15.104:0/716587065 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e4affd640 1 -- 172.21.15.104:0/716587065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c117740 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e4affd640 1 --2- 172.21.15.104:0/716587065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c12f6e0 0x7f1e4c124be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c3d0 tx=0x7f1e3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e337fe640 1 -- 172.21.15.104:0/716587065 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c0074d0 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e337fe640 1 -- 172.21.15.104:0/716587065 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0047e0 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e337fe640 1 -- 172.21.15.104:0/716587065 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c007670 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c118270 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.416 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.413+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1185a0 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.417 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.414+0000 7f1e337fe640 1 -- 172.21.15.104:0/716587065 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 4) ==== 50363+0+0 (secure 0 0 0) 0x7f1e3c011070 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.417 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.414+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c12fac0 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.417 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.414+0000 7f1e337fe640 1 --2- 172.21.15.104:0/716587065 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1e3803de00 0x7f1e380402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:31:53.417 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.414+0000 7f1e337fe640 1 -- 172.21.15.104:0/716587065 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1903+0+0 (secure 0 0 0) 0x7f1e3c051690 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.418 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.415+0000 7f1e4a7fc640 1 --2- 172.21.15.104:0/716587065 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1e3803de00 0x7f1e380402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:31:53.418 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.415+0000 7f1e4a7fc640 1 --2- 172.21.15.104:0/716587065 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1e3803de00 0x7f1e380402c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1e40034000 tx=0x7f1e4002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:31:53.421 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.419+0000 7f1e337fe640 1 -- 172.21.15.104:0/716587065 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f1e3c012dd0 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.596 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.594+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e4c116f70 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.597 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.595+0000 7f1e337fe640 1 -- 172.21.15.104:0/716587065 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+4661 (secure 0 0 0) 0x7f1e3c010d40 con 0x7f1e4c12f6e0 2024-09-07T03:31:53.597 INFO:teuthology.misc.health.smithi104.stdout: 2024-09-07T03:31:53.597 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":9,"fsid":"ccd99612-983c-4850-93dd-2abdd870e9cd","created":"2024-09-07T03:31:45.098670+0000","modified":"2024-09-07T03:31:53.201998+0000","last_up_change":"2024-09-07T03:31:53.201998+0000","last_in_change":"2024-09-07T03:31:46.143995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49009fa6-ab2b-4a54-839c-a8e81abf5b1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"797a0187-6388-4317-a7ba-79a25f6c7f5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6810","nonce":3372043485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6814","nonce":3372043485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6822","nonce":3372043485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6818","nonce":3372043485}]},"public_addr":"172.21.15.120:6810/3372043485","cluster_addr":"172.21.15.120:6814/3372043485","heartbeat_back_addr":"172.21.15.120:6822/3372043485","heartbeat_front_addr":"172.21.15.120:6818/3372043485","state":["exists","up"]},{"osd":2,"uuid":"df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"582a1603-a3e0-4712-ab2e-e3233e9a1d60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-07T03:31:53.599 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1e3803de00 msgr2=0x7f1e380402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:53.599 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 --2- 172.21.15.104:0/716587065 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1e3803de00 0x7f1e380402c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1e40034000 tx=0x7f1e4002e000 comp rx=0 tx=0).stop 2024-09-07T03:31:53.599 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c12f6e0 msgr2=0x7f1e4c124be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:31:53.599 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 --2- 172.21.15.104:0/716587065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c12f6e0 0x7f1e4c124be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c3d0 tx=0x7f1e3c00c890 comp rx=0 tx=0).stop 2024-09-07T03:31:53.599 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 shutdown_connections 2024-09-07T03:31:53.600 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 --2- 172.21.15.104:0/716587065 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1e3803de00 0x7f1e380402c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:53.600 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 --2- 172.21.15.104:0/716587065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1e4c12f6e0 0x7f1e4c124be0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:31:53.600 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 >> 172.21.15.104:0/716587065 conn(0x7f1e4c070460 msgr2=0x7f1e4c072850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:31:53.600 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 shutdown_connections 2024-09-07T03:31:53.600 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:31:53.597+0000 7f1e51414640 1 -- 172.21.15.104:0/716587065 wait complete. 2024-09-07T03:31:53.609 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-09-07T03:31:54.439 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-07T03:31:54.437+0000 7fb2205d3640 -1 osd.3 0 waiting for initial osdmap 2024-09-07T03:31:54.448 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-07T03:31:54.447+0000 7fb2183f2640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-07T03:31:54.463 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-07T03:31:54.462+0000 7fe1cd25e640 -1 osd.2 0 waiting for initial osdmap 2024-09-07T03:31:54.473 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-07T03:31:54.472+0000 7fe1c507d640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-07T03:31:54.491 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-07T03:31:54.490+0000 7f904adb9640 -1 osd.0 0 waiting for initial osdmap 2024-09-07T03:31:54.502 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-07T03:31:54.500+0000 7f9042bd8640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-07T03:32:00.013 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-07T03:32:00.114 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.110+0000 7f829ad89640 1 Processor -- start 2024-09-07T03:32:00.114 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.110+0000 7f829ad89640 1 -- start start 2024-09-07T03:32:00.114 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f829ad89640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8294114110 0x7f829412daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:00.114 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f829ad89640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8294114860 con 0x7f829412cfb0 2024-09-07T03:32:00.114 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f829ad89640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f8294114a30 con 0x7f8294114110 2024-09-07T03:32:00.114 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f8293fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8294114110 0x7f829412daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f8293fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8294114110 0x7f829412daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60492/0 (socket says 172.21.15.104:60492) 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f8298b25640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f829412cfb0 0x7f829412d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53566/0 (socket says 172.21.15.104:53566) 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f8293fff640 1 -- 172.21.15.104:0/4018049883 learned_addr learned my addr 172.21.15.104:0/4018049883 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f8293fff640 1 -- 172.21.15.104:0/4018049883 >> v1:172.21.15.104:6789/0 conn(0x7f829412cfb0 legacy=0x7f829412d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f8293fff640 1 -- 172.21.15.104:0/4018049883 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8294133340 con 0x7f8294114110 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.111+0000 7f82937fe640 1 -- 172.21.15.104:0/4018049883 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986418092 0 0) 0x7f8294114860 con 0x7f829412cfb0 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.112+0000 7f8293fff640 1 --2- 172.21.15.104:0/4018049883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 0x7f829412daa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82800097f0 tx=0x7f828002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82bfbd9be9a251f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.112+0000 7f82937fe640 1 -- 172.21.15.104:0/4018049883 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8280037070 con 0x7f8294114110 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.112+0000 7f82937fe640 1 -- 172.21.15.104:0/4018049883 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8280032440 con 0x7f8294114110 2024-09-07T03:32:00.115 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.112+0000 7f82937fe640 1 -- 172.21.15.104:0/4018049883 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f828002ae60 con 0x7f8294114110 2024-09-07T03:32:00.117 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.112+0000 7f829ad89640 1 -- 172.21.15.104:0/4018049883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 msgr2=0x7f829412daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:00.117 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.112+0000 7f829ad89640 1 --2- 172.21.15.104:0/4018049883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 0x7f829412daa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82800097f0 tx=0x7f828002a1e0 comp rx=0 tx=0).stop 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.113+0000 7f829ad89640 1 -- 172.21.15.104:0/4018049883 shutdown_connections 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.113+0000 7f829ad89640 1 --2- 172.21.15.104:0/4018049883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 0x7f829412daa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.113+0000 7f829ad89640 1 -- 172.21.15.104:0/4018049883 >> 172.21.15.104:0/4018049883 conn(0x7f829406fcf0 msgr2=0x7f82940720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.113+0000 7f829ad89640 1 -- 172.21.15.104:0/4018049883 shutdown_connections 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.113+0000 7f829ad89640 1 -- 172.21.15.104:0/4018049883 wait complete. 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.113+0000 7f829ad89640 1 Processor -- start 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.113+0000 7f829ad89640 1 -- start start 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.114+0000 7f829ad89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 0x7f829412f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.114+0000 7f829ad89640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f82941326c0 con 0x7f8294114110 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.114+0000 7f8298b25640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 0x7f829412f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.114+0000 7f8298b25640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 0x7f829412f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60506/0 (socket says 172.21.15.104:60506) 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.114+0000 7f8298b25640 1 -- 172.21.15.104:0/4206257329 learned_addr learned my addr 172.21.15.104:0/4206257329 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:00.118 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.114+0000 7f8298b25640 1 -- 172.21.15.104:0/4206257329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82941276e0 con 0x7f8294114110 2024-09-07T03:32:00.119 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.115+0000 7f8298b25640 1 --2- 172.21.15.104:0/4206257329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 0x7f829412f990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f828800c480 tx=0x7f828800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:00.119 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.115+0000 7f82917fa640 1 -- 172.21.15.104:0/4206257329 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8288017070 con 0x7f8294114110 2024-09-07T03:32:00.119 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.115+0000 7f82917fa640 1 -- 172.21.15.104:0/4206257329 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8288007470 con 0x7f8294114110 2024-09-07T03:32:00.119 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.115+0000 7f82917fa640 1 -- 172.21.15.104:0/4206257329 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8288005810 con 0x7f8294114110 2024-09-07T03:32:00.119 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.115+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8294131a30 con 0x7f8294114110 2024-09-07T03:32:00.119 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.115+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8294123d60 con 0x7f8294114110 2024-09-07T03:32:00.120 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.116+0000 7f82917fa640 1 -- 172.21.15.104:0/4206257329 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f828801a070 con 0x7f8294114110 2024-09-07T03:32:00.120 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.116+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829412ad90 con 0x7f8294114110 2024-09-07T03:32:00.120 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.116+0000 7f82917fa640 1 --2- 172.21.15.104:0/4206257329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f827803de90 0x7f8278040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:00.120 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.116+0000 7f82917fa640 1 -- 172.21.15.104:0/4206257329 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3129+0+0 (secure 0 0 0) 0x7f8288051460 con 0x7f8294114110 2024-09-07T03:32:00.120 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.116+0000 7f8293fff640 1 --2- 172.21.15.104:0/4206257329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f827803de90 0x7f8278040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:00.120 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.117+0000 7f8293fff640 1 --2- 172.21.15.104:0/4206257329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f827803de90 0x7f8278040350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8280034000 tx=0x7f828002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:00.123 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.121+0000 7f82917fa640 1 -- 172.21.15.104:0/4206257329 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f829412ad90 con 0x7f8294114110 2024-09-07T03:32:00.297 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.295+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8294132c00 con 0x7f8294114110 2024-09-07T03:32:00.298 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.295+0000 7f82917fa640 1 -- 172.21.15.104:0/4206257329 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8014 (secure 0 0 0) 0x7f82941276e0 con 0x7f8294114110 2024-09-07T03:32:00.298 INFO:teuthology.misc.health.smithi104.stdout: 2024-09-07T03:32:00.298 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":15,"fsid":"ccd99612-983c-4850-93dd-2abdd870e9cd","created":"2024-09-07T03:31:45.098670+0000","modified":"2024-09-07T03:31:59.516607+0000","last_up_change":"2024-09-07T03:31:55.439585+0000","last_in_change":"2024-09-07T03:31:46.143995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-07T03:31:57.213085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49009fa6-ab2b-4a54-839c-a8e81abf5b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6801","nonce":182397107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6803","nonce":182397107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6807","nonce":182397107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6805","nonce":182397107}]},"public_addr":"172.21.15.104:6801/182397107","cluster_addr":"172.21.15.104:6803/182397107","heartbeat_back_addr":"172.21.15.104:6807/182397107","heartbeat_front_addr":"172.21.15.104:6805/182397107","state":["exists","up"]},{"osd":1,"uuid":"797a0187-6388-4317-a7ba-79a25f6c7f5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6810","nonce":3372043485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6814","nonce":3372043485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6822","nonce":3372043485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6818","nonce":3372043485}]},"public_addr":"172.21.15.120:6810/3372043485","cluster_addr":"172.21.15.120:6814/3372043485","heartbeat_back_addr":"172.21.15.120:6822/3372043485","heartbeat_front_addr":"172.21.15.120:6818/3372043485","state":["exists","up"]},{"osd":2,"uuid":"df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6811","nonce":3781833098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6815","nonce":3781833098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6823","nonce":3781833098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6819","nonce":3781833098}]},"public_addr":"172.21.15.120:6811/3781833098","cluster_addr":"172.21.15.120:6815/3781833098","heartbeat_back_addr":"172.21.15.120:6823/3781833098","heartbeat_front_addr":"172.21.15.120:6819/3781833098","state":["exists","up"]},{"osd":3,"uuid":"582a1603-a3e0-4712-ab2e-e3233e9a1d60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6801","nonce":1193158925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6803","nonce":1193158925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6807","nonce":1193158925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6805","nonce":1193158925}]},"public_addr":"172.21.15.120:6801/1193158925","cluster_addr":"172.21.15.120:6803/1193158925","heartbeat_back_addr":"172.21.15.120:6807/1193158925","heartbeat_front_addr":"172.21.15.120:6805/1193158925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.299631+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.192229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.483211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.308063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-07T03:32:00.300 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f827803de90 msgr2=0x7f8278040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:00.300 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 --2- 172.21.15.104:0/4206257329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f827803de90 0x7f8278040350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8280034000 tx=0x7f828002e000 comp rx=0 tx=0).stop 2024-09-07T03:32:00.300 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 msgr2=0x7f829412f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:00.300 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 --2- 172.21.15.104:0/4206257329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 0x7f829412f990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f828800c480 tx=0x7f828800c940 comp rx=0 tx=0).stop 2024-09-07T03:32:00.300 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 shutdown_connections 2024-09-07T03:32:00.301 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 --2- 172.21.15.104:0/4206257329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f827803de90 0x7f8278040350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:00.301 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 --2- 172.21.15.104:0/4206257329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8294114110 0x7f829412f990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:00.301 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 >> 172.21.15.104:0/4206257329 conn(0x7f829406fcf0 msgr2=0x7f82941281c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:00.301 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 shutdown_connections 2024-09-07T03:32:00.301 INFO:teuthology.misc.health.smithi104.stderr:2024-09-07T03:32:00.297+0000 7f829ad89640 1 -- 172.21.15.104:0/4206257329 wait complete. 2024-09-07T03:32:00.309 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-07T03:32:00.309 INFO:tasks.ceph:Creating RBD pool 2024-09-07T03:32:00.310 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-07T03:32:00.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.404+0000 7ff6bf9f5640 1 Processor -- start 2024-09-07T03:32:00.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.404+0000 7ff6bf9f5640 1 -- start start 2024-09-07T03:32:00.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.404+0000 7ff6bf9f5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6b8094520 0x7ff6b8094900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:00.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.404+0000 7ff6bf9f5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6b80977c0 con 0x7ff6b80965a0 2024-09-07T03:32:00.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.404+0000 7ff6bf9f5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff6b8097f10 con 0x7ff6b8094520 2024-09-07T03:32:00.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.404+0000 7ff6bd791640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff6b8094520 0x7ff6b8094900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:00.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.404+0000 7ff6bcf90640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff6b80965a0 0x7ff6b8127fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53572/0 (socket says 172.21.15.104:53572) 2024-09-07T03:32:00.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.404+0000 7ff6bcf90640 1 -- 172.21.15.104:0/609292231 learned_addr learned my addr 172.21.15.104:0/609292231 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:00.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.405+0000 7ff6bd791640 1 -- 172.21.15.104:0/609292231 >> v1:172.21.15.104:6789/0 conn(0x7ff6b80965a0 legacy=0x7ff6b8127fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:00.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.405+0000 7ff6bd791640 1 -- 172.21.15.104:0/609292231 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b809a3a0 con 0x7ff6b8094520 2024-09-07T03:32:00.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.405+0000 7ff6affff640 1 -- 172.21.15.104:0/609292231 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015129402 0 0) 0x7ff6b80977c0 con 0x7ff6b80965a0 2024-09-07T03:32:00.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.405+0000 7ff6bd791640 1 --2- 172.21.15.104:0/609292231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 0x7ff6b8094900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400a8c0 tx=0x7ff6b402b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2edc919e6a7343e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:00.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6affff640 1 -- 172.21.15.104:0/609292231 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b400b040 con 0x7ff6b8094520 2024-09-07T03:32:00.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6affff640 1 -- 172.21.15.104:0/609292231 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b4030640 con 0x7ff6b8094520 2024-09-07T03:32:00.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6affff640 1 -- 172.21.15.104:0/609292231 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b4030940 con 0x7ff6b8094520 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/609292231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 msgr2=0x7ff6b8094900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6bf9f5640 1 --2- 172.21.15.104:0/609292231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 0x7ff6b8094900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400a8c0 tx=0x7ff6b402b4d0 comp rx=0 tx=0).stop 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/609292231 shutdown_connections 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6bf9f5640 1 --2- 172.21.15.104:0/609292231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 0x7ff6b8094900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/609292231 >> 172.21.15.104:0/609292231 conn(0x7ff6b809a930 msgr2=0x7ff6b809ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/609292231 shutdown_connections 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.406+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/609292231 wait complete. 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.407+0000 7ff6bf9f5640 1 Processor -- start 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.407+0000 7ff6bf9f5640 1 -- start start 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.407+0000 7ff6bf9f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 0x7ff6b806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:00.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.407+0000 7ff6bf9f5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b80998a0 con 0x7ff6b8094520 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.407+0000 7ff6bd791640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 0x7ff6b806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.407+0000 7ff6bd791640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 0x7ff6b806dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60526/0 (socket says 172.21.15.104:60526) 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.407+0000 7ff6bd791640 1 -- 172.21.15.104:0/3635295594 learned_addr learned my addr 172.21.15.104:0/3635295594 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.408+0000 7ff6bd791640 1 -- 172.21.15.104:0/3635295594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b806ed90 con 0x7ff6b8094520 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.408+0000 7ff6bd791640 1 --2- 172.21.15.104:0/3635295594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 0x7ff6b806dcd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6b402ba90 tx=0x7ff6b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.408+0000 7ff6adffb640 1 -- 172.21.15.104:0/3635295594 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b4040070 con 0x7ff6b8094520 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.408+0000 7ff6adffb640 1 -- 172.21.15.104:0/3635295594 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b40339f0 con 0x7ff6b8094520 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.408+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b8128830 con 0x7ff6b8094520 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.408+0000 7ff6adffb640 1 -- 172.21.15.104:0/3635295594 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b4033cd0 con 0x7ff6b8094520 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.408+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b8070810 con 0x7ff6b8094520 2024-09-07T03:32:00.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.409+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b8099e70 con 0x7ff6b8094520 2024-09-07T03:32:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.409+0000 7ff6adffb640 1 -- 172.21.15.104:0/3635295594 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff6b4043070 con 0x7ff6b8094520 2024-09-07T03:32:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.409+0000 7ff6adffb640 1 --2- 172.21.15.104:0/3635295594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff69c03de90 0x7ff69c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.409+0000 7ff6adffb640 1 -- 172.21.15.104:0/3635295594 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3129+0+0 (secure 0 0 0) 0x7ff6b40730d0 con 0x7ff6b8094520 2024-09-07T03:32:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.410+0000 7ff6bcf90640 1 --2- 172.21.15.104:0/3635295594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff69c03de90 0x7ff69c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:00.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.410+0000 7ff6bcf90640 1 --2- 172.21.15.104:0/3635295594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff69c03de90 0x7ff69c040350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8000c00 tx=0x7ff6a80078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:00.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.414+0000 7ff6adffb640 1 -- 172.21.15.104:0/3635295594 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7ff6b4007d50 con 0x7ff6b8094520 2024-09-07T03:32:00.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:00.587+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7ff6b806fbc0 con 0x7ff6b8094520 2024-09-07T03:32:01.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.525+0000 7ff6adffb640 1 -- 172.21.15.104:0/3635295594 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (secure 0 0 0) 0x7ff6b4003610 con 0x7ff6b8094520 2024-09-07T03:32:01.527 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'rbd' created 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff69c03de90 msgr2=0x7ff69c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 --2- 172.21.15.104:0/3635295594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff69c03de90 0x7ff69c040350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8000c00 tx=0x7ff6a80078f0 comp rx=0 tx=0).stop 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 msgr2=0x7ff6b806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 --2- 172.21.15.104:0/3635295594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 0x7ff6b806dcd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6b402ba90 tx=0x7ff6b4004730 comp rx=0 tx=0).stop 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 shutdown_connections 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 --2- 172.21.15.104:0/3635295594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff69c03de90 0x7ff69c040350 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 --2- 172.21.15.104:0/3635295594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6b8094520 0x7ff6b806dcd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 >> 172.21.15.104:0/3635295594 conn(0x7ff6b809a930 msgr2=0x7ff6b81b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 shutdown_connections 2024-09-07T03:32:01.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.528+0000 7ff6bf9f5640 1 -- 172.21.15.104:0/3635295594 wait complete. 2024-09-07T03:32:01.543 DEBUG:teuthology.orchestra.run.smithi104:> rbd --cluster ceph pool init rbd 2024-09-07T03:32:01.580 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:01.580 INFO:teuthology.orchestra.run.smithi104.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:01.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.579+0000 7f8c74af5f00 1 Processor -- start 2024-09-07T03:32:01.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.579+0000 7f8c74af5f00 1 -- start start 2024-09-07T03:32:01.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c74af5f00 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5613c7dd5550 0x5613c7e85450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:01.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c74af5f00 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5613c7c5bf30 con 0x5613c7dd4a60 2024-09-07T03:32:01.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c74af5f00 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5613c7cc2a10 con 0x5613c7dd5550 2024-09-07T03:32:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c72de0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5613c7dd5550 0x5613c7e85450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c735e1640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5613c7dd4a60 0x5613c7dd4e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53574/0 (socket says 172.21.15.104:53574) 2024-09-07T03:32:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c72de0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5613c7dd5550 0x5613c7e85450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60528/0 (socket says 172.21.15.104:60528) 2024-09-07T03:32:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c735e1640 1 -- 172.21.15.104:0/3912378356 learned_addr learned my addr 172.21.15.104:0/3912378356 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c72de0640 1 -- 172.21.15.104:0/3912378356 >> v1:172.21.15.104:6789/0 conn(0x5613c7dd4a60 legacy=0x5613c7dd4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c725df640 1 -- 172.21.15.104:0/3912378356 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537641803 0 0) 0x5613c7c5bf30 con 0x5613c7dd4a60 2024-09-07T03:32:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.580+0000 7f8c72de0640 1 -- 172.21.15.104:0/3912378356 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c7c410c0 con 0x5613c7dd5550 2024-09-07T03:32:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.582+0000 7f8c72de0640 1 --2- 172.21.15.104:0/3912378356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd5550 0x5613c7e85450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800a470 tx=0x7f8c68045e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a76ddf519f136ad server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.582+0000 7f8c725df640 1 -- 172.21.15.104:0/3912378356 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6805a070 con 0x5613c7dd5550 2024-09-07T03:32:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.582+0000 7f8c725df640 1 -- 172.21.15.104:0/3912378356 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6804d610 con 0x5613c7dd5550 2024-09-07T03:32:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.582+0000 7f8c725df640 1 -- 172.21.15.104:0/3912378356 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6804d930 con 0x5613c7dd5550 2024-09-07T03:32:01.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.582+0000 7f8c74af5f00 1 -- 172.21.15.104:0/3912378356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd5550 msgr2=0x5613c7e85450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:01.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.582+0000 7f8c74af5f00 1 --2- 172.21.15.104:0/3912378356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd5550 0x5613c7e85450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800a470 tx=0x7f8c68045e50 comp rx=0 tx=0).stop 2024-09-07T03:32:01.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.583+0000 7f8c74af5f00 1 -- 172.21.15.104:0/3912378356 shutdown_connections 2024-09-07T03:32:01.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.583+0000 7f8c74af5f00 1 --2- 172.21.15.104:0/3912378356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd5550 0x5613c7e85450 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:01.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.583+0000 7f8c74af5f00 1 -- 172.21.15.104:0/3912378356 >> 172.21.15.104:0/3912378356 conn(0x5613c7df1d50 msgr2=0x5613c7dee110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:01.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.583+0000 7f8c74af5f00 1 -- 172.21.15.104:0/3912378356 shutdown_connections 2024-09-07T03:32:01.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.583+0000 7f8c74af5f00 1 -- 172.21.15.104:0/3912378356 wait complete. 2024-09-07T03:32:01.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.583+0000 7f8c74af5f00 1 Processor -- start 2024-09-07T03:32:01.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.583+0000 7f8c74af5f00 1 -- start start 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c74af5f00 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd4a60 0x5613c7de8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c74af5f00 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5613c7cc69c0 con 0x5613c7dd4a60 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c735e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd4a60 0x5613c7de8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c735e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd4a60 0x5613c7de8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60538/0 (socket says 172.21.15.104:60538) 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c735e1640 1 -- 172.21.15.104:0/2029408893 learned_addr learned my addr 172.21.15.104:0/2029408893 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c735e1640 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c7e6d8f0 con 0x5613c7dd4a60 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c735e1640 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd4a60 0x5613c7de8a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001e00 tx=0x7f8c64009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c64008070 con 0x5613c7dd4a60 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6400f430 con 0x5613c7dd4a60 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613c7e6cfe0 con 0x5613c7dd4a60 2024-09-07T03:32:01.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.584+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6400f790 con 0x5613c7dd4a60 2024-09-07T03:32:01.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.585+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c7de91e0 con 0x5613c7dd4a60 2024-09-07T03:32:01.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.585+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8c6400f930 con 0x5613c7dd4a60 2024-09-07T03:32:01.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.585+0000 7f8c637fe640 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c5803c780 0x7f8c5803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:01.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.586+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3471+0+0 (secure 0 0 0) 0x7f8c64050eb0 con 0x5613c7dd4a60 2024-09-07T03:32:01.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.586+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x5613c7de96d0 con 0x5613c7dd4a60 2024-09-07T03:32:01.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.586+0000 7f8c72de0640 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c5803c780 0x7f8c5803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:01.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:01.586+0000 7f8c72de0640 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c5803c780 0x7f8c5803ec40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c68057000 tx=0x7f8c68051000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:02.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.528+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 141+0+0 (secure 0 0 0) 0x7f8c64018370 con 0x5613c7dd4a60 2024-09-07T03:32:02.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.528+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c6804d610 con 0x5613c7dd4a60 2024-09-07T03:32:02.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.529+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8c6400fe00 con 0x5613c7dd4a60 2024-09-07T03:32:02.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.529+0000 7f8c71dde640 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f8c50002ae0 con 0x5613c7dd4a60 2024-09-07T03:32:02.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.530+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 8 ==== osd_map(17..17 src has 1..17) ==== 650+0+0 (secure 0 0 0) 0x7f8c6401aa10 con 0x5613c7dd4a60 2024-09-07T03:32:02.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.530+0000 7f8c74af5f00 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5613c7dd5550 0x5613c7e91160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:02.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.530+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x5613c7e95b40 con 0x5613c7dd5550 2024-09-07T03:32:02.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.530+0000 7f8c74843640 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5613c7dd5550 0x5613c7e91160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:02.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.530+0000 7f8c74843640 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5613c7dd5550 0x5613c7e91160 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:02.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.544+0000 7f8c74843640 1 -- 172.21.15.104:0/2029408893 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f8c6c002040 con 0x5613c7dd5550 2024-09-07T03:32:02.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.546+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x5613c7ee8000 con 0x5613c7dd5550 2024-09-07T03:32:02.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.547+0000 7f8c74843640 1 -- 172.21.15.104:0/2029408893 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c6c002040 con 0x5613c7dd5550 2024-09-07T03:32:02.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.547+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x5613c7ee7110 con 0x5613c7dd5550 2024-09-07T03:32:02.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.547+0000 7f8c74843640 1 -- 172.21.15.104:0/2029408893 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c6c002040 con 0x5613c7dd5550 2024-09-07T03:32:02.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:02.547+0000 7f8c715dd640 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f8c54001f00 con 0x5613c7dd4a60 2024-09-07T03:32:03.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:03.532+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v18) ==== 55+0+0 (secure 0 0 0) 0x7f8c6401a470 con 0x5613c7dd4a60 2024-09-07T03:32:03.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:03.532+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7f8c58042280 con 0x5613c7dd4a60 2024-09-07T03:32:03.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:03.532+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 10 ==== osd_map(18..18 src has 1..18) ==== 626+0+0 (secure 0 0 0) 0x7f8c6400d750 con 0x5613c7dd4a60 2024-09-07T03:32:03.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:03.532+0000 7f8c71dde640 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f8c50005780 con 0x5613c7dd5550 2024-09-07T03:32:03.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:03.536+0000 7f8c74843640 1 -- 172.21.15.104:0/2029408893 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8c6c002040 con 0x5613c7dd5550 2024-09-07T03:32:03.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:03.536+0000 7f8c715dd640 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) -- 0x7f8c54003350 con 0x5613c7dd4a60 2024-09-07T03:32:04.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.534+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v19) ==== 43+0+0 (secure 0 0 0) 0x7f8c64017980 con 0x5613c7dd4a60 2024-09-07T03:32:04.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.534+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=19}) -- 0x7f8c58042500 con 0x5613c7dd4a60 2024-09-07T03:32:04.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.534+0000 7f8c637fe640 1 -- 172.21.15.104:0/2029408893 <== mon.0 v2:172.21.15.104:3300/0 12 ==== osd_map(19..19 src has 1..19) ==== 654+0+0 (secure 0 0 0) 0x7f8c64029030 con 0x5613c7dd4a60 2024-09-07T03:32:04.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.535+0000 7f8c71dde640 1 -- 172.21.15.104:0/2029408893 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f8c50005b40 con 0x5613c7dd5550 2024-09-07T03:32:04.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.538+0000 7f8c74843640 1 -- 172.21.15.104:0/2029408893 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6c002040 con 0x5613c7dd5550 2024-09-07T03:32:04.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.538+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5613c7dd5550 msgr2=0x5613c7e91160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:04.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.538+0000 7f8c74af5f00 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5613c7dd5550 0x5613c7e91160 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.538+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c5803c780 msgr2=0x7f8c5803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:04.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.538+0000 7f8c74af5f00 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c5803c780 0x7f8c5803ec40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c68057000 tx=0x7f8c68051000 comp rx=0 tx=0).stop 2024-09-07T03:32:04.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.538+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd4a60 msgr2=0x5613c7de8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:04.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.538+0000 7f8c74af5f00 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd4a60 0x5613c7de8a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001e00 tx=0x7f8c64009560 comp rx=0 tx=0).stop 2024-09-07T03:32:04.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.539+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 shutdown_connections 2024-09-07T03:32:04.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.539+0000 7f8c74af5f00 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5613c7dd5550 0x5613c7e91160 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.539+0000 7f8c74af5f00 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c5803c780 0x7f8c5803ec40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.539+0000 7f8c74af5f00 1 --2- 172.21.15.104:0/2029408893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5613c7dd4a60 0x5613c7de8a90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.539+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 >> 172.21.15.104:0/2029408893 conn(0x5613c7df1d50 msgr2=0x5613c7decb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:04.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.539+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 shutdown_connections 2024-09-07T03:32:04.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.539+0000 7f8c74af5f00 1 -- 172.21.15.104:0/2029408893 wait complete. 2024-09-07T03:32:04.560 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-07T03:32:04.561 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-07T03:32:04.561 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-07T03:32:04.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.710+0000 7f9e867f3640 1 Processor -- start 2024-09-07T03:32:04.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.710+0000 7f9e867f3640 1 -- start start 2024-09-07T03:32:04.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.710+0000 7f9e867f3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9e80070370 0x7f9e80070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:04.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.710+0000 7f9e867f3640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e80071de0 con 0x7f9e8009ec40 2024-09-07T03:32:04.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.710+0000 7f9e867f3640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8006dc30 con 0x7f9e80070370 2024-09-07T03:32:04.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.711+0000 7f9e7ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9e80070370 0x7f9e80070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:04.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.711+0000 7f9e7f7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9e8009ec40 0x7f9e80126960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38588/0 (socket says 172.21.15.104:38588) 2024-09-07T03:32:04.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.711+0000 7f9e7f7fe640 1 -- 172.21.15.104:0/1444077477 learned_addr learned my addr 172.21.15.104:0/1444077477 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:04.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.711+0000 7f9e7ffff640 1 -- 172.21.15.104:0/1444077477 >> v1:172.21.15.104:6789/0 conn(0x7f9e8009ec40 legacy=0x7f9e80126960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:04.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.711+0000 7f9e7effd640 1 -- 172.21.15.104:0/1444077477 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549303322 0 0) 0x7f9e80071de0 con 0x7f9e8009ec40 2024-09-07T03:32:04.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.711+0000 7f9e7ffff640 1 -- 172.21.15.104:0/1444077477 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800721e0 con 0x7f9e80070370 2024-09-07T03:32:04.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e7ffff640 1 --2- 172.21.15.104:0/1444077477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 0x7f9e80070750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009720 tx=0x7f9e7002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46d4f9f575b0cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:04.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e7effd640 1 -- 172.21.15.104:0/1444077477 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e70037070 con 0x7f9e80070370 2024-09-07T03:32:04.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e7effd640 1 -- 172.21.15.104:0/1444077477 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7002ae20 con 0x7f9e80070370 2024-09-07T03:32:04.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e7effd640 1 -- 172.21.15.104:0/1444077477 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e70032590 con 0x7f9e80070370 2024-09-07T03:32:04.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e867f3640 1 -- 172.21.15.104:0/1444077477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 msgr2=0x7f9e80070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:04.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e867f3640 1 --2- 172.21.15.104:0/1444077477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 0x7f9e80070750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009720 tx=0x7f9e7002a1a0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e867f3640 1 -- 172.21.15.104:0/1444077477 shutdown_connections 2024-09-07T03:32:04.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e867f3640 1 --2- 172.21.15.104:0/1444077477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 0x7f9e80070750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e867f3640 1 -- 172.21.15.104:0/1444077477 >> 172.21.15.104:0/1444077477 conn(0x7f9e8009c640 msgr2=0x7f9e8006ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:04.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e867f3640 1 -- 172.21.15.104:0/1444077477 shutdown_connections 2024-09-07T03:32:04.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.712+0000 7f9e867f3640 1 -- 172.21.15.104:0/1444077477 wait complete. 2024-09-07T03:32:04.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.713+0000 7f9e867f3640 1 Processor -- start 2024-09-07T03:32:04.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.713+0000 7f9e867f3640 1 -- start start 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.714+0000 7f9e867f3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 0x7f9e80119dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.714+0000 7f9e867f3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9e80071020 con 0x7f9e80070370 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.714+0000 7f9e7ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 0x7f9e80119dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.714+0000 7f9e7ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 0x7f9e80119dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52254/0 (socket says 172.21.15.104:52254) 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.714+0000 7f9e7ffff640 1 -- 172.21.15.104:0/365041568 learned_addr learned my addr 172.21.15.104:0/365041568 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.714+0000 7f9e7ffff640 1 -- 172.21.15.104:0/365041568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8011d1d0 con 0x7f9e80070370 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.714+0000 7f9e7ffff640 1 --2- 172.21.15.104:0/365041568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 0x7f9e80119dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e7002adf0 tx=0x7f9e700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.714+0000 7f9e7cff9640 1 -- 172.21.15.104:0/365041568 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e70042070 con 0x7f9e80070370 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.714+0000 7f9e7cff9640 1 -- 172.21.15.104:0/365041568 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7003e590 con 0x7f9e80070370 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.715+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8011cd90 con 0x7f9e80070370 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.715+0000 7f9e7cff9640 1 -- 172.21.15.104:0/365041568 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e70037040 con 0x7f9e80070370 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.715+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8011a300 con 0x7f9e80070370 2024-09-07T03:32:04.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.716+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e80070750 con 0x7f9e80070370 2024-09-07T03:32:04.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.716+0000 7f9e7cff9640 1 -- 172.21.15.104:0/365041568 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9e70045070 con 0x7f9e80070370 2024-09-07T03:32:04.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.716+0000 7f9e7cff9640 1 --2- 172.21.15.104:0/365041568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9e6c03de90 0x7f9e6c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:04.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.716+0000 7f9e7cff9640 1 -- 172.21.15.104:0/365041568 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f9e70072d00 con 0x7f9e80070370 2024-09-07T03:32:04.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.716+0000 7f9e7f7fe640 1 --2- 172.21.15.104:0/365041568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9e6c03de90 0x7f9e6c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:04.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.717+0000 7f9e7f7fe640 1 --2- 172.21.15.104:0/365041568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9e6c03de90 0x7f9e6c040350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000c00 tx=0x7f9e740078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:04.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.721+0000 7f9e7cff9640 1 -- 172.21.15.104:0/365041568 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f9e700463b0 con 0x7f9e80070370 2024-09-07T03:32:04.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.897+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f9e8011af20 con 0x7f9e80070370 2024-09-07T03:32:04.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.897+0000 7f9e7cff9640 1 -- 172.21.15.104:0/365041568 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7f9e7002ae20 con 0x7f9e80070370 2024-09-07T03:32:04.900 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:32:04.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9e6c03de90 msgr2=0x7f9e6c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:04.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 --2- 172.21.15.104:0/365041568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9e6c03de90 0x7f9e6c040350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000c00 tx=0x7f9e740078f0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 msgr2=0x7f9e80119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:04.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 --2- 172.21.15.104:0/365041568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 0x7f9e80119dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e7002adf0 tx=0x7f9e700046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 shutdown_connections 2024-09-07T03:32:04.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 --2- 172.21.15.104:0/365041568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9e6c03de90 0x7f9e6c040350 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 --2- 172.21.15.104:0/365041568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e80070370 0x7f9e80119dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:04.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 >> 172.21.15.104:0/365041568 conn(0x7f9e8009c640 msgr2=0x7f9e8009d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:04.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 shutdown_connections 2024-09-07T03:32:04.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:04.900+0000 7f9e867f3640 1 -- 172.21.15.104:0/365041568 wait complete. 2024-09-07T03:32:04.912 INFO:teuthology.orchestra.run.smithi104.stdout:[{"version":5,"timestamp":"2024-09-07T03:31:54.492079+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"8653.427561"}]}] 2024-09-07T03:32:04.913 INFO:tasks.ceph_manager:config epoch is 5 2024-09-07T03:32:04.913 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-07T03:32:04.913 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-07T03:32:04.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-07T03:32:05.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.008+0000 7f291d4cd640 1 Processor -- start 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.008+0000 7f291d4cd640 1 -- start start 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.009+0000 7f291d4cd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2918130270 0x7f2918132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.009+0000 7f291d4cd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f291806dc00 con 0x7f2918129d80 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.009+0000 7f291d4cd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f29181299c0 con 0x7f2918130270 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.009+0000 7f29167fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2918130270 0x7f2918132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.009+0000 7f2916ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2918129d80 0x7f291812a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38604/0 (socket says 172.21.15.104:38604) 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.009+0000 7f2916ffd640 1 -- 172.21.15.104:0/3550816705 learned_addr learned my addr 172.21.15.104:0/3550816705 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.009+0000 7f29167fc640 1 -- 172.21.15.104:0/3550816705 >> v1:172.21.15.104:6789/0 conn(0x7f2918129d80 legacy=0x7f291812a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.009+0000 7f29167fc640 1 -- 172.21.15.104:0/3550816705 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291812a870 con 0x7f2918130270 2024-09-07T03:32:05.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.009+0000 7f2915ffb640 1 -- 172.21.15.104:0/3550816705 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393178522 0 0) 0x7f291806dc00 con 0x7f2918129d80 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.010+0000 7f29167fc640 1 --2- 172.21.15.104:0/3550816705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918130270 0x7f2918132660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f290c009720 tx=0x7f290c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f523e7aa3f32f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.010+0000 7f2915ffb640 1 -- 172.21.15.104:0/3550816705 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f290c037070 con 0x7f2918130270 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.010+0000 7f2915ffb640 1 -- 172.21.15.104:0/3550816705 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f290c02ad90 con 0x7f2918130270 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.010+0000 7f2915ffb640 1 -- 172.21.15.104:0/3550816705 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f290c032590 con 0x7f2918130270 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.011+0000 7f291d4cd640 1 -- 172.21.15.104:0/3550816705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918130270 msgr2=0x7f2918132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.011+0000 7f291d4cd640 1 --2- 172.21.15.104:0/3550816705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918130270 0x7f2918132660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f290c009720 tx=0x7f290c02a110 comp rx=0 tx=0).stop 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.011+0000 7f291d4cd640 1 -- 172.21.15.104:0/3550816705 shutdown_connections 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.011+0000 7f291d4cd640 1 --2- 172.21.15.104:0/3550816705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918130270 0x7f2918132660 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.011+0000 7f291d4cd640 1 -- 172.21.15.104:0/3550816705 >> 172.21.15.104:0/3550816705 conn(0x7f2918070850 msgr2=0x7f2918072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.011+0000 7f291d4cd640 1 -- 172.21.15.104:0/3550816705 shutdown_connections 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.011+0000 7f291d4cd640 1 -- 172.21.15.104:0/3550816705 wait complete. 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f291d4cd640 1 Processor -- start 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f291d4cd640 1 -- start start 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f291d4cd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918129d80 0x7f2918115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f291d4cd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2918073a10 con 0x7f2918129d80 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f2916ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918129d80 0x7f2918115750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f2916ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918129d80 0x7f2918115750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52280/0 (socket says 172.21.15.104:52280) 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f2916ffd640 1 -- 172.21.15.104:0/3991220218 learned_addr learned my addr 172.21.15.104:0/3991220218 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f2916ffd640 1 -- 172.21.15.104:0/3991220218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2918117520 con 0x7f2918129d80 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f2916ffd640 1 --2- 172.21.15.104:0/3991220218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918129d80 0x7f2918115750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f290800c7c0 tx=0x7f290800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.012+0000 7f28ff7fe640 1 -- 172.21.15.104:0/3991220218 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2908018070 con 0x7f2918129d80 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.013+0000 7f28ff7fe640 1 -- 172.21.15.104:0/3991220218 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908004d70 con 0x7f2918129d80 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.013+0000 7f28ff7fe640 1 -- 172.21.15.104:0/3991220218 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f290800a710 con 0x7f2918129d80 2024-09-07T03:32:05.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.013+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2918118520 con 0x7f2918129d80 2024-09-07T03:32:05.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.013+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2918118960 con 0x7f2918129d80 2024-09-07T03:32:05.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.013+0000 7f28ff7fe640 1 -- 172.21.15.104:0/3991220218 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f290801b070 con 0x7f2918129d80 2024-09-07T03:32:05.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.013+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291812a160 con 0x7f2918129d80 2024-09-07T03:32:05.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.014+0000 7f28ff7fe640 1 --2- 172.21.15.104:0/3991220218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f290403de90 0x7f2904040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.014+0000 7f28ff7fe640 1 -- 172.21.15.104:0/3991220218 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f2908051860 con 0x7f2918129d80 2024-09-07T03:32:05.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.014+0000 7f29167fc640 1 --2- 172.21.15.104:0/3991220218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f290403de90 0x7f2904040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.014+0000 7f29167fc640 1 --2- 172.21.15.104:0/3991220218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f290403de90 0x7f2904040350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f290c034000 tx=0x7f290c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.018+0000 7f28ff7fe640 1 -- 172.21.15.104:0/3991220218 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f2908011db0 con 0x7f2918129d80 2024-09-07T03:32:05.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.238+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2918068da0 con 0x7f2918129d80 2024-09-07T03:32:05.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.239+0000 7f28ff7fe640 1 -- 172.21.15.104:0/3991220218 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97042 (secure 0 0 0) 0x7f2908010e00 con 0x7f2918129d80 2024-09-07T03:32:05.243 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:32:05.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f290403de90 msgr2=0x7f2904040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 --2- 172.21.15.104:0/3991220218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f290403de90 0x7f2904040350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f290c034000 tx=0x7f290c02e000 comp rx=0 tx=0).stop 2024-09-07T03:32:05.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918129d80 msgr2=0x7f2918115750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 --2- 172.21.15.104:0/3991220218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918129d80 0x7f2918115750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f290800c7c0 tx=0x7f290800cc80 comp rx=0 tx=0).stop 2024-09-07T03:32:05.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 shutdown_connections 2024-09-07T03:32:05.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 --2- 172.21.15.104:0/3991220218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f290403de90 0x7f2904040350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 --2- 172.21.15.104:0/3991220218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2918129d80 0x7f2918115750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 >> 172.21.15.104:0/3991220218 conn(0x7f2918070850 msgr2=0x7f29181282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 shutdown_connections 2024-09-07T03:32:05.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.242+0000 7f291d4cd640 1 -- 172.21.15.104:0/3991220218 wait complete. 2024-09-07T03:32:05.255 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":924102273},{"type":"v1","addr":"172.21.15.120:6825","nonce":924102273}]},"active_addr":"172.21.15.120:6825/924102273","active_change":"2024-09-07T03:31:49.191439+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":1214161039}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":198156196}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":3159800820}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":1619974016}]}]} 2024-09-07T03:32:05.258 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-07T03:32:05.259 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-07T03:32:05.259 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-07T03:32:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.354+0000 7f73878be640 1 Processor -- start 2024-09-07T03:32:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.354+0000 7f73878be640 1 -- start start 2024-09-07T03:32:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.354+0000 7f73878be640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7380129d80 0x7f738012a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.354+0000 7f73878be640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f738006dc00 con 0x7f738012a6a0 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.354+0000 7f73878be640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f73801299c0 con 0x7f7380129d80 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.354+0000 7f738565a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7380129d80 0x7f738012a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.355+0000 7f7384e59640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f738012a6a0 0x7f7380110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38608/0 (socket says 172.21.15.104:38608) 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.355+0000 7f7384e59640 1 -- 172.21.15.104:0/1938714766 learned_addr learned my addr 172.21.15.104:0/1938714766 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.355+0000 7f738565a640 1 -- 172.21.15.104:0/1938714766 >> v1:172.21.15.104:6789/0 conn(0x7f738012a6a0 legacy=0x7f7380110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.355+0000 7f738565a640 1 -- 172.21.15.104:0/1938714766 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7380114d20 con 0x7f7380129d80 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.355+0000 7f7377fff640 1 -- 172.21.15.104:0/1938714766 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194523187 0 0) 0x7f738006dc00 con 0x7f738012a6a0 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.355+0000 7f738565a640 1 --2- 172.21.15.104:0/1938714766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 0x7f738012a160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f737c009720 tx=0x7f737c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c467265b0e750141 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f7377fff640 1 -- 172.21.15.104:0/1938714766 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f737c037070 con 0x7f7380129d80 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f7377fff640 1 -- 172.21.15.104:0/1938714766 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c02ad90 con 0x7f7380129d80 2024-09-07T03:32:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f7377fff640 1 -- 172.21.15.104:0/1938714766 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f737c032590 con 0x7f7380129d80 2024-09-07T03:32:05.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f73878be640 1 -- 172.21.15.104:0/1938714766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 msgr2=0x7f738012a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f73878be640 1 --2- 172.21.15.104:0/1938714766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 0x7f738012a160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f737c009720 tx=0x7f737c02a110 comp rx=0 tx=0).stop 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f73878be640 1 -- 172.21.15.104:0/1938714766 shutdown_connections 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f73878be640 1 --2- 172.21.15.104:0/1938714766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 0x7f738012a160 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f73878be640 1 -- 172.21.15.104:0/1938714766 >> 172.21.15.104:0/1938714766 conn(0x7f7380070850 msgr2=0x7f7380072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f73878be640 1 -- 172.21.15.104:0/1938714766 shutdown_connections 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.356+0000 7f73878be640 1 -- 172.21.15.104:0/1938714766 wait complete. 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.357+0000 7f73878be640 1 Processor -- start 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.357+0000 7f73878be640 1 -- start start 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.357+0000 7f73878be640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 0x7f738011b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.357+0000 7f73878be640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7380114940 con 0x7f7380129d80 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f738565a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 0x7f738011b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f738565a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 0x7f738011b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52294/0 (socket says 172.21.15.104:52294) 2024-09-07T03:32:05.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f738565a640 1 -- 172.21.15.104:0/606942094 learned_addr learned my addr 172.21.15.104:0/606942094 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f738565a640 1 -- 172.21.15.104:0/606942094 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738011ca80 con 0x7f7380129d80 2024-09-07T03:32:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f738565a640 1 --2- 172.21.15.104:0/606942094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 0x7f738011b390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f737c009720 tx=0x7f737c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f7375ffb640 1 -- 172.21.15.104:0/606942094 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f737c041070 con 0x7f7380129d80 2024-09-07T03:32:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f7375ffb640 1 -- 172.21.15.104:0/606942094 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c03c460 con 0x7f7380129d80 2024-09-07T03:32:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738011d730 con 0x7f7380129d80 2024-09-07T03:32:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f7375ffb640 1 -- 172.21.15.104:0/606942094 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f737c037040 con 0x7f7380129d80 2024-09-07T03:32:05.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.358+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738011dd60 con 0x7f7380129d80 2024-09-07T03:32:05.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.359+0000 7f7375ffb640 1 -- 172.21.15.104:0/606942094 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f737c044070 con 0x7f7380129d80 2024-09-07T03:32:05.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.359+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738011c4f0 con 0x7f7380129d80 2024-09-07T03:32:05.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.359+0000 7f7375ffb640 1 --2- 172.21.15.104:0/606942094 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f736403de90 0x7f7364040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.359+0000 7f7375ffb640 1 -- 172.21.15.104:0/606942094 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f737c072ad0 con 0x7f7380129d80 2024-09-07T03:32:05.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.360+0000 7f7384e59640 1 --2- 172.21.15.104:0/606942094 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f736403de90 0x7f7364040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.360+0000 7f7384e59640 1 --2- 172.21.15.104:0/606942094 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f736403de90 0x7f7364040350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7370000c00 tx=0x7f73700078d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.364+0000 7f7375ffb640 1 -- 172.21.15.104:0/606942094 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f737c03cc60 con 0x7f7380129d80 2024-09-07T03:32:05.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.539+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7380071150 con 0x7f7380129d80 2024-09-07T03:32:05.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.543+0000 7f7375ffb640 1 -- 172.21.15.104:0/606942094 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+9913 (secure 0 0 0) 0x7f7380071150 con 0x7f7380129d80 2024-09-07T03:32:05.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:32:05.545 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"ccd99612-983c-4850-93dd-2abdd870e9cd","created":"2024-09-07T03:31:45.098670+0000","modified":"2024-09-07T03:32:04.532819+0000","last_up_change":"2024-09-07T03:31:55.439585+0000","last_in_change":"2024-09-07T03:31:46.143995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-07T03:31:57.213085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-07T03:32:00.591976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49009fa6-ab2b-4a54-839c-a8e81abf5b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6801","nonce":182397107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6803","nonce":182397107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6807","nonce":182397107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6805","nonce":182397107}]},"public_addr":"172.21.15.104:6801/182397107","cluster_addr":"172.21.15.104:6803/182397107","heartbeat_back_addr":"172.21.15.104:6807/182397107","heartbeat_front_addr":"172.21.15.104:6805/182397107","state":["exists","up"]},{"osd":1,"uuid":"797a0187-6388-4317-a7ba-79a25f6c7f5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6810","nonce":3372043485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6814","nonce":3372043485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6822","nonce":3372043485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6818","nonce":3372043485}]},"public_addr":"172.21.15.120:6810/3372043485","cluster_addr":"172.21.15.120:6814/3372043485","heartbeat_back_addr":"172.21.15.120:6822/3372043485","heartbeat_front_addr":"172.21.15.120:6818/3372043485","state":["exists","up"]},{"osd":2,"uuid":"df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6811","nonce":3781833098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6815","nonce":3781833098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6823","nonce":3781833098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6819","nonce":3781833098}]},"public_addr":"172.21.15.120:6811/3781833098","cluster_addr":"172.21.15.120:6815/3781833098","heartbeat_back_addr":"172.21.15.120:6823/3781833098","heartbeat_front_addr":"172.21.15.120:6819/3781833098","state":["exists","up"]},{"osd":3,"uuid":"582a1603-a3e0-4712-ab2e-e3233e9a1d60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6801","nonce":1193158925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6803","nonce":1193158925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6807","nonce":1193158925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6805","nonce":1193158925}]},"public_addr":"172.21.15.120:6801/1193158925","cluster_addr":"172.21.15.120:6803/1193158925","heartbeat_back_addr":"172.21.15.120:6807/1193158925","heartbeat_front_addr":"172.21.15.120:6805/1193158925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.299631+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.192229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.483211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.308063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-07T03:32:05.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f736403de90 msgr2=0x7f7364040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 --2- 172.21.15.104:0/606942094 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f736403de90 0x7f7364040350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7370000c00 tx=0x7f73700078d0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 msgr2=0x7f738011b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 --2- 172.21.15.104:0/606942094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 0x7f738011b390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f737c009720 tx=0x7f737c0046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 shutdown_connections 2024-09-07T03:32:05.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 --2- 172.21.15.104:0/606942094 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f736403de90 0x7f7364040350 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 --2- 172.21.15.104:0/606942094 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380129d80 0x7f738011b390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 >> 172.21.15.104:0/606942094 conn(0x7f7380070850 msgr2=0x7f7380126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 shutdown_connections 2024-09-07T03:32:05.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.545+0000 7f73878be640 1 -- 172.21.15.104:0/606942094 wait complete. 2024-09-07T03:32:05.558 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-07T03:32:05.559 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-07T03:32:05.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.653+0000 7fccb6f2c640 1 Processor -- start 2024-09-07T03:32:05.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.653+0000 7fccb6f2c640 1 -- start start 2024-09-07T03:32:05.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.653+0000 7fccb6f2c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fccb0130270 0x7fccb0132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.653+0000 7fccb6f2c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb006dc00 con 0x7fccb0129d80 2024-09-07T03:32:05.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.653+0000 7fccb6f2c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fccb01299c0 con 0x7fccb0130270 2024-09-07T03:32:05.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.653+0000 7fccb4cc8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fccb0129d80 0x7fccb012a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38612/0 (socket says 172.21.15.104:38612) 2024-09-07T03:32:05.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.653+0000 7fccb4cc8640 1 -- 172.21.15.104:0/980291803 learned_addr learned my addr 172.21.15.104:0/980291803 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:05.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.654+0000 7fcca7fff640 1 --2- 172.21.15.104:0/980291803 >> v2:172.21.15.104:3300/0 conn(0x7fccb0130270 0x7fccb0132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.654+0000 7fcca77fe640 1 -- 172.21.15.104:0/980291803 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840911705 0 0) 0x7fccb006dc00 con 0x7fccb0129d80 2024-09-07T03:32:05.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.654+0000 7fcca77fe640 1 -- 172.21.15.104:0/980291803 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc98003520 con 0x7fccb0129d80 2024-09-07T03:32:05.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.654+0000 7fcca7fff640 1 -- 172.21.15.104:0/980291803 >> v1:172.21.15.104:6789/0 conn(0x7fccb0129d80 legacy=0x7fccb012a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.654+0000 7fcca7fff640 1 -- 172.21.15.104:0/980291803 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb012a870 con 0x7fccb0130270 2024-09-07T03:32:05.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.654+0000 7fcca7fff640 1 --2- 172.21.15.104:0/980291803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0130270 0x7fccb0132660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009720 tx=0x7fcca002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7679c2fa90b976 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fcca77fe640 1 -- 172.21.15.104:0/980291803 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcca0037070 con 0x7fccb0130270 2024-09-07T03:32:05.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fcca77fe640 1 -- 172.21.15.104:0/980291803 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca002ad90 con 0x7fccb0130270 2024-09-07T03:32:05.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fcca77fe640 1 -- 172.21.15.104:0/980291803 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcca0032590 con 0x7fccb0130270 2024-09-07T03:32:05.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fccb6f2c640 1 -- 172.21.15.104:0/980291803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0130270 msgr2=0x7fccb0132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fccb6f2c640 1 --2- 172.21.15.104:0/980291803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0130270 0x7fccb0132660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009720 tx=0x7fcca002a110 comp rx=0 tx=0).stop 2024-09-07T03:32:05.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fccb6f2c640 1 -- 172.21.15.104:0/980291803 shutdown_connections 2024-09-07T03:32:05.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fccb6f2c640 1 --2- 172.21.15.104:0/980291803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0130270 0x7fccb0132660 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fccb6f2c640 1 -- 172.21.15.104:0/980291803 >> 172.21.15.104:0/980291803 conn(0x7fccb0070850 msgr2=0x7fccb0072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fccb6f2c640 1 -- 172.21.15.104:0/980291803 shutdown_connections 2024-09-07T03:32:05.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.655+0000 7fccb6f2c640 1 -- 172.21.15.104:0/980291803 wait complete. 2024-09-07T03:32:05.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.656+0000 7fccb6f2c640 1 Processor -- start 2024-09-07T03:32:05.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.656+0000 7fccb6f2c640 1 -- start start 2024-09-07T03:32:05.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fccb6f2c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0129d80 0x7fccb0115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fccb6f2c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0073a10 con 0x7fccb0129d80 2024-09-07T03:32:05.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fccb4cc8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0129d80 0x7fccb0115750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fccb4cc8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0129d80 0x7fccb0115750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52302/0 (socket says 172.21.15.104:52302) 2024-09-07T03:32:05.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fccb4cc8640 1 -- 172.21.15.104:0/2447603941 learned_addr learned my addr 172.21.15.104:0/2447603941 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:05.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fccb4cc8640 1 -- 172.21.15.104:0/2447603941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb0117520 con 0x7fccb0129d80 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fccb4cc8640 1 --2- 172.21.15.104:0/2447603941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0129d80 0x7fccb0115750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fccac00c480 tx=0x7fccac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fcca57fa640 1 -- 172.21.15.104:0/2447603941 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccac017070 con 0x7fccb0129d80 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fcca57fa640 1 -- 172.21.15.104:0/2447603941 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccac005cd0 con 0x7fccb0129d80 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb0118520 con 0x7fccb0129d80 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fcca57fa640 1 -- 172.21.15.104:0/2447603941 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccac007200 con 0x7fccb0129d80 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.657+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb0118960 con 0x7fccb0129d80 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.658+0000 7fcca57fa640 1 -- 172.21.15.104:0/2447603941 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fccac01a070 con 0x7fccb0129d80 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.658+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb012a160 con 0x7fccb0129d80 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.658+0000 7fcca57fa640 1 --2- 172.21.15.104:0/2447603941 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc9c03de90 0x7fcc9c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.658+0000 7fcca57fa640 1 -- 172.21.15.104:0/2447603941 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fccac051500 con 0x7fccb0129d80 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.659+0000 7fcca7fff640 1 --2- 172.21.15.104:0/2447603941 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc9c03de90 0x7fcc9c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.659+0000 7fcca7fff640 1 --2- 172.21.15.104:0/2447603941 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc9c03de90 0x7fcc9c040350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcca0034000 tx=0x7fcca002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.663+0000 7fcca57fa640 1 -- 172.21.15.104:0/2447603941 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fccac01b3b0 con 0x7fccb0129d80 2024-09-07T03:32:05.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.835+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccb0068da0 con 0x7fccb0129d80 2024-09-07T03:32:05.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.836+0000 7fcca57fa640 1 -- 172.21.15.104:0/2447603941 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+9913 (secure 0 0 0) 0x7fccac01b730 con 0x7fccb0129d80 2024-09-07T03:32:05.838 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:32:05.838 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"ccd99612-983c-4850-93dd-2abdd870e9cd","created":"2024-09-07T03:31:45.098670+0000","modified":"2024-09-07T03:32:04.532819+0000","last_up_change":"2024-09-07T03:31:55.439585+0000","last_in_change":"2024-09-07T03:31:46.143995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-07T03:31:57.213085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-07T03:32:00.591976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49009fa6-ab2b-4a54-839c-a8e81abf5b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6801","nonce":182397107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6803","nonce":182397107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6807","nonce":182397107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6805","nonce":182397107}]},"public_addr":"172.21.15.104:6801/182397107","cluster_addr":"172.21.15.104:6803/182397107","heartbeat_back_addr":"172.21.15.104:6807/182397107","heartbeat_front_addr":"172.21.15.104:6805/182397107","state":["exists","up"]},{"osd":1,"uuid":"797a0187-6388-4317-a7ba-79a25f6c7f5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6810","nonce":3372043485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6814","nonce":3372043485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6822","nonce":3372043485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6818","nonce":3372043485}]},"public_addr":"172.21.15.120:6810/3372043485","cluster_addr":"172.21.15.120:6814/3372043485","heartbeat_back_addr":"172.21.15.120:6822/3372043485","heartbeat_front_addr":"172.21.15.120:6818/3372043485","state":["exists","up"]},{"osd":2,"uuid":"df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6811","nonce":3781833098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6815","nonce":3781833098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6823","nonce":3781833098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6819","nonce":3781833098}]},"public_addr":"172.21.15.120:6811/3781833098","cluster_addr":"172.21.15.120:6815/3781833098","heartbeat_back_addr":"172.21.15.120:6823/3781833098","heartbeat_front_addr":"172.21.15.120:6819/3781833098","state":["exists","up"]},{"osd":3,"uuid":"582a1603-a3e0-4712-ab2e-e3233e9a1d60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6801","nonce":1193158925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6803","nonce":1193158925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6807","nonce":1193158925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6805","nonce":1193158925}]},"public_addr":"172.21.15.120:6801/1193158925","cluster_addr":"172.21.15.120:6803/1193158925","heartbeat_back_addr":"172.21.15.120:6807/1193158925","heartbeat_front_addr":"172.21.15.120:6805/1193158925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.299631+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.192229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.483211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.308063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-07T03:32:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc9c03de90 msgr2=0x7fcc9c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 --2- 172.21.15.104:0/2447603941 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc9c03de90 0x7fcc9c040350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcca0034000 tx=0x7fcca002e000 comp rx=0 tx=0).stop 2024-09-07T03:32:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0129d80 msgr2=0x7fccb0115750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 --2- 172.21.15.104:0/2447603941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0129d80 0x7fccb0115750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fccac00c480 tx=0x7fccac00c940 comp rx=0 tx=0).stop 2024-09-07T03:32:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 shutdown_connections 2024-09-07T03:32:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 --2- 172.21.15.104:0/2447603941 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc9c03de90 0x7fcc9c040350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 --2- 172.21.15.104:0/2447603941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccb0129d80 0x7fccb0115750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 >> 172.21.15.104:0/2447603941 conn(0x7fccb0070850 msgr2=0x7fccb01282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 shutdown_connections 2024-09-07T03:32:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.838+0000 7fccb6f2c640 1 -- 172.21.15.104:0/2447603941 wait complete. 2024-09-07T03:32:05.851 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-07T03:32:05.852 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-07T03:32:05.852 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-07T03:32:05.852 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-07T03:32:05.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f6d68a57640 1 Processor -- start 2024-09-07T03:32:05.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f6d68a57640 1 -- start start 2024-09-07T03:32:05.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7fb5de871640 1 Processor -- start 2024-09-07T03:32:05.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7fcce26e4640 1 Processor -- start 2024-09-07T03:32:05.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f2ef9391640 1 Processor -- start 2024-09-07T03:32:05.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7fcce26e4640 1 -- start start 2024-09-07T03:32:05.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7fb5de871640 1 -- start start 2024-09-07T03:32:05.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f2ef9391640 1 -- start start 2024-09-07T03:32:05.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f2ef9391640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ef412f170 0x7f2ef412f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f2ef9391640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef40717b0 con 0x7f2ef4071040 2024-09-07T03:32:05.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f2ef9391640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef40709d0 con 0x7f2ef412f170 2024-09-07T03:32:05.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f6d68a57640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6d64070c00 0x7f6d64070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7fcce26e4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fccdc1326a0 0x7fccdc134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7fb5de871640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb5d809ecd0 0x7fb5d81314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f6d68a57640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d6406de00 con 0x7f6d64071ec0 2024-09-07T03:32:05.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7f6d68a57640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6d64069380 con 0x7f6d64070c00 2024-09-07T03:32:05.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7fcce26e4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc126450 con 0x7fccdc125960 2024-09-07T03:32:05.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.954+0000 7fcce26e4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fccdc117100 con 0x7fccdc1326a0 2024-09-07T03:32:05.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fb5de871640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d8073050 con 0x7fb5d8071d10 2024-09-07T03:32:05.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fb5de871640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d8073600 con 0x7fb5d809ecd0 2024-09-07T03:32:05.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f6d61d9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6d64071ec0 0x7f6d6412b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38628/0 (socket says 172.21.15.104:38628) 2024-09-07T03:32:05.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f6d61d9b640 1 -- 172.21.15.104:0/1584292650 learned_addr learned my addr 172.21.15.104:0/1584292650 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:05.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f6d6259c640 1 --2- 172.21.15.104:0/1584292650 >> v2:172.21.15.104:3300/0 conn(0x7f6d64070c00 0x7f6d64070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fb5d7fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb5d8071d10 0x7fb5d80720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38644/0 (socket says 172.21.15.104:38644) 2024-09-07T03:32:05.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fccdbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fccdc125960 0x7fccdc125d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38648/0 (socket says 172.21.15.104:38648) 2024-09-07T03:32:05.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fccdbfff640 1 -- 172.21.15.104:0/3316369585 learned_addr learned my addr 172.21.15.104:0/3316369585 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:05.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fccdb7fe640 1 --2- 172.21.15.104:0/3316369585 >> v2:172.21.15.104:3300/0 conn(0x7fccdc1326a0 0x7fccdc134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f2ef2ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ef412f170 0x7f2ef412f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f2ef2ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ef412f170 0x7f2ef412f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52316/0 (socket says 172.21.15.104:52316) 2024-09-07T03:32:05.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f2ef2ffd640 1 -- 172.21.15.104:0/3096029153 learned_addr learned my addr 172.21.15.104:0/3096029153 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:05.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fb5d7fff640 1 -- 172.21.15.104:0/1099444365 learned_addr learned my addr 172.21.15.104:0/1099444365 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:05.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fb5d77fe640 1 --2- 172.21.15.104:0/1099444365 >> v2:172.21.15.104:3300/0 conn(0x7fb5d809ecd0 0x7fb5d81314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f6d6159a640 1 -- 172.21.15.104:0/1584292650 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535104364 0 0) 0x7f6d6406de00 con 0x7f6d64071ec0 2024-09-07T03:32:05.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f6d6159a640 1 -- 172.21.15.104:0/1584292650 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d4c003520 con 0x7f6d64071ec0 2024-09-07T03:32:05.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fccdb7fe640 1 -- 172.21.15.104:0/3316369585 >> v1:172.21.15.104:6789/0 conn(0x7fccdc125960 legacy=0x7fccdc125d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fccdb7fe640 1 -- 172.21.15.104:0/3316369585 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc073a30 con 0x7fccdc1326a0 2024-09-07T03:32:05.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f6d6259c640 1 -- 172.21.15.104:0/1584292650 >> v1:172.21.15.104:6789/0 conn(0x7f6d64071ec0 legacy=0x7f6d6412b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f6d6259c640 1 -- 172.21.15.104:0/1584292650 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6409ecd0 con 0x7f6d64070c00 2024-09-07T03:32:05.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f2ef2ffd640 1 -- 172.21.15.104:0/3096029153 >> v1:172.21.15.104:6789/0 conn(0x7f2ef4071040 legacy=0x7f2ef412e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7f2ef2ffd640 1 -- 172.21.15.104:0/3096029153 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef406d480 con 0x7f2ef412f170 2024-09-07T03:32:05.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fb5d77fe640 1 -- 172.21.15.104:0/1099444365 >> v1:172.21.15.104:6789/0 conn(0x7fb5d8071d10 legacy=0x7fb5d80720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.955+0000 7fb5d77fe640 1 -- 172.21.15.104:0/1099444365 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d80732f0 con 0x7fb5d809ecd0 2024-09-07T03:32:05.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7fb5d77fe640 1 --2- 172.21.15.104:0/1099444365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d809ecd0 0x7fb5d81314d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00b9c0 tx=0x7fb5cc02c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1764d9e75ea8cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7f2ef2ffd640 1 --2- 172.21.15.104:0/3096029153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef412f170 0x7f2ef412f550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40097f0 tx=0x7f2ee402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc6979e5b01b55a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7fb5d6ffd640 1 -- 172.21.15.104:0/1099444365 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5cc031640 con 0x7fb5d809ecd0 2024-09-07T03:32:05.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7fb5d6ffd640 1 -- 172.21.15.104:0/1099444365 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5cc0317e0 con 0x7fb5d809ecd0 2024-09-07T03:32:05.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7fb5d6ffd640 1 -- 172.21.15.104:0/1099444365 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5cc031ae0 con 0x7fb5d809ecd0 2024-09-07T03:32:05.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7f2ef1ffb640 1 -- 172.21.15.104:0/3096029153 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ee4037070 con 0x7f2ef412f170 2024-09-07T03:32:05.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7f2ef1ffb640 1 -- 172.21.15.104:0/3096029153 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee4032440 con 0x7f2ef412f170 2024-09-07T03:32:05.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7f2ef1ffb640 1 -- 172.21.15.104:0/3096029153 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ee402ae60 con 0x7f2ef412f170 2024-09-07T03:32:05.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7fccdb7fe640 1 --2- 172.21.15.104:0/3316369585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc1326a0 0x7fccdc134a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009720 tx=0x7fccd002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1160eeefa0760ec server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7f6d6259c640 1 --2- 172.21.15.104:0/1584292650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 0x7f6d64070fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009720 tx=0x7f6d5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2137e76139742d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.956+0000 7f6d6159a640 1 -- 172.21.15.104:0/1584292650 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d54037070 con 0x7f6d64070c00 2024-09-07T03:32:05.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fccdaffd640 1 -- 172.21.15.104:0/3316369585 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd0037070 con 0x7fccdc1326a0 2024-09-07T03:32:05.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7f6d6159a640 1 -- 172.21.15.104:0/1584292650 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5402ad90 con 0x7f6d64070c00 2024-09-07T03:32:05.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7f6d6159a640 1 -- 172.21.15.104:0/1584292650 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d54032570 con 0x7f6d64070c00 2024-09-07T03:32:05.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fccdaffd640 1 -- 172.21.15.104:0/3316369585 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd002ad90 con 0x7fccdc1326a0 2024-09-07T03:32:05.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fccdaffd640 1 -- 172.21.15.104:0/3316369585 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd0032590 con 0x7fccdc1326a0 2024-09-07T03:32:05.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fb5de871640 1 -- 172.21.15.104:0/1099444365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d809ecd0 msgr2=0x7fb5d81314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fb5de871640 1 --2- 172.21.15.104:0/1099444365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d809ecd0 0x7fb5d81314d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00b9c0 tx=0x7fb5cc02c7e0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fb5de871640 1 -- 172.21.15.104:0/1099444365 shutdown_connections 2024-09-07T03:32:05.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fb5de871640 1 --2- 172.21.15.104:0/1099444365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d809ecd0 0x7fb5d81314d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fb5de871640 1 -- 172.21.15.104:0/1099444365 >> 172.21.15.104:0/1099444365 conn(0x7fb5d809c640 msgr2=0x7fb5d806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7f2ef9391640 1 -- 172.21.15.104:0/3096029153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef412f170 msgr2=0x7f2ef412f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7f2ef9391640 1 --2- 172.21.15.104:0/3096029153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef412f170 0x7f2ef412f550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40097f0 tx=0x7f2ee402a1e0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fb5de871640 1 -- 172.21.15.104:0/1099444365 shutdown_connections 2024-09-07T03:32:05.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7f2ef9391640 1 -- 172.21.15.104:0/3096029153 shutdown_connections 2024-09-07T03:32:05.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7f2ef9391640 1 --2- 172.21.15.104:0/3096029153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef412f170 0x7f2ef412f550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7f2ef9391640 1 -- 172.21.15.104:0/3096029153 >> 172.21.15.104:0/3096029153 conn(0x7f2ef409b880 msgr2=0x7f2ef406dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7fb5de871640 1 -- 172.21.15.104:0/1099444365 wait complete. 2024-09-07T03:32:05.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7f2ef9391640 1 -- 172.21.15.104:0/3096029153 shutdown_connections 2024-09-07T03:32:05.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.957+0000 7f2ef9391640 1 -- 172.21.15.104:0/3096029153 wait complete. 2024-09-07T03:32:05.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7fcce26e4640 1 -- 172.21.15.104:0/3316369585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc1326a0 msgr2=0x7fccdc134a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7fcce26e4640 1 --2- 172.21.15.104:0/3316369585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc1326a0 0x7fccdc134a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009720 tx=0x7fccd002a110 comp rx=0 tx=0).stop 2024-09-07T03:32:05.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7f6d68a57640 1 -- 172.21.15.104:0/1584292650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 msgr2=0x7f6d64070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:05.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7f6d68a57640 1 --2- 172.21.15.104:0/1584292650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 0x7f6d64070fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009720 tx=0x7f6d5402a110 comp rx=0 tx=0).stop 2024-09-07T03:32:05.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7fcce26e4640 1 -- 172.21.15.104:0/3316369585 shutdown_connections 2024-09-07T03:32:05.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7fcce26e4640 1 --2- 172.21.15.104:0/3316369585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc1326a0 0x7fccdc134a90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7fcce26e4640 1 -- 172.21.15.104:0/3316369585 >> 172.21.15.104:0/3316369585 conn(0x7fccdc06f8d0 msgr2=0x7fccdc071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7f6d68a57640 1 -- 172.21.15.104:0/1584292650 shutdown_connections 2024-09-07T03:32:05.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7f6d68a57640 1 --2- 172.21.15.104:0/1584292650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 0x7f6d64070fe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:05.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7f6d68a57640 1 -- 172.21.15.104:0/1584292650 >> 172.21.15.104:0/1584292650 conn(0x7f6d6409c640 msgr2=0x7f6d6406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:05.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7fcce26e4640 1 -- 172.21.15.104:0/3316369585 shutdown_connections 2024-09-07T03:32:05.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7fcce26e4640 1 -- 172.21.15.104:0/3316369585 wait complete. 2024-09-07T03:32:05.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7f6d68a57640 1 -- 172.21.15.104:0/1584292650 shutdown_connections 2024-09-07T03:32:05.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7f6d68a57640 1 -- 172.21.15.104:0/1584292650 wait complete. 2024-09-07T03:32:05.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7fb5de871640 1 Processor -- start 2024-09-07T03:32:05.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7fb5de871640 1 -- start start 2024-09-07T03:32:05.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7f2ef9391640 1 Processor -- start 2024-09-07T03:32:05.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.958+0000 7f2ef9391640 1 -- start start 2024-09-07T03:32:05.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7fcce26e4640 1 Processor -- start 2024-09-07T03:32:05.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7fb5de871640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d8071d10 0x7fb5d8116b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7f2ef9391640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef4071040 0x7f2ef4121730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7f2ef9391640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef412fe20 con 0x7f2ef4071040 2024-09-07T03:32:05.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7fb5de871640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d8072980 con 0x7fb5d8071d10 2024-09-07T03:32:05.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7fcce26e4640 1 -- start start 2024-09-07T03:32:05.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7f6d68a57640 1 Processor -- start 2024-09-07T03:32:05.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7fb5d7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d8071d10 0x7fb5d8116b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7f6d68a57640 1 -- start start 2024-09-07T03:32:05.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7f2ef2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef4071040 0x7f2ef4121730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7fb5d7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d8071d10 0x7fb5d8116b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52366/0 (socket says 172.21.15.104:52366) 2024-09-07T03:32:05.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7fb5d7fff640 1 -- 172.21.15.104:0/825756322 learned_addr learned my addr 172.21.15.104:0/825756322 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:05.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7f2ef2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef4071040 0x7f2ef4121730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52350/0 (socket says 172.21.15.104:52350) 2024-09-07T03:32:05.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7f2ef2ffd640 1 -- 172.21.15.104:0/2885575910 learned_addr learned my addr 172.21.15.104:0/2885575910 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:05.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7fb5d7fff640 1 -- 172.21.15.104:0/825756322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d8126700 con 0x7fb5d8071d10 2024-09-07T03:32:05.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.959+0000 7f2ef2ffd640 1 -- 172.21.15.104:0/2885575910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef41230d0 con 0x7f2ef4071040 2024-09-07T03:32:05.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f6d68a57640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 0x7f6d641c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f6d68a57640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6d640718b0 con 0x7f6d64070c00 2024-09-07T03:32:05.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fb5d7fff640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d8071d10 0x7fb5d8116b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800c480 tx=0x7fb5c800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fcce26e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc125960 0x7fccdc1c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fcce26e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc116470 con 0x7fccdc125960 2024-09-07T03:32:05.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fccdbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc125960 0x7fccdc1c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f6d6259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 0x7f6d641c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f6d6259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 0x7f6d641c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52376/0 (socket says 172.21.15.104:52376) 2024-09-07T03:32:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f6d6259c640 1 -- 172.21.15.104:0/3755767831 learned_addr learned my addr 172.21.15.104:0/3755767831 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:05.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f2ef2ffd640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef4071040 0x7f2ef4121730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4035040 tx=0x7f2ee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fccdbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc125960 0x7fccdc1c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52384/0 (socket says 172.21.15.104:52384) 2024-09-07T03:32:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fccdbfff640 1 -- 172.21.15.104:0/3655121276 learned_addr learned my addr 172.21.15.104:0/3655121276 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fb5d4ff9640 1 -- 172.21.15.104:0/825756322 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c8017070 con 0x7fb5d8071d10 2024-09-07T03:32:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fb5d4ff9640 1 -- 172.21.15.104:0/825756322 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c8005c10 con 0x7fb5d8071d10 2024-09-07T03:32:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fb5d4ff9640 1 -- 172.21.15.104:0/825756322 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c8007070 con 0x7fb5d8071d10 2024-09-07T03:32:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fccdbfff640 1 -- 172.21.15.104:0/3655121276 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc070970 con 0x7fccdc125960 2024-09-07T03:32:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f2edb7fe640 1 -- 172.21.15.104:0/2885575910 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ee4041070 con 0x7f2ef4071040 2024-09-07T03:32:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f2edb7fe640 1 -- 172.21.15.104:0/2885575910 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee403c7a0 con 0x7f2ef4071040 2024-09-07T03:32:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f2edb7fe640 1 -- 172.21.15.104:0/2885575910 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ee4037040 con 0x7f2ef4071040 2024-09-07T03:32:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef412dd20 con 0x7f2ef4071040 2024-09-07T03:32:05.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7fccdbfff640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc125960 0x7fccdc1c3f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fccd400cbd0 tx=0x7fccd400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef4124270 con 0x7f2ef4071040 2024-09-07T03:32:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.960+0000 7f6d6259c640 1 -- 172.21.15.104:0/3755767831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d641215d0 con 0x7f6d64070c00 2024-09-07T03:32:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7f6d6259c640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 0x7f6d641c1de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d54035040 tx=0x7f6d540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7fccd8ff9640 1 -- 172.21.15.104:0/3655121276 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd4017070 con 0x7fccdc125960 2024-09-07T03:32:05.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7fcce26e4640 1 -- 172.21.15.104:0/3655121276 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc129a80 con 0x7fccdc125960 2024-09-07T03:32:05.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d8118200 con 0x7fb5d8071d10 2024-09-07T03:32:05.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d8119330 con 0x7fb5d8071d10 2024-09-07T03:32:05.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7fccd8ff9640 1 -- 172.21.15.104:0/3655121276 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd400abc0 con 0x7fccdc125960 2024-09-07T03:32:05.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7fccd8ff9640 1 -- 172.21.15.104:0/3655121276 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd4012400 con 0x7fccdc125960 2024-09-07T03:32:05.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7f6d52ffd640 1 -- 172.21.15.104:0/3755767831 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d54041020 con 0x7f6d64070c00 2024-09-07T03:32:05.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d64073380 con 0x7f6d64070c00 2024-09-07T03:32:05.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ef4124550 con 0x7f2ef4071040 2024-09-07T03:32:05.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7f2edb7fe640 1 -- 172.21.15.104:0/2885575910 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2ee4044070 con 0x7f2ef4071040 2024-09-07T03:32:05.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7fcce26e4640 1 -- 172.21.15.104:0/3655121276 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc070fe0 con 0x7fccdc125960 2024-09-07T03:32:05.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5d8119f50 con 0x7fb5d8071d10 2024-09-07T03:32:05.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.961+0000 7f6d52ffd640 1 -- 172.21.15.104:0/3755767831 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d540044c0 con 0x7f6d64070c00 2024-09-07T03:32:05.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d64122160 con 0x7f6d64070c00 2024-09-07T03:32:05.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7f6d52ffd640 1 -- 172.21.15.104:0/3755767831 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d54041020 con 0x7f6d64070c00 2024-09-07T03:32:05.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7f2edb7fe640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ee003dee0 0x7f2ee00403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7f2edb7fe640 1 -- 172.21.15.104:0/2885575910 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f2ee4072d70 con 0x7f2ef4071040 2024-09-07T03:32:05.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7f2edb7fe640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7f2ee0043660 0x7f2ee0045ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7f2edb7fe640 1 -- 172.21.15.104:0/2885575910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ee4041e70 con 0x7f2ee0043660 2024-09-07T03:32:05.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7f2edb7fe640 1 -- 172.21.15.104:0/2885575910 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2ee404e6d0 con 0x7f2ef4071040 2024-09-07T03:32:05.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7f2ef27fc640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ee003dee0 0x7f2ee00403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7f2ef37fe640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7f2ee0043660 0x7f2ee0045ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.962+0000 7fccd8ff9640 1 -- 172.21.15.104:0/3655121276 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fccd401a070 con 0x7fccdc125960 2024-09-07T03:32:05.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fb5d4ff9640 1 -- 172.21.15.104:0/825756322 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb5c801a070 con 0x7fb5d8071d10 2024-09-07T03:32:05.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fccd8ff9640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fccc803de90 0x7fccc8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fccc27fc640 1 -- 172.21.15.104:0/3655121276 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccdc125d40 con 0x7fccdc125960 2024-09-07T03:32:05.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f2ef37fe640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7f2ee0043660 0x7f2ee0045ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f6d52ffd640 1 -- 172.21.15.104:0/3755767831 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6d54044020 con 0x7f6d64070c00 2024-09-07T03:32:05.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d64120e80 con 0x7f6d64070c00 2024-09-07T03:32:05.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fccd8ff9640 1 -- 172.21.15.104:0/3655121276 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fccd4007070 con 0x7fccdc125960 2024-09-07T03:32:05.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f2ef27fc640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ee003dee0 0x7f2ee00403a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8001560 tx=0x7f2ee80079f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fb5d4ff9640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb5c403dee0 0x7fb5c40403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fb5d4ff9640 1 -- 172.21.15.104:0/825756322 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fb5c8051e00 con 0x7fb5d8071d10 2024-09-07T03:32:05.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fccd8ff9640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fccc8043610 0x7fccc8045a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fccdb7fe640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fccc803de90 0x7fccc8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fccd8ff9640 1 -- 172.21.15.104:0/3655121276 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccc8046160 con 0x7fccc8043610 2024-09-07T03:32:05.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f6d52ffd640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d4403e250 0x7f6d44040710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fb5d4ff9640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fb5c4043660 0x7fb5c4045ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fb5d4ff9640 1 -- 172.21.15.104:0/825756322 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5c800ee50 con 0x7fb5c4043660 2024-09-07T03:32:05.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fb5d4ff9640 1 -- 172.21.15.104:0/825756322 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb5c8052170 con 0x7fb5d8071d10 2024-09-07T03:32:05.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f6d52ffd640 1 -- 172.21.15.104:0/3755767831 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f6d540722c0 con 0x7f6d64070c00 2024-09-07T03:32:05.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fccd8ff9640 1 -- 172.21.15.104:0/3655121276 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fccd4007400 con 0x7fccdc125960 2024-09-07T03:32:05.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f6d52ffd640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7f6d440439d0 0x7f6d44045e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:05.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f6d52ffd640 1 -- 172.21.15.104:0/3755767831 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d54048e50 con 0x7f6d440439d0 2024-09-07T03:32:05.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f6d52ffd640 1 -- 172.21.15.104:0/3755767831 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6d54079050 con 0x7f6d64070c00 2024-09-07T03:32:05.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f6d61d9b640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d4403e250 0x7f6d44040710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fcce0c81640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fccc8043610 0x7fccc8045a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fb5d77fe640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb5c403dee0 0x7fb5c40403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7fb5dce0e640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fb5c4043660 0x7fb5c4045ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.963+0000 7f6d62d9d640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7f6d440439d0 0x7f6d44045e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:05.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.964+0000 7fccdb7fe640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fccc803de90 0x7fccc8040350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009720 tx=0x7fccd002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.964+0000 7fb5dce0e640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fb5c4043660 0x7fb5c4045ae0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.964+0000 7f2edb7fe640 1 -- 172.21.15.104:0/2885575910 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ee4041e70 con 0x7f2ee0043660 2024-09-07T03:32:05.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.964+0000 7f6d61d9b640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d4403e250 0x7f6d44040710 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6d58001610 tx=0x7f6d580078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.964+0000 7fb5d77fe640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb5c403dee0 0x7fb5c40403a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc036000 tx=0x7fb5cc031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.964+0000 7fcce0c81640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fccc8043610 0x7fccc8045a90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.964+0000 7f6d62d9d640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7f6d440439d0 0x7f6d44045e50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:05.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.964+0000 7fb5d4ff9640 1 -- 172.21.15.104:0/825756322 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5c800ee50 con 0x7fb5c4043660 2024-09-07T03:32:05.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.965+0000 7fccd8ff9640 1 -- 172.21.15.104:0/3655121276 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccc8046160 con 0x7fccc8043610 2024-09-07T03:32:06.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.965+0000 7f6d52ffd640 1 -- 172.21.15.104:0/3755767831 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d54048e50 con 0x7f6d440439d0 2024-09-07T03:32:06.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.978+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6d64121f10 con 0x7f6d440439d0 2024-09-07T03:32:06.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.979+0000 7fccc27fc640 1 -- 172.21.15.104:0/3655121276 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fccdc132870 con 0x7fccc8043610 2024-09-07T03:32:06.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.979+0000 7f6d52ffd640 1 -- 172.21.15.104:0/3755767831 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6d5c00adb0 con 0x7f6d440439d0 2024-09-07T03:32:06.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.979+0000 7fccd8ff9640 1 -- 172.21.15.104:0/3655121276 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fccdc132870 con 0x7fccc8043610 2024-09-07T03:32:06.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.979+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7f6d440439d0 msgr2=0x7f6d44045e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.979+0000 7f6d68a57640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7f6d440439d0 0x7f6d44045e50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 -- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fccc8043610 msgr2=0x7fccc8045a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fccc8043610 0x7fccc8045a90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d4403e250 msgr2=0x7f6d44040710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 -- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fccc803de90 msgr2=0x7fccc8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fccc803de90 0x7fccc8040350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009720 tx=0x7fccd002e000 comp rx=0 tx=0).stop 2024-09-07T03:32:06.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d4403e250 0x7f6d44040710 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6d58001610 tx=0x7f6d580078f0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 -- 172.21.15.104:0/3655121276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc125960 msgr2=0x7fccdc1c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc125960 0x7fccdc1c3f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fccd400cbd0 tx=0x7fccd400a430 comp rx=0 tx=0).stop 2024-09-07T03:32:06.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 msgr2=0x7f6d641c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 0x7f6d641c1de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6d54035040 tx=0x7f6d540046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 -- 172.21.15.104:0/3655121276 shutdown_connections 2024-09-07T03:32:06.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fccc8043610 0x7fccc8045a90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fccc803de90 0x7fccc8040350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 shutdown_connections 2024-09-07T03:32:06.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 --2- 172.21.15.104:0/3655121276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccdc125960 0x7fccdc1c3f80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 -- 172.21.15.104:0/3655121276 >> 172.21.15.104:0/3655121276 conn(0x7fccdc06f8d0 msgr2=0x7fccdc130d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7f6d440439d0 0x7f6d44045e50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d4403e250 0x7f6d44040710 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 --2- 172.21.15.104:0/3755767831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6d64070c00 0x7f6d641c1de0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 -- 172.21.15.104:0/3655121276 shutdown_connections 2024-09-07T03:32:06.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7fccc27fc640 1 -- 172.21.15.104:0/3655121276 wait complete. 2024-09-07T03:32:06.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 >> 172.21.15.104:0/3755767831 conn(0x7f6d6409c640 msgr2=0x7f6d64118870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 shutdown_connections 2024-09-07T03:32:06.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.980+0000 7f6d68a57640 1 -- 172.21.15.104:0/3755767831 wait complete. 2024-09-07T03:32:06.007 INFO:teuthology.orchestra.run.smithi104.stdout:38654705669 2024-09-07T03:32:06.008 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-07T03:32:06.009 INFO:teuthology.orchestra.run.smithi104.stdout:47244640262 2024-09-07T03:32:06.009 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-07T03:32:06.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.994+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ef4123e40 con 0x7f2ee0043660 2024-09-07T03:32:06.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.995+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5d8119f50 con 0x7fb5c4043660 2024-09-07T03:32:06.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.995+0000 7f2edb7fe640 1 -- 172.21.15.104:0/2885575910 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2ef4123e40 con 0x7f2ee0043660 2024-09-07T03:32:06.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.995+0000 7fb5d4ff9640 1 -- 172.21.15.104:0/825756322 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5d8119f50 con 0x7fb5c4043660 2024-09-07T03:32:06.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.995+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7f2ee0043660 msgr2=0x7f2ee0045ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.995+0000 7f2ef9391640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7f2ee0043660 0x7f2ee0045ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ee003dee0 msgr2=0x7f2ee00403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ee003dee0 0x7f2ee00403a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8001560 tx=0x7f2ee80079f0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef4071040 msgr2=0x7f2ef4121730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef4071040 0x7f2ef4121730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4035040 tx=0x7f2ee40046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 shutdown_connections 2024-09-07T03:32:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7f2ee0043660 0x7f2ee0045ae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ee003dee0 0x7f2ee00403a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 --2- 172.21.15.104:0/2885575910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ef4071040 0x7f2ef4121730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 >> 172.21.15.104:0/2885575910 conn(0x7f2ef409b880 msgr2=0x7f2ef406e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 shutdown_connections 2024-09-07T03:32:06.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7f2ef9391640 1 -- 172.21.15.104:0/2885575910 wait complete. 2024-09-07T03:32:06.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fb5c4043660 msgr2=0x7fb5c4045ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fb5c4043660 0x7fb5c4045ae0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb5c403dee0 msgr2=0x7fb5c40403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb5c403dee0 0x7fb5c40403a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc036000 tx=0x7fb5cc031000 comp rx=0 tx=0).stop 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d8071d10 msgr2=0x7fb5d8116b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d8071d10 0x7fb5d8116b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800c480 tx=0x7fb5c800c940 comp rx=0 tx=0).stop 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 shutdown_connections 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fb5c4043660 0x7fb5c4045ae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb5c403dee0 0x7fb5c40403a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 --2- 172.21.15.104:0/825756322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5d8071d10 0x7fb5d8116b10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 >> 172.21.15.104:0/825756322 conn(0x7fb5d809c640 msgr2=0x7fb5d8127990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 shutdown_connections 2024-09-07T03:32:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:05.996+0000 7fb5de871640 1 -- 172.21.15.104:0/825756322 wait complete. 2024-09-07T03:32:06.015 INFO:teuthology.orchestra.run.smithi104.stdout:47244640262 2024-09-07T03:32:06.015 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-07T03:32:06.016 INFO:teuthology.orchestra.run.smithi104.stdout:47244640262 2024-09-07T03:32:06.017 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-07T03:32:06.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.150+0000 7f8fa811e640 1 Processor -- start 2024-09-07T03:32:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.150+0000 7f3cb08c6640 1 Processor -- start 2024-09-07T03:32:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.150+0000 7f3cb08c6640 1 -- start start 2024-09-07T03:32:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.150+0000 7fd68a4eb640 1 Processor -- start 2024-09-07T03:32:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.150+0000 7f8171e96640 1 Processor -- start 2024-09-07T03:32:06.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.150+0000 7f8171e96640 1 -- start start 2024-09-07T03:32:06.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.150+0000 7f8fa811e640 1 -- start start 2024-09-07T03:32:06.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.150+0000 7fd68a4eb640 1 -- start start 2024-09-07T03:32:06.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f8171e96640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f816c12f640 0x7f816c12fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7fd68a4eb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd68409ecd0 0x7fd6841314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7fd68a4eb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd684073050 con 0x7fd684071d10 2024-09-07T03:32:06.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7fd68a4eb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fd684073600 con 0x7fd68409ecd0 2024-09-07T03:32:06.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f8171e96640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f816c116d10 con 0x7f816c12fa70 2024-09-07T03:32:06.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f8171e96640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f816c070360 con 0x7f816c12f640 2024-09-07T03:32:06.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7fd6837fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd68409ecd0 0x7fd6841314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7fd6837fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd68409ecd0 0x7fd6841314d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52396/0 (socket says 172.21.15.104:52396) 2024-09-07T03:32:06.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7fd6837fe640 1 -- 172.21.15.104:0/1509868251 learned_addr learned my addr 172.21.15.104:0/1509868251 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:06.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f816b7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f816c12fa70 0x7f816c12bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38664/0 (socket says 172.21.15.104:38664) 2024-09-07T03:32:06.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f816b7fe640 1 -- 172.21.15.104:0/2221422691 learned_addr learned my addr 172.21.15.104:0/2221422691 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:06.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f816affd640 1 --2- 172.21.15.104:0/2221422691 >> v2:172.21.15.104:3300/0 conn(0x7f816c12f640 0x7f816c12fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f3cb08c6640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3cac09ecd0 0x7f3cac1314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f8fa811e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8fa0071380 0x7f8fa012bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7fd6837fe640 1 -- 172.21.15.104:0/1509868251 >> v1:172.21.15.104:6789/0 conn(0x7fd684071d10 legacy=0x7fd6840720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f8fa811e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa006de00 con 0x7f8fa0071ec0 2024-09-07T03:32:06.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f8fa811e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa0069380 con 0x7f8fa0071380 2024-09-07T03:32:06.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7fd6837fe640 1 -- 172.21.15.104:0/1509868251 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6840732f0 con 0x7fd68409ecd0 2024-09-07T03:32:06.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f3cb08c6640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cac073050 con 0x7f3cac071d10 2024-09-07T03:32:06.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f3cb08c6640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f3cac073600 con 0x7f3cac09ecd0 2024-09-07T03:32:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f816affd640 1 -- 172.21.15.104:0/2221422691 >> v1:172.21.15.104:6789/0 conn(0x7f816c12fa70 legacy=0x7f816c12bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f816affd640 1 -- 172.21.15.104:0/2221422691 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816c070860 con 0x7f816c12f640 2024-09-07T03:32:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f3caa59c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3cac071d10 0x7f3cac0720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38672/0 (socket says 172.21.15.104:38672) 2024-09-07T03:32:06.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f3caa59c640 1 -- 172.21.15.104:0/3762227694 learned_addr learned my addr 172.21.15.104:0/3762227694 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:06.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f8fa5eba640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8fa0071ec0 0x7f8fa012b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38678/0 (socket says 172.21.15.104:38678) 2024-09-07T03:32:06.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f8fa5eba640 1 -- 172.21.15.104:0/105659804 learned_addr learned my addr 172.21.15.104:0/105659804 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:06.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.151+0000 7f3ca9d9b640 1 --2- 172.21.15.104:0/3762227694 >> v2:172.21.15.104:3300/0 conn(0x7f3cac09ecd0 0x7f3cac1314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.152+0000 7f8fa56b9640 1 --2- 172.21.15.104:0/105659804 >> v2:172.21.15.104:3300/0 conn(0x7f8fa0071380 0x7f8fa012bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.152+0000 7f3ca9d9b640 1 -- 172.21.15.104:0/3762227694 >> v1:172.21.15.104:6789/0 conn(0x7f3cac071d10 legacy=0x7f3cac0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.152+0000 7f3ca9d9b640 1 -- 172.21.15.104:0/3762227694 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac0732f0 con 0x7f3cac09ecd0 2024-09-07T03:32:06.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.152+0000 7f8fa4eb8640 1 -- 172.21.15.104:0/105659804 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76227556 0 0) 0x7f8fa006de00 con 0x7f8fa0071ec0 2024-09-07T03:32:06.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.152+0000 7f8fa4eb8640 1 -- 172.21.15.104:0/105659804 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f8c003520 con 0x7f8fa0071ec0 2024-09-07T03:32:06.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.152+0000 7f8fa56b9640 1 -- 172.21.15.104:0/105659804 >> v1:172.21.15.104:6789/0 conn(0x7f8fa0071ec0 legacy=0x7f8fa012b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.152+0000 7f8fa56b9640 1 -- 172.21.15.104:0/105659804 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa009ecd0 con 0x7f8fa0071380 2024-09-07T03:32:06.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.152+0000 7f816affd640 1 --2- 172.21.15.104:0/2221422691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 0x7f816c12fe50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8160009720 tx=0x7f816002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28eefa941f7c7d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.152+0000 7f816a7fc640 1 -- 172.21.15.104:0/2221422691 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8160037070 con 0x7f816c12f640 2024-09-07T03:32:06.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7fd6837fe640 1 --2- 172.21.15.104:0/1509868251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68409ecd0 0x7fd6841314d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd67800ba90 tx=0x7fd67802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1defcd665dca09 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f3ca9d9b640 1 --2- 172.21.15.104:0/3762227694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac09ecd0 0x7f3cac1314d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009720 tx=0x7f3ca002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc532acffef59e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f816a7fc640 1 -- 172.21.15.104:0/2221422691 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f816002ad90 con 0x7f816c12f640 2024-09-07T03:32:06.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f816a7fc640 1 -- 172.21.15.104:0/2221422691 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8160032590 con 0x7f816c12f640 2024-09-07T03:32:06.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f3ca959a640 1 -- 172.21.15.104:0/3762227694 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ca0037070 con 0x7f3cac09ecd0 2024-09-07T03:32:06.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8fa56b9640 1 --2- 172.21.15.104:0/105659804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 0x7f8fa012bed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009750 tx=0x7f8f9002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e229f1eb56eee90d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f3ca959a640 1 -- 172.21.15.104:0/3762227694 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca002ad90 con 0x7f3cac09ecd0 2024-09-07T03:32:06.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7fd682ffd640 1 -- 172.21.15.104:0/1509868251 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd678033570 con 0x7fd68409ecd0 2024-09-07T03:32:06.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f3ca959a640 1 -- 172.21.15.104:0/3762227694 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ca0032590 con 0x7f3cac09ecd0 2024-09-07T03:32:06.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7fd682ffd640 1 -- 172.21.15.104:0/1509868251 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd678038070 con 0x7fd68409ecd0 2024-09-07T03:32:06.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7fd682ffd640 1 -- 172.21.15.104:0/1509868251 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd678033860 con 0x7fd68409ecd0 2024-09-07T03:32:06.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8fa4eb8640 1 -- 172.21.15.104:0/105659804 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f90037070 con 0x7f8fa0071380 2024-09-07T03:32:06.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8fa4eb8640 1 -- 172.21.15.104:0/105659804 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9002ad80 con 0x7f8fa0071380 2024-09-07T03:32:06.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8fa4eb8640 1 -- 172.21.15.104:0/105659804 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f90032590 con 0x7f8fa0071380 2024-09-07T03:32:06.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8171e96640 1 -- 172.21.15.104:0/2221422691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 msgr2=0x7f816c12fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8171e96640 1 --2- 172.21.15.104:0/2221422691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 0x7f816c12fe50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8160009720 tx=0x7f816002a110 comp rx=0 tx=0).stop 2024-09-07T03:32:06.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8171e96640 1 -- 172.21.15.104:0/2221422691 shutdown_connections 2024-09-07T03:32:06.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8171e96640 1 --2- 172.21.15.104:0/2221422691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 0x7f816c12fe50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8171e96640 1 -- 172.21.15.104:0/2221422691 >> 172.21.15.104:0/2221422691 conn(0x7f816c071da0 msgr2=0x7f816c0721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8171e96640 1 -- 172.21.15.104:0/2221422691 shutdown_connections 2024-09-07T03:32:06.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.153+0000 7f8171e96640 1 -- 172.21.15.104:0/2221422691 wait complete. 2024-09-07T03:32:06.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f3cb08c6640 1 -- 172.21.15.104:0/3762227694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac09ecd0 msgr2=0x7f3cac1314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f3cb08c6640 1 --2- 172.21.15.104:0/3762227694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac09ecd0 0x7f3cac1314d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009720 tx=0x7f3ca002a110 comp rx=0 tx=0).stop 2024-09-07T03:32:06.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1509868251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68409ecd0 msgr2=0x7fd6841314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7fd68a4eb640 1 --2- 172.21.15.104:0/1509868251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68409ecd0 0x7fd6841314d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd67800ba90 tx=0x7fd67802c8b0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f3cb08c6640 1 -- 172.21.15.104:0/3762227694 shutdown_connections 2024-09-07T03:32:06.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f3cb08c6640 1 --2- 172.21.15.104:0/3762227694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac09ecd0 0x7f3cac1314d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f3cb08c6640 1 -- 172.21.15.104:0/3762227694 >> 172.21.15.104:0/3762227694 conn(0x7f3cac09c640 msgr2=0x7f3cac06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1509868251 shutdown_connections 2024-09-07T03:32:06.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7fd68a4eb640 1 --2- 172.21.15.104:0/1509868251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd68409ecd0 0x7fd6841314d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1509868251 >> 172.21.15.104:0/1509868251 conn(0x7fd68409c640 msgr2=0x7fd68406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f3cb08c6640 1 -- 172.21.15.104:0/3762227694 shutdown_connections 2024-09-07T03:32:06.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1509868251 shutdown_connections 2024-09-07T03:32:06.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f3cb08c6640 1 -- 172.21.15.104:0/3762227694 wait complete. 2024-09-07T03:32:06.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1509868251 wait complete. 2024-09-07T03:32:06.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f8fa811e640 1 -- 172.21.15.104:0/105659804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 msgr2=0x7f8fa012bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f8fa811e640 1 --2- 172.21.15.104:0/105659804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 0x7f8fa012bed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009750 tx=0x7f8f9002a140 comp rx=0 tx=0).stop 2024-09-07T03:32:06.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f8fa811e640 1 -- 172.21.15.104:0/105659804 shutdown_connections 2024-09-07T03:32:06.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f8fa811e640 1 --2- 172.21.15.104:0/105659804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 0x7f8fa012bed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f8fa811e640 1 -- 172.21.15.104:0/105659804 >> 172.21.15.104:0/105659804 conn(0x7f8fa009c640 msgr2=0x7f8fa006ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f8fa811e640 1 -- 172.21.15.104:0/105659804 shutdown_connections 2024-09-07T03:32:06.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f8fa811e640 1 -- 172.21.15.104:0/105659804 wait complete. 2024-09-07T03:32:06.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.154+0000 7f8171e96640 1 Processor -- start 2024-09-07T03:32:06.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7f8171e96640 1 -- start start 2024-09-07T03:32:06.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7f3cb08c6640 1 Processor -- start 2024-09-07T03:32:06.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7f3cb08c6640 1 -- start start 2024-09-07T03:32:06.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7f8fa811e640 1 Processor -- start 2024-09-07T03:32:06.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7fd68a4eb640 1 Processor -- start 2024-09-07T03:32:06.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7f8fa811e640 1 -- start start 2024-09-07T03:32:06.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7f3cb08c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac071d10 0x7f3cac125200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7f8171e96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 0x7f816c11fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7f3cb08c6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac072980 con 0x7f3cac071d10 2024-09-07T03:32:06.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.155+0000 7f8171e96640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f816c12c770 con 0x7f816c12f640 2024-09-07T03:32:06.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7fd68a4eb640 1 -- start start 2024-09-07T03:32:06.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f816b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 0x7f816c11fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f3caa59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac071d10 0x7f3cac125200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f3caa59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac071d10 0x7f3cac125200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52418/0 (socket says 172.21.15.104:52418) 2024-09-07T03:32:06.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f816b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 0x7f816c11fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52428/0 (socket says 172.21.15.104:52428) 2024-09-07T03:32:06.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f816b7fe640 1 -- 172.21.15.104:0/4026908689 learned_addr learned my addr 172.21.15.104:0/4026908689 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:06.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f3caa59c640 1 -- 172.21.15.104:0/729916071 learned_addr learned my addr 172.21.15.104:0/729916071 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:06.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8fa811e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 0x7f8fa01c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f816b7fe640 1 -- 172.21.15.104:0/4026908689 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816c0a01c0 con 0x7f816c12f640 2024-09-07T03:32:06.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8fa811e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa0072b10 con 0x7f8fa0071380 2024-09-07T03:32:06.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f3caa59c640 1 -- 172.21.15.104:0/729916071 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac117990 con 0x7f3cac071d10 2024-09-07T03:32:06.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7fd68a4eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd684071d10 0x7fd6841148c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8fa5eba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 0x7f8fa01c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8fa5eba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 0x7f8fa01c0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52434/0 (socket says 172.21.15.104:52434) 2024-09-07T03:32:06.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8fa5eba640 1 -- 172.21.15.104:0/3101044052 learned_addr learned my addr 172.21.15.104:0/3101044052 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:06.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f3caa59c640 1 --2- 172.21.15.104:0/729916071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac071d10 0x7f3cac125200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00e8c0 tx=0x7f3c9c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f816b7fe640 1 --2- 172.21.15.104:0/4026908689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 0x7f816c11fc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f815c00c480 tx=0x7f815c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7fd68a4eb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd684072980 con 0x7fd684071d10 2024-09-07T03:32:06.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7fd683fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd684071d10 0x7fd6841148c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7fd683fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd684071d10 0x7fd6841148c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52446/0 (socket says 172.21.15.104:52446) 2024-09-07T03:32:06.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8153fff640 1 -- 172.21.15.104:0/4026908689 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f815c017070 con 0x7f816c12f640 2024-09-07T03:32:06.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8153fff640 1 -- 172.21.15.104:0/4026908689 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815c005c10 con 0x7f816c12f640 2024-09-07T03:32:06.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816c09f920 con 0x7f816c12f640 2024-09-07T03:32:06.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7fd683fff640 1 -- 172.21.15.104:0/1578989693 learned_addr learned my addr 172.21.15.104:0/1578989693 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:06.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8fa5eba640 1 -- 172.21.15.104:0/3101044052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa0073380 con 0x7f8fa0071380 2024-09-07T03:32:06.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8153fff640 1 -- 172.21.15.104:0/4026908689 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f815c007070 con 0x7f816c12f640 2024-09-07T03:32:06.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816c121720 con 0x7f816c12f640 2024-09-07T03:32:06.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f3c9affd640 1 -- 172.21.15.104:0/729916071 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c9c015070 con 0x7f3cac071d10 2024-09-07T03:32:06.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f3c9affd640 1 -- 172.21.15.104:0/729916071 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c9c005ae0 con 0x7f3cac071d10 2024-09-07T03:32:06.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.156+0000 7f3c9affd640 1 -- 172.21.15.104:0/729916071 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c9c005dc0 con 0x7f3cac071d10 2024-09-07T03:32:06.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.157+0000 7fd683fff640 1 -- 172.21.15.104:0/1578989693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd684117940 con 0x7fd684071d10 2024-09-07T03:32:06.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.157+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac117e10 con 0x7f3cac071d10 2024-09-07T03:32:06.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.157+0000 7f8fa5eba640 1 --2- 172.21.15.104:0/3101044052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 0x7f8fa01c0dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c480 tx=0x7f8f9c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.157+0000 7fd683fff640 1 --2- 172.21.15.104:0/1578989693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd684071d10 0x7fd6841148c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c3d0 tx=0x7fd67400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.157+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cac125920 con 0x7f3cac071d10 2024-09-07T03:32:06.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.157+0000 7fd680ff9640 1 -- 172.21.15.104:0/1578989693 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd674017070 con 0x7fd684071d10 2024-09-07T03:32:06.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd684117c70 con 0x7fd684071d10 2024-09-07T03:32:06.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.157+0000 7f8f967fc640 1 -- 172.21.15.104:0/3101044052 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c017070 con 0x7f8fa0071380 2024-09-07T03:32:06.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.157+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa011edb0 con 0x7f8fa0071380 2024-09-07T03:32:06.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.157+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa011e200 con 0x7f8fa0071380 2024-09-07T03:32:06.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7fd680ff9640 1 -- 172.21.15.104:0/1578989693 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd674005200 con 0x7fd684071d10 2024-09-07T03:32:06.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7fd680ff9640 1 -- 172.21.15.104:0/1578989693 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6740035f0 con 0x7fd684071d10 2024-09-07T03:32:06.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd684117300 con 0x7fd684071d10 2024-09-07T03:32:06.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f816c12cc20 con 0x7f816c12f640 2024-09-07T03:32:06.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7f8f967fc640 1 -- 172.21.15.104:0/3101044052 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c005cd0 con 0x7f8fa0071380 2024-09-07T03:32:06.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7f8153fff640 1 -- 172.21.15.104:0/4026908689 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f815c01a070 con 0x7f816c12f640 2024-09-07T03:32:06.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7f8f967fc640 1 -- 172.21.15.104:0/3101044052 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c007200 con 0x7f8fa0071380 2024-09-07T03:32:06.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7f3c9affd640 1 -- 172.21.15.104:0/729916071 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3c9c018070 con 0x7f3cac071d10 2024-09-07T03:32:06.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cac0720f0 con 0x7f3cac071d10 2024-09-07T03:32:06.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7f3c9affd640 1 --2- 172.21.15.104:0/729916071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3c8c03df30 0x7f3c8c0403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7f3c9affd640 1 -- 172.21.15.104:0/729916071 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f3c9c052110 con 0x7f3cac071d10 2024-09-07T03:32:06.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.158+0000 7f8153fff640 1 --2- 172.21.15.104:0/4026908689 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f815803dec0 0x7f8158040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7f8153fff640 1 -- 172.21.15.104:0/4026908689 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f815c0514f0 con 0x7f816c12f640 2024-09-07T03:32:06.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7fd680ff9640 1 -- 172.21.15.104:0/1578989693 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd67401a070 con 0x7fd684071d10 2024-09-07T03:32:06.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7f816affd640 1 --2- 172.21.15.104:0/4026908689 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f815803dec0 0x7f8158040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7f3ca9d9b640 1 --2- 172.21.15.104:0/729916071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3c8c03df30 0x7f3c8c0403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd684116fc0 con 0x7fd684071d10 2024-09-07T03:32:06.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7fd680ff9640 1 --2- 172.21.15.104:0/1578989693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd67003de90 0x7fd670040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7fd680ff9640 1 -- 172.21.15.104:0/1578989693 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fd674051510 con 0x7fd684071d10 2024-09-07T03:32:06.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.159+0000 7f816affd640 1 --2- 172.21.15.104:0/4026908689 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f815803dec0 0x7f8158040380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8160034000 tx=0x7f816002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.160+0000 7f3ca9d9b640 1 --2- 172.21.15.104:0/729916071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3c8c03df30 0x7f3c8c0403f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0034000 tx=0x7f3ca002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.160+0000 7fd6837fe640 1 --2- 172.21.15.104:0/1578989693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd67003de90 0x7fd670040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.160+0000 7f8f967fc640 1 -- 172.21.15.104:0/3101044052 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8f9c01a070 con 0x7f8fa0071380 2024-09-07T03:32:06.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.160+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa012b7c0 con 0x7f8fa0071380 2024-09-07T03:32:06.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.160+0000 7f8f967fc640 1 --2- 172.21.15.104:0/3101044052 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f8403de90 0x7f8f84040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:06.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.160+0000 7f8f967fc640 1 -- 172.21.15.104:0/3101044052 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f8f9c051600 con 0x7f8fa0071380 2024-09-07T03:32:06.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.160+0000 7fd6837fe640 1 --2- 172.21.15.104:0/1578989693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd67003de90 0x7fd670040350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd678037000 tx=0x7fd678008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.160+0000 7f8fa56b9640 1 --2- 172.21.15.104:0/3101044052 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f8403de90 0x7f8f84040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:06.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.161+0000 7f8fa56b9640 1 --2- 172.21.15.104:0/3101044052 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f8403de90 0x7f8f84040350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009750 tx=0x7f8f9002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:06.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.164+0000 7f8153fff640 1 -- 172.21.15.104:0/4026908689 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f815c019cd0 con 0x7f816c12f640 2024-09-07T03:32:06.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.168+0000 7f3c9affd640 1 -- 172.21.15.104:0/729916071 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f3c9c01f070 con 0x7f3cac071d10 2024-09-07T03:32:06.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.173+0000 7f8f967fc640 1 -- 172.21.15.104:0/3101044052 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f8fa0073380 con 0x7f8fa0071380 2024-09-07T03:32:06.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.177+0000 7fd680ff9640 1 -- 172.21.15.104:0/1578989693 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fd684116fc0 con 0x7fd684071d10 2024-09-07T03:32:06.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.361+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f816c068da0 con 0x7f816c12f640 2024-09-07T03:32:06.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.361+0000 7f8153fff640 1 -- 172.21.15.104:0/4026908689 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f815c019cd0 con 0x7f816c12f640 2024-09-07T03:32:06.363 INFO:teuthology.orchestra.run.smithi104.stdout:47244640261 2024-09-07T03:32:06.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f815803dec0 msgr2=0x7f8158040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 --2- 172.21.15.104:0/4026908689 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f815803dec0 0x7f8158040380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8160034000 tx=0x7f816002e000 comp rx=0 tx=0).stop 2024-09-07T03:32:06.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 msgr2=0x7f816c11fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 --2- 172.21.15.104:0/4026908689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 0x7f816c11fc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f815c00c480 tx=0x7f815c00c940 comp rx=0 tx=0).stop 2024-09-07T03:32:06.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 shutdown_connections 2024-09-07T03:32:06.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 --2- 172.21.15.104:0/4026908689 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f815803dec0 0x7f8158040380 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 --2- 172.21.15.104:0/4026908689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f816c12f640 0x7f816c11fc70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 >> 172.21.15.104:0/4026908689 conn(0x7f816c071da0 msgr2=0x7f816c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 shutdown_connections 2024-09-07T03:32:06.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.364+0000 7f8171e96640 1 -- 172.21.15.104:0/4026908689 wait complete. 2024-09-07T03:32:06.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.376+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd6840720f0 con 0x7fd684071d10 2024-09-07T03:32:06.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.376+0000 7fd680ff9640 1 -- 172.21.15.104:0/1578989693 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd684117940 con 0x7fd684071d10 2024-09-07T03:32:06.379 INFO:teuthology.orchestra.run.smithi104.stdout:47244640261 2024-09-07T03:32:06.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.0 2024-09-07T03:32:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd67003de90 msgr2=0x7fd670040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 --2- 172.21.15.104:0/1578989693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd67003de90 0x7fd670040350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd678037000 tx=0x7fd678008040 comp rx=0 tx=0).stop 2024-09-07T03:32:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd684071d10 msgr2=0x7fd6841148c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 --2- 172.21.15.104:0/1578989693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd684071d10 0x7fd6841148c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c3d0 tx=0x7fd67400c890 comp rx=0 tx=0).stop 2024-09-07T03:32:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 shutdown_connections 2024-09-07T03:32:06.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 --2- 172.21.15.104:0/1578989693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd67003de90 0x7fd670040350 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 --2- 172.21.15.104:0/1578989693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd684071d10 0x7fd6841148c0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c3d0 tx=0x7fd67400c890 comp rx=0 tx=0).stop 2024-09-07T03:32:06.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 >> 172.21.15.104:0/1578989693 conn(0x7fd68409c640 msgr2=0x7fd68409d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 shutdown_connections 2024-09-07T03:32:06.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.379+0000 7fd68a4eb640 1 -- 172.21.15.104:0/1578989693 wait complete. 2024-09-07T03:32:06.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.383+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3cac068da0 con 0x7f3cac071d10 2024-09-07T03:32:06.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.383+0000 7f3c9affd640 1 -- 172.21.15.104:0/729916071 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3cac073050 con 0x7f3cac071d10 2024-09-07T03:32:06.385 INFO:teuthology.orchestra.run.smithi104.stdout:47244640261 2024-09-07T03:32:06.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.385+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3c8c03df30 msgr2=0x7f3c8c0403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.385+0000 7f3cb08c6640 1 --2- 172.21.15.104:0/729916071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3c8c03df30 0x7f3c8c0403f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0034000 tx=0x7f3ca002e000 comp rx=0 tx=0).stop 2024-09-07T03:32:06.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.385+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac071d10 msgr2=0x7f3cac125200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.385+0000 7f3cb08c6640 1 --2- 172.21.15.104:0/729916071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac071d10 0x7f3cac125200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00e8c0 tx=0x7f3c9c00ed80 comp rx=0 tx=0).stop 2024-09-07T03:32:06.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.386+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 shutdown_connections 2024-09-07T03:32:06.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.386+0000 7f3cb08c6640 1 --2- 172.21.15.104:0/729916071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3c8c03df30 0x7f3c8c0403f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.386+0000 7f3cb08c6640 1 --2- 172.21.15.104:0/729916071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cac071d10 0x7f3cac125200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.386+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 >> 172.21.15.104:0/729916071 conn(0x7f3cac09c640 msgr2=0x7f3cac128930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.386+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 shutdown_connections 2024-09-07T03:32:06.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.386+0000 7f3cb08c6640 1 -- 172.21.15.104:0/729916071 wait complete. 2024-09-07T03:32:06.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.3 2024-09-07T03:32:06.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.393+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8fa011dd60 con 0x7f8fa0071380 2024-09-07T03:32:06.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.393+0000 7f8f967fc640 1 -- 172.21.15.104:0/3101044052 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f9c01b3b0 con 0x7f8fa0071380 2024-09-07T03:32:06.397 INFO:teuthology.orchestra.run.smithi104.stdout:38654705668 2024-09-07T03:32:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.395+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f8403de90 msgr2=0x7f8f84040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.395+0000 7f8fa811e640 1 --2- 172.21.15.104:0/3101044052 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f8403de90 0x7f8f84040350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009750 tx=0x7f8f9002e000 comp rx=0 tx=0).stop 2024-09-07T03:32:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.395+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 msgr2=0x7f8fa01c0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.395+0000 7f8fa811e640 1 --2- 172.21.15.104:0/3101044052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 0x7f8fa01c0dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c480 tx=0x7f8f9c00c940 comp rx=0 tx=0).stop 2024-09-07T03:32:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.395+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 shutdown_connections 2024-09-07T03:32:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.395+0000 7f8fa811e640 1 --2- 172.21.15.104:0/3101044052 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f8403de90 0x7f8f84040350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.395+0000 7f8fa811e640 1 --2- 172.21.15.104:0/3101044052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8fa0071380 0x7f8fa01c0dd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.395+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 >> 172.21.15.104:0/3101044052 conn(0x7f8fa009c640 msgr2=0x7f8fa006ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:06.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.396+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 shutdown_connections 2024-09-07T03:32:06.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:06.396+0000 7f8fa811e640 1 -- 172.21.15.104:0/3101044052 wait complete. 2024-09-07T03:32:06.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.2 2024-09-07T03:32:06.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-09-07T03:32:07.382 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-07T03:32:07.393 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-07T03:32:07.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-07T03:32:07.409 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-07T03:32:07.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.487+0000 7f93ec7a3640 1 Processor -- start 2024-09-07T03:32:07.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.487+0000 7f93ec7a3640 1 -- start start 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93ec7a3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f93e4070960 0x7f93e4134780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93ec7a3640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e4071680 con 0x7f93e406fe70 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93ec7a3640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f93e40a30e0 con 0x7f93e4070960 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93ea53f640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f93e406fe70 0x7f93e4070250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38690/0 (socket says 172.21.15.104:38690) 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93ea53f640 1 -- 172.21.15.104:0/2212771215 learned_addr learned my addr 172.21.15.104:0/2212771215 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93e9d3e640 1 --2- 172.21.15.104:0/2212771215 >> v2:172.21.15.104:3300/0 conn(0x7f93e4070960 0x7f93e4134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93e953d640 1 -- 172.21.15.104:0/2212771215 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488347289 0 0) 0x7f93e4071680 con 0x7f93e406fe70 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93e953d640 1 -- 172.21.15.104:0/2212771215 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93d0003520 con 0x7f93e406fe70 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93e9d3e640 1 -- 172.21.15.104:0/2212771215 >> v1:172.21.15.104:6789/0 conn(0x7f93e406fe70 legacy=0x7f93e4070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.488+0000 7f93e9d3e640 1 -- 172.21.15.104:0/2212771215 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e4071dd0 con 0x7f93e4070960 2024-09-07T03:32:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.489+0000 7f93e9d3e640 1 --2- 172.21.15.104:0/2212771215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e4070960 0x7f93e4134780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009720 tx=0x7f93d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1194f1c34cc540b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.490+0000 7f93e953d640 1 -- 172.21.15.104:0/2212771215 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d4037070 con 0x7f93e4070960 2024-09-07T03:32:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.490+0000 7f93e953d640 1 -- 172.21.15.104:0/2212771215 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d402ad90 con 0x7f93e4070960 2024-09-07T03:32:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.490+0000 7f93e953d640 1 -- 172.21.15.104:0/2212771215 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d4032590 con 0x7f93e4070960 2024-09-07T03:32:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.490+0000 7f93ec7a3640 1 -- 172.21.15.104:0/2212771215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e4070960 msgr2=0x7f93e4134780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.490+0000 7f93ec7a3640 1 --2- 172.21.15.104:0/2212771215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e4070960 0x7f93e4134780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009720 tx=0x7f93d402a110 comp rx=0 tx=0).stop 2024-09-07T03:32:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.490+0000 7f93ec7a3640 1 -- 172.21.15.104:0/2212771215 shutdown_connections 2024-09-07T03:32:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.490+0000 7f93ec7a3640 1 --2- 172.21.15.104:0/2212771215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e4070960 0x7f93e4134780 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.490+0000 7f93ec7a3640 1 -- 172.21.15.104:0/2212771215 >> 172.21.15.104:0/2212771215 conn(0x7f93e40a0a50 msgr2=0x7f93e406e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.491+0000 7f93ec7a3640 1 -- 172.21.15.104:0/2212771215 shutdown_connections 2024-09-07T03:32:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.491+0000 7f93ec7a3640 1 -- 172.21.15.104:0/2212771215 wait complete. 2024-09-07T03:32:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.491+0000 7f93ec7a3640 1 Processor -- start 2024-09-07T03:32:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.491+0000 7f93ec7a3640 1 -- start start 2024-09-07T03:32:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.492+0000 7f93ec7a3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406fe70 0x7f93e411ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.492+0000 7f93ec7a3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4075cc0 con 0x7f93e406fe70 2024-09-07T03:32:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.492+0000 7f93ea53f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406fe70 0x7f93e411ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.492+0000 7f93ea53f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406fe70 0x7f93e411ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52462/0 (socket says 172.21.15.104:52462) 2024-09-07T03:32:07.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.492+0000 7f93ea53f640 1 -- 172.21.15.104:0/3408387638 learned_addr learned my addr 172.21.15.104:0/3408387638 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:07.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.492+0000 7f93ea53f640 1 -- 172.21.15.104:0/3408387638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e411c380 con 0x7f93e406fe70 2024-09-07T03:32:07.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.492+0000 7f93ea53f640 1 --2- 172.21.15.104:0/3408387638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406fe70 0x7f93e411ac50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93e0001eb0 tx=0x7f93e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.493+0000 7f93daffd640 1 -- 172.21.15.104:0/3408387638 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e0007410 con 0x7f93e406fe70 2024-09-07T03:32:07.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.493+0000 7f93daffd640 1 -- 172.21.15.104:0/3408387638 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e00075d0 con 0x7f93e406fe70 2024-09-07T03:32:07.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.493+0000 7f93daffd640 1 -- 172.21.15.104:0/3408387638 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e0004950 con 0x7f93e406fe70 2024-09-07T03:32:07.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.493+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e411d060 con 0x7f93e406fe70 2024-09-07T03:32:07.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.493+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e411dc20 con 0x7f93e406fe70 2024-09-07T03:32:07.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.494+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e4134c40 con 0x7f93e406fe70 2024-09-07T03:32:07.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.494+0000 7f93daffd640 1 -- 172.21.15.104:0/3408387638 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f93e0011070 con 0x7f93e406fe70 2024-09-07T03:32:07.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.494+0000 7f93daffd640 1 --2- 172.21.15.104:0/3408387638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f93c803dec0 0x7f93c8040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.494+0000 7f93daffd640 1 -- 172.21.15.104:0/3408387638 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f93e0051db0 con 0x7f93e406fe70 2024-09-07T03:32:07.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.495+0000 7f93e9d3e640 1 --2- 172.21.15.104:0/3408387638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f93c803dec0 0x7f93c8040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.495+0000 7f93e9d3e640 1 --2- 172.21.15.104:0/3408387638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f93c803dec0 0x7f93c8040380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93d4034000 tx=0x7f93d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.503+0000 7f93daffd640 1 -- 172.21.15.104:0/3408387638 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f93e0010d80 con 0x7f93e406fe70 2024-09-07T03:32:07.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7ff0c0f10640 1 Processor -- start 2024-09-07T03:32:07.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7f13136a2640 1 Processor -- start 2024-09-07T03:32:07.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7ff0c0f10640 1 -- start start 2024-09-07T03:32:07.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7f13136a2640 1 -- start start 2024-09-07T03:32:07.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7f13136a2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f130c06fe70 0x7f130c070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7f13136a2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c071680 con 0x7f130c070790 2024-09-07T03:32:07.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7f13136a2640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f130c0a30e0 con 0x7f130c06fe70 2024-09-07T03:32:07.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7ff0c0f10640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff0bc070e60 0x7ff0bc138c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7f1310c3d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f130c070790 0x7f130c12ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38700/0 (socket says 172.21.15.104:38700) 2024-09-07T03:32:07.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7ff0c0f10640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0bc071eb0 con 0x7ff0bc070370 2024-09-07T03:32:07.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.528+0000 7ff0c0f10640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7ff0bc069380 con 0x7ff0bc070e60 2024-09-07T03:32:07.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7ff0b9d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff0bc070e60 0x7ff0bc138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7ff0b9d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff0bc070e60 0x7ff0bc138c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52478/0 (socket says 172.21.15.104:52478) 2024-09-07T03:32:07.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7ff0b9d9b640 1 -- 172.21.15.104:0/116099925 learned_addr learned my addr 172.21.15.104:0/116099925 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:07.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7f131143e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f130c06fe70 0x7f130c070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7f1310c3d640 1 -- 172.21.15.104:0/1487029160 learned_addr learned my addr 172.21.15.104:0/1487029160 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:07.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7f1303fff640 1 -- 172.21.15.104:0/1487029160 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359916171 0 0) 0x7f130c071680 con 0x7f130c070790 2024-09-07T03:32:07.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7ff0b9d9b640 1 -- 172.21.15.104:0/116099925 >> v1:172.21.15.104:6789/0 conn(0x7ff0bc070370 legacy=0x7ff0bc070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7ff0b9d9b640 1 -- 172.21.15.104:0/116099925 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc0721e0 con 0x7ff0bc070e60 2024-09-07T03:32:07.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7f1303fff640 1 -- 172.21.15.104:0/1487029160 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12f8003520 con 0x7f130c070790 2024-09-07T03:32:07.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7f131143e640 1 -- 172.21.15.104:0/1487029160 >> v1:172.21.15.104:6789/0 conn(0x7f130c070790 legacy=0x7f130c12ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.529+0000 7f131143e640 1 -- 172.21.15.104:0/1487029160 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c071dd0 con 0x7f130c06fe70 2024-09-07T03:32:07.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.530+0000 7ff0b9d9b640 1 --2- 172.21.15.104:0/116099925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070e60 0x7ff0bc138c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00097f0 tx=0x7ff0b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa78e9f926b0c907 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.530+0000 7ff0b959a640 1 -- 172.21.15.104:0/116099925 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b0037070 con 0x7ff0bc070e60 2024-09-07T03:32:07.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.530+0000 7ff0b959a640 1 -- 172.21.15.104:0/116099925 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b0032440 con 0x7ff0bc070e60 2024-09-07T03:32:07.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.530+0000 7ff0b959a640 1 -- 172.21.15.104:0/116099925 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b002ae60 con 0x7ff0bc070e60 2024-09-07T03:32:07.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.530+0000 7f131143e640 1 --2- 172.21.15.104:0/1487029160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 0x7f130c070250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1308009720 tx=0x7f130802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8300cca7493c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.530+0000 7f1303fff640 1 -- 172.21.15.104:0/1487029160 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1308037070 con 0x7f130c06fe70 2024-09-07T03:32:07.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.530+0000 7f1303fff640 1 -- 172.21.15.104:0/1487029160 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f130802ad90 con 0x7f130c06fe70 2024-09-07T03:32:07.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.530+0000 7f1303fff640 1 -- 172.21.15.104:0/1487029160 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1308032590 con 0x7f130c06fe70 2024-09-07T03:32:07.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f37652bf640 1 Processor -- start 2024-09-07T03:32:07.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f37652bf640 1 -- start start 2024-09-07T03:32:07.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7ff0c0f10640 1 -- 172.21.15.104:0/116099925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070e60 msgr2=0x7ff0bc138c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7ff0c0f10640 1 --2- 172.21.15.104:0/116099925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070e60 0x7ff0bc138c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00097f0 tx=0x7ff0b002a1e0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7ff0c0f10640 1 -- 172.21.15.104:0/116099925 shutdown_connections 2024-09-07T03:32:07.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7ff0c0f10640 1 --2- 172.21.15.104:0/116099925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070e60 0x7ff0bc138c20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7ff0c0f10640 1 -- 172.21.15.104:0/116099925 >> 172.21.15.104:0/116099925 conn(0x7ff0bc09c640 msgr2=0x7ff0bc06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:07.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f37652bf640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3760125890 0x7f3760125c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f37652bf640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f376006fe70 con 0x7f376006ed40 2024-09-07T03:32:07.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f37652bf640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f3760117030 con 0x7f3760125890 2024-09-07T03:32:07.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f13136a2640 1 -- 172.21.15.104:0/1487029160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 msgr2=0x7f130c070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f13136a2640 1 --2- 172.21.15.104:0/1487029160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 0x7f130c070250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1308009720 tx=0x7f130802a110 comp rx=0 tx=0).stop 2024-09-07T03:32:07.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f13136a2640 1 -- 172.21.15.104:0/1487029160 shutdown_connections 2024-09-07T03:32:07.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f13136a2640 1 --2- 172.21.15.104:0/1487029160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 0x7f130c070250 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f13136a2640 1 -- 172.21.15.104:0/1487029160 >> 172.21.15.104:0/1487029160 conn(0x7f130c0a0a50 msgr2=0x7f130c06e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:07.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7ff0c0f10640 1 -- 172.21.15.104:0/116099925 shutdown_connections 2024-09-07T03:32:07.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7ff0c0f10640 1 -- 172.21.15.104:0/116099925 wait complete. 2024-09-07T03:32:07.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f375effd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3760125890 0x7f3760125c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f3757fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f376006ed40 0x7f376006f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38718/0 (socket says 172.21.15.104:38718) 2024-09-07T03:32:07.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f3757fff640 1 -- 172.21.15.104:0/1565184428 learned_addr learned my addr 172.21.15.104:0/1565184428 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:07.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f13136a2640 1 -- 172.21.15.104:0/1487029160 shutdown_connections 2024-09-07T03:32:07.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.531+0000 7f13136a2640 1 -- 172.21.15.104:0/1487029160 wait complete. 2024-09-07T03:32:07.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.532+0000 7f375effd640 1 -- 172.21.15.104:0/1565184428 >> v1:172.21.15.104:6789/0 conn(0x7f376006ed40 legacy=0x7f376006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.532+0000 7f375e7fc640 1 -- 172.21.15.104:0/1565184428 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57397818 0 0) 0x7f376006fe70 con 0x7f376006ed40 2024-09-07T03:32:07.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.532+0000 7f375effd640 1 -- 172.21.15.104:0/1565184428 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3760116c90 con 0x7f3760125890 2024-09-07T03:32:07.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f13136a2640 1 Processor -- start 2024-09-07T03:32:07.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f13136a2640 1 -- start start 2024-09-07T03:32:07.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f375effd640 1 --2- 172.21.15.104:0/1565184428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3760125890 0x7f3760125c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3750009720 tx=0x7f375002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acbcb80880dfef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7ff0c0f10640 1 Processor -- start 2024-09-07T03:32:07.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7ff0c0f10640 1 -- start start 2024-09-07T03:32:07.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f375e7fc640 1 -- 172.21.15.104:0/1565184428 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3750037070 con 0x7f3760125890 2024-09-07T03:32:07.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f375e7fc640 1 -- 172.21.15.104:0/1565184428 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375002ae20 con 0x7f3760125890 2024-09-07T03:32:07.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f375e7fc640 1 -- 172.21.15.104:0/1565184428 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3750032590 con 0x7f3760125890 2024-09-07T03:32:07.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f13136a2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 0x7f130c11d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f13136a2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f130c075cc0 con 0x7f130c06fe70 2024-09-07T03:32:07.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f131143e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 0x7f130c11d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f131143e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 0x7f130c11d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52502/0 (socket says 172.21.15.104:52502) 2024-09-07T03:32:07.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7ff0c0f10640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070370 0x7ff0bc131540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7f131143e640 1 -- 172.21.15.104:0/46337734 learned_addr learned my addr 172.21.15.104:0/46337734 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:07.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f131143e640 1 -- 172.21.15.104:0/46337734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c120250 con 0x7f130c06fe70 2024-09-07T03:32:07.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f37652bf640 1 -- 172.21.15.104:0/1565184428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3760125890 msgr2=0x7f3760125c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f37652bf640 1 --2- 172.21.15.104:0/1565184428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3760125890 0x7f3760125c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3750009720 tx=0x7f375002a1a0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.533+0000 7ff0c0f10640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc09ee50 con 0x7ff0bc070370 2024-09-07T03:32:07.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7ff0ba59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070370 0x7ff0bc131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7ff0ba59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070370 0x7ff0bc131540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52514/0 (socket says 172.21.15.104:52514) 2024-09-07T03:32:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7ff0ba59c640 1 -- 172.21.15.104:0/3656761485 learned_addr learned my addr 172.21.15.104:0/3656761485 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f131143e640 1 --2- 172.21.15.104:0/46337734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 0x7f130c11d0e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1308000c00 tx=0x7f13080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f37652bf640 1 -- 172.21.15.104:0/1565184428 shutdown_connections 2024-09-07T03:32:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f37652bf640 1 --2- 172.21.15.104:0/1565184428 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3760125890 0x7f3760125c70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f37652bf640 1 -- 172.21.15.104:0/1565184428 >> 172.21.15.104:0/1565184428 conn(0x7f3760071580 msgr2=0x7f376009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f1301ffb640 1 -- 172.21.15.104:0/46337734 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1308041070 con 0x7f130c06fe70 2024-09-07T03:32:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f37652bf640 1 -- 172.21.15.104:0/1565184428 shutdown_connections 2024-09-07T03:32:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f1301ffb640 1 -- 172.21.15.104:0/46337734 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f130803c460 con 0x7f130c06fe70 2024-09-07T03:32:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f1301ffb640 1 -- 172.21.15.104:0/46337734 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1308037040 con 0x7f130c06fe70 2024-09-07T03:32:07.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130c11e810 con 0x7f130c06fe70 2024-09-07T03:32:07.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7ff0ba59c640 1 -- 172.21.15.104:0/3656761485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc123c90 con 0x7ff0bc070370 2024-09-07T03:32:07.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7ff0ba59c640 1 --2- 172.21.15.104:0/3656761485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070370 0x7ff0bc131540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00c480 tx=0x7ff0ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130c1204f0 con 0x7f130c06fe70 2024-09-07T03:32:07.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.534+0000 7f37652bf640 1 -- 172.21.15.104:0/1565184428 wait complete. 2024-09-07T03:32:07.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.535+0000 7ff0aaffd640 1 -- 172.21.15.104:0/3656761485 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac017070 con 0x7ff0bc070370 2024-09-07T03:32:07.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.535+0000 7ff0aaffd640 1 -- 172.21.15.104:0/3656761485 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac005200 con 0x7ff0bc070370 2024-09-07T03:32:07.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.535+0000 7ff0aaffd640 1 -- 172.21.15.104:0/3656761485 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac0035f0 con 0x7ff0bc070370 2024-09-07T03:32:07.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.535+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0bc124130 con 0x7ff0bc070370 2024-09-07T03:32:07.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.535+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0bc131c60 con 0x7ff0bc070370 2024-09-07T03:32:07.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.535+0000 7f37652bf640 1 Processor -- start 2024-09-07T03:32:07.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.535+0000 7f1301ffb640 1 -- 172.21.15.104:0/46337734 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1308044070 con 0x7f130c06fe70 2024-09-07T03:32:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.536+0000 7f1301ffb640 1 --2- 172.21.15.104:0/46337734 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f12f003dec0 0x7f12f0040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.536+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f130c070250 con 0x7f130c06fe70 2024-09-07T03:32:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.536+0000 7f37652bf640 1 -- start start 2024-09-07T03:32:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.536+0000 7ff0aaffd640 1 -- 172.21.15.104:0/3656761485 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff0ac01a070 con 0x7ff0bc070370 2024-09-07T03:32:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.536+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a0005080 con 0x7ff0bc070370 2024-09-07T03:32:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.536+0000 7ff0aaffd640 1 --2- 172.21.15.104:0/3656761485 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff09c03de90 0x7ff09c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.536+0000 7ff0aaffd640 1 -- 172.21.15.104:0/3656761485 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7ff0ac051570 con 0x7ff0bc070370 2024-09-07T03:32:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.536+0000 7f1301ffb640 1 -- 172.21.15.104:0/46337734 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f13080728a0 con 0x7f130c06fe70 2024-09-07T03:32:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.536+0000 7f1310c3d640 1 --2- 172.21.15.104:0/46337734 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f12f003dec0 0x7f12f0040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7ff0b9d9b640 1 --2- 172.21.15.104:0/3656761485 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff09c03de90 0x7ff09c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7f37652bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f376006ed40 0x7f376011a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7f37652bf640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f37601261b0 con 0x7f376006ed40 2024-09-07T03:32:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7f375effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f376006ed40 0x7f376011a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7f375effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f376006ed40 0x7f376011a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52524/0 (socket says 172.21.15.104:52524) 2024-09-07T03:32:07.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7f375effd640 1 -- 172.21.15.104:0/554015275 learned_addr learned my addr 172.21.15.104:0/554015275 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:07.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7f1310c3d640 1 --2- 172.21.15.104:0/46337734 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f12f003dec0 0x7f12f0040380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12fc001610 tx=0x7f12fc0078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7f375effd640 1 -- 172.21.15.104:0/554015275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376011bba0 con 0x7f376006ed40 2024-09-07T03:32:07.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7ff0b9d9b640 1 --2- 172.21.15.104:0/3656761485 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff09c03de90 0x7ff09c040350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0034000 tx=0x7ff0b002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.537+0000 7f375effd640 1 --2- 172.21.15.104:0/554015275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f376006ed40 0x7f376011a280 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f375002a1e0 tx=0x7f37500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.541+0000 7f1301ffb640 1 -- 172.21.15.104:0/46337734 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f130c120250 con 0x7f130c06fe70 2024-09-07T03:32:07.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.549+0000 7f37577fe640 1 -- 172.21.15.104:0/554015275 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3750042070 con 0x7f376006ed40 2024-09-07T03:32:07.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.550+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376011cfb0 con 0x7f376006ed40 2024-09-07T03:32:07.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.550+0000 7ff0aaffd640 1 -- 172.21.15.104:0/3656761485 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7ff0bc071eb0 con 0x7ff0bc070370 2024-09-07T03:32:07.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.550+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376011a9a0 con 0x7f376006ed40 2024-09-07T03:32:07.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.551+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f376011d390 con 0x7f376006ed40 2024-09-07T03:32:07.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.551+0000 7f37577fe640 1 -- 172.21.15.104:0/554015275 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375003e7a0 con 0x7f376006ed40 2024-09-07T03:32:07.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.551+0000 7f37577fe640 1 -- 172.21.15.104:0/554015275 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375004c060 con 0x7f376006ed40 2024-09-07T03:32:07.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.552+0000 7f37577fe640 1 -- 172.21.15.104:0/554015275 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3750045070 con 0x7f376006ed40 2024-09-07T03:32:07.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.553+0000 7f37577fe640 1 --2- 172.21.15.104:0/554015275 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374003dec0 0x7f3740040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.553+0000 7f37577fe640 1 -- 172.21.15.104:0/554015275 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f3750073570 con 0x7f376006ed40 2024-09-07T03:32:07.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.553+0000 7f3757fff640 1 --2- 172.21.15.104:0/554015275 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374003dec0 0x7f3740040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.554+0000 7f3757fff640 1 --2- 172.21.15.104:0/554015275 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374003dec0 0x7f3740040380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3748001220 tx=0x7f37480078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.556+0000 7f37577fe640 1 -- 172.21.15.104:0/554015275 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f375002ae20 con 0x7f376006ed40 2024-09-07T03:32:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.688+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f93e4070250 con 0x7f93e406fe70 2024-09-07T03:32:07.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.689+0000 7f93daffd640 1 -- 172.21.15.104:0/3408387638 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93e0012d90 con 0x7f93e406fe70 2024-09-07T03:32:07.691 INFO:teuthology.orchestra.run.smithi104.stdout:47244640263 2024-09-07T03:32:07.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f93c803dec0 msgr2=0x7f93c8040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 --2- 172.21.15.104:0/3408387638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f93c803dec0 0x7f93c8040380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93d4034000 tx=0x7f93d402e000 comp rx=0 tx=0).stop 2024-09-07T03:32:07.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406fe70 msgr2=0x7f93e411ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 --2- 172.21.15.104:0/3408387638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406fe70 0x7f93e411ac50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93e0001eb0 tx=0x7f93e000c8e0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 shutdown_connections 2024-09-07T03:32:07.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 --2- 172.21.15.104:0/3408387638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f93c803dec0 0x7f93c8040380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 --2- 172.21.15.104:0/3408387638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93e406fe70 0x7f93e411ac50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 >> 172.21.15.104:0/3408387638 conn(0x7f93e40a0a50 msgr2=0x7f93e412bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:07.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 shutdown_connections 2024-09-07T03:32:07.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.691+0000 7f93ec7a3640 1 -- 172.21.15.104:0/3408387638 wait complete. 2024-09-07T03:32:07.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640263 for osd.0 2024-09-07T03:32:07.708 DEBUG:teuthology.parallel:result is None 2024-09-07T03:32:07.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.731+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff0a0005370 con 0x7ff0bc070370 2024-09-07T03:32:07.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.732+0000 7ff0aaffd640 1 -- 172.21.15.104:0/3656761485 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff0ac011590 con 0x7ff0bc070370 2024-09-07T03:32:07.734 INFO:teuthology.orchestra.run.smithi104.stdout:38654705669 2024-09-07T03:32:07.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff09c03de90 msgr2=0x7ff09c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 --2- 172.21.15.104:0/3656761485 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff09c03de90 0x7ff09c040350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0034000 tx=0x7ff0b002e000 comp rx=0 tx=0).stop 2024-09-07T03:32:07.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070370 msgr2=0x7ff0bc131540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 --2- 172.21.15.104:0/3656761485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070370 0x7ff0bc131540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00c480 tx=0x7ff0ac00c940 comp rx=0 tx=0).stop 2024-09-07T03:32:07.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 shutdown_connections 2024-09-07T03:32:07.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 --2- 172.21.15.104:0/3656761485 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff09c03de90 0x7ff09c040350 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 --2- 172.21.15.104:0/3656761485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0bc070370 0x7ff0bc131540 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 >> 172.21.15.104:0/3656761485 conn(0x7ff0bc09c640 msgr2=0x7ff0bc09ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:07.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 shutdown_connections 2024-09-07T03:32:07.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.734+0000 7ff0c0f10640 1 -- 172.21.15.104:0/3656761485 wait complete. 2024-09-07T03:32:07.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.735+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f130c068da0 con 0x7f130c06fe70 2024-09-07T03:32:07.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.736+0000 7f1301ffb640 1 -- 172.21.15.104:0/46337734 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f130803c760 con 0x7f130c06fe70 2024-09-07T03:32:07.738 INFO:teuthology.orchestra.run.smithi104.stdout:47244640263 2024-09-07T03:32:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f12f003dec0 msgr2=0x7f12f0040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 --2- 172.21.15.104:0/46337734 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f12f003dec0 0x7f12f0040380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12fc001610 tx=0x7f12fc0078f0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 msgr2=0x7f130c11d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 --2- 172.21.15.104:0/46337734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 0x7f130c11d0e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1308000c00 tx=0x7f13080046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 shutdown_connections 2024-09-07T03:32:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 --2- 172.21.15.104:0/46337734 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f12f003dec0 0x7f12f0040380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 --2- 172.21.15.104:0/46337734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f130c06fe70 0x7f130c11d0e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 >> 172.21.15.104:0/46337734 conn(0x7f130c0a0a50 msgr2=0x7f130c12e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 shutdown_connections 2024-09-07T03:32:07.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.738+0000 7f13136a2640 1 -- 172.21.15.104:0/46337734 wait complete. 2024-09-07T03:32:07.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.740+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f376011c880 con 0x7f376006ed40 2024-09-07T03:32:07.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.740+0000 7f37577fe640 1 -- 172.21.15.104:0/554015275 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3750051430 con 0x7f376006ed40 2024-09-07T03:32:07.742 INFO:teuthology.orchestra.run.smithi104.stdout:47244640263 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374003dec0 msgr2=0x7f3740040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 --2- 172.21.15.104:0/554015275 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374003dec0 0x7f3740040380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3748001220 tx=0x7f37480078f0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f376006ed40 msgr2=0x7f376011a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 --2- 172.21.15.104:0/554015275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f376006ed40 0x7f376011a280 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f375002a1e0 tx=0x7f37500046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 shutdown_connections 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 --2- 172.21.15.104:0/554015275 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374003dec0 0x7f3740040380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 --2- 172.21.15.104:0/554015275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f376006ed40 0x7f376011a280 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 >> 172.21.15.104:0/554015275 conn(0x7f3760071580 msgr2=0x7f376012bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 shutdown_connections 2024-09-07T03:32:07.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.742+0000 7f37652bf640 1 -- 172.21.15.104:0/554015275 wait complete. 2024-09-07T03:32:07.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-09-07T03:32:07.748 DEBUG:teuthology.parallel:result is None 2024-09-07T03:32:07.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640263 for osd.3 2024-09-07T03:32:07.752 DEBUG:teuthology.parallel:result is None 2024-09-07T03:32:07.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640263 for osd.2 2024-09-07T03:32:07.756 DEBUG:teuthology.parallel:result is None 2024-09-07T03:32:07.756 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-07T03:32:07.756 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:32:07.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ef857640 1 Processor -- start 2024-09-07T03:32:07.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ef857640 1 -- start start 2024-09-07T03:32:07.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ef857640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f81e8130270 0x7f81e8132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ef857640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e806dc00 con 0x7f81e8129d80 2024-09-07T03:32:07.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ef857640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f81e81299c0 con 0x7f81e8130270 2024-09-07T03:32:07.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ecdf2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f81e8130270 0x7f81e8132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ed5f3640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f81e8129d80 0x7f81e812a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38720/0 (socket says 172.21.15.104:38720) 2024-09-07T03:32:07.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ed5f3640 1 -- 172.21.15.104:0/1587550898 learned_addr learned my addr 172.21.15.104:0/1587550898 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:07.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ecdf2640 1 -- 172.21.15.104:0/1587550898 >> v1:172.21.15.104:6789/0 conn(0x7f81e8129d80 legacy=0x7f81e812a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81ecdf2640 1 -- 172.21.15.104:0/1587550898 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e812a870 con 0x7f81e8130270 2024-09-07T03:32:07.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.892+0000 7f81dbfff640 1 -- 172.21.15.104:0/1587550898 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168419547 0 0) 0x7f81e806dc00 con 0x7f81e8129d80 2024-09-07T03:32:07.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.893+0000 7f81ecdf2640 1 --2- 172.21.15.104:0/1587550898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8130270 0x7f81e8132660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009720 tx=0x7f81e402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7433c33593dc8d67 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.893+0000 7f81dbfff640 1 -- 172.21.15.104:0/1587550898 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e4037070 con 0x7f81e8130270 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.893+0000 7f81dbfff640 1 -- 172.21.15.104:0/1587550898 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e402ad90 con 0x7f81e8130270 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.893+0000 7f81dbfff640 1 -- 172.21.15.104:0/1587550898 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e4032590 con 0x7f81e8130270 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.894+0000 7f81ef857640 1 -- 172.21.15.104:0/1587550898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8130270 msgr2=0x7f81e8132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.894+0000 7f81ef857640 1 --2- 172.21.15.104:0/1587550898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8130270 0x7f81e8132660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009720 tx=0x7f81e402a110 comp rx=0 tx=0).stop 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.894+0000 7f81ef857640 1 -- 172.21.15.104:0/1587550898 shutdown_connections 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.894+0000 7f81ef857640 1 --2- 172.21.15.104:0/1587550898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8130270 0x7f81e8132660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.894+0000 7f81ef857640 1 -- 172.21.15.104:0/1587550898 >> 172.21.15.104:0/1587550898 conn(0x7f81e8070850 msgr2=0x7f81e8072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.894+0000 7f81ef857640 1 -- 172.21.15.104:0/1587550898 shutdown_connections 2024-09-07T03:32:07.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.894+0000 7f81ef857640 1 -- 172.21.15.104:0/1587550898 wait complete. 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.895+0000 7f81ef857640 1 Processor -- start 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.895+0000 7f81ef857640 1 -- start start 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.895+0000 7f81ef857640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8129d80 0x7f81e8112730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.895+0000 7f81ef857640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f81e8073a10 con 0x7f81e8129d80 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.895+0000 7f81ed5f3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8129d80 0x7f81e8112730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.895+0000 7f81ed5f3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8129d80 0x7f81e8112730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52540/0 (socket says 172.21.15.104:52540) 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.895+0000 7f81ed5f3640 1 -- 172.21.15.104:0/490165526 learned_addr learned my addr 172.21.15.104:0/490165526 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.896+0000 7f81ed5f3640 1 -- 172.21.15.104:0/490165526 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e8126970 con 0x7f81e8129d80 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.896+0000 7f81ed5f3640 1 --2- 172.21.15.104:0/490165526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8129d80 0x7f81e8112730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c3d0 tx=0x7f81dc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.896+0000 7f81d9ffb640 1 -- 172.21.15.104:0/490165526 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81dc0074d0 con 0x7f81e8129d80 2024-09-07T03:32:07.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.896+0000 7f81d9ffb640 1 -- 172.21.15.104:0/490165526 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc0047e0 con 0x7f81e8129d80 2024-09-07T03:32:07.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.896+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e81142b0 con 0x7f81e8129d80 2024-09-07T03:32:07.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.896+0000 7f81d9ffb640 1 -- 172.21.15.104:0/490165526 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81dc007670 con 0x7f81e8129d80 2024-09-07T03:32:07.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.896+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e8112e50 con 0x7f81e8129d80 2024-09-07T03:32:07.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.897+0000 7f81d9ffb640 1 -- 172.21.15.104:0/490165526 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f81dc011070 con 0x7f81e8129d80 2024-09-07T03:32:07.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.897+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e812a160 con 0x7f81e8129d80 2024-09-07T03:32:07.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.897+0000 7f81d9ffb640 1 --2- 172.21.15.104:0/490165526 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f81cc03dec0 0x7f81cc040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:07.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.897+0000 7f81d9ffb640 1 -- 172.21.15.104:0/490165526 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f81dc051e20 con 0x7f81e8129d80 2024-09-07T03:32:07.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.897+0000 7f81ecdf2640 1 --2- 172.21.15.104:0/490165526 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f81cc03dec0 0x7f81cc040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:07.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.898+0000 7f81ecdf2640 1 --2- 172.21.15.104:0/490165526 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f81cc03dec0 0x7f81cc040380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f81e4034000 tx=0x7f81e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:07.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:07.902+0000 7f81d9ffb640 1 -- 172.21.15.104:0/490165526 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f81dc012dd0 con 0x7f81e8129d80 2024-09-07T03:32:08.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.072+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81e8119440 con 0x7f81cc03dec0 2024-09-07T03:32:08.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.074+0000 7f81d9ffb640 1 -- 172.21.15.104:0/490165526 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32193 (secure 0 0 0) 0x7f81e4032740 con 0x7f81cc03dec0 2024-09-07T03:32:08.077 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:32:08.077 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f81cc03dec0 msgr2=0x7f81cc040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 --2- 172.21.15.104:0/490165526 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f81cc03dec0 0x7f81cc040380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f81e4034000 tx=0x7f81e402e000 comp rx=0 tx=0).stop 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8129d80 msgr2=0x7f81e8112730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 --2- 172.21.15.104:0/490165526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8129d80 0x7f81e8112730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c3d0 tx=0x7f81dc00c890 comp rx=0 tx=0).stop 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 shutdown_connections 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 --2- 172.21.15.104:0/490165526 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f81cc03dec0 0x7f81cc040380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 --2- 172.21.15.104:0/490165526 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81e8129d80 0x7f81e8112730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 >> 172.21.15.104:0/490165526 conn(0x7f81e8070850 msgr2=0x7f81e81b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 shutdown_connections 2024-09-07T03:32:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.077+0000 7f81ef857640 1 -- 172.21.15.104:0/490165526 wait complete. 2024-09-07T03:32:08.089 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-07T03:32:07.198259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114092,"kb_used_data":1808,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373268,"statfs":{"total":386547056640,"available":386430226432,"internally_reserved":0,"allocated":1851392,"data_stored":1391362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.665233"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.539724+0000","last_change":"2024-09-07T03:32:04.539724+0000","last_active":"2024-09-07T03:32:04.539724+0000","last_peered":"2024-09-07T03:32:04.539724+0000","last_clean":"2024-09-07T03:32:04.539724+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:32:04.539724+0000","last_undegraded":"2024-09-07T03:32:04.539724+0000","last_fullsized":"2024-09-07T03:32:04.539724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:55:55.896127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.541772+0000","last_change":"2024-09-07T03:32:04.542033+0000","last_active":"2024-09-07T03:32:04.541772+0000","last_peered":"2024-09-07T03:32:04.541772+0000","last_clean":"2024-09-07T03:32:04.541772+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:32:04.541772+0000","last_undegraded":"2024-09-07T03:32:04.541772+0000","last_fullsized":"2024-09-07T03:32:04.541772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:18:29.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.539029+0000","last_change":"2024-09-07T03:32:04.539029+0000","last_active":"2024-09-07T03:32:04.539029+0000","last_peered":"2024-09-07T03:32:04.539029+0000","last_clean":"2024-09-07T03:32:04.539029+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:32:04.539029+0000","last_undegraded":"2024-09-07T03:32:04.539029+0000","last_fullsized":"2024-09-07T03:32:04.539029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:37:36.714209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.541712+0000","last_change":"2024-09-07T03:32:04.541917+0000","last_active":"2024-09-07T03:32:04.541712+0000","last_peered":"2024-09-07T03:32:04.541712+0000","last_clean":"2024-09-07T03:32:04.541712+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:32:04.541712+0000","last_undegraded":"2024-09-07T03:32:04.541712+0000","last_fullsized":"2024-09-07T03:32:04.541712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:39:36.959986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.540387+0000","last_change":"2024-09-07T03:32:04.539644+0000","last_active":"2024-09-07T03:32:04.540387+0000","last_peered":"2024-09-07T03:32:04.540387+0000","last_clean":"2024-09-07T03:32:04.540387+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:32:04.540387+0000","last_undegraded":"2024-09-07T03:32:04.540387+0000","last_fullsized":"2024-09-07T03:32:04.540387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:43.880721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.537641+0000","last_change":"2024-09-07T03:32:04.537641+0000","last_active":"2024-09-07T03:32:04.537641+0000","last_peered":"2024-09-07T03:32:04.537641+0000","last_clean":"2024-09-07T03:32:04.537641+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:32:04.537641+0000","last_undegraded":"2024-09-07T03:32:04.537641+0000","last_fullsized":"2024-09-07T03:32:04.537641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.563922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.539038+0000","last_change":"2024-09-07T03:32:04.539038+0000","last_active":"2024-09-07T03:32:04.539038+0000","last_peered":"2024-09-07T03:32:04.539038+0000","last_clean":"2024-09-07T03:32:04.539038+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:32:04.539038+0000","last_undegraded":"2024-09-07T03:32:04.539038+0000","last_fullsized":"2024-09-07T03:32:04.539038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:11.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.539297+0000","last_change":"2024-09-07T03:32:04.539297+0000","last_active":"2024-09-07T03:32:04.539297+0000","last_peered":"2024-09-07T03:32:04.539297+0000","last_clean":"2024-09-07T03:32:04.539297+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:32:04.539297+0000","last_undegraded":"2024-09-07T03:32:04.539297+0000","last_fullsized":"2024-09-07T03:32:04.539297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:06.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'72","reported_seq":110,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.541391+0000","last_change":"2024-09-07T03:31:58.568783+0000","last_active":"2024-09-07T03:32:04.541391+0000","last_peered":"2024-09-07T03:32:04.541391+0000","last_clean":"2024-09-07T03:32:04.541391+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:32:04.541391+0000","last_undegraded":"2024-09-07T03:32:04.541391+0000","last_fullsized":"2024-09-07T03:32:04.541391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_clean_scrub_stamp":"2024-09-07T03:31:57.501815+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:54.736044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":52647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640263,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":761856,"data_stored":643034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:32:08.090 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:32:08.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e39c8e640 1 Processor -- start 2024-09-07T03:32:08.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e39c8e640 1 -- start start 2024-09-07T03:32:08.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e39c8e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3e34129d80 0x7f3e3412a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:08.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e39c8e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e3406dc00 con 0x7f3e3412a6a0 2024-09-07T03:32:08.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e39c8e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f3e341299c0 con 0x7f3e34129d80 2024-09-07T03:32:08.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e337fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3e34129d80 0x7f3e3412a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:08.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e32ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3e3412a6a0 0x7f3e34110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38732/0 (socket says 172.21.15.104:38732) 2024-09-07T03:32:08.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e32ffd640 1 -- 172.21.15.104:0/606014773 learned_addr learned my addr 172.21.15.104:0/606014773 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:08.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e337fe640 1 -- 172.21.15.104:0/606014773 >> v1:172.21.15.104:6789/0 conn(0x7f3e3412a6a0 legacy=0x7f3e34110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e337fe640 1 -- 172.21.15.104:0/606014773 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e34114d20 con 0x7f3e34129d80 2024-09-07T03:32:08.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.185+0000 7f3e327fc640 1 -- 172.21.15.104:0/606014773 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468219854 0 0) 0x7f3e3406dc00 con 0x7f3e3412a6a0 2024-09-07T03:32:08.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.186+0000 7f3e337fe640 1 --2- 172.21.15.104:0/606014773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 0x7f3e3412a160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009720 tx=0x7f3e1c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9628ec1a5938d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:08.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.186+0000 7f3e327fc640 1 -- 172.21.15.104:0/606014773 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c037070 con 0x7f3e34129d80 2024-09-07T03:32:08.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.186+0000 7f3e327fc640 1 -- 172.21.15.104:0/606014773 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c02ad90 con 0x7f3e34129d80 2024-09-07T03:32:08.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.186+0000 7f3e327fc640 1 -- 172.21.15.104:0/606014773 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c032590 con 0x7f3e34129d80 2024-09-07T03:32:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.187+0000 7f3e39c8e640 1 -- 172.21.15.104:0/606014773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 msgr2=0x7f3e3412a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.187+0000 7f3e39c8e640 1 --2- 172.21.15.104:0/606014773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 0x7f3e3412a160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009720 tx=0x7f3e1c02a110 comp rx=0 tx=0).stop 2024-09-07T03:32:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.187+0000 7f3e39c8e640 1 -- 172.21.15.104:0/606014773 shutdown_connections 2024-09-07T03:32:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.187+0000 7f3e39c8e640 1 --2- 172.21.15.104:0/606014773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 0x7f3e3412a160 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.187+0000 7f3e39c8e640 1 -- 172.21.15.104:0/606014773 >> 172.21.15.104:0/606014773 conn(0x7f3e34070850 msgr2=0x7f3e34072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.187+0000 7f3e39c8e640 1 -- 172.21.15.104:0/606014773 shutdown_connections 2024-09-07T03:32:08.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.187+0000 7f3e39c8e640 1 -- 172.21.15.104:0/606014773 wait complete. 2024-09-07T03:32:08.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.187+0000 7f3e39c8e640 1 Processor -- start 2024-09-07T03:32:08.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.188+0000 7f3e39c8e640 1 -- start start 2024-09-07T03:32:08.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.188+0000 7f3e39c8e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 0x7f3e341c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:08.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.188+0000 7f3e39c8e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3e34114940 con 0x7f3e34129d80 2024-09-07T03:32:08.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.188+0000 7f3e337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 0x7f3e341c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:08.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.188+0000 7f3e337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 0x7f3e341c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52562/0 (socket says 172.21.15.104:52562) 2024-09-07T03:32:08.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.188+0000 7f3e337fe640 1 -- 172.21.15.104:0/492075301 learned_addr learned my addr 172.21.15.104:0/492075301 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.188+0000 7f3e337fe640 1 -- 172.21.15.104:0/492075301 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3411e030 con 0x7f3e34129d80 2024-09-07T03:32:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.188+0000 7f3e337fe640 1 --2- 172.21.15.104:0/492075301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 0x7f3e341c1d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009720 tx=0x7f3e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.189+0000 7f3e2bfff640 1 -- 172.21.15.104:0/492075301 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c041070 con 0x7f3e34129d80 2024-09-07T03:32:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.189+0000 7f3e2bfff640 1 -- 172.21.15.104:0/492075301 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c03c460 con 0x7f3e34129d80 2024-09-07T03:32:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.189+0000 7f3e2bfff640 1 -- 172.21.15.104:0/492075301 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c037040 con 0x7f3e34129d80 2024-09-07T03:32:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.189+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3411c790 con 0x7f3e34129d80 2024-09-07T03:32:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.189+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e341c22c0 con 0x7f3e34129d80 2024-09-07T03:32:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.189+0000 7f3e2bfff640 1 -- 172.21.15.104:0/492075301 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3e1c044070 con 0x7f3e34129d80 2024-09-07T03:32:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.190+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e341119e0 con 0x7f3e34129d80 2024-09-07T03:32:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.190+0000 7f3e2bfff640 1 --2- 172.21.15.104:0/492075301 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3e1403de90 0x7f3e14040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.190+0000 7f3e2bfff640 1 -- 172.21.15.104:0/492075301 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f3e1c072ad0 con 0x7f3e34129d80 2024-09-07T03:32:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.190+0000 7f3e32ffd640 1 --2- 172.21.15.104:0/492075301 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3e1403de90 0x7f3e14040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.190+0000 7f3e32ffd640 1 --2- 172.21.15.104:0/492075301 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3e1403de90 0x7f3e14040350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e240015a0 tx=0x7f3e24007c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:08.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.194+0000 7f3e2bfff640 1 -- 172.21.15.104:0/492075301 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f3e1c03cc60 con 0x7f3e34129d80 2024-09-07T03:32:08.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.363+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e341276b0 con 0x7f3e1403de90 2024-09-07T03:32:08.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.365+0000 7f3e2bfff640 1 -- 172.21.15.104:0/492075301 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32193 (secure 0 0 0) 0x7f3e2400c760 con 0x7f3e1403de90 2024-09-07T03:32:08.366 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:32:08.367 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:32:08.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.366+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3e1403de90 msgr2=0x7f3e14040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.366+0000 7f3e39c8e640 1 --2- 172.21.15.104:0/492075301 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3e1403de90 0x7f3e14040350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e240015a0 tx=0x7f3e24007c70 comp rx=0 tx=0).stop 2024-09-07T03:32:08.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.366+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 msgr2=0x7f3e341c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.366+0000 7f3e39c8e640 1 --2- 172.21.15.104:0/492075301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 0x7f3e341c1d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009720 tx=0x7f3e1c0046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.366+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 shutdown_connections 2024-09-07T03:32:08.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.366+0000 7f3e39c8e640 1 --2- 172.21.15.104:0/492075301 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3e1403de90 0x7f3e14040350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.366+0000 7f3e39c8e640 1 --2- 172.21.15.104:0/492075301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e34129d80 0x7f3e341c1d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.366+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 >> 172.21.15.104:0/492075301 conn(0x7f3e34070850 msgr2=0x7f3e34126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:08.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.367+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 shutdown_connections 2024-09-07T03:32:08.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.367+0000 7f3e39c8e640 1 -- 172.21.15.104:0/492075301 wait complete. 2024-09-07T03:32:08.379 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-07T03:32:07.198259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114092,"kb_used_data":1808,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373268,"statfs":{"total":386547056640,"available":386430226432,"internally_reserved":0,"allocated":1851392,"data_stored":1391362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.665233"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.539724+0000","last_change":"2024-09-07T03:32:04.539724+0000","last_active":"2024-09-07T03:32:04.539724+0000","last_peered":"2024-09-07T03:32:04.539724+0000","last_clean":"2024-09-07T03:32:04.539724+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:32:04.539724+0000","last_undegraded":"2024-09-07T03:32:04.539724+0000","last_fullsized":"2024-09-07T03:32:04.539724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:55:55.896127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.541772+0000","last_change":"2024-09-07T03:32:04.542033+0000","last_active":"2024-09-07T03:32:04.541772+0000","last_peered":"2024-09-07T03:32:04.541772+0000","last_clean":"2024-09-07T03:32:04.541772+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:32:04.541772+0000","last_undegraded":"2024-09-07T03:32:04.541772+0000","last_fullsized":"2024-09-07T03:32:04.541772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:18:29.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.539029+0000","last_change":"2024-09-07T03:32:04.539029+0000","last_active":"2024-09-07T03:32:04.539029+0000","last_peered":"2024-09-07T03:32:04.539029+0000","last_clean":"2024-09-07T03:32:04.539029+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:32:04.539029+0000","last_undegraded":"2024-09-07T03:32:04.539029+0000","last_fullsized":"2024-09-07T03:32:04.539029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:37:36.714209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.541712+0000","last_change":"2024-09-07T03:32:04.541917+0000","last_active":"2024-09-07T03:32:04.541712+0000","last_peered":"2024-09-07T03:32:04.541712+0000","last_clean":"2024-09-07T03:32:04.541712+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:32:04.541712+0000","last_undegraded":"2024-09-07T03:32:04.541712+0000","last_fullsized":"2024-09-07T03:32:04.541712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:39:36.959986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.540387+0000","last_change":"2024-09-07T03:32:04.539644+0000","last_active":"2024-09-07T03:32:04.540387+0000","last_peered":"2024-09-07T03:32:04.540387+0000","last_clean":"2024-09-07T03:32:04.540387+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:32:04.540387+0000","last_undegraded":"2024-09-07T03:32:04.540387+0000","last_fullsized":"2024-09-07T03:32:04.540387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:43.880721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.537641+0000","last_change":"2024-09-07T03:32:04.537641+0000","last_active":"2024-09-07T03:32:04.537641+0000","last_peered":"2024-09-07T03:32:04.537641+0000","last_clean":"2024-09-07T03:32:04.537641+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:32:04.537641+0000","last_undegraded":"2024-09-07T03:32:04.537641+0000","last_fullsized":"2024-09-07T03:32:04.537641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.563922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.539038+0000","last_change":"2024-09-07T03:32:04.539038+0000","last_active":"2024-09-07T03:32:04.539038+0000","last_peered":"2024-09-07T03:32:04.539038+0000","last_clean":"2024-09-07T03:32:04.539038+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:32:04.539038+0000","last_undegraded":"2024-09-07T03:32:04.539038+0000","last_fullsized":"2024-09-07T03:32:04.539038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:11.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.539297+0000","last_change":"2024-09-07T03:32:04.539297+0000","last_active":"2024-09-07T03:32:04.539297+0000","last_peered":"2024-09-07T03:32:04.539297+0000","last_clean":"2024-09-07T03:32:04.539297+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:32:04.539297+0000","last_undegraded":"2024-09-07T03:32:04.539297+0000","last_fullsized":"2024-09-07T03:32:04.539297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:06.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'72","reported_seq":110,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-07T03:32:04.541391+0000","last_change":"2024-09-07T03:31:58.568783+0000","last_active":"2024-09-07T03:32:04.541391+0000","last_peered":"2024-09-07T03:32:04.541391+0000","last_clean":"2024-09-07T03:32:04.541391+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:32:04.541391+0000","last_undegraded":"2024-09-07T03:32:04.541391+0000","last_fullsized":"2024-09-07T03:32:04.541391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_clean_scrub_stamp":"2024-09-07T03:31:57.501815+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:54.736044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":52647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640263,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":761856,"data_stored":643034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:32:08.380 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-07T03:32:08.380 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-07T03:32:08.380 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-07T03:32:08.380 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-07T03:32:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.475+0000 7f06b1edb640 1 Processor -- start 2024-09-07T03:32:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.475+0000 7f06b1edb640 1 -- start start 2024-09-07T03:32:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.476+0000 7f06b1edb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f06ac129d80 0x7f06ac12a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.476+0000 7f06b1edb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ac06dc00 con 0x7f06ac12a6a0 2024-09-07T03:32:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.476+0000 7f06b1edb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f06ac1299c0 con 0x7f06ac129d80 2024-09-07T03:32:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.476+0000 7f06ab7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f06ac129d80 0x7f06ac12a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.476+0000 7f06aaffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f06ac12a6a0 0x7f06ac110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38748/0 (socket says 172.21.15.104:38748) 2024-09-07T03:32:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.476+0000 7f06aaffd640 1 -- 172.21.15.104:0/4014558332 learned_addr learned my addr 172.21.15.104:0/4014558332 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:32:08.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.476+0000 7f06ab7fe640 1 -- 172.21.15.104:0/4014558332 >> v1:172.21.15.104:6789/0 conn(0x7f06ac12a6a0 legacy=0x7f06ac110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.476+0000 7f06ab7fe640 1 -- 172.21.15.104:0/4014558332 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac114d20 con 0x7f06ac129d80 2024-09-07T03:32:08.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.476+0000 7f06aa7fc640 1 -- 172.21.15.104:0/4014558332 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356262289 0 0) 0x7f06ac06dc00 con 0x7f06ac12a6a0 2024-09-07T03:32:08.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06ab7fe640 1 --2- 172.21.15.104:0/4014558332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 0x7f06ac12a160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f069c009720 tx=0x7f069c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba49b5e811671956 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06aa7fc640 1 -- 172.21.15.104:0/4014558332 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c037070 con 0x7f06ac129d80 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06aa7fc640 1 -- 172.21.15.104:0/4014558332 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c02ad90 con 0x7f06ac129d80 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06aa7fc640 1 -- 172.21.15.104:0/4014558332 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c032590 con 0x7f06ac129d80 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06b1edb640 1 -- 172.21.15.104:0/4014558332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 msgr2=0x7f06ac12a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06b1edb640 1 --2- 172.21.15.104:0/4014558332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 0x7f06ac12a160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f069c009720 tx=0x7f069c02a110 comp rx=0 tx=0).stop 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06b1edb640 1 -- 172.21.15.104:0/4014558332 shutdown_connections 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06b1edb640 1 --2- 172.21.15.104:0/4014558332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 0x7f06ac12a160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06b1edb640 1 -- 172.21.15.104:0/4014558332 >> 172.21.15.104:0/4014558332 conn(0x7f06ac070850 msgr2=0x7f06ac072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06b1edb640 1 -- 172.21.15.104:0/4014558332 shutdown_connections 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.477+0000 7f06b1edb640 1 -- 172.21.15.104:0/4014558332 wait complete. 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.478+0000 7f06b1edb640 1 Processor -- start 2024-09-07T03:32:08.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.478+0000 7f06b1edb640 1 -- start start 2024-09-07T03:32:08.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f06b1edb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 0x7f06ac11b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f06b1edb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac114940 con 0x7f06ac129d80 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f06ab7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 0x7f06ac11b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f06ab7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 0x7f06ac11b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52584/0 (socket says 172.21.15.104:52584) 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f06ab7fe640 1 -- 172.21.15.104:0/2382002721 learned_addr learned my addr 172.21.15.104:0/2382002721 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f06ab7fe640 1 -- 172.21.15.104:0/2382002721 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac11ca80 con 0x7f06ac129d80 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f06ab7fe640 1 --2- 172.21.15.104:0/2382002721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 0x7f06ac11b390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f069c009720 tx=0x7f069c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f0693fff640 1 -- 172.21.15.104:0/2382002721 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c041070 con 0x7f06ac129d80 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f0693fff640 1 -- 172.21.15.104:0/2382002721 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c03c460 con 0x7f06ac129d80 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ac11d730 con 0x7f06ac129d80 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f0693fff640 1 -- 172.21.15.104:0/2382002721 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f069c037040 con 0x7f06ac129d80 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.479+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ac11dd60 con 0x7f06ac129d80 2024-09-07T03:32:08.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.480+0000 7f0693fff640 1 -- 172.21.15.104:0/2382002721 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f069c044070 con 0x7f06ac129d80 2024-09-07T03:32:08.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.480+0000 7f0693fff640 1 --2- 172.21.15.104:0/2382002721 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f069803de90 0x7f0698040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:08.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.480+0000 7f0693fff640 1 -- 172.21.15.104:0/2382002721 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f069c072ad0 con 0x7f06ac129d80 2024-09-07T03:32:08.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.480+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ac11c4f0 con 0x7f06ac129d80 2024-09-07T03:32:08.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.481+0000 7f06aaffd640 1 --2- 172.21.15.104:0/2382002721 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f069803de90 0x7f0698040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:08.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.481+0000 7f06aaffd640 1 --2- 172.21.15.104:0/2382002721 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f069803de90 0x7f0698040350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06a0000c00 tx=0x7f06a00078d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:08.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.485+0000 7f0693fff640 1 -- 172.21.15.104:0/2382002721 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f069c03c740 con 0x7f06ac129d80 2024-09-07T03:32:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.694+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f06ac071150 con 0x7f06ac129d80 2024-09-07T03:32:08.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.695+0000 7f0693fff640 1 -- 172.21.15.104:0/2382002721 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f06ac071150 con 0x7f06ac129d80 2024-09-07T03:32:08.697 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:32:08.698 INFO:teuthology.orchestra.run.smithi104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-07T03:32:08.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f069803de90 msgr2=0x7f0698040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 --2- 172.21.15.104:0/2382002721 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f069803de90 0x7f0698040350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06a0000c00 tx=0x7f06a00078d0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 msgr2=0x7f06ac11b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 --2- 172.21.15.104:0/2382002721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 0x7f06ac11b390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f069c009720 tx=0x7f069c0046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 shutdown_connections 2024-09-07T03:32:08.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 --2- 172.21.15.104:0/2382002721 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f069803de90 0x7f0698040350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 --2- 172.21.15.104:0/2382002721 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06ac129d80 0x7f06ac11b390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 >> 172.21.15.104:0/2382002721 conn(0x7f06ac070850 msgr2=0x7f06ac126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:08.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 shutdown_connections 2024-09-07T03:32:08.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:32:08.697+0000 7f06b1edb640 1 -- 172.21.15.104:0/2382002721 wait complete. 2024-09-07T03:32:08.709 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-07T03:32:08.710 INFO:teuthology.run_tasks:Running task rgw... 2024-09-07T03:32:08.726 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-07T03:32:08.726 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-07T03:32:08.726 INFO:tasks.rgw:Creating data pools 2024-09-07T03:32:08.726 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-07T03:32:08.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-07T03:32:08.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.839+0000 7f2949be2640 1 Processor -- start 2024-09-07T03:32:08.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.839+0000 7f2949be2640 1 -- start start 2024-09-07T03:32:08.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.840+0000 7f2949be2640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2944110490 0x7f294411c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:08.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.840+0000 7f2949be2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2944110920 con 0x7f2944074af0 2024-09-07T03:32:08.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.840+0000 7f2949be2640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2944110af0 con 0x7f2944110490 2024-09-07T03:32:08.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.840+0000 7f2942ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2944110490 0x7f294411c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:08.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.840+0000 7f29437fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2944074af0 0x7f294410fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:46000/0 (socket says 172.21.15.120:46000) 2024-09-07T03:32:08.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.840+0000 7f29437fe640 1 -- 172.21.15.120:0/3510104470 learned_addr learned my addr 172.21.15.120:0/3510104470 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:08.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.840+0000 7f2942ffd640 1 -- 172.21.15.120:0/3510104470 >> v1:172.21.15.104:6789/0 conn(0x7f2944074af0 legacy=0x7f294410fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.840+0000 7f2942ffd640 1 -- 172.21.15.120:0/3510104470 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294411d660 con 0x7f2944110490 2024-09-07T03:32:08.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.841+0000 7f2942ffd640 1 --2- 172.21.15.120:0/3510104470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944110490 0x7f294411c110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2938009720 tx=0x7f293802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabcdd341fcda202 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:08.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.841+0000 7f29427fc640 1 -- 172.21.15.120:0/3510104470 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2938037070 con 0x7f2944110490 2024-09-07T03:32:08.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.841+0000 7f29427fc640 1 -- 172.21.15.120:0/3510104470 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293802ad90 con 0x7f2944110490 2024-09-07T03:32:08.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.841+0000 7f29427fc640 1 -- 172.21.15.120:0/3510104470 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2938032590 con 0x7f2944110490 2024-09-07T03:32:08.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.842+0000 7f2949be2640 1 -- 172.21.15.120:0/3510104470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944110490 msgr2=0x7f294411c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.842+0000 7f2949be2640 1 --2- 172.21.15.120:0/3510104470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944110490 0x7f294411c110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2938009720 tx=0x7f293802a110 comp rx=0 tx=0).stop 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.842+0000 7f2949be2640 1 -- 172.21.15.120:0/3510104470 shutdown_connections 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.842+0000 7f2949be2640 1 --2- 172.21.15.120:0/3510104470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944110490 0x7f294411c110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.842+0000 7f2949be2640 1 -- 172.21.15.120:0/3510104470 >> 172.21.15.120:0/3510104470 conn(0x7f294406fef0 msgr2=0x7f2944072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.842+0000 7f2949be2640 1 -- 172.21.15.120:0/3510104470 shutdown_connections 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.842+0000 7f2949be2640 1 -- 172.21.15.120:0/3510104470 wait complete. 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.842+0000 7f2949be2640 1 Processor -- start 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.843+0000 7f2949be2640 1 -- start start 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.843+0000 7f2949be2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944074af0 0x7f29441a5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:08.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.843+0000 7f2949be2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f294411c9e0 con 0x7f2944074af0 2024-09-07T03:32:08.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.843+0000 7f29437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944074af0 0x7f29441a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:08.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.843+0000 7f29437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944074af0 0x7f29441a5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:53402/0 (socket says 172.21.15.120:53402) 2024-09-07T03:32:08.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.843+0000 7f29437fe640 1 -- 172.21.15.120:0/4086427722 learned_addr learned my addr 172.21.15.120:0/4086427722 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:08.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.843+0000 7f29437fe640 1 -- 172.21.15.120:0/4086427722 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29441a5b50 con 0x7f2944074af0 2024-09-07T03:32:08.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.844+0000 7f29437fe640 1 --2- 172.21.15.120:0/4086427722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944074af0 0x7f29441a5580 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f293400c480 tx=0x7f293400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:08.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.844+0000 7f292bfff640 1 -- 172.21.15.120:0/4086427722 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2934017070 con 0x7f2944074af0 2024-09-07T03:32:08.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.844+0000 7f292bfff640 1 -- 172.21.15.120:0/4086427722 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2934005c10 con 0x7f2944074af0 2024-09-07T03:32:08.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.844+0000 7f292bfff640 1 -- 172.21.15.120:0/4086427722 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2934007070 con 0x7f2944074af0 2024-09-07T03:32:08.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.844+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29441a5e40 con 0x7f2944074af0 2024-09-07T03:32:08.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.844+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29441ab010 con 0x7f2944074af0 2024-09-07T03:32:08.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.845+0000 7f292bfff640 1 -- 172.21.15.120:0/4086427722 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f293401a070 con 0x7f2944074af0 2024-09-07T03:32:08.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.845+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29441a6180 con 0x7f2944074af0 2024-09-07T03:32:08.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.845+0000 7f292bfff640 1 --2- 172.21.15.120:0/4086427722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f293003dec0 0x7f2930040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:08.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.845+0000 7f292bfff640 1 -- 172.21.15.120:0/4086427722 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f2934051530 con 0x7f2944074af0 2024-09-07T03:32:08.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.845+0000 7f2942ffd640 1 --2- 172.21.15.120:0/4086427722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f293003dec0 0x7f2930040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:08.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.845+0000 7f2942ffd640 1 --2- 172.21.15.120:0/4086427722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f293003dec0 0x7f2930040380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2938034000 tx=0x7f293802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:08.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:08.849+0000 7f292bfff640 1 -- 172.21.15.120:0/4086427722 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f293401ac60 con 0x7f2944074af0 2024-09-07T03:32:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.029+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7f294411d010 con 0x7f2944074af0 2024-09-07T03:32:09.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.554+0000 7f292bfff640 1 -- 172.21.15.120:0/4086427722 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v20) ==== 171+0+0 (secure 0 0 0) 0x7f2934019cd0 con 0x7f2944074af0 2024-09-07T03:32:09.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.556+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f293003dec0 msgr2=0x7f2930040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:09.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.556+0000 7f2949be2640 1 --2- 172.21.15.120:0/4086427722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f293003dec0 0x7f2930040380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2938034000 tx=0x7f293802e000 comp rx=0 tx=0).stop 2024-09-07T03:32:09.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.556+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944074af0 msgr2=0x7f29441a5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:09.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.556+0000 7f2949be2640 1 --2- 172.21.15.120:0/4086427722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944074af0 0x7f29441a5580 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f293400c480 tx=0x7f293400c940 comp rx=0 tx=0).stop 2024-09-07T03:32:09.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.556+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 shutdown_connections 2024-09-07T03:32:09.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.556+0000 7f2949be2640 1 --2- 172.21.15.120:0/4086427722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f293003dec0 0x7f2930040380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:09.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.556+0000 7f2949be2640 1 --2- 172.21.15.120:0/4086427722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2944074af0 0x7f29441a5580 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:09.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.556+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 >> 172.21.15.120:0/4086427722 conn(0x7f294406fef0 msgr2=0x7f2944115ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:09.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.556+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 shutdown_connections 2024-09-07T03:32:09.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.557+0000 7f2949be2640 1 -- 172.21.15.120:0/4086427722 wait complete. 2024-09-07T03:32:09.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-07T03:32:09.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.674+0000 7f22752d4640 1 Processor -- start 2024-09-07T03:32:09.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.674+0000 7f22752d4640 1 -- start start 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.674+0000 7f22752d4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f227010fff0 0x7f22701103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.674+0000 7f22752d4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2270110a90 con 0x7f2270114dd0 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.674+0000 7f22752d4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f2270115990 con 0x7f227010fff0 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.674+0000 7f226effd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f227010fff0 0x7f22701103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.675+0000 7f2267fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2270114dd0 0x7f2270115280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:46002/0 (socket says 172.21.15.120:46002) 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.675+0000 7f226effd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f227010fff0 0x7f22701103d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:53406/0 (socket says 172.21.15.120:53406) 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.675+0000 7f2267fff640 1 -- 172.21.15.120:0/1479358528 learned_addr learned my addr 172.21.15.120:0/1479358528 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.675+0000 7f226effd640 1 -- 172.21.15.120:0/1479358528 >> v1:172.21.15.104:6789/0 conn(0x7f2270114dd0 legacy=0x7f2270115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.675+0000 7f226effd640 1 -- 172.21.15.120:0/1479358528 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2270115b40 con 0x7f227010fff0 2024-09-07T03:32:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.675+0000 7f226e7fc640 1 -- 172.21.15.120:0/1479358528 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352120701 0 0) 0x7f2270110a90 con 0x7f2270114dd0 2024-09-07T03:32:09.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f226effd640 1 --2- 172.21.15.120:0/1479358528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 0x7f22701103d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2260009720 tx=0x7f226002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c48af11be99e467 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:09.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f226e7fc640 1 -- 172.21.15.120:0/1479358528 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2260037070 con 0x7f227010fff0 2024-09-07T03:32:09.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f226e7fc640 1 -- 172.21.15.120:0/1479358528 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226002ad90 con 0x7f227010fff0 2024-09-07T03:32:09.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f226e7fc640 1 -- 172.21.15.120:0/1479358528 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2260032590 con 0x7f227010fff0 2024-09-07T03:32:09.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f22752d4640 1 -- 172.21.15.120:0/1479358528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 msgr2=0x7f22701103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:09.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f22752d4640 1 --2- 172.21.15.120:0/1479358528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 0x7f22701103d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2260009720 tx=0x7f226002a110 comp rx=0 tx=0).stop 2024-09-07T03:32:09.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f22752d4640 1 -- 172.21.15.120:0/1479358528 shutdown_connections 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f22752d4640 1 --2- 172.21.15.120:0/1479358528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 0x7f22701103d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f22752d4640 1 -- 172.21.15.120:0/1479358528 >> 172.21.15.120:0/1479358528 conn(0x7f227006ff80 msgr2=0x7f22700723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f22752d4640 1 -- 172.21.15.120:0/1479358528 shutdown_connections 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.676+0000 7f22752d4640 1 -- 172.21.15.120:0/1479358528 wait complete. 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.677+0000 7f22752d4640 1 Processor -- start 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.677+0000 7f22752d4640 1 -- start start 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.677+0000 7f22752d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 0x7f22701a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.677+0000 7f22752d4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f22700742a0 con 0x7f227010fff0 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.677+0000 7f226effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 0x7f22701a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.677+0000 7f226effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 0x7f22701a4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:53416/0 (socket says 172.21.15.120:53416) 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.677+0000 7f226effd640 1 -- 172.21.15.120:0/3560051471 learned_addr learned my addr 172.21.15.120:0/3560051471 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.678+0000 7f226effd640 1 -- 172.21.15.120:0/3560051471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22701a4840 con 0x7f227010fff0 2024-09-07T03:32:09.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.678+0000 7f226effd640 1 --2- 172.21.15.120:0/3560051471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 0x7f22701a4270 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2260009720 tx=0x7f22600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.678+0000 7f22677fe640 1 -- 172.21.15.120:0/3560051471 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2260041070 con 0x7f227010fff0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.678+0000 7f22677fe640 1 -- 172.21.15.120:0/3560051471 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226003c460 con 0x7f227010fff0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.678+0000 7f22677fe640 1 -- 172.21.15.120:0/3560051471 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2260037040 con 0x7f227010fff0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.678+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22701a4b30 con 0x7f227010fff0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.678+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22701a9d00 con 0x7f227010fff0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.679+0000 7f22677fe640 1 -- 172.21.15.120:0/3560051471 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2260044070 con 0x7f227010fff0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.679+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22701a4e70 con 0x7f227010fff0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.679+0000 7f22677fe640 1 --2- 172.21.15.120:0/3560051471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f225003dec0 0x7f2250040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.679+0000 7f22677fe640 1 -- 172.21.15.120:0/3560051471 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3825+0+0 (secure 0 0 0) 0x7f2260072e80 con 0x7f227010fff0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.679+0000 7f2267fff640 1 --2- 172.21.15.120:0/3560051471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f225003dec0 0x7f2250040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:09.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.679+0000 7f2267fff640 1 --2- 172.21.15.120:0/3560051471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f225003dec0 0x7f2250040380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2258000c00 tx=0x7f22580078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:09.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.684+0000 7f22677fe640 1 -- 172.21.15.120:0/3560051471 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f2260071bf0 con 0x7f227010fff0 2024-09-07T03:32:09.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:09.857+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f2270110450 con 0x7f227010fff0 2024-09-07T03:32:11.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.085+0000 7f22677fe640 1 -- 172.21.15.120:0/3560051471 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v22) ==== 227+0+0 (secure 0 0 0) 0x7f226003d3f0 con 0x7f227010fff0 2024-09-07T03:32:11.086 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'default.rgw.buckets.data' created 2024-09-07T03:32:11.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.087+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f225003dec0 msgr2=0x7f2250040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:11.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.087+0000 7f22752d4640 1 --2- 172.21.15.120:0/3560051471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f225003dec0 0x7f2250040380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2258000c00 tx=0x7f22580078f0 comp rx=0 tx=0).stop 2024-09-07T03:32:11.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.087+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 msgr2=0x7f22701a4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:11.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.087+0000 7f22752d4640 1 --2- 172.21.15.120:0/3560051471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 0x7f22701a4270 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2260009720 tx=0x7f22600046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:11.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.087+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 shutdown_connections 2024-09-07T03:32:11.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.088+0000 7f22752d4640 1 --2- 172.21.15.120:0/3560051471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f225003dec0 0x7f2250040380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:11.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.088+0000 7f22752d4640 1 --2- 172.21.15.120:0/3560051471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f227010fff0 0x7f22701a4270 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:11.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.088+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 >> 172.21.15.120:0/3560051471 conn(0x7f227006ff80 msgr2=0x7f2270112e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:11.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.088+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 shutdown_connections 2024-09-07T03:32:11.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.088+0000 7f22752d4640 1 -- 172.21.15.120:0/3560051471 wait complete. 2024-09-07T03:32:11.108 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.206+0000 7f97b74c8640 1 Processor -- start 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b74c8640 1 -- start start 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b74c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f97b010fff0 0x7f97b01103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b74c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97b0110a90 con 0x7f97b0114dd0 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b74c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f97b0115990 con 0x7f97b010fff0 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b5264640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f97b010fff0 0x7f97b01103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b4a63640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f97b0114dd0 0x7f97b0115280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:46008/0 (socket says 172.21.15.120:46008) 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b5264640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f97b010fff0 0x7f97b01103d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:53428/0 (socket says 172.21.15.120:53428) 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b4a63640 1 -- 172.21.15.120:0/3459007226 learned_addr learned my addr 172.21.15.120:0/3459007226 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b5264640 1 -- 172.21.15.120:0/3459007226 >> v1:172.21.15.104:6789/0 conn(0x7f97b0114dd0 legacy=0x7f97b0115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:11.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.207+0000 7f97b5264640 1 -- 172.21.15.120:0/3459007226 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b0115b40 con 0x7f97b010fff0 2024-09-07T03:32:11.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.208+0000 7f97b5264640 1 --2- 172.21.15.120:0/3459007226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 0x7f97b01103d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009720 tx=0x7f97a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25b00881f978a0b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:11.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.208+0000 7f97affff640 1 -- 172.21.15.120:0/3459007226 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a8037070 con 0x7f97b010fff0 2024-09-07T03:32:11.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.208+0000 7f97affff640 1 -- 172.21.15.120:0/3459007226 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a802ad90 con 0x7f97b010fff0 2024-09-07T03:32:11.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.208+0000 7f97affff640 1 -- 172.21.15.120:0/3459007226 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a8032590 con 0x7f97b010fff0 2024-09-07T03:32:11.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.209+0000 7f97b74c8640 1 -- 172.21.15.120:0/3459007226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 msgr2=0x7f97b01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.209+0000 7f97b74c8640 1 --2- 172.21.15.120:0/3459007226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 0x7f97b01103d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009720 tx=0x7f97a802a110 comp rx=0 tx=0).stop 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.209+0000 7f97b74c8640 1 -- 172.21.15.120:0/3459007226 shutdown_connections 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.209+0000 7f97b74c8640 1 --2- 172.21.15.120:0/3459007226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 0x7f97b01103d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.209+0000 7f97b74c8640 1 -- 172.21.15.120:0/3459007226 >> 172.21.15.120:0/3459007226 conn(0x7f97b006ff80 msgr2=0x7f97b00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.209+0000 7f97b74c8640 1 -- 172.21.15.120:0/3459007226 shutdown_connections 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.209+0000 7f97b74c8640 1 -- 172.21.15.120:0/3459007226 wait complete. 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.210+0000 7f97b74c8640 1 Processor -- start 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.210+0000 7f97b74c8640 1 -- start start 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.210+0000 7f97b74c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 0x7f97b0111fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.210+0000 7f97b74c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f97b011b1f0 con 0x7f97b010fff0 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.210+0000 7f97b5264640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 0x7f97b0111fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.210+0000 7f97b5264640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 0x7f97b0111fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:53434/0 (socket says 172.21.15.120:53434) 2024-09-07T03:32:11.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.210+0000 7f97b5264640 1 -- 172.21.15.120:0/1692533762 learned_addr learned my addr 172.21.15.120:0/1692533762 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:11.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.211+0000 7f97b5264640 1 -- 172.21.15.120:0/1692533762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b0113ec0 con 0x7f97b010fff0 2024-09-07T03:32:11.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.211+0000 7f97b5264640 1 --2- 172.21.15.120:0/1692533762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 0x7f97b0111fc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97a802a150 tx=0x7f97a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:11.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.211+0000 7f97adffb640 1 -- 172.21.15.120:0/1692533762 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a8041070 con 0x7f97b010fff0 2024-09-07T03:32:11.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.211+0000 7f97adffb640 1 -- 172.21.15.120:0/1692533762 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a8032e30 con 0x7f97b010fff0 2024-09-07T03:32:11.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.211+0000 7f97adffb640 1 -- 172.21.15.120:0/1692533762 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a8037040 con 0x7f97b010fff0 2024-09-07T03:32:11.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.211+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b0112560 con 0x7f97b010fff0 2024-09-07T03:32:11.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.211+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b0112b00 con 0x7f97b010fff0 2024-09-07T03:32:11.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.212+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b0112e40 con 0x7f97b010fff0 2024-09-07T03:32:11.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.212+0000 7f97adffb640 1 -- 172.21.15.120:0/1692533762 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f97a8044070 con 0x7f97b010fff0 2024-09-07T03:32:11.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.212+0000 7f97adffb640 1 --2- 172.21.15.120:0/1692533762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f979c03de70 0x7f979c040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:11.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.213+0000 7f97adffb640 1 -- 172.21.15.120:0/1692533762 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4272+0+0 (secure 0 0 0) 0x7f97a8072f20 con 0x7f97b010fff0 2024-09-07T03:32:11.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.213+0000 7f97b4a63640 1 --2- 172.21.15.120:0/1692533762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f979c03de70 0x7f979c040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:11.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.213+0000 7f97b4a63640 1 --2- 172.21.15.120:0/1692533762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f979c03de70 0x7f979c040330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f97a4007fd0 tx=0x7f97a4007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:11.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.217+0000 7f97adffb640 1 -- 172.21.15.120:0/1692533762 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f97a803cdf0 con 0x7f97b010fff0 2024-09-07T03:32:11.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:11.393+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f97b0110450 con 0x7f97b010fff0 2024-09-07T03:32:12.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.088+0000 7f97adffb640 1 -- 172.21.15.120:0/1692533762 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v23) ==== 185+0+0 (secure 0 0 0) 0x7f97a8071b00 con 0x7f97b010fff0 2024-09-07T03:32:12.089 INFO:teuthology.orchestra.run.smithi120.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-07T03:32:12.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.092+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f979c03de70 msgr2=0x7f979c040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:12.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.092+0000 7f97b74c8640 1 --2- 172.21.15.120:0/1692533762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f979c03de70 0x7f979c040330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f97a4007fd0 tx=0x7f97a4007aa0 comp rx=0 tx=0).stop 2024-09-07T03:32:12.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.092+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 msgr2=0x7f97b0111fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:12.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.092+0000 7f97b74c8640 1 --2- 172.21.15.120:0/1692533762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 0x7f97b0111fc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97a802a150 tx=0x7f97a80046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:12.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.093+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 shutdown_connections 2024-09-07T03:32:12.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.093+0000 7f97b74c8640 1 --2- 172.21.15.120:0/1692533762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f979c03de70 0x7f979c040330 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:12.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.093+0000 7f97b74c8640 1 --2- 172.21.15.120:0/1692533762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97b010fff0 0x7f97b0111fc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:12.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.093+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 >> 172.21.15.120:0/1692533762 conn(0x7f97b006ff80 msgr2=0x7f97b0110d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:12.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.093+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 shutdown_connections 2024-09-07T03:32:12.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.093+0000 7f97b74c8640 1 -- 172.21.15.120:0/1692533762 wait complete. 2024-09-07T03:32:12.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-07T03:32:12.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.228+0000 7f630fa40640 1 Processor -- start 2024-09-07T03:32:12.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.228+0000 7f630fa40640 1 -- start start 2024-09-07T03:32:12.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.228+0000 7f630fa40640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f63081136f0 0x7f6308113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:12.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.228+0000 7f630fa40640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6308114190 con 0x7f6308073ee0 2024-09-07T03:32:12.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.228+0000 7f630fa40640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6308074aa0 con 0x7f63081136f0 2024-09-07T03:32:12.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.229+0000 7f630d7dc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f63081136f0 0x7f6308113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:12.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.229+0000 7f630d7dc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f63081136f0 0x7f6308113ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:53440/0 (socket says 172.21.15.120:53440) 2024-09-07T03:32:12.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.229+0000 7f630cfdb640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6308073ee0 0x7f6308074390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:46016/0 (socket says 172.21.15.120:46016) 2024-09-07T03:32:12.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.229+0000 7f630d7dc640 1 -- 172.21.15.120:0/3903792485 learned_addr learned my addr 172.21.15.120:0/3903792485 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:12.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.229+0000 7f630d7dc640 1 -- 172.21.15.120:0/3903792485 >> v1:172.21.15.104:6789/0 conn(0x7f6308073ee0 legacy=0x7f6308074390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:12.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.229+0000 7f630d7dc640 1 -- 172.21.15.120:0/3903792485 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6308074c50 con 0x7f63081136f0 2024-09-07T03:32:12.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f630d7dc640 1 --2- 172.21.15.120:0/3903792485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63081136f0 0x7f6308113ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f63040097f0 tx=0x7f630402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c6f29639a69200 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:12.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f62fffff640 1 -- 172.21.15.120:0/3903792485 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6304037070 con 0x7f63081136f0 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f62fffff640 1 -- 172.21.15.120:0/3903792485 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6304032440 con 0x7f63081136f0 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f62fffff640 1 -- 172.21.15.120:0/3903792485 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f630402ae60 con 0x7f63081136f0 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f630fa40640 1 -- 172.21.15.120:0/3903792485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63081136f0 msgr2=0x7f6308113ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f630fa40640 1 --2- 172.21.15.120:0/3903792485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63081136f0 0x7f6308113ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f63040097f0 tx=0x7f630402a1e0 comp rx=0 tx=0).stop 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f630fa40640 1 -- 172.21.15.120:0/3903792485 shutdown_connections 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f630fa40640 1 --2- 172.21.15.120:0/3903792485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63081136f0 0x7f6308113ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f630fa40640 1 -- 172.21.15.120:0/3903792485 >> 172.21.15.120:0/3903792485 conn(0x7f630806ff80 msgr2=0x7f63080723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f630fa40640 1 -- 172.21.15.120:0/3903792485 shutdown_connections 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.230+0000 7f630fa40640 1 -- 172.21.15.120:0/3903792485 wait complete. 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.231+0000 7f630fa40640 1 Processor -- start 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.231+0000 7f630fa40640 1 -- start start 2024-09-07T03:32:12.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.231+0000 7f630fa40640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6308073ee0 0x7f63081a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.231+0000 7f630fa40640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f630811bb90 con 0x7f6308073ee0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.231+0000 7f630d7dc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6308073ee0 0x7f63081a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.231+0000 7f630d7dc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6308073ee0 0x7f63081a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:53444/0 (socket says 172.21.15.120:53444) 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.231+0000 7f630d7dc640 1 -- 172.21.15.120:0/1144110790 learned_addr learned my addr 172.21.15.120:0/1144110790 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.232+0000 7f630d7dc640 1 -- 172.21.15.120:0/1144110790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63081a5bf0 con 0x7f6308073ee0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.232+0000 7f630d7dc640 1 --2- 172.21.15.120:0/1144110790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6308073ee0 0x7f63081a5620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6304035040 tx=0x7f63040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.232+0000 7f62fdffb640 1 -- 172.21.15.120:0/1144110790 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6304041070 con 0x7f6308073ee0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.232+0000 7f62fdffb640 1 -- 172.21.15.120:0/1144110790 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f630403c7a0 con 0x7f6308073ee0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.232+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63081a5e80 con 0x7f6308073ee0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.232+0000 7f62fdffb640 1 -- 172.21.15.120:0/1144110790 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6304037040 con 0x7f6308073ee0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.232+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63081aae50 con 0x7f6308073ee0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.233+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63081ab950 con 0x7f6308073ee0 2024-09-07T03:32:12.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.233+0000 7f62fdffb640 1 -- 172.21.15.120:0/1144110790 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6304044070 con 0x7f6308073ee0 2024-09-07T03:32:12.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.233+0000 7f62fdffb640 1 --2- 172.21.15.120:0/1144110790 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f62ec03de70 0x7f62ec040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:12.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.234+0000 7f62fdffb640 1 -- 172.21.15.120:0/1144110790 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4283+0+0 (secure 0 0 0) 0x7f63040730f0 con 0x7f6308073ee0 2024-09-07T03:32:12.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.234+0000 7f630cfdb640 1 --2- 172.21.15.120:0/1144110790 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f62ec03de70 0x7f62ec040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:12.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.234+0000 7f630cfdb640 1 --2- 172.21.15.120:0/1144110790 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f62ec03de70 0x7f62ec040330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62f8001630 tx=0x7f62f8007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:12.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.238+0000 7f62fdffb640 1 -- 172.21.15.120:0/1144110790 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f630403ac80 con 0x7f6308073ee0 2024-09-07T03:32:12.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:12.413+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f63081abb70 con 0x7f6308073ee0 2024-09-07T03:32:13.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.090+0000 7f62fdffb640 1 -- 172.21.15.120:0/1144110790 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v24) ==== 169+0+0 (secure 0 0 0) 0x7f630403d3f0 con 0x7f6308073ee0 2024-09-07T03:32:13.091 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'default.rgw.buckets.index' created 2024-09-07T03:32:13.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.092+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f62ec03de70 msgr2=0x7f62ec040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:13.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.092+0000 7f630fa40640 1 --2- 172.21.15.120:0/1144110790 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f62ec03de70 0x7f62ec040330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62f8001630 tx=0x7f62f8007a20 comp rx=0 tx=0).stop 2024-09-07T03:32:13.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.092+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6308073ee0 msgr2=0x7f63081a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.092+0000 7f630fa40640 1 --2- 172.21.15.120:0/1144110790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6308073ee0 0x7f63081a5620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6304035040 tx=0x7f63040046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.092+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 shutdown_connections 2024-09-07T03:32:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.092+0000 7f630fa40640 1 --2- 172.21.15.120:0/1144110790 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f62ec03de70 0x7f62ec040330 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62f8001630 tx=0x7f62f8007a20 comp rx=0 tx=0).stop 2024-09-07T03:32:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.092+0000 7f630fa40640 1 --2- 172.21.15.120:0/1144110790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6308073ee0 0x7f63081a5620 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.092+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 >> 172.21.15.120:0/1144110790 conn(0x7f630806ff80 msgr2=0x7f630810ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.093+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 shutdown_connections 2024-09-07T03:32:13.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.093+0000 7f630fa40640 1 -- 172.21.15.120:0/1144110790 wait complete. 2024-09-07T03:32:13.112 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-07T03:32:13.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.210+0000 7f00e24fe640 1 Processor -- start 2024-09-07T03:32:13.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.210+0000 7f00e24fe640 1 -- start start 2024-09-07T03:32:13.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.210+0000 7f00e24fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f00dc114790 0x7f00dc114b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:13.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.210+0000 7f00e24fe640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00dc115260 con 0x7f00dc06d280 2024-09-07T03:32:13.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.210+0000 7f00e24fe640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f00dc06de40 con 0x7f00dc114790 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.211+0000 7f00dbfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f00dc114790 0x7f00dc114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.211+0000 7f00dbfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f00dc114790 0x7f00dc114b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:53460/0 (socket says 172.21.15.120:53460) 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.211+0000 7f00d3fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f00dc06d280 0x7f00dc06d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:46022/0 (socket says 172.21.15.120:46022) 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.211+0000 7f00dbfff640 1 -- 172.21.15.120:0/3403140767 learned_addr learned my addr 172.21.15.120:0/3403140767 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.211+0000 7f00dbfff640 1 -- 172.21.15.120:0/3403140767 >> v1:172.21.15.104:6789/0 conn(0x7f00dc06d280 legacy=0x7f00dc06d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.211+0000 7f00dbfff640 1 -- 172.21.15.120:0/3403140767 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00dc06dff0 con 0x7f00dc114790 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.212+0000 7f00dbfff640 1 --2- 172.21.15.120:0/3403140767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc114790 0x7f00dc114b70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0097f0 tx=0x7f00cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb087f016981d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.212+0000 7f00db7fe640 1 -- 172.21.15.120:0/3403140767 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00cc037070 con 0x7f00dc114790 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.212+0000 7f00db7fe640 1 -- 172.21.15.120:0/3403140767 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00cc032440 con 0x7f00dc114790 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.212+0000 7f00db7fe640 1 -- 172.21.15.120:0/3403140767 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00cc02ae60 con 0x7f00dc114790 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.212+0000 7f00e24fe640 1 -- 172.21.15.120:0/3403140767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc114790 msgr2=0x7f00dc114b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.212+0000 7f00e24fe640 1 --2- 172.21.15.120:0/3403140767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc114790 0x7f00dc114b70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0097f0 tx=0x7f00cc02a1e0 comp rx=0 tx=0).stop 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.212+0000 7f00e24fe640 1 -- 172.21.15.120:0/3403140767 shutdown_connections 2024-09-07T03:32:13.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.212+0000 7f00e24fe640 1 --2- 172.21.15.120:0/3403140767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc114790 0x7f00dc114b70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.212+0000 7f00e24fe640 1 -- 172.21.15.120:0/3403140767 >> 172.21.15.120:0/3403140767 conn(0x7f00dc070cd0 msgr2=0x7f00dc0730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.213+0000 7f00e24fe640 1 -- 172.21.15.120:0/3403140767 shutdown_connections 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.213+0000 7f00e24fe640 1 -- 172.21.15.120:0/3403140767 wait complete. 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.213+0000 7f00e24fe640 1 Processor -- start 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.213+0000 7f00e24fe640 1 -- start start 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.213+0000 7f00e24fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc06d280 0x7f00dc10fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.213+0000 7f00e24fe640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc11cc20 con 0x7f00dc06d280 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc06d280 0x7f00dc10fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc06d280 0x7f00dc10fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:53468/0 (socket says 172.21.15.120:53468) 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00dbfff640 1 -- 172.21.15.120:0/3129466795 learned_addr learned my addr 172.21.15.120:0/3129466795 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00dbfff640 1 -- 172.21.15.120:0/3129466795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00dc111da0 con 0x7f00dc06d280 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00dbfff640 1 --2- 172.21.15.120:0/3129466795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc06d280 0x7f00dc10fea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f00cc035040 tx=0x7f00cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00d97fa640 1 -- 172.21.15.120:0/3129466795 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00cc041070 con 0x7f00dc06d280 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00d97fa640 1 -- 172.21.15.120:0/3129466795 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00cc03c7a0 con 0x7f00dc06d280 2024-09-07T03:32:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00dc110440 con 0x7f00dc06d280 2024-09-07T03:32:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00d97fa640 1 -- 172.21.15.120:0/3129466795 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00cc037040 con 0x7f00dc06d280 2024-09-07T03:32:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.214+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00dc1109e0 con 0x7f00dc06d280 2024-09-07T03:32:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.215+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00dc110d20 con 0x7f00dc06d280 2024-09-07T03:32:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.215+0000 7f00d97fa640 1 -- 172.21.15.120:0/3129466795 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f00cc044070 con 0x7f00dc06d280 2024-09-07T03:32:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.215+0000 7f00d97fa640 1 --2- 172.21.15.120:0/3129466795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f00bc03de70 0x7f00bc040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.215+0000 7f00d97fa640 1 -- 172.21.15.120:0/3129466795 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4647+0+0 (secure 0 0 0) 0x7f00cc073320 con 0x7f00dc06d280 2024-09-07T03:32:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.216+0000 7f00d3fff640 1 --2- 172.21.15.120:0/3129466795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f00bc03de70 0x7f00bc040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.216+0000 7f00d3fff640 1 --2- 172.21.15.120:0/3129466795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f00bc03de70 0x7f00bc040330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00c4001630 tx=0x7f00c4007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:13.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.220+0000 7f00d97fa640 1 -- 172.21.15.120:0/3129466795 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f00cc03ac80 con 0x7f00dc06d280 2024-09-07T03:32:13.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:13.397+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f00dc114790 con 0x7f00dc06d280 2024-09-07T03:32:14.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.097+0000 7f00d97fa640 1 -- 172.21.15.120:0/3129466795 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v25) ==== 187+0+0 (secure 0 0 0) 0x7f00cc0730d0 con 0x7f00dc06d280 2024-09-07T03:32:14.099 INFO:teuthology.orchestra.run.smithi120.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-07T03:32:14.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f00bc03de70 msgr2=0x7f00bc040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 --2- 172.21.15.120:0/3129466795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f00bc03de70 0x7f00bc040330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00c4001630 tx=0x7f00c4007a20 comp rx=0 tx=0).stop 2024-09-07T03:32:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc06d280 msgr2=0x7f00dc10fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 --2- 172.21.15.120:0/3129466795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc06d280 0x7f00dc10fea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f00cc035040 tx=0x7f00cc0046c0 comp rx=0 tx=0).stop 2024-09-07T03:32:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 shutdown_connections 2024-09-07T03:32:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 --2- 172.21.15.120:0/3129466795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f00bc03de70 0x7f00bc040330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 --2- 172.21.15.120:0/3129466795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00dc06d280 0x7f00dc10fea0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 >> 172.21.15.120:0/3129466795 conn(0x7f00dc070cd0 msgr2=0x7f00dc1163c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 shutdown_connections 2024-09-07T03:32:14.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:14.100+0000 7f00e24fe640 1 -- 172.21.15.120:0/3129466795 wait complete. 2024-09-07T03:32:14.131 DEBUG:tasks.rgw:Pools created 2024-09-07T03:32:14.131 INFO:tasks.rgw:Starting rgw... 2024-09-07T03:32:14.131 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-07T03:32:14.132 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-07T03:32:14.132 DEBUG:teuthology.orchestra.run.smithi120:> sudo echo -n http://smithi120.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-07T03:32:14.159 INFO:teuthology.orchestra.run.smithi120.stdout:http://smithi120.front.sepia.ceph.com:80 2024-09-07T03:32:14.159 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-07T03:32:14.225 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-07T03:32:14.225 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-07T03:32:14.267 INFO:tasks.rgw.client.0:Started 2024-09-07T03:32:14.267 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi120.front.sepia.ceph.com:80/ 2024-09-07T03:32:14.268 DEBUG:teuthology.orchestra.run.smithi120:> curl http://smithi120.front.sepia.ceph.com:80/ 2024-09-07T03:32:14.295 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-07T03:32:14.296 INFO:teuthology.orchestra.run.smithi120.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-07T03:32:14.296 INFO:teuthology.orchestra.run.smithi120.stderr: Dload Upload Total Spent Left Speed 2024-09-07T03:32:14.296 INFO:teuthology.orchestra.run.smithi120.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-07T03:32:14.296 INFO:teuthology.orchestra.run.smithi120.stderr:curl: (7) Failed to connect to smithi120.front.sepia.ceph.com port 80: Connection refused 2024-09-07T03:32:15.297 DEBUG:teuthology.orchestra.run.smithi120:> curl http://smithi120.front.sepia.ceph.com:80/ 2024-09-07T03:32:15.318 INFO:teuthology.orchestra.run.smithi120.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-07T03:32:15.318 INFO:teuthology.orchestra.run.smithi120.stderr: Dload Upload Total Spent Left Speed 2024-09-07T03:32:15.320 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-07T03:32:15.320 INFO:teuthology.orchestra.run.smithi120.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-07T03:32:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:curl: (7) Failed to connect to smithi120.front.sepia.ceph.com port 80: Connection refused 2024-09-07T03:32:17.321 DEBUG:teuthology.orchestra.run.smithi120:> curl http://smithi120.front.sepia.ceph.com:80/ 2024-09-07T03:32:17.346 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-07T03:32:17.346 INFO:teuthology.orchestra.run.smithi120.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-07T03:32:17.346 INFO:teuthology.orchestra.run.smithi120.stderr: Dload Upload Total Spent Left Speed 2024-09-07T03:32:17.347 INFO:teuthology.orchestra.run.smithi120.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-07T03:32:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:curl: (7) Failed to connect to smithi120.front.sepia.ceph.com port 80: Connection refused 2024-09-07T03:32:21.347 DEBUG:teuthology.orchestra.run.smithi120:> curl http://smithi120.front.sepia.ceph.com:80/ 2024-09-07T03:32:21.370 INFO:teuthology.orchestra.run.smithi120.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-07T03:32:21.371 INFO:teuthology.orchestra.run.smithi120.stderr: Dload Upload Total Spent Left Speed 2024-09-07T03:32:21.372 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-07T03:32:21.372 INFO:teuthology.orchestra.run.smithi120.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-07T03:32:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:curl: (7) Failed to connect to smithi120.front.sepia.ceph.com port 80: Connection refused 2024-09-07T03:32:29.373 DEBUG:teuthology.orchestra.run.smithi120:> curl http://smithi120.front.sepia.ceph.com:80/ 2024-09-07T03:32:29.397 INFO:teuthology.orchestra.run.smithi120.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-07T03:32:29.397 INFO:teuthology.orchestra.run.smithi120.stderr: Dload Upload Total Spent Left Speed 2024-09-07T03:32:29.399 INFO:teuthology.orchestra.run.smithi120.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-07T03:32:29.400 INFO:teuthology.orchestra.run.smithi120.stdout:anonymous 2024-09-07T03:32:29.401 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-07T03:32:31.370 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-07T03:32:31.371 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-07T03:32:31.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-07T03:32:31.371 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-07T03:32:31.420 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:31.421 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:31.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.420+0000 7f7268a0e800 1 Processor -- start 2024-09-07T03:32:31.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.420+0000 7f7268a0e800 1 -- start start 2024-09-07T03:32:31.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.420+0000 7f7268a0e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d58d5541f0 0x55d58d559d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.420+0000 7f7268a0e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d58d3fde40 con 0x55d58d552de0 2024-09-07T03:32:31.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.420+0000 7f7268a0e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d58d3c8680 con 0x55d58d5541f0 2024-09-07T03:32:31.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.421+0000 7f725bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d58d5541f0 0x55d58d559d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.421+0000 7f72641bc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55d58d552de0 0x55d58d553ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48136/0 (socket says 172.21.15.120:48136) 2024-09-07T03:32:31.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.421+0000 7f72641bc640 1 -- 172.21.15.120:0/2947319010 learned_addr learned my addr 172.21.15.120:0/2947319010 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.421+0000 7f725bfff640 1 -- 172.21.15.120:0/2947319010 >> v1:172.21.15.104:6789/0 conn(0x55d58d552de0 legacy=0x55d58d553ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.421+0000 7f725bfff640 1 -- 172.21.15.120:0/2947319010 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58d3e46b0 con 0x55d58d5541f0 2024-09-07T03:32:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.421+0000 7f72639bb640 1 -- 172.21.15.120:0/2947319010 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839653140 0 0) 0x55d58d3fde40 con 0x55d58d552de0 2024-09-07T03:32:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.423+0000 7f725bfff640 1 --2- 172.21.15.120:0/2947319010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d5541f0 0x55d58d559d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f724c00a470 tx=0x7f724c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f6681a3a831426 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.423+0000 7f72639bb640 1 -- 172.21.15.120:0/2947319010 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724c053570 con 0x55d58d5541f0 2024-09-07T03:32:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.423+0000 7f72639bb640 1 -- 172.21.15.120:0/2947319010 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f724c058070 con 0x55d58d5541f0 2024-09-07T03:32:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.423+0000 7f72639bb640 1 -- 172.21.15.120:0/2947319010 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724c053880 con 0x55d58d5541f0 2024-09-07T03:32:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.423+0000 7f7268a0e800 1 -- 172.21.15.120:0/2947319010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d5541f0 msgr2=0x55d58d559d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.423+0000 7f7268a0e800 1 --2- 172.21.15.120:0/2947319010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d5541f0 0x55d58d559d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f724c00a470 tx=0x7f724c045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.424+0000 7f7268a0e800 1 -- 172.21.15.120:0/2947319010 shutdown_connections 2024-09-07T03:32:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.424+0000 7f7268a0e800 1 --2- 172.21.15.120:0/2947319010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d5541f0 0x55d58d559d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.424+0000 7f7268a0e800 1 -- 172.21.15.120:0/2947319010 >> 172.21.15.120:0/2947319010 conn(0x55d58d54e1b0 msgr2=0x55d58d550610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.424+0000 7f7268a0e800 1 -- 172.21.15.120:0/2947319010 shutdown_connections 2024-09-07T03:32:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.424+0000 7f7268a0e800 1 -- 172.21.15.120:0/2947319010 wait complete. 2024-09-07T03:32:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.439+0000 7f7268a0e800 1 Processor -- start 2024-09-07T03:32:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.439+0000 7f7268a0e800 1 -- start start 2024-09-07T03:32:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.439+0000 7f7268a0e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d642340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.439+0000 7f7268a0e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d58d3ecdd0 con 0x55d58d552de0 2024-09-07T03:32:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.440+0000 7f72641bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d642340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.440+0000 7f72641bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d642340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40544/0 (socket says 172.21.15.120:40544) 2024-09-07T03:32:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.440+0000 7f72641bc640 1 -- 172.21.15.120:0/1350690828 learned_addr learned my addr 172.21.15.120:0/1350690828 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.440+0000 7f72641bc640 1 -- 172.21.15.120:0/1350690828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58d405e10 con 0x55d58d552de0 2024-09-07T03:32:31.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.440+0000 7f72641bc640 1 --2- 172.21.15.120:0/1350690828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d642340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f725400b210 tx=0x7f725400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9bca06d16ccbbb server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.440+0000 7f715260c640 1 -- 172.21.15.120:0/1350690828 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7254008070 con 0x55d58d552de0 2024-09-07T03:32:31.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.440+0000 7f715260c640 1 -- 172.21.15.120:0/1350690828 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725400d500 con 0x55d58d552de0 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.440+0000 7f715260c640 1 -- 172.21.15.120:0/1350690828 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725400d800 con 0x55d58d552de0 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.441+0000 7f7268a0e800 1 -- 172.21.15.120:0/1350690828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 msgr2=0x55d58d642340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.441+0000 7f7268a0e800 1 --2- 172.21.15.120:0/1350690828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d642340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f725400b210 tx=0x7f725400b6d0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.441+0000 7f7268a0e800 1 -- 172.21.15.120:0/1350690828 shutdown_connections 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.441+0000 7f7268a0e800 1 --2- 172.21.15.120:0/1350690828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d642340 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.441+0000 7f7268a0e800 1 -- 172.21.15.120:0/1350690828 >> 172.21.15.120:0/1350690828 conn(0x55d58d54e1b0 msgr2=0x55d58d63dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.441+0000 7f7268a0e800 1 -- 172.21.15.120:0/1350690828 shutdown_connections 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.441+0000 7f7268a0e800 1 -- 172.21.15.120:0/1350690828 wait complete. 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.442+0000 7f7268a0e800 1 Processor -- start 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.442+0000 7f7268a0e800 1 -- start start 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.442+0000 7f7268a0e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d649cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.442+0000 7f7268a0e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d58d5548e0 con 0x55d58d552de0 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.442+0000 7f72641bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d649cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.442+0000 7f72641bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d649cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40546/0 (socket says 172.21.15.120:40546) 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.442+0000 7f72641bc640 1 -- 172.21.15.120:0/4220143961 learned_addr learned my addr 172.21.15.120:0/4220143961 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.443+0000 7f72641bc640 1 -- 172.21.15.120:0/4220143961 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58d64a230 con 0x55d58d552de0 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.443+0000 7f72641bc640 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d649cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f725400b710 tx=0x7f7254000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.443+0000 7f7150e09640 1 -- 172.21.15.120:0/4220143961 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7254001540 con 0x55d58d552de0 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.443+0000 7f7150e09640 1 -- 172.21.15.120:0/4220143961 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725400f980 con 0x55d58d552de0 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.443+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d58d64a4c0 con 0x55d58d552de0 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.443+0000 7f7150e09640 1 -- 172.21.15.120:0/4220143961 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725400fca0 con 0x55d58d552de0 2024-09-07T03:32:31.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.443+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58d64aec0 con 0x55d58d552de0 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.444+0000 7f7150e09640 1 -- 172.21.15.120:0/4220143961 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7254017040 con 0x55d58d552de0 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.444+0000 7f7150e09640 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f714c03c730 0x7f714c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.444+0000 7f7150e09640 1 -- 172.21.15.120:0/4220143961 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f7254015020 con 0x55d58d552de0 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.444+0000 7f725bfff640 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f714c03c730 0x7f714c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.444+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d5541f0 0x55d58d651320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.444+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d651860 con 0x55d58d5541f0 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.445+0000 7f72649bd640 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d5541f0 0x55d58d651320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.445+0000 7f725bfff640 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f714c03c730 0x7f714c03ebf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f724c057000 tx=0x7f724c052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.445+0000 7f72649bd640 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d5541f0 0x55d58d651320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.445+0000 7f72649bd640 1 -- 172.21.15.120:0/4220143961 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725c00a4d0 con 0x55d58d5541f0 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.445+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d652110 0x55d58d6545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.445+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d654d40 con 0x55d58d652110 2024-09-07T03:32:31.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.446+0000 7f72641bc640 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d652110 0x55d58d6545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.446+0000 7f72641bc640 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d652110 0x55d58d6545d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.446+0000 7f72641bc640 1 -- 172.21.15.120:0/4220143961 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f725402d070 con 0x55d58d652110 2024-09-07T03:32:31.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.446+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d6565f0 con 0x55d58d652110 2024-09-07T03:32:31.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.447+0000 7f72641bc640 1 -- 172.21.15.120:0/4220143961 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f725402d070 con 0x55d58d652110 2024-09-07T03:32:31.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.447+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d655730 con 0x55d58d652110 2024-09-07T03:32:31.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.447+0000 7f72641bc640 1 -- 172.21.15.120:0/4220143961 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f725402d070 con 0x55d58d652110 2024-09-07T03:32:31.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.447+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d655b90 con 0x55d58d5541f0 2024-09-07T03:32:31.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.448+0000 7f72649bd640 1 -- 172.21.15.120:0/4220143961 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f725c00a4d0 con 0x55d58d5541f0 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.448+0000 7f7268a0e800 1 Processor -- start 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.448+0000 7f7268a0e800 1 -- start start 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.448+0000 7f7268a0e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d4c6e70 0x55d58d6687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.448+0000 7f7268a0e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d58d44aa00 con 0x55d58d4c6e70 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.448+0000 7f72649bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d4c6e70 0x55d58d6687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.448+0000 7f72649bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d4c6e70 0x55d58d6687b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40550/0 (socket says 172.21.15.120:40550) 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.448+0000 7f72649bd640 1 -- 172.21.15.120:0/2729760060 learned_addr learned my addr 172.21.15.120:0/2729760060 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.449+0000 7f72649bd640 1 -- 172.21.15.120:0/2729760060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58d668cf0 con 0x55d58d4c6e70 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.449+0000 7f72649bd640 1 --2- 172.21.15.120:0/2729760060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d4c6e70 0x55d58d6687b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f725c016d20 tx=0x7f725c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.449+0000 7f7149ffb640 1 -- 172.21.15.120:0/2729760060 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c017660 con 0x55d58d4c6e70 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.449+0000 7f7149ffb640 1 -- 172.21.15.120:0/2729760060 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c01b030 con 0x55d58d4c6e70 2024-09-07T03:32:31.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.449+0000 7f7268a0e800 1 -- 172.21.15.120:0/2729760060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d58d668ec0 con 0x55d58d4c6e70 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.449+0000 7f7149ffb640 1 -- 172.21.15.120:0/2729760060 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c017950 con 0x55d58d4c6e70 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.449+0000 7f7268a0e800 1 -- 172.21.15.120:0/2729760060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58d669410 con 0x55d58d4c6e70 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.450+0000 7f7149ffb640 1 -- 172.21.15.120:0/2729760060 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f725c017af0 con 0x55d58d4c6e70 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.450+0000 7f7149ffb640 1 --2- 172.21.15.120:0/2729760060 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713c03c780 0x7f713c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.450+0000 7f7149ffb640 1 -- 172.21.15.120:0/2729760060 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f725c00e040 con 0x55d58d4c6e70 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.450+0000 7f72641bc640 1 --2- 172.21.15.120:0/2729760060 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713c03c780 0x7f713c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.451+0000 7f7268a0e800 1 Processor -- start 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.451+0000 7f7268a0e800 1 -- start start 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.451+0000 7f72641bc640 1 --2- 172.21.15.120:0/2729760060 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713c03c780 0x7f713c03ec40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55d58d64b3e0 tx=0x7f725401b440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.451+0000 7f7268a0e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d672ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.451+0000 7f7268a0e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d58d642b90 con 0x55d58d6726d0 2024-09-07T03:32:31.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.451+0000 7f72649bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d672ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.451+0000 7f72649bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d672ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40552/0 (socket says 172.21.15.120:40552) 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.451+0000 7f72649bd640 1 -- 172.21.15.120:0/825959293 learned_addr learned my addr 172.21.15.120:0/825959293 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.451+0000 7f72649bd640 1 -- 172.21.15.120:0/825959293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58d6730c0 con 0x55d58d6726d0 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f72649bd640 1 --2- 172.21.15.120:0/825959293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d672ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f725c053e00 tx=0x7f725c028d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a845126ffc81fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f71437fe640 1 -- 172.21.15.120:0/825959293 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c051070 con 0x55d58d6726d0 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f71437fe640 1 -- 172.21.15.120:0/825959293 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c0149b0 con 0x55d58d6726d0 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f71437fe640 1 -- 172.21.15.120:0/825959293 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c04cca0 con 0x55d58d6726d0 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f7268a0e800 1 -- 172.21.15.120:0/825959293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 msgr2=0x55d58d672ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f7268a0e800 1 --2- 172.21.15.120:0/825959293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d672ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f725c053e00 tx=0x7f725c028d80 comp rx=0 tx=0).stop 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f7268a0e800 1 -- 172.21.15.120:0/825959293 shutdown_connections 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f7268a0e800 1 --2- 172.21.15.120:0/825959293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d672ad0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f7268a0e800 1 -- 172.21.15.120:0/825959293 >> 172.21.15.120:0/825959293 conn(0x55d58d66ead0 msgr2=0x55d58d66cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f7268a0e800 1 -- 172.21.15.120:0/825959293 shutdown_connections 2024-09-07T03:32:31.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.452+0000 7f7268a0e800 1 -- 172.21.15.120:0/825959293 wait complete. 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.453+0000 7f7268a0e800 1 Processor -- start 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.453+0000 7f7268a0e800 1 -- start start 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.453+0000 7f7268a0e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d679ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.453+0000 7f7268a0e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d58d6736e0 con 0x55d58d6726d0 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.453+0000 7f72649bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d679ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.453+0000 7f72649bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d679ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40566/0 (socket says 172.21.15.120:40566) 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.453+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 learned_addr learned my addr 172.21.15.120:0/4191118279 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.453+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58d67a200 con 0x55d58d6726d0 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.454+0000 7f72649bd640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d679ca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f725c028fd0 tx=0x7f725c053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.454+0000 7f7141ffb640 1 -- 172.21.15.120:0/4191118279 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c012570 con 0x55d58d6726d0 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.454+0000 7f7141ffb640 1 -- 172.21.15.120:0/4191118279 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c0137d0 con 0x55d58d6726d0 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.454+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d58d67a490 con 0x55d58d6726d0 2024-09-07T03:32:31.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.454+0000 7f7141ffb640 1 -- 172.21.15.120:0/4191118279 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c013ab0 con 0x55d58d6726d0 2024-09-07T03:32:31.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.454+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58d67ae10 con 0x55d58d6726d0 2024-09-07T03:32:31.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.455+0000 7f7141ffb640 1 -- 172.21.15.120:0/4191118279 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f725c04c030 con 0x55d58d6726d0 2024-09-07T03:32:31.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.455+0000 7f7141ffb640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713403c730 0x7f713403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.455+0000 7f7141ffb640 1 -- 172.21.15.120:0/4191118279 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f725c035ca0 con 0x55d58d6726d0 2024-09-07T03:32:31.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.455+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.455+0000 7f72641bc640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713403c730 0x7f713403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.455+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d685820 0x55d58d687cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.455+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d688400 con 0x55d58d685820 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.455+0000 7f725bfff640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d685820 0x55d58d687cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.455+0000 7f72641bc640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713403c730 0x7f713403ebf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f725401ac10 tx=0x7f7254043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f725bfff640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d685820 0x55d58d687cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 20 realm 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d688830 con 0x55d58d685820 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d689100 con 0x55d58d685820 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d689b20 0x55d58d68bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.456+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d68c680 con 0x55d58d689b20 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.457+0000 7f72649bd640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d689b20 0x55d58d68bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.457+0000 7f72649bd640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d689b20 0x55d58d68bf10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.457+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.457+0000 7f7268a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.457+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.457+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d68cf20 con 0x55d58d689b20 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.458+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.458+0000 7f7268a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.458+0000 7f7268a0e800 20 searching for the correct realm 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.458+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d58d68ec90 0x55d58d6910a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.458+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d68ec90 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.458+0000 7f72641bc640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d58d68ec90 0x55d58d6910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.458+0000 7f72641bc640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d58d68ec90 0x55d58d6910a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.458+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.458+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d689b20 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.459+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.459+0000 7f72649bd640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f725c014440 0x7f725c055070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.459+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x7f725c014440 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.459+0000 7f725bfff640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f725c014440 0x7f725c055070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.459+0000 7f725bfff640 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f725c014440 0x7f725c055070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.459+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.459+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.460+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.460+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.460+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.460+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d68ec90 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.460+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.460+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.460+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.460+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d689b20 2024-09-07T03:32:31.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.461+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.461+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d689b20 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.461+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.461+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.461+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.461+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x7f725c014440 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.462+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.462+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.462+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.462+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x7f725c014440 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.462+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.462+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d689b20 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.462+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.462+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d68ec90 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.463+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.463+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.463+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.463+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d689b20 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.463+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.463+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d68ec90 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.463+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.464+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.464+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.464+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.464+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.464+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.464+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.464+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d68ec90 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.464+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.464+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x7f725c014440 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.465+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.465+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d685820 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.465+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.465+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x7f725c014440 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.465+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.465+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d68ec90 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.465+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.465+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x7f725c014440 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.466+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.466+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d689b20 2024-09-07T03:32:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.466+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.466+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d689b20 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.466+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.466+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d68ec90 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d689b20 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v27'3 uv3 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691770 con 0x55d58d689b20 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f7268a0e800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f7268a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f7268a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:31.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f7268a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f7268a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f7268a0e800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.467+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d68d870 con 0x55d58d685820 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d68dc60 con 0x55d58d689b20 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d68e0c0 con 0x55d58d685820 2024-09-07T03:32:31.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 zone default found 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 4 Realm: () 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 zonegroup default 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d691c40 con 0x7f725c014440 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.468+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d693f00 con 0x55d58d68ec90 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f7268a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f7268a0e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d694350 con 0x55d58d68ec90 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f7268a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f7268a0e800 20 started sync module instance, tier type = 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f7268a0e800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.469+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d693390 con 0x55d58d689b20 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.470+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.470+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94375688877952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d692ff0 con 0x55d58d689b20 2024-09-07T03:32:31.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.470+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.471+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94375688877952] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.472+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.472+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94375688883664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695670 con 0x55d58d685820 2024-09-07T03:32:31.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.472+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d6960d0 con 0x55d58d689b20 2024-09-07T03:32:31.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.473+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94375688883664] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.473+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.473+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94375688882096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d6960d0 con 0x55d58d689b20 2024-09-07T03:32:31.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.473+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d696b80 con 0x7f725c014440 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.474+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94375688882096] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.475+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.475+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94375688887216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d696b80 con 0x7f725c014440 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.475+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d697590 con 0x55d58d689b20 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.476+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94375688887216] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.479+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.479+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94375688889952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d697590 con 0x55d58d689b20 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.479+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d697fd0 con 0x55d58d68ec90 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.481+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.481+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94375688895264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d698870 con 0x55d58d68ec90 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.482+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d699320 con 0x55d58d68ec90 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.482+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94375688889952] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.483+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94375688895264] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.484+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.485+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94375688897472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d698e30 con 0x55d58d68ec90 2024-09-07T03:32:31.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.485+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d699d30 con 0x7f725c014440 2024-09-07T03:32:31.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94375688897472] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94375688892640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d699d30 con 0x7f725c014440 2024-09-07T03:32:31.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f7268a0e800 20 add_watcher() i=0 2024-09-07T03:32:31.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f7268a0e800 20 add_watcher() i=1 2024-09-07T03:32:31.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f7268a0e800 20 add_watcher() i=2 2024-09-07T03:32:31.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f7268a0e800 20 add_watcher() i=3 2024-09-07T03:32:31.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f7268a0e800 20 add_watcher() i=4 2024-09-07T03:32:31.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f7268a0e800 20 add_watcher() i=5 2024-09-07T03:32:31.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.490+0000 7f7268a0e800 20 add_watcher() i=6 2024-09-07T03:32:31.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.493+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94375688892640] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.493+0000 7f7268a0e800 20 add_watcher() i=7 2024-09-07T03:32:31.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.493+0000 7f7268a0e800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:31.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.493+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d58d69d010 con 0x55d58d685820 2024-09-07T03:32:31.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.493+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.493+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94375688903152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d69a2c0 con 0x55d58d685820 2024-09-07T03:32:31.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94375688903152] v34'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f711a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:31.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f7268a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:31.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f7268a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:31.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f7268a0e800 5 note: GC not initialized 2024-09-07T03:32:31.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f71197e2640 20 reqs_thread_entry: start 2024-09-07T03:32:31.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f7268a0e800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:31.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f7268a0e800 20 Filter name: none 2024-09-07T03:32:31.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f708affd640 20 reqs_thread_entry: start 2024-09-07T03:32:31.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.495+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d6cf900 con 0x55d58d68ec90 2024-09-07T03:32:31.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.496+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(62 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.496+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d698870 con 0x55d58d689b20 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.496+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(63 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.496+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d693390 con 0x55d58d685820 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.496+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.496+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.497+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.497+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x7f725c014440 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.497+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(66 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.497+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d689b20 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.497+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.497+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.498+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.498+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d68ec90 2024-09-07T03:32:31.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.498+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(69 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.498+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x7f725c014440 2024-09-07T03:32:31.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.498+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.498+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d689b20 2024-09-07T03:32:31.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.498+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(71 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.498+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.499+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(72 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.499+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d68ec90 2024-09-07T03:32:31.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.499+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.499+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.499+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(74 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.499+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d68ec90 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.499+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(75 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.499+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x7f725c014440 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.500+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(76 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.500+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d68ec90 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.500+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(77 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.500+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.500+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(78 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.500+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d689b20 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.501+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(79 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.501+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x7f725c014440 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.501+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(80 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.501+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d689b20 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.501+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(81 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.501+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.501+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(82 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.501+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d68ec90 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.502+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(83 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.502+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x7f725c014440 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.502+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(84 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.502+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.502+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(85 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.502+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.502+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(86 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.502+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d68ec90 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.503+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.503+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d68ec90 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.503+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.503+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x7f725c014440 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.503+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(89 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.503+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d685820 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.503+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(90 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.503+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d689b20 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.504+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(91 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.504+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x55d58d68ec90 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.504+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(92 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.504+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d58d695280 con 0x7f725c014440 2024-09-07T03:32:31.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.504+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(93 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.505+0000 7f711a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:31.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.505+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94375688903152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d698870 con 0x55d58d685820 2024-09-07T03:32:31.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.506+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94375688903152] v34'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.506+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94375688877952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d693390 con 0x55d58d689b20 2024-09-07T03:32:31.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.507+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94375688877952] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.507+0000 7f7268a0e800 20 remove_watcher() i=0 2024-09-07T03:32:31.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.507+0000 7f7268a0e800 2 removed watcher, disabling cache 2024-09-07T03:32:31.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.507+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94375688883664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d698820 con 0x55d58d685820 2024-09-07T03:32:31.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.509+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94375688883664] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c051070 con 0x55d58d685820 2024-09-07T03:32:31.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.509+0000 7f7268a0e800 20 remove_watcher() i=1 2024-09-07T03:32:31.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.509+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94375688882096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d698820 con 0x55d58d689b20 2024-09-07T03:32:31.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.512+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94375688882096] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.512+0000 7f7268a0e800 20 remove_watcher() i=2 2024-09-07T03:32:31.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.512+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94375688887216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d698820 con 0x7f725c014440 2024-09-07T03:32:31.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.514+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94375688887216] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.514+0000 7f7268a0e800 20 remove_watcher() i=3 2024-09-07T03:32:31.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.514+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94375688889952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d698820 con 0x55d58d689b20 2024-09-07T03:32:31.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.517+0000 7f72649bd640 1 -- 172.21.15.120:0/4191118279 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94375688889952] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725c027070 con 0x55d58d689b20 2024-09-07T03:32:31.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.517+0000 7f7268a0e800 20 remove_watcher() i=4 2024-09-07T03:32:31.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.517+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94375688895264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d698820 con 0x55d58d68ec90 2024-09-07T03:32:31.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.518+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94375688895264] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.518+0000 7f7268a0e800 20 remove_watcher() i=5 2024-09-07T03:32:31.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.518+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94375688897472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d6947b0 con 0x55d58d68ec90 2024-09-07T03:32:31.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.519+0000 7f72641bc640 1 -- 172.21.15.120:0/4191118279 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94375688897472] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725402d070 con 0x55d58d68ec90 2024-09-07T03:32:31.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.519+0000 7f7268a0e800 20 remove_watcher() i=6 2024-09-07T03:32:31.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.519+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94375688892640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d58d697b20 con 0x7f725c014440 2024-09-07T03:32:31.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94375688892640] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c051070 con 0x7f725c014440 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 20 remove_watcher() i=7 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d689b20 msgr2=0x55d58d68bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d689b20 0x55d58d68bf10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d685820 msgr2=0x55d58d687cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d685820 0x55d58d687cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f725c014440 msgr2=0x7f725c055070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f725c014440 0x7f725c055070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d58d68ec90 msgr2=0x55d58d6910a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d58d68ec90 0x55d58d6910a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713403c730 msgr2=0x7f713403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713403c730 0x7f713403ebf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f725401ac10 tx=0x7f7254043000 comp rx=0 tx=0).stop 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 msgr2=0x55d58d679ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4191118279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d6726d0 0x55d58d679ca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f725c028fd0 tx=0x7f725c053d60 comp rx=0 tx=0).stop 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 reap_dead start 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f725bfff640 1 -- 172.21.15.120:0/4191118279 reap_dead start 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 shutdown_connections 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 >> 172.21.15.120:0/4191118279 conn(0x55d58d66ead0 msgr2=0x55d58d66cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 shutdown_connections 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.522+0000 7f7268a0e800 1 -- 172.21.15.120:0/4191118279 wait complete. 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/2729760060 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713c03c780 msgr2=0x7f713c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/2729760060 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713c03c780 0x7f713c03ec40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55d58d64b3e0 tx=0x7f725401b440 comp rx=0 tx=0).stop 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/2729760060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d4c6e70 msgr2=0x55d58d6687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/2729760060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d4c6e70 0x55d58d6687b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f725c016d20 tx=0x7f725c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/2729760060 shutdown_connections 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/2729760060 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f713c03c780 0x7f713c03ec40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/2729760060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d4c6e70 0x55d58d6687b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/2729760060 >> 172.21.15.120:0/2729760060 conn(0x55d58d658e90 msgr2=0x55d58d659270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/2729760060 shutdown_connections 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/2729760060 wait complete. 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d652110 msgr2=0x55d58d6545d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d652110 0x55d58d6545d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d5541f0 msgr2=0x55d58d651320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d5541f0 0x55d58d651320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f714c03c730 msgr2=0x7f714c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f714c03c730 0x7f714c03ebf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f724c057000 tx=0x7f724c052000 comp rx=0 tx=0).stop 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 msgr2=0x55d58d649cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d649cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f725400b710 tx=0x7f7254000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 shutdown_connections 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d58d652110 0x55d58d6545d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d58d5541f0 0x55d58d651320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f714c03c730 0x7f714c03ebf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 --2- 172.21.15.120:0/4220143961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d58d552de0 0x55d58d649cd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 >> 172.21.15.120:0/4220143961 conn(0x55d58d54e1b0 msgr2=0x55d58d643620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 shutdown_connections 2024-09-07T03:32:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.523+0000 7f7268a0e800 1 -- 172.21.15.120:0/4220143961 wait complete. 2024-09-07T03:32:31.545 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-07T03:32:31.546 DEBUG:tasks.util.rgw: json result: [] 2024-09-07T03:32:31.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-07T03:32:31.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-07T03:32:31.546 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-07T03:32:31.593 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:31.593 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:31.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4756298800 1 Processor -- start 2024-09-07T03:32:31.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4756298800 1 -- start start 2024-09-07T03:32:31.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4756298800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e466e96df0 0x55e466e97af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4756298800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e466d41e40 con 0x55e466e98030 2024-09-07T03:32:31.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4756298800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e466d0c680 con 0x55e466e96df0 2024-09-07T03:32:31.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4753d89640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e466e96df0 0x55e466e97af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4753d89640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e466e96df0 0x55e466e97af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40578/0 (socket says 172.21.15.120:40578) 2024-09-07T03:32:31.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4753588640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55e466e98030 0x55e466e9cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48150/0 (socket says 172.21.15.120:48150) 2024-09-07T03:32:31.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4753d89640 1 -- 172.21.15.120:0/2696513685 learned_addr learned my addr 172.21.15.120:0/2696513685 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4753d89640 1 -- 172.21.15.120:0/2696513685 >> v1:172.21.15.104:6789/0 conn(0x55e466e98030 legacy=0x55e466e9cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.590+0000 7f4753d89640 1 -- 172.21.15.120:0/2696513685 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e466d286b0 con 0x55e466e96df0 2024-09-07T03:32:31.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.592+0000 7f4753d89640 1 --2- 172.21.15.120:0/2696513685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466e97af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f474400a520 tx=0x7f4744045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91750219ebe84a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.592+0000 7f4752d87640 1 -- 172.21.15.120:0/2696513685 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4744055070 con 0x55e466e96df0 2024-09-07T03:32:31.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.592+0000 7f4752d87640 1 -- 172.21.15.120:0/2696513685 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47440515b0 con 0x55e466e96df0 2024-09-07T03:32:31.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.592+0000 7f4752d87640 1 -- 172.21.15.120:0/2696513685 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47440518d0 con 0x55e466e96df0 2024-09-07T03:32:31.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.593+0000 7f4756298800 1 -- 172.21.15.120:0/2696513685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 msgr2=0x55e466e97af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.593+0000 7f4756298800 1 --2- 172.21.15.120:0/2696513685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466e97af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f474400a520 tx=0x7f4744045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.593+0000 7f4756298800 1 -- 172.21.15.120:0/2696513685 shutdown_connections 2024-09-07T03:32:31.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.593+0000 7f4756298800 1 --2- 172.21.15.120:0/2696513685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466e97af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.593+0000 7f4756298800 1 -- 172.21.15.120:0/2696513685 >> 172.21.15.120:0/2696513685 conn(0x55e466e921c0 msgr2=0x55e466e94620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.593+0000 7f4756298800 1 -- 172.21.15.120:0/2696513685 shutdown_connections 2024-09-07T03:32:31.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.593+0000 7f4756298800 1 -- 172.21.15.120:0/2696513685 wait complete. 2024-09-07T03:32:31.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.607+0000 7f4756298800 1 Processor -- start 2024-09-07T03:32:31.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.607+0000 7f4756298800 1 -- start start 2024-09-07T03:32:31.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.607+0000 7f4756298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466e0adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.607+0000 7f4756298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e466d30dd0 con 0x55e466e96df0 2024-09-07T03:32:31.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.607+0000 7f4753d89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466e0adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.607+0000 7f4753d89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466e0adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40594/0 (socket says 172.21.15.120:40594) 2024-09-07T03:32:31.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.607+0000 7f4753d89640 1 -- 172.21.15.120:0/957955503 learned_addr learned my addr 172.21.15.120:0/957955503 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.607+0000 7f4753d89640 1 -- 172.21.15.120:0/957955503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e466d49e10 con 0x55e466e96df0 2024-09-07T03:32:31.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.608+0000 7f4753d89640 1 --2- 172.21.15.120:0/957955503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466e0adb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4744025da0 tx=0x7f4744051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc1289a119e4357 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.608+0000 7f4641e0b640 1 -- 172.21.15.120:0/957955503 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4744051ac0 con 0x55e466e96df0 2024-09-07T03:32:31.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.608+0000 7f4641e0b640 1 -- 172.21.15.120:0/957955503 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4744051c60 con 0x55e466e96df0 2024-09-07T03:32:31.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.608+0000 7f4641e0b640 1 -- 172.21.15.120:0/957955503 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474405a450 con 0x55e466e96df0 2024-09-07T03:32:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 -- 172.21.15.120:0/957955503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 msgr2=0x55e466e0adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 --2- 172.21.15.120:0/957955503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466e0adb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4744025da0 tx=0x7f4744051000 comp rx=0 tx=0).stop 2024-09-07T03:32:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 -- 172.21.15.120:0/957955503 shutdown_connections 2024-09-07T03:32:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 --2- 172.21.15.120:0/957955503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466e0adb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 -- 172.21.15.120:0/957955503 >> 172.21.15.120:0/957955503 conn(0x55e466e921c0 msgr2=0x55e466f81ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 -- 172.21.15.120:0/957955503 shutdown_connections 2024-09-07T03:32:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 -- 172.21.15.120:0/957955503 wait complete. 2024-09-07T03:32:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 Processor -- start 2024-09-07T03:32:31.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 -- start start 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466f8ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4756298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e466e98720 con 0x55e466e96df0 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4753d89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466f8ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4753d89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466f8ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40600/0 (socket says 172.21.15.120:40600) 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.609+0000 7f4753d89640 1 -- 172.21.15.120:0/4255473949 learned_addr learned my addr 172.21.15.120:0/4255473949 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.610+0000 7f4753d89640 1 -- 172.21.15.120:0/4255473949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e466f8f3c0 con 0x55e466e96df0 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.610+0000 7f4753d89640 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466f8ee60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4744067040 tx=0x7f4744002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.610+0000 7f463bfff640 1 -- 172.21.15.120:0/4255473949 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4744073070 con 0x55e466e96df0 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.610+0000 7f463bfff640 1 -- 172.21.15.120:0/4255473949 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474405a600 con 0x55e466e96df0 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.610+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e466f8f650 con 0x55e466e96df0 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.611+0000 7f463bfff640 1 -- 172.21.15.120:0/4255473949 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474405a8e0 con 0x55e466e96df0 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.611+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e466f90260 con 0x55e466e96df0 2024-09-07T03:32:31.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.611+0000 7f463bfff640 1 -- 172.21.15.120:0/4255473949 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4744076070 con 0x55e466e96df0 2024-09-07T03:32:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.611+0000 7f463bfff640 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f463c03c710 0x7f463c03ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.611+0000 7f463bfff640 1 -- 172.21.15.120:0/4255473949 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f4744062070 con 0x55e466e96df0 2024-09-07T03:32:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.611+0000 7f4753588640 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f463c03c710 0x7f463c03ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.611+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466e98030 0x55e466f964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.611+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466f969f0 con 0x55e466e98030 2024-09-07T03:32:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.612+0000 7f475458a640 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466e98030 0x55e466f964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.612+0000 7f4753588640 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f463c03c710 0x7f463c03ebd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4748001e30 tx=0x7f4748001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.612+0000 7f475458a640 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466e98030 0x55e466f964b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.612+0000 7f475458a640 1 -- 172.21.15.120:0/4255473949 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f474c00a4d0 con 0x55e466e98030 2024-09-07T03:32:31.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.612+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466f97410 0x55e466f99820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.612+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466f99f90 con 0x55e466f97410 2024-09-07T03:32:31.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.612+0000 7f4753d89640 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466f97410 0x55e466f99820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.613+0000 7f4753d89640 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466f97410 0x55e466f99820 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.613+0000 7f4753d89640 1 -- 172.21.15.120:0/4255473949 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4744075030 con 0x55e466f97410 2024-09-07T03:32:31.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.613+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466f9b840 con 0x55e466f97410 2024-09-07T03:32:31.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.613+0000 7f4753d89640 1 -- 172.21.15.120:0/4255473949 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4744075030 con 0x55e466f97410 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.613+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466f9a950 con 0x55e466f97410 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.613+0000 7f4753d89640 1 -- 172.21.15.120:0/4255473949 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4744075030 con 0x55e466f97410 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.613+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466f9ad70 con 0x55e466e98030 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.614+0000 7f475458a640 1 -- 172.21.15.120:0/4255473949 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f474c00a4d0 con 0x55e466e98030 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.614+0000 7f4756298800 1 Processor -- start 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.614+0000 7f4756298800 1 -- start start 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.614+0000 7f4756298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466fa9d00 0x55e466faa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.614+0000 7f4756298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e466d8ea00 con 0x55e466fa9d00 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.614+0000 7f475458a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466fa9d00 0x55e466faa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.615+0000 7f475458a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466fa9d00 0x55e466faa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40614/0 (socket says 172.21.15.120:40614) 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.615+0000 7f475458a640 1 -- 172.21.15.120:0/2227967346 learned_addr learned my addr 172.21.15.120:0/2227967346 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.615+0000 7f475458a640 1 -- 172.21.15.120:0/2227967346 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e466faa760 con 0x55e466fa9d00 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.615+0000 7f475458a640 1 --2- 172.21.15.120:0/2227967346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466fa9d00 0x55e466faa120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f474c016d20 tx=0x7f474c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.615+0000 7f46397fa640 1 -- 172.21.15.120:0/2227967346 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474c017660 con 0x55e466fa9d00 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.615+0000 7f46397fa640 1 -- 172.21.15.120:0/2227967346 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474c01b030 con 0x55e466fa9d00 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.615+0000 7f4756298800 1 -- 172.21.15.120:0/2227967346 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e466faaf90 con 0x55e466fa9d00 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.615+0000 7f46397fa640 1 -- 172.21.15.120:0/2227967346 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474c017950 con 0x55e466fa9d00 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.615+0000 7f4756298800 1 -- 172.21.15.120:0/2227967346 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e466fab530 con 0x55e466fa9d00 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.616+0000 7f46397fa640 1 -- 172.21.15.120:0/2227967346 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f474c017af0 con 0x55e466fa9d00 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.616+0000 7f46397fa640 1 --2- 172.21.15.120:0/2227967346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f462c03c780 0x7f462c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.616+0000 7f46397fa640 1 -- 172.21.15.120:0/2227967346 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f474c00e040 con 0x55e466fa9d00 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.616+0000 7f4753d89640 1 --2- 172.21.15.120:0/2227967346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f462c03c780 0x7f462c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f4756298800 1 Processor -- start 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f4756298800 1 -- start start 2024-09-07T03:32:31.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f4753d89640 1 --2- 172.21.15.120:0/2227967346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f462c03c780 0x7f462c03ec40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55e466f9a470 tx=0x7f474407f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f4756298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466f876c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f4756298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e466f8a250 con 0x55e466f872c0 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f475458a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466f876c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f475458a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466f876c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40630/0 (socket says 172.21.15.120:40630) 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f475458a640 1 -- 172.21.15.120:0/3824048056 learned_addr learned my addr 172.21.15.120:0/3824048056 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f475458a640 1 -- 172.21.15.120:0/3824048056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e466f87c00 con 0x55e466f872c0 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f475458a640 1 --2- 172.21.15.120:0/3824048056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466f876c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f474c053fc0 tx=0x7f474c0540b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6714c96eef17b911 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f4632ffd640 1 -- 172.21.15.120:0/3824048056 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474c014d40 con 0x55e466f872c0 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f4632ffd640 1 -- 172.21.15.120:0/3824048056 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474c051070 con 0x55e466f872c0 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.617+0000 7f4632ffd640 1 -- 172.21.15.120:0/3824048056 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474c0149b0 con 0x55e466f872c0 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 -- 172.21.15.120:0/3824048056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 msgr2=0x55e466f876c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 --2- 172.21.15.120:0/3824048056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466f876c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f474c053fc0 tx=0x7f474c0540b0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 -- 172.21.15.120:0/3824048056 shutdown_connections 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 --2- 172.21.15.120:0/3824048056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466f876c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 -- 172.21.15.120:0/3824048056 >> 172.21.15.120:0/3824048056 conn(0x55e466fb2c20 msgr2=0x55e466fb0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 -- 172.21.15.120:0/3824048056 shutdown_connections 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 -- 172.21.15.120:0/3824048056 wait complete. 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 Processor -- start 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 -- start start 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466fc0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.618+0000 7f4756298800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e466f86180 con 0x55e466f872c0 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f475458a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466fc0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f475458a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466fc0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40634/0 (socket says 172.21.15.120:40634) 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 learned_addr learned my addr 172.21.15.120:0/4148852126 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e466fc05c0 con 0x55e466f872c0 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f475458a640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466fc0060 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f474c053d30 tx=0x7f474c053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f46317fa640 1 -- 172.21.15.120:0/4148852126 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474c012570 con 0x55e466f872c0 2024-09-07T03:32:31.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f46317fa640 1 -- 172.21.15.120:0/4148852126 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f474c055890 con 0x55e466f872c0 2024-09-07T03:32:31.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e466fc0850 con 0x55e466f872c0 2024-09-07T03:32:31.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f46317fa640 1 -- 172.21.15.120:0/4148852126 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f474c028820 con 0x55e466f872c0 2024-09-07T03:32:31.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.619+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e466fc11d0 con 0x55e466f872c0 2024-09-07T03:32:31.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.620+0000 7f46317fa640 1 -- 172.21.15.120:0/4148852126 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f474c0127a0 con 0x55e466f872c0 2024-09-07T03:32:31.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.620+0000 7f46317fa640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f461c03c730 0x7f461c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.620+0000 7f46317fa640 1 -- 172.21.15.120:0/4148852126 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f474c03cc90 con 0x55e466f872c0 2024-09-07T03:32:31.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.620+0000 7f4753d89640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f461c03c730 0x7f461c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4753d89640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f461c03c730 0x7f461c03ebf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4744097620 tx=0x7f4744088000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466fcbb90 0x55e466fce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fce7a0 con 0x55e466fcbb90 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4753588640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466fcbb90 0x55e466fce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4753588640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466fcbb90 0x55e466fce050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4756298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4756298800 20 realm 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.621+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fcaee0 con 0x55e466fcbb90 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4756298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4756298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fcf290 con 0x55e466fcbb90 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4756298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466fd0070 0x55e466fd2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd2b30 con 0x55e466fd0070 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.622+0000 7f475458a640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466fd0070 0x55e466fd2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f475458a640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466fd0070 0x55e466fd2460 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f4756298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:31.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd3380 con 0x55e466fd0070 2024-09-07T03:32:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f4756298800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f4756298800 20 searching for the correct realm 2024-09-07T03:32:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e466fd50f0 0x55e466fd7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd50f0 2024-09-07T03:32:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f4753d89640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e466fd50f0 0x55e466fd7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.623+0000 7f4753d89640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e466fd50f0 0x55e466fd7520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.624+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.624+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd0070 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.624+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.624+0000 7f475458a640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f474c04e040 0x7f474c029a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.624+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x7f474c04e040 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.624+0000 7f4753588640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f474c04e040 0x7f474c029a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.625+0000 7f4753588640 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f474c04e040 0x7f474c029a80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.625+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x7f474c04e040 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.625+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.625+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.625+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.625+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.625+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd50f0 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.625+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.625+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.626+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.626+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd0070 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.626+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.626+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd0070 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.626+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.626+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.626+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.626+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x7f474c04e040 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.627+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x7f474c04e040 2024-09-07T03:32:31.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.627+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.627+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.627+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x7f474c04e040 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.627+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f474800f610 con 0x7f474c04e040 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.627+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd0070 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.628+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.628+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd50f0 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.628+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.628+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.628+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.628+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd0070 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.628+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.628+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd50f0 2024-09-07T03:32:31.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.629+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.629+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.629+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.629+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.629+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.629+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.629+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.629+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd50f0 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x7f474c04e040 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x7f474c04e040 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fcbb90 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x55e466fcbb90 2024-09-07T03:32:31.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x7f474c04e040 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x7f474c04e040 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd50f0 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.630+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x7f474c04e040 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.631+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f610 con 0x7f474c04e040 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.631+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd0070 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.631+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.631+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd0070 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.631+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.631+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd50f0 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd0070 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v27'3 uv3 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd7bf0 con 0x55e466fd0070 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd3d00 con 0x55e466fcbb90 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.632+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd3940 con 0x55e466fd0070 2024-09-07T03:32:31.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd4140 con 0x55e466fcbb90 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 20 zone default found 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 4 Realm: () 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 20 zonegroup default 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd8520 con 0x7f474c04e040 2024-09-07T03:32:31.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.633+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fda760 con 0x55e466fd50f0 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.634+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.634+0000 7f4756298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.634+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.634+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdab00 con 0x55e466fd50f0 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.634+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.634+0000 7f4756298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.634+0000 7f4756298800 20 started sync module instance, tier type = 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.634+0000 7f4756298800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.634+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd9bf0 con 0x55e466fd0070 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.635+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.635+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94439468802288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fd9bf0 con 0x55e466fd0070 2024-09-07T03:32:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.635+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdb500 con 0x55e466fcbb90 2024-09-07T03:32:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.636+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94439468802288] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.636+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.636+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94439468799808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdb8a0 con 0x55e466fcbb90 2024-09-07T03:32:31.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.637+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdc300 con 0x55e466fd0070 2024-09-07T03:32:31.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.639+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94439468799808] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.639+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.639+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94439468806160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdc2c0 con 0x55e466fd0070 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.639+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdcdc0 con 0x7f474c04e040 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.642+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.642+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94439468812480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdcdc0 con 0x7f474c04e040 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.642+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdddb0 con 0x55e466fd0070 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.644+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94439468806160] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.647+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94439468812480] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.647+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.647+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94439468814768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fddd70 con 0x55e466fd0070 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.647+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fde650 con 0x55e466fd50f0 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.650+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.650+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94439468814768] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.650+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94439468816512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fddd70 con 0x55e466fd50f0 2024-09-07T03:32:31.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.650+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdf050 con 0x55e466fd50f0 2024-09-07T03:32:31.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.651+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94439468816512] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.654+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.654+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94439468818848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdf010 con 0x55e466fd50f0 2024-09-07T03:32:31.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.654+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdfab0 con 0x7f474c04e040 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94439468818848] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94439468824544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdf010 con 0x7f474c04e040 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4756298800 20 add_watcher() i=0 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4756298800 20 add_watcher() i=1 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4756298800 20 add_watcher() i=2 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4756298800 20 add_watcher() i=3 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4756298800 20 add_watcher() i=4 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4756298800 20 add_watcher() i=5 2024-09-07T03:32:31.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.657+0000 7f4756298800 20 add_watcher() i=6 2024-09-07T03:32:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.660+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94439468824544] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.660+0000 7f4756298800 20 add_watcher() i=7 2024-09-07T03:32:31.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.660+0000 7f4756298800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:31.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.660+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e466fe3020 con 0x55e466fcbb90 2024-09-07T03:32:31.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.660+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.660+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94439468821808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fe04d0 con 0x55e466fcbb90 2024-09-07T03:32:31.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.661+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94439468821808] v34'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.661+0000 7f4609fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:31.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.661+0000 7f4756298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:31.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.661+0000 7f4756298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:31.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.662+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feb890 con 0x55e466fd0070 2024-09-07T03:32:31.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.663+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'41 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.663+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feb910 con 0x7f474c04e040 2024-09-07T03:32:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.664+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'16 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.664+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466febf80 con 0x55e466fd50f0 2024-09-07T03:32:31.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.665+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.665+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fec380 con 0x55e466fcbb90 2024-09-07T03:32:31.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.666+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.666+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fec730 con 0x55e466fd0070 2024-09-07T03:32:31.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.667+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'26 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.667+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fec710 con 0x55e466fd50f0 2024-09-07T03:32:31.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.670+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.670+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fec680 con 0x55e466fd0070 2024-09-07T03:32:31.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.672+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.672+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fec6e0 con 0x55e466fcbb90 2024-09-07T03:32:31.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.673+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.674+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fec7e0 con 0x55e466fd0070 2024-09-07T03:32:31.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.674+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.675+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecc00 con 0x55e466fd0070 2024-09-07T03:32:31.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.676+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.676+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecbb0 con 0x55e466fd0070 2024-09-07T03:32:31.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.677+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.677+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feca10 con 0x55e466fd50f0 2024-09-07T03:32:31.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.678+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.678+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecb40 con 0x55e466fd0070 2024-09-07T03:32:31.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.680+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.680+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecb40 con 0x55e466fcbb90 2024-09-07T03:32:31.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.681+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.681+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecbd0 con 0x55e466fcbb90 2024-09-07T03:32:31.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.682+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.682+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecc60 con 0x55e466fd0070 2024-09-07T03:32:31.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.683+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.683+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecc60 con 0x55e466fd0070 2024-09-07T03:32:31.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.684+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.684+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecc60 con 0x55e466fd50f0 2024-09-07T03:32:31.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.686+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.686+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecc60 con 0x55e466fd0070 2024-09-07T03:32:31.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.687+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.687+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecc90 con 0x55e466fcbb90 2024-09-07T03:32:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.688+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'35 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.688+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecc90 con 0x55e466fd0070 2024-09-07T03:32:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.689+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.689+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecc60 con 0x55e466fd0070 2024-09-07T03:32:31.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.690+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.690+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feccd0 con 0x55e466fd50f0 2024-09-07T03:32:31.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.691+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.691+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feccd0 con 0x55e466fd0070 2024-09-07T03:32:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.693+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.693+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feccd0 con 0x55e466fd50f0 2024-09-07T03:32:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.694+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.694+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feccd0 con 0x55e466fd50f0 2024-09-07T03:32:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.695+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'26 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.695+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecd30 con 0x55e466fd50f0 2024-09-07T03:32:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.696+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.696+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feccf0 con 0x55e466fd0070 2024-09-07T03:32:31.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.697+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'22 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.697+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feccf0 con 0x55e466fcbb90 2024-09-07T03:32:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.699+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.699+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feccf0 con 0x55e466fd0070 2024-09-07T03:32:31.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.700+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'22 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.700+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466feccf0 con 0x55e466fcbb90 2024-09-07T03:32:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.701+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.701+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fecd30 con 0x7f474c04e040 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4608fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4756298800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4756298800 20 Filter name: none 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f45827fc640 20 reqs_thread_entry: start 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4756298800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4756298800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e467017c90 con 0x7f474c04e040 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4756298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4756298800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-07T03:32:31.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.702+0000 7f4756298800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-07T03:32:31.705 INFO:teuthology.orchestra.run.smithi120.stderr:could not remove user: unable to remove user, user does not exist 2024-09-07T03:32:31.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.703+0000 7f4609fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:31.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.703+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94439468821808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fe2100 con 0x55e466fcbb90 2024-09-07T03:32:31.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.704+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94439468821808] v34'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.704+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94439468802288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fea2e0 con 0x55e466fd0070 2024-09-07T03:32:31.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.705+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94439468802288] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.705+0000 7f4756298800 20 remove_watcher() i=0 2024-09-07T03:32:31.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.705+0000 7f4756298800 2 removed watcher, disabling cache 2024-09-07T03:32:31.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.705+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94439468799808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fda0f0 con 0x55e466fcbb90 2024-09-07T03:32:31.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.706+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94439468799808] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474803c040 con 0x55e466fcbb90 2024-09-07T03:32:31.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.706+0000 7f4756298800 20 remove_watcher() i=1 2024-09-07T03:32:31.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.706+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94439468806160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fda0f0 con 0x55e466fd0070 2024-09-07T03:32:31.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.708+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94439468806160] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.708+0000 7f4756298800 20 remove_watcher() i=2 2024-09-07T03:32:31.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.708+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94439468812480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdb010 con 0x7f474c04e040 2024-09-07T03:32:31.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.709+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94439468812480] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.709+0000 7f4756298800 20 remove_watcher() i=3 2024-09-07T03:32:31.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.709+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94439468814768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fda0f0 con 0x55e466fd0070 2024-09-07T03:32:31.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.710+0000 7f475458a640 1 -- 172.21.15.120:0/4148852126 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94439468814768] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474c027070 con 0x55e466fd0070 2024-09-07T03:32:31.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.710+0000 7f4756298800 20 remove_watcher() i=4 2024-09-07T03:32:31.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.710+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94439468816512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdb010 con 0x55e466fd50f0 2024-09-07T03:32:31.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.711+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94439468816512] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.711+0000 7f4756298800 20 remove_watcher() i=5 2024-09-07T03:32:31.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.711+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94439468818848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdb010 con 0x55e466fd50f0 2024-09-07T03:32:31.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.714+0000 7f4753d89640 1 -- 172.21.15.120:0/4148852126 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94439468818848] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4744075030 con 0x55e466fd50f0 2024-09-07T03:32:31.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.714+0000 7f4756298800 20 remove_watcher() i=6 2024-09-07T03:32:31.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.714+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94439468824544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e466fdb010 con 0x7f474c04e040 2024-09-07T03:32:31.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94439468824544] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474803c040 con 0x7f474c04e040 2024-09-07T03:32:31.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 20 remove_watcher() i=7 2024-09-07T03:32:31.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466fd0070 msgr2=0x55e466fd2460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466fd0070 0x55e466fd2460 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466fcbb90 msgr2=0x55e466fce050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466fcbb90 0x55e466fce050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f474c04e040 msgr2=0x7f474c029a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f474c04e040 0x7f474c029a80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e466fd50f0 msgr2=0x55e466fd7520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e466fd50f0 0x55e466fd7520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f461c03c730 msgr2=0x7f461c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f461c03c730 0x7f461c03ebf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4744097620 tx=0x7f4744088000 comp rx=0 tx=0).stop 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 msgr2=0x55e466fc0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4753588640 1 -- 172.21.15.120:0/4148852126 reap_dead start 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466fc0060 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f474c053d30 tx=0x7f474c053d60 comp rx=0 tx=0).stop 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 shutdown_connections 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 --2- 172.21.15.120:0/4148852126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466f872c0 0x55e466fc0060 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 >> 172.21.15.120:0/4148852126 conn(0x55e466fb2c20 msgr2=0x55e466fb0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 shutdown_connections 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.716+0000 7f4756298800 1 -- 172.21.15.120:0/4148852126 wait complete. 2024-09-07T03:32:31.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/2227967346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f462c03c780 msgr2=0x7f462c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/2227967346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f462c03c780 0x7f462c03ec40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55e466f9a470 tx=0x7f474407f040 comp rx=0 tx=0).stop 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/2227967346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466fa9d00 msgr2=0x55e466faa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/2227967346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466fa9d00 0x55e466faa120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f474c016d20 tx=0x7f474c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/2227967346 shutdown_connections 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/2227967346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f462c03c780 0x7f462c03ec40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/2227967346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466fa9d00 0x55e466faa120 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/2227967346 >> 172.21.15.120:0/2227967346 conn(0x55e466f9e0b0 msgr2=0x55e466f9e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/2227967346 shutdown_connections 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/2227967346 wait complete. 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466f97410 msgr2=0x55e466f99820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466f97410 0x55e466f99820 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466e98030 msgr2=0x55e466f964b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466e98030 0x55e466f964b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f463c03c710 msgr2=0x7f463c03ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f463c03c710 0x7f463c03ebd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4748001e30 tx=0x7f4748001390 comp rx=0 tx=0).stop 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 msgr2=0x55e466f8ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466f8ee60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4744067040 tx=0x7f4744002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 shutdown_connections 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e466f97410 0x55e466f99820 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e466e98030 0x55e466f964b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f463c03c710 0x7f463c03ebd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 --2- 172.21.15.120:0/4255473949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e466e96df0 0x55e466f8ee60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 >> 172.21.15.120:0/4255473949 conn(0x55e466e921c0 msgr2=0x55e466f806d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 shutdown_connections 2024-09-07T03:32:31.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.717+0000 7f4756298800 1 -- 172.21.15.120:0/4255473949 wait complete. 2024-09-07T03:32:31.727 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-07T03:32:31.727 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-07T03:32:31.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-07T03:32:31.727 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-07T03:32:31.771 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:31.771 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.770+0000 7fca0f328800 1 Processor -- start 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.771+0000 7fca0f328800 1 -- start start 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.771+0000 7fca0f328800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5612747af440 0x5612747b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.771+0000 7fca0f328800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56127465ae40 con 0x5612747b2390 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.771+0000 7fca0f328800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x561274625680 con 0x5612747af440 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.771+0000 7fca0b04b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5612747af440 0x5612747b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.771+0000 7fca0a84a640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5612747b2390 0x5612747b6ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48162/0 (socket says 172.21.15.120:48162) 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.771+0000 7fca0a84a640 1 -- 172.21.15.120:0/2759575849 learned_addr learned my addr 172.21.15.120:0/2759575849 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.771+0000 7fca0b04b640 1 -- 172.21.15.120:0/2759575849 >> v1:172.21.15.104:6789/0 conn(0x5612747b2390 legacy=0x5612747b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.771+0000 7fca0b04b640 1 -- 172.21.15.120:0/2759575849 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612746416b0 con 0x5612747af440 2024-09-07T03:32:31.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.773+0000 7fca0b04b640 1 --2- 172.21.15.120:0/2759575849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612747b1e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00a470 tx=0x7fc9fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37817feccfe5fdbe server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.773+0000 7fca0a049640 1 -- 172.21.15.120:0/2759575849 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc053570 con 0x5612747af440 2024-09-07T03:32:31.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.773+0000 7fca0a049640 1 -- 172.21.15.120:0/2759575849 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc058070 con 0x5612747af440 2024-09-07T03:32:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.773+0000 7fca0a049640 1 -- 172.21.15.120:0/2759575849 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc053880 con 0x5612747af440 2024-09-07T03:32:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.774+0000 7fca0f328800 1 -- 172.21.15.120:0/2759575849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 msgr2=0x5612747b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.774+0000 7fca0f328800 1 --2- 172.21.15.120:0/2759575849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612747b1e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00a470 tx=0x7fc9fc045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:31.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.774+0000 7fca0f328800 1 -- 172.21.15.120:0/2759575849 shutdown_connections 2024-09-07T03:32:31.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.774+0000 7fca0f328800 1 --2- 172.21.15.120:0/2759575849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612747b1e50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.774+0000 7fca0f328800 1 -- 172.21.15.120:0/2759575849 >> 172.21.15.120:0/2759575849 conn(0x5612747aa920 msgr2=0x5612747acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.774+0000 7fca0f328800 1 -- 172.21.15.120:0/2759575849 shutdown_connections 2024-09-07T03:32:31.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.774+0000 7fca0f328800 1 -- 172.21.15.120:0/2759575849 wait complete. 2024-09-07T03:32:31.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.787+0000 7fca0f328800 1 Processor -- start 2024-09-07T03:32:31.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.788+0000 7fca0f328800 1 -- start start 2024-09-07T03:32:31.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.788+0000 7fca0f328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612747b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.788+0000 7fca0f328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561274649dd0 con 0x5612747af440 2024-09-07T03:32:31.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.788+0000 7fca0b04b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612747b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.788+0000 7fca0b04b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612747b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40644/0 (socket says 172.21.15.120:40644) 2024-09-07T03:32:31.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.788+0000 7fca0b04b640 1 -- 172.21.15.120:0/2659575600 learned_addr learned my addr 172.21.15.120:0/2659575600 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.788+0000 7fca0b04b640 1 -- 172.21.15.120:0/2659575600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561274662e10 con 0x5612747af440 2024-09-07T03:32:31.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.788+0000 7fca0b04b640 1 --2- 172.21.15.120:0/2659575600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612747b15c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc025c20 tx=0x7fc9fc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d7ead9a1993431 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fc8f960a640 1 -- 172.21.15.120:0/2659575600 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc053570 con 0x5612747af440 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fc8f960a640 1 -- 172.21.15.120:0/2659575600 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc063070 con 0x5612747af440 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fc8f960a640 1 -- 172.21.15.120:0/2659575600 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc053840 con 0x5612747af440 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fca0f328800 1 -- 172.21.15.120:0/2659575600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 msgr2=0x5612747b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fca0f328800 1 --2- 172.21.15.120:0/2659575600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612747b15c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc025c20 tx=0x7fc9fc051000 comp rx=0 tx=0).stop 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fca0f328800 1 -- 172.21.15.120:0/2659575600 shutdown_connections 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fca0f328800 1 --2- 172.21.15.120:0/2659575600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612747b15c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fca0f328800 1 -- 172.21.15.120:0/2659575600 >> 172.21.15.120:0/2659575600 conn(0x5612747aa920 msgr2=0x56127489c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fca0f328800 1 -- 172.21.15.120:0/2659575600 shutdown_connections 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.789+0000 7fca0f328800 1 -- 172.21.15.120:0/2659575600 wait complete. 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.790+0000 7fca0f328800 1 Processor -- start 2024-09-07T03:32:31.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.790+0000 7fca0f328800 1 -- start start 2024-09-07T03:32:31.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.790+0000 7fca0f328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612748aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.790+0000 7fca0f328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5612747b2c00 con 0x5612747af440 2024-09-07T03:32:31.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.790+0000 7fca0b04b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612748aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.790+0000 7fca0b04b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612748aa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40646/0 (socket says 172.21.15.120:40646) 2024-09-07T03:32:31.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.790+0000 7fca0b04b640 1 -- 172.21.15.120:0/3974587564 learned_addr learned my addr 172.21.15.120:0/3974587564 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.790+0000 7fca0b04b640 1 -- 172.21.15.120:0/3974587564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612748aa850 con 0x5612747af440 2024-09-07T03:32:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.790+0000 7fca0b04b640 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612748aa2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc053d60 tx=0x7fc9fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.791+0000 7fc8f7e07640 1 -- 172.21.15.120:0/3974587564 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc068470 con 0x5612747af440 2024-09-07T03:32:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.791+0000 7fc8f7e07640 1 -- 172.21.15.120:0/3974587564 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc068610 con 0x5612747af440 2024-09-07T03:32:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.791+0000 7fc8f7e07640 1 -- 172.21.15.120:0/3974587564 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc0688f0 con 0x5612747af440 2024-09-07T03:32:31.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.791+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612748aaae0 con 0x5612747af440 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.791+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612748ab4e0 con 0x5612747af440 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.791+0000 7fc8f7e07640 1 -- 172.21.15.120:0/3974587564 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc9fc068a90 con 0x5612747af440 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.792+0000 7fc8f7e07640 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8f003c730 0x7fc8f003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.792+0000 7fc8f7e07640 1 -- 172.21.15.120:0/3974587564 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fc9fc097f00 con 0x5612747af440 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.792+0000 7fca0a84a640 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8f003c730 0x7fc8f003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.792+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612747b2390 0x5612748b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.792+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748ac090 con 0x5612747b2390 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.792+0000 7fca0b84c640 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612747b2390 0x5612748b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.792+0000 7fca0a84a640 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8f003c730 0x7fc8f003ebf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4001d70 tx=0x7fc9f40012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.792+0000 7fca0b84c640 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612747b2390 0x5612748b1940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.793+0000 7fca0b84c640 1 -- 172.21.15.120:0/3974587564 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0400a4d0 con 0x5612747b2390 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.793+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748b2870 0x5612748b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.793+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748b52c0 con 0x5612748b2870 2024-09-07T03:32:31.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.793+0000 7fca0b04b640 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748b2870 0x5612748b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.793+0000 7fca0b04b640 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748b2870 0x5612748b4c60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.794+0000 7fca0b04b640 1 -- 172.21.15.120:0/3974587564 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9fc079020 con 0x5612748b2870 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.794+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748b6b70 con 0x5612748b2870 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.794+0000 7fca0b04b640 1 -- 172.21.15.120:0/3974587564 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9fc079020 con 0x5612748b2870 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.794+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748b5bf0 con 0x5612748b2870 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.794+0000 7fca0b04b640 1 -- 172.21.15.120:0/3974587564 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9fc079020 con 0x5612748b2870 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.794+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748b6050 con 0x5612747b2390 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.795+0000 7fca0b84c640 1 -- 172.21.15.120:0/3974587564 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca0400a4d0 con 0x5612747b2390 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.795+0000 7fca0f328800 1 Processor -- start 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.795+0000 7fca0f328800 1 -- start start 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.795+0000 7fca0f328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748c5050 0x5612748c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.795+0000 7fca0f328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5612746a7a00 con 0x5612748c5050 2024-09-07T03:32:31.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.795+0000 7fca0b84c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748c5050 0x5612748c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.795+0000 7fca0b84c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748c5050 0x5612748c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40656/0 (socket says 172.21.15.120:40656) 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.795+0000 7fca0b84c640 1 -- 172.21.15.120:0/1763789277 learned_addr learned my addr 172.21.15.120:0/1763789277 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.796+0000 7fca0b84c640 1 -- 172.21.15.120:0/1763789277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612748c5ab0 con 0x5612748c5050 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.796+0000 7fca0b84c640 1 --2- 172.21.15.120:0/1763789277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748c5050 0x5612748c5470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fca04016d20 tx=0x7fca0400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.796+0000 7fc8f5602640 1 -- 172.21.15.120:0/1763789277 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04017660 con 0x5612748c5050 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.796+0000 7fc8f5602640 1 -- 172.21.15.120:0/1763789277 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0401b030 con 0x5612748c5050 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.796+0000 7fc8f5602640 1 -- 172.21.15.120:0/1763789277 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04017950 con 0x5612748c5050 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.796+0000 7fca0f328800 1 -- 172.21.15.120:0/1763789277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612748c62e0 con 0x5612748c5050 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.796+0000 7fca0f328800 1 -- 172.21.15.120:0/1763789277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612748c6880 con 0x5612748c5050 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.797+0000 7fc8f5602640 1 -- 172.21.15.120:0/1763789277 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fca04017af0 con 0x5612748c5050 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.797+0000 7fc8f5602640 1 --2- 172.21.15.120:0/1763789277 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8e403c780 0x7fc8e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.797+0000 7fc8f5602640 1 -- 172.21.15.120:0/1763789277 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fca0400e040 con 0x5612748c5050 2024-09-07T03:32:31.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.797+0000 7fca0b04b640 1 --2- 172.21.15.120:0/1763789277 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8e403c780 0x7fc8e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.797+0000 7fca0f328800 1 Processor -- start 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.797+0000 7fca0b04b640 1 --2- 172.21.15.120:0/1763789277 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8e403c780 0x7fc8e403ec40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5612748b2030 tx=0x7fc9fc089040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.797+0000 7fca0f328800 1 -- start start 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fca0f328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fca0f328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5612747afe60 con 0x5612748d1ab0 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fca0b84c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fca0b84c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40666/0 (socket says 172.21.15.120:40666) 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fca0b84c640 1 -- 172.21.15.120:0/336778975 learned_addr learned my addr 172.21.15.120:0/336778975 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fca0b84c640 1 -- 172.21.15.120:0/336778975 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612748d24a0 con 0x5612748d1ab0 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fca0b84c640 1 --2- 172.21.15.120:0/336778975 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d1eb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fca04054030 tx=0x7fca04054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87881848d1c67505 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fc8eeffd640 1 -- 172.21.15.120:0/336778975 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04014d40 con 0x5612748d1ab0 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fc8eeffd640 1 -- 172.21.15.120:0/336778975 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca040149b0 con 0x5612748d1ab0 2024-09-07T03:32:31.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.798+0000 7fc8eeffd640 1 -- 172.21.15.120:0/336778975 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04028350 con 0x5612748d1ab0 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 -- 172.21.15.120:0/336778975 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 msgr2=0x5612748d1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 --2- 172.21.15.120:0/336778975 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d1eb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fca04054030 tx=0x7fca04054060 comp rx=0 tx=0).stop 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 -- 172.21.15.120:0/336778975 shutdown_connections 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 --2- 172.21.15.120:0/336778975 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d1eb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 -- 172.21.15.120:0/336778975 >> 172.21.15.120:0/336778975 conn(0x5612748cded0 msgr2=0x5612748cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 -- 172.21.15.120:0/336778975 shutdown_connections 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 -- 172.21.15.120:0/336778975 wait complete. 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 Processor -- start 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 -- start start 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0f328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5612748d2a90 con 0x5612748d1ab0 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0b84c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.799+0000 7fca0b84c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40674/0 (socket says 172.21.15.120:40674) 2024-09-07T03:32:31.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.800+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 learned_addr learned my addr 172.21.15.120:0/767370693 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.800+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612748d9590 con 0x5612748d1ab0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.800+0000 7fca0b84c640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d9030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca04053d10 tx=0x7fca04053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.800+0000 7fc8ed7fa640 1 -- 172.21.15.120:0/767370693 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04012570 con 0x5612748d1ab0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.800+0000 7fc8ed7fa640 1 -- 172.21.15.120:0/767370693 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca04005500 con 0x5612748d1ab0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.800+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612748d9820 con 0x5612748d1ab0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.800+0000 7fc8ed7fa640 1 -- 172.21.15.120:0/767370693 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04055570 con 0x5612748d1ab0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.800+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612748da3b0 con 0x5612748d1ab0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.801+0000 7fc8ed7fa640 1 -- 172.21.15.120:0/767370693 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fca040127a0 con 0x5612748d1ab0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.801+0000 7fc8ed7fa640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8d403c730 0x7fc8d403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.801+0000 7fc8ed7fa640 1 -- 172.21.15.120:0/767370693 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fca04048920 con 0x5612748d1ab0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.801+0000 7fca0b04b640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8d403c730 0x7fc8d403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.801+0000 7fca0b04b640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8d403c730 0x7fc8d403ebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0873f0 tx=0x7fc9fc090000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612748e4b90 0x5612748e7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748e77a0 con 0x5612748e4b90 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0a84a640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612748e4b90 0x5612748e7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0a84a640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612748e4b90 0x5612748e7050 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f4009050 con 0x5612748e4b90 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 20 realm 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748e3ee0 con 0x5612748e4b90 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f4009050 con 0x5612748e4b90 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.802+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748e8290 con 0x5612748e4b90 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.803+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f4009050 con 0x5612748e4b90 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.803+0000 7fca0f328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.803+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.803+0000 7fca0f328800 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748e9070 0x5612748eb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.803+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748ebb30 con 0x5612748e9070 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.803+0000 7fca0b84c640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748e9070 0x5612748eb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.803+0000 7fca0b84c640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748e9070 0x5612748eb460 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0f328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748ec380 con 0x5612748e9070 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0f328800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0f328800 20 searching for the correct realm 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0f328800 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612748ee0f0 0x5612748f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748ee0f0 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0b04b640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612748ee0f0 0x5612748f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.804+0000 7fca0b04b640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612748ee0f0 0x5612748f0520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.805+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.805+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e9070 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.805+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.805+0000 7fca0b84c640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca04014440 0x7fca0403bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.805+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x7fca04014440 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.805+0000 7fca0a84a640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca04014440 0x7fca0403bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.806+0000 7fca0a84a640 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca04014440 0x7fca0403bab0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.806+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4009050 con 0x7fca04014440 2024-09-07T03:32:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.806+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.806+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4009050 con 0x5612748e4b90 2024-09-07T03:32:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.806+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.806+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.806+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748ee0f0 2024-09-07T03:32:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.806+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.806+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.807+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.807+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e9070 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.807+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.807+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e9070 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x7fca04014440 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x7fca04014440 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.808+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e9070 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.809+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.809+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748ee0f0 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.809+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.809+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.809+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.809+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e9070 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.809+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.809+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748ee0f0 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.810+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.810+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.810+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.810+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.810+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.810+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.810+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.810+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748ee0f0 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x7fca04014440 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e4b90 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x7fca04014440 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748ee0f0 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.811+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x7fca04014440 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.812+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.812+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e9070 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.812+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.812+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e9070 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.812+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.812+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748ee0f0 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.812+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e9070 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v27'3 uv3 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612748f0bf0 con 0x5612748e9070 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748ecd00 con 0x5612748e4b90 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.813+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748ec940 con 0x5612748e9070 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:31.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748ed140 con 0x5612748e4b90 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 zone default found 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 4 Realm: () 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 zonegroup default 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748f1520 con 0x7fca04014440 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748f33e0 con 0x5612748ee0f0 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.814+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748f3870 con 0x5612748ee0f0 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.815+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.815+0000 7fca0f328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.815+0000 7fca0f328800 20 started sync module instance, tier type = 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.815+0000 7fca0f328800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.815+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f2750 con 0x5612748e9070 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.816+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.816+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94637264937632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f3cd0 con 0x5612748e9070 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.816+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f4520 con 0x5612748e4b90 2024-09-07T03:32:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.817+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94637264937632] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.817+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.817+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94637264944336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f45a0 con 0x5612748e4b90 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.817+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f4df0 con 0x5612748e9070 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.819+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94637264944336] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.819+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.819+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94637264945872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f4ce0 con 0x5612748e9070 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.819+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f5860 con 0x7fca04014440 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.820+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.820+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94637264950096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f5820 con 0x7fca04014440 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.820+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f67f0 con 0x5612748e9070 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.820+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94637264945872] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.822+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94637264950096] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.823+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.823+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94637264954112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f67f0 con 0x5612748e9070 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.823+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f5dc0 con 0x5612748ee0f0 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.824+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.824+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94637264956384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f5dc0 con 0x5612748ee0f0 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.824+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f7c10 con 0x5612748ee0f0 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.824+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94637264954112] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.825+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94637264956384] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.826+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.826+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94637264959232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f7bd0 con 0x5612748ee0f0 2024-09-07T03:32:31.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.826+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f84b0 con 0x7fca04014440 2024-09-07T03:32:31.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94637264959232] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94637264946992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f7bd0 con 0x7fca04014440 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0f328800 20 add_watcher() i=0 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0f328800 20 add_watcher() i=1 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0f328800 20 add_watcher() i=2 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0f328800 20 add_watcher() i=3 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0f328800 20 add_watcher() i=4 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0f328800 20 add_watcher() i=5 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.829+0000 7fca0f328800 20 add_watcher() i=6 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.830+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94637264946992] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.830+0000 7fca0f328800 20 add_watcher() i=7 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.830+0000 7fca0f328800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.830+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612748fb5a0 con 0x5612748e4b90 2024-09-07T03:32:31.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.830+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.830+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94637264961536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f8ac0 con 0x5612748e4b90 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.832+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94637264961536] v34'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.832+0000 7fc8c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.832+0000 7fca0f328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.832+0000 7fca0f328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.832+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274903df0 con 0x5612748e9070 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.833+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'42 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.833+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274903ec0 con 0x7fca04014440 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.834+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'17 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.834+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749045f0 con 0x5612748ee0f0 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.835+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'17 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.835+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274904aa0 con 0x5612748e4b90 2024-09-07T03:32:31.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.836+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'38 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.836+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274901d70 con 0x5612748e9070 2024-09-07T03:32:31.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.838+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'29 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.838+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274901d70 con 0x5612748ee0f0 2024-09-07T03:32:31.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.839+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.839+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274902d80 con 0x5612748e9070 2024-09-07T03:32:31.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.840+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.840+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274902f50 con 0x5612748e4b90 2024-09-07T03:32:31.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.841+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.841+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749057d0 con 0x5612748e9070 2024-09-07T03:32:31.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.842+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.842+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749057d0 con 0x5612748e9070 2024-09-07T03:32:31.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.843+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.843+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749057d0 con 0x5612748e9070 2024-09-07T03:32:31.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.845+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.845+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749057d0 con 0x5612748ee0f0 2024-09-07T03:32:31.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.846+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.846+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749057d0 con 0x5612748e9070 2024-09-07T03:32:31.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.847+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.847+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749057d0 con 0x5612748e4b90 2024-09-07T03:32:31.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.848+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.848+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905600 con 0x5612748e4b90 2024-09-07T03:32:31.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.849+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.849+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749056f0 con 0x5612748e9070 2024-09-07T03:32:31.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.850+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.850+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749056f0 con 0x5612748e9070 2024-09-07T03:32:31.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.851+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.851+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612749056b0 con 0x5612748ee0f0 2024-09-07T03:32:31.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.852+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.852+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748e9070 2024-09-07T03:32:31.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.853+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.853+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748e4b90 2024-09-07T03:32:31.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.855+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'40 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.855+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748e9070 2024-09-07T03:32:31.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.856+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.856+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748e9070 2024-09-07T03:32:31.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.858+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.858+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748ee0f0 2024-09-07T03:32:31.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.860+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.860+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748e9070 2024-09-07T03:32:31.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.862+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.862+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748ee0f0 2024-09-07T03:32:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.863+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.863+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748ee0f0 2024-09-07T03:32:31.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.864+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'28 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.864+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748ee0f0 2024-09-07T03:32:31.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.866+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.866+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748e9070 2024-09-07T03:32:31.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.867+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'23 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.867+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748e4b90 2024-09-07T03:32:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.869+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.869+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748e9070 2024-09-07T03:32:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.870+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'25 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.870+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x5612748e4b90 2024-09-07T03:32:31.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.873+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'34 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.873+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274905780 con 0x7fca04014440 2024-09-07T03:32:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.875+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.875+0000 7fc8c0fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.875+0000 7fca0f328800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.875+0000 7fca0f328800 20 Filter name: none 2024-09-07T03:32:31.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.875+0000 7fc83a7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:31.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.876+0000 7fca0f328800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-07T03:32:31.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.876+0000 7fca0f328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:31.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.876+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561274930980 con 0x7fca04014440 2024-09-07T03:32:31.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.876+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.876+0000 7fca0f328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:31.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.876+0000 7fca0f328800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-07T03:32:31.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.876+0000 7fca0f328800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-07T03:32:31.879 INFO:teuthology.orchestra.run.smithi120.stderr:could not remove user: unable to remove user, user does not exist 2024-09-07T03:32:31.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.877+0000 7fc8c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:31.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.877+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94637264961536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561274897f50 con 0x5612748e4b90 2024-09-07T03:32:31.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.878+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94637264961536] v34'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.878+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94637264937632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f8000 con 0x5612748e9070 2024-09-07T03:32:31.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.879+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94637264937632] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.879+0000 7fca0f328800 20 remove_watcher() i=0 2024-09-07T03:32:31.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.879+0000 7fca0f328800 2 removed watcher, disabling cache 2024-09-07T03:32:31.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.879+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94637264944336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f22a0 con 0x5612748e4b90 2024-09-07T03:32:31.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.880+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94637264944336] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x5612748e4b90 2024-09-07T03:32:31.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.880+0000 7fca0f328800 20 remove_watcher() i=1 2024-09-07T03:32:31.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.880+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94637264945872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f22a0 con 0x5612748e9070 2024-09-07T03:32:31.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.883+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94637264945872] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.883+0000 7fca0f328800 20 remove_watcher() i=2 2024-09-07T03:32:31.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.883+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94637264950096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f42d0 con 0x7fca04014440 2024-09-07T03:32:31.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.885+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94637264950096] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.885+0000 7fca0f328800 20 remove_watcher() i=3 2024-09-07T03:32:31.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.885+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94637264954112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f22a0 con 0x5612748e9070 2024-09-07T03:32:31.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.888+0000 7fca0b84c640 1 -- 172.21.15.120:0/767370693 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94637264954112] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca04027070 con 0x5612748e9070 2024-09-07T03:32:31.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.889+0000 7fca0f328800 20 remove_watcher() i=4 2024-09-07T03:32:31.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.889+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94637264956384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f6300 con 0x5612748ee0f0 2024-09-07T03:32:31.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.889+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94637264956384] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.889+0000 7fca0f328800 20 remove_watcher() i=5 2024-09-07T03:32:31.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.889+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94637264959232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f22a0 con 0x5612748ee0f0 2024-09-07T03:32:31.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.893+0000 7fca0b04b640 1 -- 172.21.15.120:0/767370693 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94637264959232] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc09a040 con 0x5612748ee0f0 2024-09-07T03:32:31.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.893+0000 7fca0f328800 20 remove_watcher() i=6 2024-09-07T03:32:31.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.893+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94637264946992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612748f6be0 con 0x7fca04014440 2024-09-07T03:32:31.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94637264946992] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4028040 con 0x7fca04014440 2024-09-07T03:32:31.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0f328800 20 remove_watcher() i=7 2024-09-07T03:32:31.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748e9070 msgr2=0x5612748eb460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0f328800 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748e9070 0x5612748eb460 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612748e4b90 msgr2=0x5612748e7050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0f328800 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612748e4b90 0x5612748e7050 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca04014440 msgr2=0x7fca0403bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0f328800 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca04014440 0x7fca0403bab0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612748ee0f0 msgr2=0x5612748f0520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.894+0000 7fca0f328800 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612748ee0f0 0x5612748f0520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8d403c730 msgr2=0x7fc8d403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8d403c730 0x7fc8d403ebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0873f0 tx=0x7fc9fc090000 comp rx=0 tx=0).stop 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 msgr2=0x5612748d9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 --2- 172.21.15.120:0/767370693 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748d1ab0 0x5612748d9030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca04053d10 tx=0x7fca04053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0a84a640 1 -- 172.21.15.120:0/767370693 reap_dead start 2024-09-07T03:32:31.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 shutdown_connections 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 >> 172.21.15.120:0/767370693 conn(0x5612748cded0 msgr2=0x5612748cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 shutdown_connections 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/767370693 wait complete. 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/1763789277 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8e403c780 msgr2=0x7fc8e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 --2- 172.21.15.120:0/1763789277 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8e403c780 0x7fc8e403ec40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5612748b2030 tx=0x7fc9fc089040 comp rx=0 tx=0).stop 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/1763789277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748c5050 msgr2=0x5612748c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 --2- 172.21.15.120:0/1763789277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748c5050 0x5612748c5470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fca04016d20 tx=0x7fca0400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/1763789277 shutdown_connections 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 --2- 172.21.15.120:0/1763789277 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8e403c780 0x7fc8e403ec40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 --2- 172.21.15.120:0/1763789277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612748c5050 0x5612748c5470 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/1763789277 >> 172.21.15.120:0/1763789277 conn(0x5612748b9400 msgr2=0x5612748b97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/1763789277 shutdown_connections 2024-09-07T03:32:31.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/1763789277 wait complete. 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748b2870 msgr2=0x5612748b4c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748b2870 0x5612748b4c60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612747b2390 msgr2=0x5612748b1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.895+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612747b2390 0x5612748b1940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8f003c730 msgr2=0x7fc8f003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8f003c730 0x7fc8f003ebf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4001d70 tx=0x7fc9f40012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 msgr2=0x5612748aa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612748aa2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc053d60 tx=0x7fc9fc002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 shutdown_connections 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612748b2870 0x5612748b4c60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612747b2390 0x5612748b1940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc8f003c730 0x7fc8f003ebf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 --2- 172.21.15.120:0/3974587564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612747af440 0x5612748aa2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 >> 172.21.15.120:0/3974587564 conn(0x5612747aa920 msgr2=0x56127489bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 shutdown_connections 2024-09-07T03:32:31.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.896+0000 7fca0f328800 1 -- 172.21.15.120:0/3974587564 wait complete. 2024-09-07T03:32:31.905 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-07T03:32:31.905 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-07T03:32:31.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-07T03:32:31.906 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-07T03:32:31.950 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:31.950 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:31.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.949+0000 7fe7a100e800 1 Processor -- start 2024-09-07T03:32:31.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.949+0000 7fe7a100e800 1 -- start start 2024-09-07T03:32:31.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.949+0000 7fe7a100e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561d920eadf0 0x561d920ebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.949+0000 7fe7a100e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d91f95e40 con 0x561d920ec030 2024-09-07T03:32:31.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.949+0000 7fe7a100e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x561d91f60680 con 0x561d920eadf0 2024-09-07T03:32:31.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.950+0000 7fe79c659640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561d920eadf0 0x561d920ebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.950+0000 7fe79c659640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561d920eadf0 0x561d920ebaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40684/0 (socket says 172.21.15.120:40684) 2024-09-07T03:32:31.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.950+0000 7fe793e58640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x561d920ec030 0x561d920f0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48178/0 (socket says 172.21.15.120:48178) 2024-09-07T03:32:31.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.950+0000 7fe79c659640 1 -- 172.21.15.120:0/1561727847 learned_addr learned my addr 172.21.15.120:0/1561727847 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.950+0000 7fe79c659640 1 -- 172.21.15.120:0/1561727847 >> v1:172.21.15.104:6789/0 conn(0x561d920ec030 legacy=0x561d920f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.950+0000 7fe79c659640 1 -- 172.21.15.120:0/1561727847 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d91f7c6b0 con 0x561d920eadf0 2024-09-07T03:32:31.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.952+0000 7fe79c659640 1 --2- 172.21.15.120:0/1561727847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d920ebaf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe78c005fd0 tx=0x7fe78c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4c70dff5dea3d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.952+0000 7fe79be58640 1 -- 172.21.15.120:0/1561727847 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe78c04e600 con 0x561d920eadf0 2024-09-07T03:32:31.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.952+0000 7fe79be58640 1 -- 172.21.15.120:0/1561727847 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c04e7a0 con 0x561d920eadf0 2024-09-07T03:32:31.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.952+0000 7fe79be58640 1 -- 172.21.15.120:0/1561727847 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe78c04eaa0 con 0x561d920eadf0 2024-09-07T03:32:31.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.953+0000 7fe7a100e800 1 -- 172.21.15.120:0/1561727847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 msgr2=0x561d920ebaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.953+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1561727847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d920ebaf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe78c005fd0 tx=0x7fe78c045cf0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.953+0000 7fe7a100e800 1 -- 172.21.15.120:0/1561727847 shutdown_connections 2024-09-07T03:32:31.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.953+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1561727847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d920ebaf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.953+0000 7fe7a100e800 1 -- 172.21.15.120:0/1561727847 >> 172.21.15.120:0/1561727847 conn(0x561d920e61c0 msgr2=0x561d920e8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.953+0000 7fe7a100e800 1 -- 172.21.15.120:0/1561727847 shutdown_connections 2024-09-07T03:32:31.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.953+0000 7fe7a100e800 1 -- 172.21.15.120:0/1561727847 wait complete. 2024-09-07T03:32:31.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.966+0000 7fe7a100e800 1 Processor -- start 2024-09-07T03:32:31.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.966+0000 7fe7a100e800 1 -- start start 2024-09-07T03:32:31.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.966+0000 7fe7a100e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921da560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.966+0000 7fe7a100e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561d91f84dd0 con 0x561d920eadf0 2024-09-07T03:32:31.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.967+0000 7fe79c659640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921da560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.967+0000 7fe79c659640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921da560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40700/0 (socket says 172.21.15.120:40700) 2024-09-07T03:32:31.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.967+0000 7fe79c659640 1 -- 172.21.15.120:0/3531185388 learned_addr learned my addr 172.21.15.120:0/3531185388 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.967+0000 7fe79c659640 1 -- 172.21.15.120:0/3531185388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d91f9de10 con 0x561d920eadf0 2024-09-07T03:32:31.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.967+0000 7fe79c659640 1 --2- 172.21.15.120:0/3531185388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921da560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe78c005fd0 tx=0x7fe78c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2cec160dcbdcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.967+0000 7fe68a60c640 1 -- 172.21.15.120:0/3531185388 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe78c04eb40 con 0x561d920eadf0 2024-09-07T03:32:31.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.967+0000 7fe68a60c640 1 -- 172.21.15.120:0/3531185388 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c066070 con 0x561d920eadf0 2024-09-07T03:32:31.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.967+0000 7fe68a60c640 1 -- 172.21.15.120:0/3531185388 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe78c04ee50 con 0x561d920eadf0 2024-09-07T03:32:31.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 -- 172.21.15.120:0/3531185388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 msgr2=0x561d921da560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:31.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3531185388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921da560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe78c005fd0 tx=0x7fe78c050000 comp rx=0 tx=0).stop 2024-09-07T03:32:31.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 -- 172.21.15.120:0/3531185388 shutdown_connections 2024-09-07T03:32:31.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3531185388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921da560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 -- 172.21.15.120:0/3531185388 >> 172.21.15.120:0/3531185388 conn(0x561d920e61c0 msgr2=0x561d921d5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 -- 172.21.15.120:0/3531185388 shutdown_connections 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 -- 172.21.15.120:0/3531185388 wait complete. 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 Processor -- start 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 -- start start 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921e2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.968+0000 7fe7a100e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561d920ec720 con 0x561d920eadf0 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe79c659640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921e2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe79c659640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921e2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40714/0 (socket says 172.21.15.120:40714) 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe79c659640 1 -- 172.21.15.120:0/3212750613 learned_addr learned my addr 172.21.15.120:0/3212750613 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe79c659640 1 -- 172.21.15.120:0/3212750613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d921e3450 con 0x561d920eadf0 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe79c659640 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921e2ef0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe78c063040 tx=0x7fe78c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe688e09640 1 -- 172.21.15.120:0/3212750613 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe78c06d550 con 0x561d920eadf0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe688e09640 1 -- 172.21.15.120:0/3212750613 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c071030 con 0x561d920eadf0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d921e36e0 con 0x561d920eadf0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe688e09640 1 -- 172.21.15.120:0/3212750613 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe78c06d820 con 0x561d920eadf0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.969+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d921e40e0 con 0x561d920eadf0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.970+0000 7fe688e09640 1 -- 172.21.15.120:0/3212750613 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe78c06d9c0 con 0x561d920eadf0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.970+0000 7fe688e09640 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe68403c780 0x7fe68403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.970+0000 7fe688e09640 1 -- 172.21.15.120:0/3212750613 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fe78c098240 con 0x561d920eadf0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.970+0000 7fe793e58640 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe68403c780 0x7fe68403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.970+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d920ec030 0x561d921ea540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.970+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d921eaa80 con 0x561d920ec030 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.971+0000 7fe79ce5a640 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d920ec030 0x561d921ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.971+0000 7fe793e58640 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe68403c780 0x7fe68403ec40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe784001e30 tx=0x7fe784001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.971+0000 7fe79ce5a640 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d920ec030 0x561d921ea540 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.971+0000 7fe79ce5a640 1 -- 172.21.15.120:0/3212750613 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d920ec030 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.971+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d921eb330 0x561d921ed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.971+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d921edf10 con 0x561d921eb330 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.971+0000 7fe79c659640 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d921eb330 0x561d921ed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.972+0000 7fe79c659640 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d921eb330 0x561d921ed7a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.972+0000 7fe79c659640 1 -- 172.21.15.120:0/3212750613 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe78c07d070 con 0x561d921eb330 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.972+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d921ef7c0 con 0x561d921eb330 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.972+0000 7fe79c659640 1 -- 172.21.15.120:0/3212750613 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe78c07d070 con 0x561d921eb330 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.972+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d921ee900 con 0x561d921eb330 2024-09-07T03:32:31.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.972+0000 7fe79c659640 1 -- 172.21.15.120:0/3212750613 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe78c07d070 con 0x561d921eb330 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.972+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d921eed60 con 0x561d920ec030 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.973+0000 7fe79ce5a640 1 -- 172.21.15.120:0/3212750613 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe7940083e0 con 0x561d920ec030 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.973+0000 7fe7a100e800 1 Processor -- start 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.973+0000 7fe7a100e800 1 -- start start 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.973+0000 7fe7a100e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921fdcb0 0x561d921fe0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.973+0000 7fe7a100e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561d91fe2a00 con 0x561d921fdcb0 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.973+0000 7fe79ce5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921fdcb0 0x561d921fe0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.974+0000 7fe79ce5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921fdcb0 0x561d921fe0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40716/0 (socket says 172.21.15.120:40716) 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.974+0000 7fe79ce5a640 1 -- 172.21.15.120:0/98213490 learned_addr learned my addr 172.21.15.120:0/98213490 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.974+0000 7fe79ce5a640 1 -- 172.21.15.120:0/98213490 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d921fe710 con 0x561d921fdcb0 2024-09-07T03:32:31.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.974+0000 7fe79ce5a640 1 --2- 172.21.15.120:0/98213490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921fdcb0 0x561d921fe0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe79400aa90 tx=0x7fe79400af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.974+0000 7fe681ffb640 1 -- 172.21.15.120:0/98213490 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe794007d70 con 0x561d921fdcb0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.974+0000 7fe681ffb640 1 -- 172.21.15.120:0/98213490 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe794018430 con 0x561d921fdcb0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.974+0000 7fe7a100e800 1 -- 172.21.15.120:0/98213490 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d921fef40 con 0x561d921fdcb0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.974+0000 7fe681ffb640 1 -- 172.21.15.120:0/98213490 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe794018750 con 0x561d921fdcb0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.974+0000 7fe7a100e800 1 -- 172.21.15.120:0/98213490 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d921ff4e0 con 0x561d921fdcb0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.975+0000 7fe681ffb640 1 -- 172.21.15.120:0/98213490 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe794020020 con 0x561d921fdcb0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.975+0000 7fe681ffb640 1 --2- 172.21.15.120:0/98213490 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe67403c780 0x7fe67403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.975+0000 7fe681ffb640 1 -- 172.21.15.120:0/98213490 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fe79401e020 con 0x561d921fdcb0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.975+0000 7fe79c659640 1 --2- 172.21.15.120:0/98213490 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe67403c780 0x7fe67403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe7a100e800 1 Processor -- start 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe7a100e800 1 -- start start 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe79c659640 1 --2- 172.21.15.120:0/98213490 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe67403c780 0x7fe67403ec40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x561d921e4600 tx=0x7fe78c082040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe7a100e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d921dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe7a100e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561d921dacf0 con 0x561d921dc8e0 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe79ce5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d921dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe79ce5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d921dcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40724/0 (socket says 172.21.15.120:40724) 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe79ce5a640 1 -- 172.21.15.120:0/2623616737 learned_addr learned my addr 172.21.15.120:0/2623616737 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe79ce5a640 1 -- 172.21.15.120:0/2623616737 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d921dd2d0 con 0x561d921dc8e0 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe79ce5a640 1 --2- 172.21.15.120:0/2623616737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d921dcce0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe7940531c0 tx=0x7fe7940206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e9974765f0a395 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe67b7fe640 1 -- 172.21.15.120:0/2623616737 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe794020b70 con 0x561d921dc8e0 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe67b7fe640 1 -- 172.21.15.120:0/2623616737 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe794022410 con 0x561d921dc8e0 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.976+0000 7fe67b7fe640 1 -- 172.21.15.120:0/2623616737 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe79404c590 con 0x561d921dc8e0 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 -- 172.21.15.120:0/2623616737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 msgr2=0x561d921dcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 --2- 172.21.15.120:0/2623616737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d921dcce0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe7940531c0 tx=0x7fe7940206e0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 -- 172.21.15.120:0/2623616737 shutdown_connections 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 --2- 172.21.15.120:0/2623616737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d921dcce0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 -- 172.21.15.120:0/2623616737 >> 172.21.15.120:0/2623616737 conn(0x561d92206bd0 msgr2=0x561d92204e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 -- 172.21.15.120:0/2623616737 shutdown_connections 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 -- 172.21.15.120:0/2623616737 wait complete. 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 Processor -- start 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 -- start start 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d92213fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.977+0000 7fe7a100e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561d921dd940 con 0x561d921dc8e0 2024-09-07T03:32:32.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe79ce5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d92213fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe79ce5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d92213fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40736/0 (socket says 172.21.15.120:40736) 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 learned_addr learned my addr 172.21.15.120:0/1166270295 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d92214510 con 0x561d921dc8e0 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe79ce5a640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d92213fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe794020d60 tx=0x7fe794053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe679ffb640 1 -- 172.21.15.120:0/1166270295 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe794017e60 con 0x561d921dc8e0 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe679ffb640 1 -- 172.21.15.120:0/1166270295 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe794031020 con 0x561d921dc8e0 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d922147a0 con 0x561d921dc8e0 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe679ffb640 1 -- 172.21.15.120:0/1166270295 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe794020b70 con 0x561d921dc8e0 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.978+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d92215330 con 0x561d921dc8e0 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.979+0000 7fe679ffb640 1 -- 172.21.15.120:0/1166270295 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe794016040 con 0x561d921dc8e0 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.979+0000 7fe679ffb640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe66c03c7a0 0x7fe66c03ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.979+0000 7fe679ffb640 1 -- 172.21.15.120:0/1166270295 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fe794032030 con 0x561d921dc8e0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.979+0000 7fe79c659640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe66c03c7a0 0x7fe66c03ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe79c659640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe66c03c7a0 0x7fe66c03ec60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe78c04e5a0 tx=0x7fe78c08b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d9221fab0 0x561d92221f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d922226c0 con 0x561d9221fab0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe793e58640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d9221fab0 0x561d92221f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe793e58640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d9221fab0 0x561d92221f70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe7a100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe7a100e800 20 realm 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.980+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9221ee00 con 0x561d9221fab0 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d922231b0 con 0x561d9221fab0 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d92223f90 0x561d92226380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d92226a50 con 0x561d92223f90 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe79ce5a640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d92223f90 0x561d92226380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe79ce5a640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d92223f90 0x561d92226380 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.981+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d922272a0 con 0x561d92223f90 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.982+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.982+0000 7fe7a100e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.982+0000 7fe7a100e800 20 searching for the correct realm 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.982+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561d92229010 0x561d9222b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.982+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92229010 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.982+0000 7fe79c659640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561d92229010 0x561d9222b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.982+0000 7fe79c659640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561d92229010 0x561d9222b460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.982+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.982+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92223f90 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.983+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.983+0000 7fe79ce5a640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe79400f870 0x7fe79401f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.983+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x7fe79400f870 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.983+0000 7fe793e58640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe79400f870 0x7fe79401f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.983+0000 7fe793e58640 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe79400f870 0x7fe79401f2c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.983+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x7fe79400f870 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.983+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.983+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.983+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.984+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.984+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92229010 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.984+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.984+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.984+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.984+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92223f90 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.984+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.984+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92223f90 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x7fe79400f870 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x7fe79400f870 2024-09-07T03:32:32.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x7fe79400f870 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe78400f610 con 0x7fe79400f870 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.985+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92223f90 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.986+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.986+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92229010 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.986+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.986+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.986+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.986+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92223f90 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92229010 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.987+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92229010 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x7fe79400f870 2024-09-07T03:32:32.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x7fe79400f870 2024-09-07T03:32:32.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d9221fab0 2024-09-07T03:32:32.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x561d9221fab0 2024-09-07T03:32:32.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x7fe79400f870 2024-09-07T03:32:32.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x7fe79400f870 2024-09-07T03:32:32.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92229010 2024-09-07T03:32:32.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.988+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x7fe79400f870 2024-09-07T03:32:32.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.989+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78400f610 con 0x7fe79400f870 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.989+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bb30 con 0x561d92223f90 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.989+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.989+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe794068040 con 0x561d92223f90 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe794068040 con 0x561d92229010 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe794068040 con 0x561d92223f90 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v27'3 uv3 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe794068040 con 0x561d92223f90 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe7a100e800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe7a100e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe7a100e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe7a100e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe7a100e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe7a100e800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.990+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d92227af0 con 0x561d9221fab0 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d92227ee0 con 0x561d92223f90 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d92227ee0 con 0x561d9221fab0 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 20 zone default found 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 4 Realm: () 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 20 zonegroup default 2024-09-07T03:32:32.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9222bfb0 con 0x7fe79400f870 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.991+0000 7fe7a100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9222dd70 con 0x561d92229010 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe7a100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9222e200 con 0x561d92229010 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe7a100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe7a100e800 20 started sync module instance, tier type = 2024-09-07T03:32:32.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe7a100e800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:32.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.992+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222d1e0 con 0x561d92223f90 2024-09-07T03:32:32.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.993+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.993+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94685005797120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222d1e0 con 0x561d92223f90 2024-09-07T03:32:32.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.993+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222ece0 con 0x561d9221fab0 2024-09-07T03:32:32.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.994+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94685005797120] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.994+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.994+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94685005794608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222d150 con 0x561d9221fab0 2024-09-07T03:32:32.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.994+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222fba0 con 0x561d92223f90 2024-09-07T03:32:32.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.997+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94685005794608] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.997+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.997+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94685005803728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222fba0 con 0x561d92223f90 2024-09-07T03:32:32.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:31.997+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d922305f0 con 0x7fe79400f870 2024-09-07T03:32:32.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.000+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94685005803728] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.000+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.000+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94685005807872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222fba0 con 0x7fe79400f870 2024-09-07T03:32:32.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.000+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92231030 con 0x561d92223f90 2024-09-07T03:32:32.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.001+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94685005807872] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.002+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.002+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94685005811040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222fba0 con 0x561d92223f90 2024-09-07T03:32:32.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.002+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92231a70 con 0x561d92229010 2024-09-07T03:32:32.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.003+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.003+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94685005813184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d922322c0 con 0x561d92229010 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.003+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92232d70 con 0x561d92229010 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.003+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94685005811040] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.004+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94685005813184] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.005+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.005+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94685005805296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92231e10 con 0x561d92229010 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.005+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92233610 con 0x7fe79400f870 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94685005805296] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94685005817936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92231e10 con 0x7fe79400f870 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe7a100e800 20 add_watcher() i=0 2024-09-07T03:32:32.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe7a100e800 20 add_watcher() i=1 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe7a100e800 20 add_watcher() i=2 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe7a100e800 20 add_watcher() i=3 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe7a100e800 20 add_watcher() i=4 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe7a100e800 20 add_watcher() i=5 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.008+0000 7fe7a100e800 20 add_watcher() i=6 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.009+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94685005817936] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.009+0000 7fe7a100e800 20 add_watcher() i=7 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.009+0000 7fe7a100e800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.009+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d922367b0 con 0x561d9221fab0 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.009+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.009+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94685005820256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92233d00 con 0x561d9221fab0 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.011+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94685005820256] v34'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.011+0000 7fe6527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.011+0000 7fe7a100e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.011+0000 7fe7a100e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.011+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223f050 con 0x561d92223f90 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.012+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'43 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.012+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223f0b0 con 0x7fe79400f870 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.013+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'18 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.013+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223f780 con 0x561d92229010 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.015+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.015+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223fc10 con 0x561d9221fab0 2024-09-07T03:32:32.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.016+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'43 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.016+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223fbb0 con 0x561d92223f90 2024-09-07T03:32:32.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.017+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'32 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.017+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223fc40 con 0x561d92229010 2024-09-07T03:32:32.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.018+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.018+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223fd70 con 0x561d92223f90 2024-09-07T03:32:32.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.020+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.020+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223fe00 con 0x561d9221fab0 2024-09-07T03:32:32.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.021+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.021+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223fef0 con 0x561d92223f90 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.022+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.022+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d922402b0 con 0x561d92223f90 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.023+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.023+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240000 con 0x561d92223f90 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.024+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.024+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240000 con 0x561d92229010 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.025+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.025+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d922405d0 con 0x561d92223f90 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.026+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.026+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223e830 con 0x561d9221fab0 2024-09-07T03:32:32.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.027+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.027+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d922405b0 con 0x561d9221fab0 2024-09-07T03:32:32.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.028+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.028+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d922405b0 con 0x561d92223f90 2024-09-07T03:32:32.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.029+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.029+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240590 con 0x561d92223f90 2024-09-07T03:32:32.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.030+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.030+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240590 con 0x561d92229010 2024-09-07T03:32:32.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.031+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.031+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240590 con 0x561d92223f90 2024-09-07T03:32:32.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.032+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.032+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240590 con 0x561d9221fab0 2024-09-07T03:32:32.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.033+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'45 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.033+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240590 con 0x561d92223f90 2024-09-07T03:32:32.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.034+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.034+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240590 con 0x561d92223f90 2024-09-07T03:32:32.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.035+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.035+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240000 con 0x561d92229010 2024-09-07T03:32:32.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.039+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.039+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240000 con 0x561d92223f90 2024-09-07T03:32:32.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.040+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.040+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240060 con 0x561d92229010 2024-09-07T03:32:32.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.041+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.041+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240060 con 0x561d92229010 2024-09-07T03:32:32.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.044+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'30 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.044+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240060 con 0x561d92229010 2024-09-07T03:32:32.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.046+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.046+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240060 con 0x561d92223f90 2024-09-07T03:32:32.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.047+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.047+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240060 con 0x561d9221fab0 2024-09-07T03:32:32.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.048+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.048+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240060 con 0x561d92223f90 2024-09-07T03:32:32.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.049+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.049+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d922400a0 con 0x561d9221fab0 2024-09-07T03:32:32.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.052+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'36 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.052+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92240060 con 0x7fe79400f870 2024-09-07T03:32:32.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.055+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.055+0000 7fe6517e2640 20 reqs_thread_entry: start 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.055+0000 7fe7a100e800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.055+0000 7fe7a100e800 20 Filter name: none 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.055+0000 7fe5c2ffd640 20 reqs_thread_entry: start 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.055+0000 7fe7a100e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.055+0000 7fe7a100e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.055+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9226b390 con 0x7fe79400f870 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.056+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.056+0000 7fe7a100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.056+0000 7fe7a100e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-07T03:32:32.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.056+0000 7fe7a100e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:32:32.059 INFO:teuthology.orchestra.run.smithi120.stderr:could not remove user: unable to remove user, user does not exist 2024-09-07T03:32:32.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.056+0000 7fe6527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.056+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94685005820256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9223e300 con 0x561d9221fab0 2024-09-07T03:32:32.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.057+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94685005820256] v34'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.057+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94685005797120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92233160 con 0x561d92223f90 2024-09-07T03:32:32.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.058+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94685005797120] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.058+0000 7fe7a100e800 20 remove_watcher() i=0 2024-09-07T03:32:32.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.058+0000 7fe7a100e800 2 removed watcher, disabling cache 2024-09-07T03:32:32.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.058+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94685005794608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92233160 con 0x561d9221fab0 2024-09-07T03:32:32.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.059+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94685005794608] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x561d9221fab0 2024-09-07T03:32:32.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.059+0000 7fe7a100e800 20 remove_watcher() i=1 2024-09-07T03:32:32.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.059+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94685005803728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222cd30 con 0x561d92223f90 2024-09-07T03:32:32.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.060+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94685005803728] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.060+0000 7fe7a100e800 20 remove_watcher() i=2 2024-09-07T03:32:32.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.060+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94685005807872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92233160 con 0x7fe79400f870 2024-09-07T03:32:32.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.061+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94685005807872] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.061+0000 7fe7a100e800 20 remove_watcher() i=3 2024-09-07T03:32:32.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.061+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94685005811040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222f0d0 con 0x561d92223f90 2024-09-07T03:32:32.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.063+0000 7fe79ce5a640 1 -- 172.21.15.120:0/1166270295 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94685005811040] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7940083e0 con 0x561d92223f90 2024-09-07T03:32:32.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.063+0000 7fe7a100e800 20 remove_watcher() i=4 2024-09-07T03:32:32.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.063+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94685005813184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9222cd30 con 0x561d92229010 2024-09-07T03:32:32.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.063+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94685005813184] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.063+0000 7fe7a100e800 20 remove_watcher() i=5 2024-09-07T03:32:32.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.064+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94685005805296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92230100 con 0x561d92229010 2024-09-07T03:32:32.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.069+0000 7fe79c659640 1 -- 172.21.15.120:0/1166270295 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94685005805296] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78c07d070 con 0x561d92229010 2024-09-07T03:32:32.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.069+0000 7fe7a100e800 20 remove_watcher() i=6 2024-09-07T03:32:32.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.069+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94685005817936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d92233160 con 0x7fe79400f870 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94685005817936] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78403c040 con 0x7fe79400f870 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 20 remove_watcher() i=7 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d92223f90 msgr2=0x561d92226380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d92223f90 0x561d92226380 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d9221fab0 msgr2=0x561d92221f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d9221fab0 0x561d92221f70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe79400f870 msgr2=0x7fe79401f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe79400f870 0x7fe79401f2c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561d92229010 msgr2=0x561d9222b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561d92229010 0x561d9222b460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe66c03c7a0 msgr2=0x7fe66c03ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe66c03c7a0 0x7fe66c03ec60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe78c04e5a0 tx=0x7fe78c08b000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe793e58640 1 -- 172.21.15.120:0/1166270295 reap_dead start 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 msgr2=0x561d92213fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d92213fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe794020d60 tx=0x7fe794053150 comp rx=0 tx=0).stop 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 shutdown_connections 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/1166270295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921dc8e0 0x561d92213fb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 >> 172.21.15.120:0/1166270295 conn(0x561d92206bd0 msgr2=0x561d92204de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 shutdown_connections 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/1166270295 wait complete. 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/98213490 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe67403c780 msgr2=0x7fe67403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/98213490 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe67403c780 0x7fe67403ec40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x561d921e4600 tx=0x7fe78c082040 comp rx=0 tx=0).stop 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/98213490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921fdcb0 msgr2=0x561d921fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/98213490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921fdcb0 0x561d921fe0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe79400aa90 tx=0x7fe79400af50 comp rx=0 tx=0).stop 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/98213490 shutdown_connections 2024-09-07T03:32:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/98213490 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe67403c780 0x7fe67403ec40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 --2- 172.21.15.120:0/98213490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d921fdcb0 0x561d921fe0d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/98213490 >> 172.21.15.120:0/98213490 conn(0x561d921f2060 msgr2=0x561d921f2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/98213490 shutdown_connections 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.070+0000 7fe7a100e800 1 -- 172.21.15.120:0/98213490 wait complete. 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d921eb330 msgr2=0x561d921ed7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d921eb330 0x561d921ed7a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d920ec030 msgr2=0x561d921ea540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d920ec030 0x561d921ea540 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe68403c780 msgr2=0x7fe68403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe68403c780 0x7fe68403ec40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe784001e30 tx=0x7fe784001390 comp rx=0 tx=0).stop 2024-09-07T03:32:32.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 msgr2=0x561d921e2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921e2ef0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe78c063040 tx=0x7fe78c003330 comp rx=0 tx=0).stop 2024-09-07T03:32:32.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 shutdown_connections 2024-09-07T03:32:32.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561d921eb330 0x561d921ed7a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561d920ec030 0x561d921ea540 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe68403c780 0x7fe68403ec40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 --2- 172.21.15.120:0/3212750613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561d920eadf0 0x561d921e2ef0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 >> 172.21.15.120:0/3212750613 conn(0x561d920e61c0 msgr2=0x561d921db720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 shutdown_connections 2024-09-07T03:32:32.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.071+0000 7fe7a100e800 1 -- 172.21.15.120:0/3212750613 wait complete. 2024-09-07T03:32:32.080 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-07T03:32:32.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-07T03:32:32.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-07T03:32:32.081 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-07T03:32:32.127 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:32.127 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:32.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.126+0000 7f192e210800 1 Processor -- start 2024-09-07T03:32:32.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.126+0000 7f192e210800 1 -- start start 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.126+0000 7f192e210800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559c6fe3a210 0x559c6fe3fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.126+0000 7f192e210800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559c6fce3e40 con 0x559c6fe38e00 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.126+0000 7f192e210800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x559c6fcae680 con 0x559c6fe3a210 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.127+0000 7f19299bc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x559c6fe38e00 0x559c6fe39b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48190/0 (socket says 172.21.15.120:48190) 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.127+0000 7f19299bc640 1 -- 172.21.15.120:0/3405181668 learned_addr learned my addr 172.21.15.120:0/3405181668 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.127+0000 7f1923fff640 1 --2- 172.21.15.120:0/3405181668 >> v2:172.21.15.104:3300/0 conn(0x559c6fe3a210 0x559c6fe3fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.127+0000 7f19291bb640 1 -- 172.21.15.120:0/3405181668 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672062971 0 0) 0x559c6fce3e40 con 0x559c6fe38e00 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.127+0000 7f19291bb640 1 -- 172.21.15.120:0/3405181668 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1918001e10 con 0x559c6fe38e00 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.127+0000 7f1923fff640 1 -- 172.21.15.120:0/3405181668 >> v1:172.21.15.104:6789/0 conn(0x559c6fe38e00 legacy=0x559c6fe39b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.127+0000 7f1923fff640 1 -- 172.21.15.120:0/3405181668 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6fcca6b0 con 0x559c6fe3a210 2024-09-07T03:32:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.129+0000 7f1923fff640 1 --2- 172.21.15.120:0/3405181668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe3a210 0x559c6fe3fdb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f191400a470 tx=0x7f1914045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c3d513eaa57ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.129+0000 7f19291bb640 1 -- 172.21.15.120:0/3405181668 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1914059070 con 0x559c6fe3a210 2024-09-07T03:32:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.129+0000 7f19291bb640 1 -- 172.21.15.120:0/3405181668 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1914054570 con 0x559c6fe3a210 2024-09-07T03:32:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.129+0000 7f19291bb640 1 -- 172.21.15.120:0/3405181668 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1914054850 con 0x559c6fe3a210 2024-09-07T03:32:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.130+0000 7f192e210800 1 -- 172.21.15.120:0/3405181668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe3a210 msgr2=0x559c6fe3fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.130+0000 7f192e210800 1 --2- 172.21.15.120:0/3405181668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe3a210 0x559c6fe3fdb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f191400a470 tx=0x7f1914045920 comp rx=0 tx=0).stop 2024-09-07T03:32:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.130+0000 7f192e210800 1 -- 172.21.15.120:0/3405181668 shutdown_connections 2024-09-07T03:32:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.130+0000 7f192e210800 1 --2- 172.21.15.120:0/3405181668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe3a210 0x559c6fe3fdb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.130+0000 7f192e210800 1 -- 172.21.15.120:0/3405181668 >> 172.21.15.120:0/3405181668 conn(0x559c6fe341f0 msgr2=0x559c6fe36630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.130+0000 7f192e210800 1 -- 172.21.15.120:0/3405181668 shutdown_connections 2024-09-07T03:32:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.130+0000 7f192e210800 1 -- 172.21.15.120:0/3405181668 wait complete. 2024-09-07T03:32:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.143+0000 7f192e210800 1 Processor -- start 2024-09-07T03:32:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.143+0000 7f192e210800 1 -- start start 2024-09-07T03:32:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.144+0000 7f192e210800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6ff28340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.144+0000 7f192e210800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559c6fcd2dd0 con 0x559c6fe38e00 2024-09-07T03:32:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.144+0000 7f19299bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6ff28340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.144+0000 7f19299bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6ff28340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40758/0 (socket says 172.21.15.120:40758) 2024-09-07T03:32:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.144+0000 7f19299bc640 1 -- 172.21.15.120:0/1869491946 learned_addr learned my addr 172.21.15.120:0/1869491946 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.144+0000 7f19299bc640 1 -- 172.21.15.120:0/1869491946 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6fcebe10 con 0x559c6fe38e00 2024-09-07T03:32:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.144+0000 7f19299bc640 1 --2- 172.21.15.120:0/1869491946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6ff28340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f191c001e30 tx=0x7f191c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b27bccf4f1b3066 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f1817e07640 1 -- 172.21.15.120:0/1869491946 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c012020 con 0x559c6fe38e00 2024-09-07T03:32:32.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f1817e07640 1 -- 172.21.15.120:0/1869491946 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c00e470 con 0x559c6fe38e00 2024-09-07T03:32:32.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f1817e07640 1 -- 172.21.15.120:0/1869491946 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c00e790 con 0x559c6fe38e00 2024-09-07T03:32:32.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f192e210800 1 -- 172.21.15.120:0/1869491946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 msgr2=0x559c6ff28340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f192e210800 1 --2- 172.21.15.120:0/1869491946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6ff28340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f191c001e30 tx=0x7f191c00b780 comp rx=0 tx=0).stop 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f192e210800 1 -- 172.21.15.120:0/1869491946 shutdown_connections 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f192e210800 1 --2- 172.21.15.120:0/1869491946 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6ff28340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f192e210800 1 -- 172.21.15.120:0/1869491946 >> 172.21.15.120:0/1869491946 conn(0x559c6fe341f0 msgr2=0x559c6ff23cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f192e210800 1 -- 172.21.15.120:0/1869491946 shutdown_connections 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.145+0000 7f192e210800 1 -- 172.21.15.120:0/1869491946 wait complete. 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.146+0000 7f192e210800 1 Processor -- start 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.146+0000 7f192e210800 1 -- start start 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.146+0000 7f192e210800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6fdad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.146+0000 7f192e210800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559c6fe3a900 con 0x559c6fe38e00 2024-09-07T03:32:32.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.146+0000 7f19299bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6fdad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.146+0000 7f19299bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6fdad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40774/0 (socket says 172.21.15.120:40774) 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.146+0000 7f19299bc640 1 -- 172.21.15.120:0/4051638327 learned_addr learned my addr 172.21.15.120:0/4051638327 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.146+0000 7f19299bc640 1 -- 172.21.15.120:0/4051638327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6fdadae0 con 0x559c6fe38e00 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.147+0000 7f19299bc640 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6fdad580 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x559c6ff292d0 tx=0x7f191c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.147+0000 7f1816604640 1 -- 172.21.15.120:0/4051638327 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c012030 con 0x559c6fe38e00 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.147+0000 7f1816604640 1 -- 172.21.15.120:0/4051638327 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c01a7a0 con 0x559c6fe38e00 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.147+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c6ff339d0 con 0x559c6fe38e00 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.147+0000 7f1816604640 1 -- 172.21.15.120:0/4051638327 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c01aaa0 con 0x559c6fe38e00 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.147+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c6ff33f90 con 0x559c6fe38e00 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.148+0000 7f1816604640 1 -- 172.21.15.120:0/4051638327 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f191c015020 con 0x559c6fe38e00 2024-09-07T03:32:32.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.148+0000 7f1816604640 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f181003c730 0x7f181003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.148+0000 7f1816604640 1 -- 172.21.15.120:0/4051638327 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f191c020070 con 0x559c6fe38e00 2024-09-07T03:32:32.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.148+0000 7f1923fff640 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f181003c730 0x7f181003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.148+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6fe3a210 0x559c6ff37f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.148+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff38580 con 0x559c6fe3a210 2024-09-07T03:32:32.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.148+0000 7f192a1bd640 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6fe3a210 0x559c6ff37f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.148+0000 7f1923fff640 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f181003c730 0x7f181003ebf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x559c6fe38540 tx=0x7f1914050000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.148+0000 7f192a1bd640 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6fe3a210 0x559c6ff37f30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.149+0000 7f192a1bd640 1 -- 172.21.15.120:0/4051638327 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f192400a4d0 con 0x559c6fe3a210 2024-09-07T03:32:32.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.149+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff39370 0x559c6ff3b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.149+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff3bda0 con 0x559c6ff39370 2024-09-07T03:32:32.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.149+0000 7f19299bc640 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff39370 0x559c6ff3b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.149+0000 7f19299bc640 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff39370 0x559c6ff3b760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.149+0000 7f19299bc640 1 -- 172.21.15.120:0/4051638327 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff39370 2024-09-07T03:32:32.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.149+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff3d650 con 0x559c6ff39370 2024-09-07T03:32:32.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.150+0000 7f19299bc640 1 -- 172.21.15.120:0/4051638327 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff39370 2024-09-07T03:32:32.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.150+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff3c790 con 0x559c6ff39370 2024-09-07T03:32:32.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.150+0000 7f19299bc640 1 -- 172.21.15.120:0/4051638327 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff39370 2024-09-07T03:32:32.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.150+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff3cbf0 con 0x559c6fe3a210 2024-09-07T03:32:32.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.150+0000 7f192a1bd640 1 -- 172.21.15.120:0/4051638327 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f192400a4d0 con 0x559c6fe3a210 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f192e210800 1 Processor -- start 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f192e210800 1 -- start start 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f192e210800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff4bb40 0x559c6ff4bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f192e210800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559c6fd30a00 con 0x559c6ff4bb40 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f192a1bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff4bb40 0x559c6ff4bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f192a1bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff4bb40 0x559c6ff4bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40778/0 (socket says 172.21.15.120:40778) 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f192a1bd640 1 -- 172.21.15.120:0/4154365475 learned_addr learned my addr 172.21.15.120:0/4154365475 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f192a1bd640 1 -- 172.21.15.120:0/4154365475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6ff4c5a0 con 0x559c6ff4bb40 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f192a1bd640 1 --2- 172.21.15.120:0/4154365475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff4bb40 0x559c6ff4bf60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1924016d20 tx=0x7f192400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.151+0000 7f180f7fe640 1 -- 172.21.15.120:0/4154365475 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1924017660 con 0x559c6ff4bb40 2024-09-07T03:32:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.152+0000 7f180f7fe640 1 -- 172.21.15.120:0/4154365475 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f192401b030 con 0x559c6ff4bb40 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.152+0000 7f192e210800 1 -- 172.21.15.120:0/4154365475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c6ff4cdd0 con 0x559c6ff4bb40 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.152+0000 7f180f7fe640 1 -- 172.21.15.120:0/4154365475 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1924017950 con 0x559c6ff4bb40 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.152+0000 7f192e210800 1 -- 172.21.15.120:0/4154365475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c6ff4d370 con 0x559c6ff4bb40 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.152+0000 7f180f7fe640 1 -- 172.21.15.120:0/4154365475 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1924017af0 con 0x559c6ff4bb40 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f180f7fe640 1 --2- 172.21.15.120:0/4154365475 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f180403c780 0x7f180403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f180f7fe640 1 -- 172.21.15.120:0/4154365475 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f192400e040 con 0x559c6ff4bb40 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f19299bc640 1 --2- 172.21.15.120:0/4154365475 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f180403c780 0x7f180403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f192e210800 1 Processor -- start 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f192e210800 1 -- start start 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f19299bc640 1 --2- 172.21.15.120:0/4154365475 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f180403c780 0x7f180403ec40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x559c6ff38b30 tx=0x7f191c052040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f192e210800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f192e210800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559c6ff28b90 con 0x559c6ff585e0 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f192a1bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f192a1bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40784/0 (socket says 172.21.15.120:40784) 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f192a1bd640 1 -- 172.21.15.120:0/399503662 learned_addr learned my addr 172.21.15.120:0/399503662 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.153+0000 7f192a1bd640 1 -- 172.21.15.120:0/399503662 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6ff58fd0 con 0x559c6ff585e0 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f192a1bd640 1 --2- 172.21.15.120:0/399503662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff589e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1924054030 tx=0x7f1924054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef1f771c39244f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f180d7fa640 1 -- 172.21.15.120:0/399503662 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1924014d40 con 0x559c6ff585e0 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f180d7fa640 1 -- 172.21.15.120:0/399503662 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19240149b0 con 0x559c6ff585e0 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f180d7fa640 1 -- 172.21.15.120:0/399503662 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1924028350 con 0x559c6ff585e0 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f192e210800 1 -- 172.21.15.120:0/399503662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 msgr2=0x559c6ff589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f192e210800 1 --2- 172.21.15.120:0/399503662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff589e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1924054030 tx=0x7f1924054060 comp rx=0 tx=0).stop 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f192e210800 1 -- 172.21.15.120:0/399503662 shutdown_connections 2024-09-07T03:32:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f192e210800 1 --2- 172.21.15.120:0/399503662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff589e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f192e210800 1 -- 172.21.15.120:0/399503662 >> 172.21.15.120:0/399503662 conn(0x559c6ff549e0 msgr2=0x559c6ff52c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f192e210800 1 -- 172.21.15.120:0/399503662 shutdown_connections 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.154+0000 7f192e210800 1 -- 172.21.15.120:0/399503662 wait complete. 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192e210800 1 Processor -- start 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192e210800 1 -- start start 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192e210800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff5fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192e210800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559c6ff595c0 con 0x559c6ff585e0 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192a1bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff5fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192a1bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff5fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40796/0 (socket says 172.21.15.120:40796) 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 learned_addr learned my addr 172.21.15.120:0/876231674 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c6ff60100 con 0x559c6ff585e0 2024-09-07T03:32:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192a1bd640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff5fba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1924053d10 tx=0x7f1924053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f17fb7fe640 1 -- 172.21.15.120:0/876231674 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1924012570 con 0x559c6ff585e0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f17fb7fe640 1 -- 172.21.15.120:0/876231674 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1924005500 con 0x559c6ff585e0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c6ff60390 con 0x559c6ff585e0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f17fb7fe640 1 -- 172.21.15.120:0/876231674 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1924055570 con 0x559c6ff585e0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.155+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c6ff60f20 con 0x559c6ff585e0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.156+0000 7f17fb7fe640 1 -- 172.21.15.120:0/876231674 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f19240127a0 con 0x559c6ff585e0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.156+0000 7f17fb7fe640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f17f403c730 0x7f17f403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.156+0000 7f17fb7fe640 1 -- 172.21.15.120:0/876231674 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1924048920 con 0x559c6ff585e0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.156+0000 7f19299bc640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f17f403c730 0x7f17f403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.157+0000 7f19299bc640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f17f403c730 0x7f17f403ebf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f191c01a6a0 tx=0x7f191c00ef90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.157+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.157+0000 7f192e210800 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6ff6b700 0x559c6ff6dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.157+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff6e310 con 0x559c6ff6b700 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.157+0000 7f1923fff640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6ff6b700 0x559c6ff6dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f1923fff640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6ff6b700 0x559c6ff6dbc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 20 realm 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff6e740 con 0x559c6ff6b700 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff6f010 con 0x559c6ff6b700 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff6fa30 0x559c6ff71e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.158+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff725d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192a1bd640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff6fa30 0x559c6ff71e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192a1bd640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff6fa30 0x559c6ff71e60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192e210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff72e20 con 0x559c6ff6fa30 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192e210800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192e210800 20 searching for the correct realm 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192e210800 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559c6ff74b90 0x559c6ff77000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.159+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff74b90 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.160+0000 7f19299bc640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559c6ff74b90 0x559c6ff77000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.160+0000 7f19299bc640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559c6ff74b90 0x559c6ff77000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.160+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.160+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.161+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.161+0000 7f192a1bd640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1924014440 0x7f192403bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.161+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x7f1924014440 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.161+0000 7f1923fff640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1924014440 0x7f192403bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.161+0000 7f1923fff640 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1924014440 0x7f192403bab0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.161+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.161+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.161+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.161+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.162+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.162+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff74b90 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.162+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.162+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.162+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.162+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.162+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.162+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x7f1924014440 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x7f1924014440 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.163+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.164+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.164+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff74b90 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.164+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.164+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.164+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.164+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.164+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.164+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff74b90 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff74b90 2024-09-07T03:32:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.165+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x7f1924014440 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.166+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.166+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6b700 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.166+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.166+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x7f1924014440 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.166+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.166+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff74b90 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.166+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.166+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x7f1924014440 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.167+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.167+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.167+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.167+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.167+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.167+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff74b90 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.167+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.167+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.167+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v27'3 uv3 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff776d0 con 0x559c6ff6fa30 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:32.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:32.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff73770 con 0x559c6ff6b700 2024-09-07T03:32:32.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff733b0 con 0x559c6ff6fa30 2024-09-07T03:32:32.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff73bb0 con 0x559c6ff6b700 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.168+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 zone default found 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 4 Realm: () 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:32.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 zonegroup default 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff78000 con 0x7f1924014440 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff79cd0 con 0x559c6ff74b90 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7a190 con 0x559c6ff74b90 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 started sync module instance, tier type = 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.169+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff78aa0 con 0x559c6ff6fa30 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.171+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.171+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94130381754000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7aaa0 con 0x559c6ff6fa30 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.171+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7b2f0 con 0x559c6ff6b700 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.171+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94130381754000] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.172+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.172+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94130381759984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7af60 con 0x559c6ff6b700 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.172+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7ba60 con 0x559c6ff6fa30 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.173+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.173+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94130381763920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7ba60 con 0x559c6ff6fa30 2024-09-07T03:32:32.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.173+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94130381759984] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.173+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7aa50 con 0x7f1924014440 2024-09-07T03:32:32.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.174+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94130381763920] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.175+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.175+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94130381766272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7aa50 con 0x7f1924014440 2024-09-07T03:32:32.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.175+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7cff0 con 0x559c6ff6fa30 2024-09-07T03:32:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.176+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94130381766272] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.177+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.177+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94130381767968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7cff0 con 0x559c6ff6fa30 2024-09-07T03:32:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.177+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7d9b0 con 0x559c6ff74b90 2024-09-07T03:32:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.179+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.179+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94130381767968] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.179+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94130381772032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7e200 con 0x559c6ff74b90 2024-09-07T03:32:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.179+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7cb80 con 0x559c6ff74b90 2024-09-07T03:32:32.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.181+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.182+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94130381776704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7f010 con 0x559c6ff74b90 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.182+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7fa80 con 0x7f1924014440 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.184+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94130381772032] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94130381776704] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94130381780304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7eb60 con 0x7f1924014440 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f192e210800 20 add_watcher() i=0 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f192e210800 20 add_watcher() i=1 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f192e210800 20 add_watcher() i=2 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f192e210800 20 add_watcher() i=3 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f192e210800 20 add_watcher() i=4 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f192e210800 20 add_watcher() i=5 2024-09-07T03:32:32.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.190+0000 7f192e210800 20 add_watcher() i=6 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.191+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94130381780304] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.191+0000 7f192e210800 20 add_watcher() i=7 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.191+0000 7f192e210800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.191+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7eb60 con 0x559c6ff6b700 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.191+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.191+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94130381774160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7eb60 con 0x559c6ff6b700 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.192+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94130381774160] v34'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.192+0000 7f17dbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.192+0000 7f192e210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.192+0000 7f192e210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.193+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff84da0 con 0x559c6ff6fa30 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.194+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'44 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.194+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff84d40 con 0x7f1924014440 2024-09-07T03:32:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.195+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.195+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8b570 con 0x559c6ff74b90 2024-09-07T03:32:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.196+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.196+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8bae0 con 0x559c6ff6b700 2024-09-07T03:32:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.197+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'48 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.197+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8bf90 con 0x559c6ff6fa30 2024-09-07T03:32:32.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.198+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'35 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.198+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8bf90 con 0x559c6ff74b90 2024-09-07T03:32:32.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.199+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.199+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8aa10 con 0x559c6ff6fa30 2024-09-07T03:32:32.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.200+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.200+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8aa10 con 0x559c6ff6b700 2024-09-07T03:32:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.201+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.201+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8abe0 con 0x559c6ff6fa30 2024-09-07T03:32:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.202+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.202+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8abe0 con 0x559c6ff6fa30 2024-09-07T03:32:32.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.203+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.203+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8acd0 con 0x559c6ff6fa30 2024-09-07T03:32:32.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.204+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.204+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8acd0 con 0x559c6ff74b90 2024-09-07T03:32:32.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.205+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.205+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8ad60 con 0x559c6ff6fa30 2024-09-07T03:32:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.206+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.206+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff6b700 2024-09-07T03:32:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.207+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.207+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff6b700 2024-09-07T03:32:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.208+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'49 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.208+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff6fa30 2024-09-07T03:32:32.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.209+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.209+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff6fa30 2024-09-07T03:32:32.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.210+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.210+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff74b90 2024-09-07T03:32:32.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.212+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.212+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff6fa30 2024-09-07T03:32:32.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.213+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.213+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff6b700 2024-09-07T03:32:32.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.214+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'50 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.214+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff6fa30 2024-09-07T03:32:32.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.215+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.215+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff6fa30 2024-09-07T03:32:32.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.216+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.216+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff74b90 2024-09-07T03:32:32.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.218+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.218+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff6fa30 2024-09-07T03:32:32.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.219+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.219+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff74b90 2024-09-07T03:32:32.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.220+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.220+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8c920 con 0x559c6ff74b90 2024-09-07T03:32:32.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.223+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'32 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.223+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8caf0 con 0x559c6ff74b90 2024-09-07T03:32:32.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.226+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.226+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8caf0 con 0x559c6ff6fa30 2024-09-07T03:32:32.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.227+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.227+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8caf0 con 0x559c6ff6b700 2024-09-07T03:32:32.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.228+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.228+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8caf0 con 0x559c6ff6fa30 2024-09-07T03:32:32.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.229+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'31 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.229+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8caf0 con 0x559c6ff6b700 2024-09-07T03:32:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.234+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'38 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.234+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff8caf0 con 0x7f1924014440 2024-09-07T03:32:32.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.235+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f17daffd640 20 reqs_thread_entry: start 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f192e210800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f192e210800 20 Filter name: none 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f17d8ff9640 20 reqs_thread_entry: start 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f192e210800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f192e210800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559c6ffb7530 con 0x559c6ff6b700 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f192e210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f192e210800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.236+0000 7f192e210800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:could not remove user: unable to remove user, user does not exist 2024-09-07T03:32:32.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.237+0000 7f17dbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.237+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94130381774160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff89f20 con 0x559c6ff6b700 2024-09-07T03:32:32.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.238+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94130381774160] v34'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.238+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94130381754000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7dd50 con 0x559c6ff6fa30 2024-09-07T03:32:32.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.239+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94130381754000] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.239+0000 7f192e210800 20 remove_watcher() i=0 2024-09-07T03:32:32.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.239+0000 7f192e210800 2 removed watcher, disabling cache 2024-09-07T03:32:32.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.239+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94130381759984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff78e90 con 0x559c6ff6b700 2024-09-07T03:32:32.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.240+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94130381759984] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191405c040 con 0x559c6ff6b700 2024-09-07T03:32:32.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.241+0000 7f192e210800 20 remove_watcher() i=1 2024-09-07T03:32:32.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.241+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94130381763920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff78e90 con 0x559c6ff6fa30 2024-09-07T03:32:32.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.243+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94130381763920] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.243+0000 7f192e210800 20 remove_watcher() i=2 2024-09-07T03:32:32.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.243+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94130381766272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff78e90 con 0x7f1924014440 2024-09-07T03:32:32.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.244+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94130381766272] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.244+0000 7f192e210800 20 remove_watcher() i=3 2024-09-07T03:32:32.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.244+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94130381767968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff78e90 con 0x559c6ff6fa30 2024-09-07T03:32:32.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.246+0000 7f192a1bd640 1 -- 172.21.15.120:0/876231674 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94130381767968] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1924027070 con 0x559c6ff6fa30 2024-09-07T03:32:32.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.246+0000 7f192e210800 20 remove_watcher() i=4 2024-09-07T03:32:32.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.246+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94130381772032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7c520 con 0x559c6ff74b90 2024-09-07T03:32:32.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.247+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94130381772032] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.247+0000 7f192e210800 20 remove_watcher() i=5 2024-09-07T03:32:32.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.247+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94130381776704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff78e90 con 0x559c6ff74b90 2024-09-07T03:32:32.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.248+0000 7f19299bc640 1 -- 172.21.15.120:0/876231674 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94130381776704] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c018950 con 0x559c6ff74b90 2024-09-07T03:32:32.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.248+0000 7f192e210800 20 remove_watcher() i=6 2024-09-07T03:32:32.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.248+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94130381780304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559c6ff7d500 con 0x7f1924014440 2024-09-07T03:32:32.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94130381780304] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191405c040 con 0x7f1924014440 2024-09-07T03:32:32.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 20 remove_watcher() i=7 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff6fa30 msgr2=0x559c6ff71e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff6fa30 0x559c6ff71e60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6ff6b700 msgr2=0x559c6ff6dbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6ff6b700 0x559c6ff6dbc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1924014440 msgr2=0x7f192403bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1924014440 0x7f192403bab0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559c6ff74b90 msgr2=0x559c6ff77000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559c6ff74b90 0x559c6ff77000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f17f403c730 msgr2=0x7f17f403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f17f403c730 0x7f17f403ebf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f191c01a6a0 tx=0x7f191c00ef90 comp rx=0 tx=0).stop 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 msgr2=0x559c6ff5fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/876231674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff585e0 0x559c6ff5fba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1924053d10 tx=0x7f1924053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 reap_dead start 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f1923fff640 1 -- 172.21.15.120:0/876231674 reap_dead start 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 shutdown_connections 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 >> 172.21.15.120:0/876231674 conn(0x559c6ff549e0 msgr2=0x559c6ff52bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 shutdown_connections 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/876231674 wait complete. 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/4154365475 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f180403c780 msgr2=0x7f180403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/4154365475 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f180403c780 0x7f180403ec40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x559c6ff38b30 tx=0x7f191c052040 comp rx=0 tx=0).stop 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/4154365475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff4bb40 msgr2=0x559c6ff4bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/4154365475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff4bb40 0x559c6ff4bf60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1924016d20 tx=0x7f192400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/4154365475 shutdown_connections 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/4154365475 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f180403c780 0x7f180403ec40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 --2- 172.21.15.120:0/4154365475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6ff4bb40 0x559c6ff4bf60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.249+0000 7f192e210800 1 -- 172.21.15.120:0/4154365475 >> 172.21.15.120:0/4154365475 conn(0x559c6ff3fef0 msgr2=0x559c6ff402d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4154365475 shutdown_connections 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4154365475 wait complete. 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff39370 msgr2=0x559c6ff3b760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff39370 0x559c6ff3b760 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6fe3a210 msgr2=0x559c6ff37f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6fe3a210 0x559c6ff37f30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f181003c730 msgr2=0x7f181003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f181003c730 0x7f181003ebf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x559c6fe38540 tx=0x7f1914050000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 msgr2=0x559c6fdad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6fdad580 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x559c6ff292d0 tx=0x7f191c0040e0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 shutdown_connections 2024-09-07T03:32:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559c6ff39370 0x559c6ff3b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559c6fe3a210 0x559c6ff37f30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f181003c730 0x7f181003ebf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 --2- 172.21.15.120:0/4051638327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559c6fe38e00 0x559c6fdad580 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 >> 172.21.15.120:0/4051638327 conn(0x559c6fe341f0 msgr2=0x559c6ff29620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 shutdown_connections 2024-09-07T03:32:32.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.250+0000 7f192e210800 1 -- 172.21.15.120:0/4051638327 wait complete. 2024-09-07T03:32:32.259 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-07T03:32:32.260 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-07T03:32:32.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-07T03:32:32.260 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-07T03:32:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.306+0000 7f7f438bb800 1 Processor -- start 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.306+0000 7f7f438bb800 1 -- start start 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.306+0000 7f7f438bb800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557ac6757090 0x557ac675fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.306+0000 7f7f438bb800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557ac6600e40 con 0x557ac6755570 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.306+0000 7f7f438bb800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x557ac65cb680 con 0x557ac6757090 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.306+0000 7f7f40ba4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x557ac6757090 0x557ac675fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.306+0000 7f7f413a5640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x557ac6755570 0x557ac6755970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48194/0 (socket says 172.21.15.120:48194) 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.306+0000 7f7f413a5640 1 -- 172.21.15.120:0/3692804276 learned_addr learned my addr 172.21.15.120:0/3692804276 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.306+0000 7f7f40ba4640 1 -- 172.21.15.120:0/3692804276 >> v1:172.21.15.104:6789/0 conn(0x557ac6755570 legacy=0x557ac6755970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.307+0000 7f7f40ba4640 1 -- 172.21.15.120:0/3692804276 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ac65e76b0 con 0x557ac6757090 2024-09-07T03:32:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.307+0000 7f7f33fff640 1 -- 172.21.15.120:0/3692804276 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660433460 0 0) 0x557ac6600e40 con 0x557ac6755570 2024-09-07T03:32:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.308+0000 7f7f40ba4640 1 --2- 172.21.15.120:0/3692804276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6757090 0x557ac675fbb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800a470 tx=0x7f7f38045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b376bb41a249860 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.308+0000 7f7f33fff640 1 -- 172.21.15.120:0/3692804276 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f38053570 con 0x557ac6757090 2024-09-07T03:32:32.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.308+0000 7f7f33fff640 1 -- 172.21.15.120:0/3692804276 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f38058070 con 0x557ac6757090 2024-09-07T03:32:32.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.308+0000 7f7f33fff640 1 -- 172.21.15.120:0/3692804276 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f38053880 con 0x557ac6757090 2024-09-07T03:32:32.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.309+0000 7f7f438bb800 1 -- 172.21.15.120:0/3692804276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6757090 msgr2=0x557ac675fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.309+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3692804276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6757090 0x557ac675fbb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800a470 tx=0x7f7f38045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:32.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.309+0000 7f7f438bb800 1 -- 172.21.15.120:0/3692804276 shutdown_connections 2024-09-07T03:32:32.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.309+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3692804276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6757090 0x557ac675fbb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.309+0000 7f7f438bb800 1 -- 172.21.15.120:0/3692804276 >> 172.21.15.120:0/3692804276 conn(0x557ac67512c0 msgr2=0x557ac6753700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.309+0000 7f7f438bb800 1 -- 172.21.15.120:0/3692804276 shutdown_connections 2024-09-07T03:32:32.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.309+0000 7f7f438bb800 1 -- 172.21.15.120:0/3692804276 wait complete. 2024-09-07T03:32:32.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.323+0000 7f7f438bb800 1 Processor -- start 2024-09-07T03:32:32.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.323+0000 7f7f438bb800 1 -- start start 2024-09-07T03:32:32.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.323+0000 7f7f438bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6848770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.323+0000 7f7f438bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557ac65efdd0 con 0x557ac6755570 2024-09-07T03:32:32.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.323+0000 7f7f413a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6848770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.323+0000 7f7f413a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6848770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40814/0 (socket says 172.21.15.120:40814) 2024-09-07T03:32:32.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.323+0000 7f7f413a5640 1 -- 172.21.15.120:0/3367095585 learned_addr learned my addr 172.21.15.120:0/3367095585 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.323+0000 7f7f413a5640 1 -- 172.21.15.120:0/3367095585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ac6608e10 con 0x557ac6755570 2024-09-07T03:32:32.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7f413a5640 1 --2- 172.21.15.120:0/3367095585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6848770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001ea0 tx=0x7f7f3400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba2cb1ecb01ff26 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7e2f606640 1 -- 172.21.15.120:0/3367095585 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f34008070 con 0x557ac6755570 2024-09-07T03:32:32.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7e2f606640 1 -- 172.21.15.120:0/3367095585 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3400d500 con 0x557ac6755570 2024-09-07T03:32:32.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7e2f606640 1 -- 172.21.15.120:0/3367095585 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3400d880 con 0x557ac6755570 2024-09-07T03:32:32.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7f438bb800 1 -- 172.21.15.120:0/3367095585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 msgr2=0x557ac6848770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3367095585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6848770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001ea0 tx=0x7f7f3400b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7f438bb800 1 -- 172.21.15.120:0/3367095585 shutdown_connections 2024-09-07T03:32:32.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3367095585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6848770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7f438bb800 1 -- 172.21.15.120:0/3367095585 >> 172.21.15.120:0/3367095585 conn(0x557ac67512c0 msgr2=0x557ac68440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.324+0000 7f7f438bb800 1 -- 172.21.15.120:0/3367095585 shutdown_connections 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.325+0000 7f7f438bb800 1 -- 172.21.15.120:0/3367095585 wait complete. 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.325+0000 7f7f438bb800 1 Processor -- start 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.325+0000 7f7f438bb800 1 -- start start 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.325+0000 7f7f438bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6850090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.325+0000 7f7f438bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557ac67603c0 con 0x557ac6755570 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.325+0000 7f7f413a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6850090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.325+0000 7f7f413a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6850090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40826/0 (socket says 172.21.15.120:40826) 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.325+0000 7f7f413a5640 1 -- 172.21.15.120:0/3885540246 learned_addr learned my addr 172.21.15.120:0/3885540246 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.325+0000 7f7f413a5640 1 -- 172.21.15.120:0/3885540246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ac68505f0 con 0x557ac6755570 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.326+0000 7f7f413a5640 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6850090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7f340012f0 tx=0x7f7f34000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.326+0000 7f7e2de03640 1 -- 172.21.15.120:0/3885540246 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3400f9d0 con 0x557ac6755570 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.326+0000 7f7e2de03640 1 -- 172.21.15.120:0/3885540246 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3400fb70 con 0x557ac6755570 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.326+0000 7f7e2de03640 1 -- 172.21.15.120:0/3885540246 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3400fe50 con 0x557ac6755570 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.326+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ac6850880 con 0x557ac6755570 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.326+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ac6851280 con 0x557ac6755570 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.326+0000 7f7f438bb800 1 Processor -- start 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.326+0000 7f7f438bb800 1 -- start start 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.326+0000 7f7f438bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac685f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7f438bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557ac664da00 con 0x557ac685d5a0 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7e2de03640 1 -- 172.21.15.120:0/3885540246 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7f34017040 con 0x557ac6755570 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7f41ba6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac685f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7f41ba6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac685f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40828/0 (socket says 172.21.15.120:40828) 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7f41ba6640 1 -- 172.21.15.120:0/839480374 learned_addr learned my addr 172.21.15.120:0/839480374 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7e2de03640 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e2803c8d0 0x7f7e2803ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7e2de03640 1 -- 172.21.15.120:0/3885540246 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f7f34015020 con 0x557ac6755570 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7f413a5640 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e2803c8d0 0x7f7e2803ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7f41ba6640 1 -- 172.21.15.120:0/839480374 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ac685ff60 con 0x557ac685d5a0 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7f413a5640 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e2803c8d0 0x7f7e2803ed90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001460 tx=0x7f7f3400bfd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7f41ba6640 1 --2- 172.21.15.120:0/839480374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac685f990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00a3e0 tx=0x7f7f3c00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28717948c1ddd53d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7e277fe640 1 -- 172.21.15.120:0/839480374 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c015070 con 0x557ac685d5a0 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.327+0000 7f7e277fe640 1 -- 172.21.15.120:0/839480374 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c001670 con 0x557ac685d5a0 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7e277fe640 1 -- 172.21.15.120:0/839480374 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c001990 con 0x557ac685d5a0 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7f438bb800 1 -- 172.21.15.120:0/839480374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 msgr2=0x557ac685f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7f438bb800 1 --2- 172.21.15.120:0/839480374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac685f990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00a3e0 tx=0x7f7f3c00a8a0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7f438bb800 1 -- 172.21.15.120:0/839480374 shutdown_connections 2024-09-07T03:32:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7f438bb800 1 --2- 172.21.15.120:0/839480374 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac685f990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7f438bb800 1 -- 172.21.15.120:0/839480374 >> 172.21.15.120:0/839480374 conn(0x557ac6757090 msgr2=0x557ac6857ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7f438bb800 1 -- 172.21.15.120:0/839480374 shutdown_connections 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7f438bb800 1 -- 172.21.15.120:0/839480374 wait complete. 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7f438bb800 1 Processor -- start 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.328+0000 7f7f438bb800 1 -- start start 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7f438bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac6864540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7f438bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557ac68602b0 con 0x557ac685d5a0 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7f41ba6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac6864540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7f41ba6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac6864540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40840/0 (socket says 172.21.15.120:40840) 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7f41ba6640 1 -- 172.21.15.120:0/442083197 learned_addr learned my addr 172.21.15.120:0/442083197 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7f41ba6640 1 -- 172.21.15.120:0/442083197 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ac6864aa0 con 0x557ac685d5a0 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7f41ba6640 1 --2- 172.21.15.120:0/442083197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac6864540 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c013040 tx=0x7f7f3c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7e25ffb640 1 -- 172.21.15.120:0/442083197 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c020020 con 0x557ac685d5a0 2024-09-07T03:32:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7e25ffb640 1 -- 172.21.15.120:0/442083197 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c010780 con 0x557ac685d5a0 2024-09-07T03:32:32.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7f438bb800 1 -- 172.21.15.120:0/442083197 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ac6864d30 con 0x557ac685d5a0 2024-09-07T03:32:32.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7e25ffb640 1 -- 172.21.15.120:0/442083197 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c015040 con 0x557ac685d5a0 2024-09-07T03:32:32.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.329+0000 7f7f438bb800 1 -- 172.21.15.120:0/442083197 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ac68656b0 con 0x557ac685d5a0 2024-09-07T03:32:32.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.330+0000 7f7e25ffb640 1 -- 172.21.15.120:0/442083197 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7f3c023020 con 0x557ac685d5a0 2024-09-07T03:32:32.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.330+0000 7f7e25ffb640 1 --2- 172.21.15.120:0/442083197 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e1c03c780 0x7f7e1c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7e25ffb640 1 -- 172.21.15.120:0/442083197 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f7f3c0532d0 con 0x557ac685d5a0 2024-09-07T03:32:32.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f40ba4640 1 --2- 172.21.15.120:0/442083197 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e1c03c780 0x7f7e1c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f438bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:32.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f438bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:32.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f438bb800 1 Processor -- start 2024-09-07T03:32:32.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f40ba4640 1 --2- 172.21.15.120:0/442083197 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e1c03c780 0x7f7e1c03ec40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f38057000 tx=0x7f7f38052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f438bb800 1 -- start start 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f438bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac687e3d0 0x557ac687e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f438bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x557ac6848fc0 con 0x557ac687e3d0 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f413a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac687e3d0 0x557ac687e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f413a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac687e3d0 0x557ac687e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40848/0 (socket says 172.21.15.120:40848) 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.331+0000 7f7f413a5640 1 -- 172.21.15.120:0/806221959 learned_addr learned my addr 172.21.15.120:0/806221959 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.332+0000 7f7f413a5640 1 -- 172.21.15.120:0/806221959 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ac687ee30 con 0x557ac687e3d0 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.332+0000 7f7f413a5640 1 --2- 172.21.15.120:0/806221959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac687e3d0 0x557ac687e7f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400ed30 tx=0x7f7f3403e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.332+0000 7f7e05fe3640 1 -- 172.21.15.120:0/806221959 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3401a4f0 con 0x557ac687e3d0 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.332+0000 7f7e05fe3640 1 -- 172.21.15.120:0/806221959 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f340092b0 con 0x557ac687e3d0 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.332+0000 7f7f438bb800 1 -- 172.21.15.120:0/806221959 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ac687f660 con 0x557ac687e3d0 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.332+0000 7f7e05fe3640 1 -- 172.21.15.120:0/806221959 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f340232a0 con 0x557ac687e3d0 2024-09-07T03:32:32.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.332+0000 7f7f438bb800 1 -- 172.21.15.120:0/806221959 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ac687fc00 con 0x557ac687e3d0 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.333+0000 7f7e05fe3640 1 -- 172.21.15.120:0/806221959 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7f34009a20 con 0x557ac687e3d0 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.333+0000 7f7e05fe3640 1 --2- 172.21.15.120:0/806221959 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7d8403c780 0x7f7d8403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.333+0000 7f7e05fe3640 1 -- 172.21.15.120:0/806221959 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f7f3404ac60 con 0x557ac687e3d0 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.333+0000 7f7f40ba4640 1 --2- 172.21.15.120:0/806221959 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7d8403c780 0x7f7d8403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.333+0000 7f7d7f7fe640 20 reqs_thread_entry: start 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.333+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x557ac688bf00 0x557ac688e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.333+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557ac688ea90 con 0x557ac688bf00 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.333+0000 7f7f40ba4640 1 --2- 172.21.15.120:0/806221959 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7d8403c780 0x7f7d8403ec40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f38045a60 tx=0x7f7f38005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.334+0000 7f7f41ba6640 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x557ac688bf00 0x557ac688e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.334+0000 7f7f41ba6640 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x557ac688bf00 0x557ac688e3c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.334+0000 7f7f41ba6640 1 -- 172.21.15.120:0/3885540246 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f3c00e070 con 0x557ac688bf00 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.334+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557ac6890350 con 0x557ac688bf00 2024-09-07T03:32:32.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.335+0000 7f7f41ba6640 1 -- 172.21.15.120:0/3885540246 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(2 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7f3c00e070 con 0x557ac688bf00 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.335+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557ac6894e80 con 0x557ac688bf00 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.336+0000 7f7f41ba6640 1 -- 172.21.15.120:0/3885540246 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f7f3c00e070 con 0x557ac688bf00 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/442083197 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e1c03c780 msgr2=0x7f7e1c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 --2- 172.21.15.120:0/442083197 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e1c03c780 0x7f7e1c03ec40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f38057000 tx=0x7f7f38052000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/442083197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 msgr2=0x557ac6864540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 --2- 172.21.15.120:0/442083197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac6864540 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c013040 tx=0x7f7f3c003370 comp rx=0 tx=0).stop 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/442083197 shutdown_connections 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 --2- 172.21.15.120:0/442083197 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e1c03c780 0x7f7e1c03ec40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 --2- 172.21.15.120:0/442083197 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac685d5a0 0x557ac6864540 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/442083197 >> 172.21.15.120:0/442083197 conn(0x557ac6757090 msgr2=0x557ac6857e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/442083197 shutdown_connections 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/442083197 wait complete. 2024-09-07T03:32:32.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/806221959 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7d8403c780 msgr2=0x7f7d8403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 --2- 172.21.15.120:0/806221959 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7d8403c780 0x7f7d8403ec40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f38045a60 tx=0x7f7f38005a00 comp rx=0 tx=0).stop 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/806221959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac687e3d0 msgr2=0x557ac687e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 --2- 172.21.15.120:0/806221959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac687e3d0 0x557ac687e7f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400ed30 tx=0x7f7f3403e7c0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/806221959 shutdown_connections 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 --2- 172.21.15.120:0/806221959 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7d8403c780 0x7f7d8403ec40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 --2- 172.21.15.120:0/806221959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac687e3d0 0x557ac687e7f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.337+0000 7f7f438bb800 1 -- 172.21.15.120:0/806221959 >> 172.21.15.120:0/806221959 conn(0x557ac6873930 msgr2=0x557ac6873d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 -- 172.21.15.120:0/806221959 shutdown_connections 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 -- 172.21.15.120:0/806221959 wait complete. 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x557ac688bf00 msgr2=0x557ac688e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x557ac688bf00 0x557ac688e3c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e2803c8d0 msgr2=0x7f7e2803ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e2803c8d0 0x7f7e2803ed90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001460 tx=0x7f7f3400bfd0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 msgr2=0x557ac6850090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6850090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7f340012f0 tx=0x7f7f34000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 shutdown_connections 2024-09-07T03:32:32.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x557ac688bf00 0x557ac688e3c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f7e2803c8d0 0x7f7e2803ed90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 --2- 172.21.15.120:0/3885540246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557ac6755570 0x557ac6850090 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 >> 172.21.15.120:0/3885540246 conn(0x557ac67512c0 msgr2=0x557ac6849a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 shutdown_connections 2024-09-07T03:32:32.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.338+0000 7f7f438bb800 1 -- 172.21.15.120:0/3885540246 wait complete. 2024-09-07T03:32:32.348 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"cf0fab6f-a978-4ce5-bacd-166891c31743","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-07T03:32:32.348 DEBUG:tasks.util.rgw: json result: {'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-07T03:32:32.350 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-07T03:32:32.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-07T03:32:32.351 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-07T03:32:32.393 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:32.394 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:32.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.393+0000 7f1c94f2e800 1 Processor -- start 2024-09-07T03:32:32.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.393+0000 7f1c94f2e800 1 -- start start 2024-09-07T03:32:32.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.393+0000 7f1c94f2e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5601035f8470 0x5601035f8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.393+0000 7f1c94f2e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601034a3e40 con 0x5601035f8db0 2024-09-07T03:32:32.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.393+0000 7f1c94f2e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56010346e680 con 0x5601035f8470 2024-09-07T03:32:32.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.394+0000 7f1c90cdd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5601035f8470 0x5601035f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.394+0000 7f1c90cdd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5601035f8470 0x5601035f8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40860/0 (socket says 172.21.15.120:40860) 2024-09-07T03:32:32.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.394+0000 7f1c884dc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5601035f8db0 0x5601035f9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48204/0 (socket says 172.21.15.120:48204) 2024-09-07T03:32:32.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.394+0000 7f1c90cdd640 1 -- 172.21.15.120:0/163707430 learned_addr learned my addr 172.21.15.120:0/163707430 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.394+0000 7f1c90cdd640 1 -- 172.21.15.120:0/163707430 >> v1:172.21.15.104:6789/0 conn(0x5601035f8db0 legacy=0x5601035f9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.394+0000 7f1c90cdd640 1 -- 172.21.15.120:0/163707430 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010348a6b0 con 0x5601035f8470 2024-09-07T03:32:32.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.394+0000 7f1c8bfff640 1 -- 172.21.15.120:0/163707430 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172192014 0 0) 0x5601034a3e40 con 0x5601035f8db0 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/163707430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601035f8870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000a520 tx=0x7f1c80045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ec6ea15af8408 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c8bfff640 1 -- 172.21.15.120:0/163707430 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c80055070 con 0x5601035f8470 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c8bfff640 1 -- 172.21.15.120:0/163707430 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c800515b0 con 0x5601035f8470 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c8bfff640 1 -- 172.21.15.120:0/163707430 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c800518d0 con 0x5601035f8470 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c94f2e800 1 -- 172.21.15.120:0/163707430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 msgr2=0x5601035f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/163707430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601035f8870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000a520 tx=0x7f1c80045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c94f2e800 1 -- 172.21.15.120:0/163707430 shutdown_connections 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/163707430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601035f8870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c94f2e800 1 -- 172.21.15.120:0/163707430 >> 172.21.15.120:0/163707430 conn(0x5601035f41a0 msgr2=0x5601035f6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c94f2e800 1 -- 172.21.15.120:0/163707430 shutdown_connections 2024-09-07T03:32:32.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.396+0000 7f1c94f2e800 1 -- 172.21.15.120:0/163707430 wait complete. 2024-09-07T03:32:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.410+0000 7f1c94f2e800 1 Processor -- start 2024-09-07T03:32:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.410+0000 7f1c94f2e800 1 -- start start 2024-09-07T03:32:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.410+0000 7f1c94f2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036eb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.410+0000 7f1c94f2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560103492dd0 con 0x5601035f8470 2024-09-07T03:32:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.410+0000 7f1c90cdd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036eb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.410+0000 7f1c90cdd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036eb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40870/0 (socket says 172.21.15.120:40870) 2024-09-07T03:32:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.410+0000 7f1c90cdd640 1 -- 172.21.15.120:0/3367257934 learned_addr learned my addr 172.21.15.120:0/3367257934 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.411+0000 7f1c90cdd640 1 -- 172.21.15.120:0/3367257934 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601034abe10 con 0x5601035f8470 2024-09-07T03:32:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.411+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/3367257934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036eb6a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c80025da0 tx=0x7f1c80051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46f0d37dbdfee66 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.411+0000 7f1b7ee0d640 1 -- 172.21.15.120:0/3367257934 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c80051950 con 0x5601035f8470 2024-09-07T03:32:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.411+0000 7f1b7ee0d640 1 -- 172.21.15.120:0/3367257934 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c80051af0 con 0x5601035f8470 2024-09-07T03:32:32.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.411+0000 7f1b7ee0d640 1 -- 172.21.15.120:0/3367257934 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c80051dd0 con 0x5601035f8470 2024-09-07T03:32:32.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3367257934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 msgr2=0x5601036eb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3367257934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036eb6a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c80025da0 tx=0x7f1c80051000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3367257934 shutdown_connections 2024-09-07T03:32:32.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3367257934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036eb6a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3367257934 >> 172.21.15.120:0/3367257934 conn(0x5601035f41a0 msgr2=0x5601036e7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3367257934 shutdown_connections 2024-09-07T03:32:32.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3367257934 wait complete. 2024-09-07T03:32:32.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 Processor -- start 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 -- start start 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c94f2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5601035f9d30 con 0x5601035f8470 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c90cdd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c90cdd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40886/0 (socket says 172.21.15.120:40886) 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.412+0000 7f1c90cdd640 1 -- 172.21.15.120:0/3913130508 learned_addr learned my addr 172.21.15.120:0/3913130508 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.413+0000 7f1c90cdd640 1 -- 172.21.15.120:0/3913130508 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601036f3380 con 0x5601035f8470 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.413+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036f2e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c80025da0 tx=0x7f1c80002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.413+0000 7f1b7d60a640 1 -- 172.21.15.120:0/3913130508 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8005a600 con 0x5601035f8470 2024-09-07T03:32:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.413+0000 7f1b7d60a640 1 -- 172.21.15.120:0/3913130508 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c80073070 con 0x5601035f8470 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.413+0000 7f1b7d60a640 1 -- 172.21.15.120:0/3913130508 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8005a910 con 0x5601035f8470 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.413+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601036f3610 con 0x5601035f8470 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.413+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601036f4220 con 0x5601035f8470 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.414+0000 7f1b7d60a640 1 -- 172.21.15.120:0/3913130508 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1c80058070 con 0x5601035f8470 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.414+0000 7f1b7d60a640 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7803c730 0x7f1b7803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.414+0000 7f1b7d60a640 1 -- 172.21.15.120:0/3913130508 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1c8006b040 con 0x5601035f8470 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.414+0000 7f1c884dc640 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7803c730 0x7f1b7803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.414+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5601035f8db0 0x5601036fa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.414+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5601036fa9b0 con 0x5601035f8db0 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.414+0000 7f1c914de640 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5601035f8db0 0x5601036fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.415+0000 7f1c884dc640 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7803c730 0x7f1b7803ebf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c78000c00 tx=0x7f1c780013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.415+0000 7f1c914de640 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5601035f8db0 0x5601036fa470 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.415+0000 7f1c914de640 1 -- 172.21.15.120:0/3913130508 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c8c00a4d0 con 0x5601035f8db0 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.415+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5601036fb2b0 0x5601036fd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.415+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5601036fdeb0 con 0x5601036fb2b0 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.415+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5601036fb2b0 0x5601036fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.416+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5601036fb2b0 0x5601036fd740 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.416+0000 7f1c90cdd640 1 -- 172.21.15.120:0/3913130508 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c80057030 con 0x5601036fb2b0 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.416+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5601036ff760 con 0x5601036fb2b0 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.416+0000 7f1c90cdd640 1 -- 172.21.15.120:0/3913130508 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c80057030 con 0x5601036fb2b0 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.416+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5601036fe8d0 con 0x5601036fb2b0 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.416+0000 7f1c90cdd640 1 -- 172.21.15.120:0/3913130508 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c80057030 con 0x5601036fb2b0 2024-09-07T03:32:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.416+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5601036fecf0 con 0x5601035f8db0 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.417+0000 7f1c914de640 1 -- 172.21.15.120:0/3913130508 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c8c00a4d0 con 0x5601035f8db0 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.417+0000 7f1c94f2e800 1 Processor -- start 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.417+0000 7f1c94f2e800 1 -- start start 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.417+0000 7f1c94f2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010370dc40 0x56010370e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.417+0000 7f1c94f2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5601034f0a00 con 0x56010370dc40 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.417+0000 7f1c914de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010370dc40 0x56010370e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.417+0000 7f1c914de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010370dc40 0x56010370e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40902/0 (socket says 172.21.15.120:40902) 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.417+0000 7f1c914de640 1 -- 172.21.15.120:0/4245350768 learned_addr learned my addr 172.21.15.120:0/4245350768 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.418+0000 7f1c914de640 1 -- 172.21.15.120:0/4245350768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010370e6a0 con 0x56010370dc40 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.418+0000 7f1c914de640 1 --2- 172.21.15.120:0/4245350768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010370dc40 0x56010370e060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c016d20 tx=0x7f1c8c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.418+0000 7f1b767fc640 1 -- 172.21.15.120:0/4245350768 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8c017660 con 0x56010370dc40 2024-09-07T03:32:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.418+0000 7f1b767fc640 1 -- 172.21.15.120:0/4245350768 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8c01b030 con 0x56010370dc40 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.418+0000 7f1b767fc640 1 -- 172.21.15.120:0/4245350768 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8c017950 con 0x56010370dc40 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.418+0000 7f1c94f2e800 1 -- 172.21.15.120:0/4245350768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56010370eed0 con 0x56010370dc40 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.418+0000 7f1c94f2e800 1 -- 172.21.15.120:0/4245350768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56010370f470 con 0x56010370dc40 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.419+0000 7f1b767fc640 1 -- 172.21.15.120:0/4245350768 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1c8c017af0 con 0x56010370dc40 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.419+0000 7f1b767fc640 1 --2- 172.21.15.120:0/4245350768 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b6803c780 0x7f1b6803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.419+0000 7f1b767fc640 1 -- 172.21.15.120:0/4245350768 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1c8c00e040 con 0x56010370dc40 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.419+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/4245350768 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b6803c780 0x7f1b6803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.419+0000 7f1c94f2e800 1 Processor -- start 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.419+0000 7f1c94f2e800 1 -- start start 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.419+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/4245350768 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b6803c780 0x7f1b6803ec40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5601036fe3f0 tx=0x7f1c80084040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1c94f2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x56010371aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1c94f2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5601036ebe30 con 0x56010371a6e0 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1c914de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x56010371aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1c914de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x56010371aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40918/0 (socket says 172.21.15.120:40918) 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1c914de640 1 -- 172.21.15.120:0/3476251599 learned_addr learned my addr 172.21.15.120:0/3476251599 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1c914de640 1 -- 172.21.15.120:0/3476251599 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010371b0d0 con 0x56010371a6e0 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1c914de640 1 --2- 172.21.15.120:0/3476251599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x56010371aae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c054030 tx=0x7f1c8c054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7116a82f48a1bc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1b67fff640 1 -- 172.21.15.120:0/3476251599 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8c014d40 con 0x56010371a6e0 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1b67fff640 1 -- 172.21.15.120:0/3476251599 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8c0149b0 con 0x56010371a6e0 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.420+0000 7f1b67fff640 1 -- 172.21.15.120:0/3476251599 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8c028350 con 0x56010371a6e0 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3476251599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 msgr2=0x56010371aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3476251599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x56010371aae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c054030 tx=0x7f1c8c054060 comp rx=0 tx=0).stop 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3476251599 shutdown_connections 2024-09-07T03:32:32.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3476251599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x56010371aae0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3476251599 >> 172.21.15.120:0/3476251599 conn(0x560103716ae0 msgr2=0x560103714d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3476251599 shutdown_connections 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3476251599 wait complete. 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 Processor -- start 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 -- start start 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x560103721ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c94f2e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56010371b6c0 con 0x56010371a6e0 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c914de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x560103721ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c914de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x560103721ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40920/0 (socket says 172.21.15.120:40920) 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.421+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 learned_addr learned my addr 172.21.15.120:0/2537758531 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.422+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560103722200 con 0x56010371a6e0 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.422+0000 7f1c914de640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x560103721ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c053d10 tx=0x7f1c8c053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.422+0000 7f1b667fc640 1 -- 172.21.15.120:0/2537758531 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8c012570 con 0x56010371a6e0 2024-09-07T03:32:32.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.422+0000 7f1b667fc640 1 -- 172.21.15.120:0/2537758531 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8c005500 con 0x56010371a6e0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.422+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560103722490 con 0x56010371a6e0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.422+0000 7f1b667fc640 1 -- 172.21.15.120:0/2537758531 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8c055570 con 0x56010371a6e0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.422+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560103723020 con 0x56010371a6e0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.423+0000 7f1b667fc640 1 -- 172.21.15.120:0/2537758531 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1c8c0127a0 con 0x56010371a6e0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.423+0000 7f1b667fc640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b5c03c6e0 0x7f1b5c03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.423+0000 7f1b667fc640 1 -- 172.21.15.120:0/2537758531 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1c8c048920 con 0x56010371a6e0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.423+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b5c03c6e0 0x7f1b5c03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.423+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.423+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56010372d800 0x56010372fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.423+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103730410 con 0x56010372d800 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.423+0000 7f1c884dc640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56010372d800 0x56010372fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.423+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b5c03c6e0 0x7f1b5c03eba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c80097990 tx=0x7f1c80086000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c884dc640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56010372d800 0x56010372fcc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 20 realm 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56010372cb50 con 0x56010372d800 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103730ef0 con 0x56010372d800 2024-09-07T03:32:32.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560103731cd0 0x5601037340c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.424+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103734750 con 0x560103731cd0 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c914de640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560103731cd0 0x5601037340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c914de640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560103731cd0 0x5601037340c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c94f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103734ff0 con 0x560103731cd0 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c94f2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c94f2e800 20 searching for the correct realm 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560103736d60 0x560103739170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.425+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560103739840 con 0x560103736d60 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.426+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560103736d60 0x560103739170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.426+0000 7f1c90cdd640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560103736d60 0x560103739170 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.426+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.426+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560103739840 con 0x560103731cd0 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.426+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.426+0000 7f1c914de640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1c8c014440 0x7f1c8c03bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.426+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560103739840 con 0x7f1c8c014440 2024-09-07T03:32:32.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.427+0000 7f1c884dc640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1c8c014440 0x7f1c8c03bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.427+0000 7f1c884dc640 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1c8c014440 0x7f1c8c03bab0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.427+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x7f1c8c014440 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.427+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560103739840 con 0x56010372d800 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.427+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.427+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560103739840 con 0x56010372d800 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.428+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.428+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560103739840 con 0x560103736d60 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.428+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.428+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x56010372d800 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.428+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.428+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103731cd0 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.428+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.428+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103731cd0 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x56010372d800 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x7f1c8c014440 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x7f1c8c014440 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x56010372d800 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x7f1c8c014440 2024-09-07T03:32:32.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c7800f5f0 con 0x7f1c8c014440 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.429+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103731cd0 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.430+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.430+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103736d60 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.430+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.430+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x56010372d800 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.430+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.430+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103731cd0 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.430+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.430+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103736d60 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.431+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.431+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x56010372d800 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.431+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.431+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x56010372d800 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.431+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.431+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x56010372d800 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.431+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.431+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103736d60 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.432+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.432+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x7f1c8c014440 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.432+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x7f1c8c014440 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.432+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x56010372d800 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.432+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x56010372d800 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.432+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x7f1c8c014440 2024-09-07T03:32:32.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.432+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x7f1c8c014440 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.432+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103736d60 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.433+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.433+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x7f1c8c014440 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.433+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c7800f5f0 con 0x7f1c8c014440 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.433+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103731cd0 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.433+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.433+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103731cd0 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.433+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.433+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103736d60 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103731cd0 2024-09-07T03:32:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1c800af040 con 0x560103731cd0 2024-09-07T03:32:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103735970 con 0x56010372d800 2024-09-07T03:32:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.434+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103735dc0 con 0x560103731cd0 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103736220 con 0x56010372d800 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 20 zone default found 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 4 Realm: () 2024-09-07T03:32:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 20 zonegroup default 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5601037354f0 con 0x7f1c8c014440 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x7f1c8c014440 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.435+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56010373bf40 con 0x560103736d60 2024-09-07T03:32:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.436+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.436+0000 7f1c94f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.436+0000 7f1c94f2e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.436+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56010373c410 con 0x560103736d60 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.436+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.436+0000 7f1c94f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.436+0000 7f1c94f2e800 20 started sync module instance, tier type = 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.436+0000 7f1c94f2e800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.436+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373ad40 con 0x560103731cd0 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.437+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.437+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94562352869680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373a9a0 con 0x560103731cd0 2024-09-07T03:32:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.437+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373d380 con 0x56010372d800 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.438+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94562352869680] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.438+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.438+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94562352875632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373d770 con 0x56010372d800 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.438+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373e1b0 con 0x560103731cd0 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.440+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94562352875632] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.443+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.443+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94562352880768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373e170 con 0x560103731cd0 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.443+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373ec40 con 0x7f1c8c014440 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.444+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94562352880768] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.444+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x7f1c8c014440 2024-09-07T03:32:32.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.444+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94562352883472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373ec00 con 0x7f1c8c014440 2024-09-07T03:32:32.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.444+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373f6f0 con 0x560103731cd0 2024-09-07T03:32:32.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.445+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94562352883472] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x7f1c8c014440 2024-09-07T03:32:32.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.445+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.445+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94562352877200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56010373f6f0 con 0x560103731cd0 2024-09-07T03:32:32.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.445+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103740100 con 0x560103736d60 2024-09-07T03:32:32.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.446+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.446+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94562352888912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601037409a0 con 0x560103736d60 2024-09-07T03:32:32.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.446+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103741440 con 0x560103736d60 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.446+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94562352877200] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.447+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94562352888912] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.449+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.449+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94562352893712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601037404f0 con 0x560103736d60 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.449+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103741ce0 con 0x7f1c8c014440 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.450+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94562352893712] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.453+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x7f1c8c014440 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.453+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94562352886224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601037404f0 con 0x7f1c8c014440 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.453+0000 7f1c94f2e800 20 add_watcher() i=0 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.453+0000 7f1c94f2e800 20 add_watcher() i=1 2024-09-07T03:32:32.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.453+0000 7f1c94f2e800 20 add_watcher() i=2 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.453+0000 7f1c94f2e800 20 add_watcher() i=3 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.453+0000 7f1c94f2e800 20 add_watcher() i=4 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.453+0000 7f1c94f2e800 20 add_watcher() i=5 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.453+0000 7f1c94f2e800 20 add_watcher() i=6 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.456+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94562352886224] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x7f1c8c014440 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.456+0000 7f1c94f2e800 20 add_watcher() i=7 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.456+0000 7f1c94f2e800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.456+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103744e00 con 0x56010372d800 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.456+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.456+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94562352896048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103742320 con 0x56010372d800 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.457+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94562352896048] v34'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.457+0000 7f1b46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.457+0000 7f1c94f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:32.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.457+0000 7f1c94f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:32.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.457+0000 7f1c94f2e800 5 note: GC not initialized 2024-09-07T03:32:32.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.458+0000 7f1b45fe3640 20 reqs_thread_entry: start 2024-09-07T03:32:32.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.458+0000 7f1c94f2e800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:32.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.458+0000 7f1c94f2e800 20 Filter name: none 2024-09-07T03:32:32.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.458+0000 7f1ab77fe640 20 reqs_thread_entry: start 2024-09-07T03:32:32.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.458+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5601037784a0 con 0x560103731cd0 2024-09-07T03:32:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.459+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.459+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5601037784a0 con 0x560103731cd0 2024-09-07T03:32:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.459+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.459+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.459+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.459+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.459+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.459+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.460+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.461+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.461+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.461+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.461+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.461+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.461+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x7f1c8c014440 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.461+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x7f1c8c014440 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.461+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.461+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.462+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x7f1c8c014440 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.462+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x7f1c8c014440 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.462+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.462+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.462+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.462+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.462+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.462+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.462+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.463+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.463+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.463+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.463+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.463+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.463+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.464+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.464+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.464+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.464+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.464+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.464+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.464+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.464+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.464+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.465+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.465+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.465+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.465+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.465+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.465+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.465+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.465+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.465+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.466+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.466+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.466+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.467+0000 7f1b46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.467+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94562352896048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.468+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94562352896048] v34'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.468+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94562352869680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.469+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94562352869680] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.469+0000 7f1c94f2e800 20 remove_watcher() i=0 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.469+0000 7f1c94f2e800 2 removed watcher, disabling cache 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.469+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94562352875632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x56010372d800 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.470+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94562352875632] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x56010372d800 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.470+0000 7f1c94f2e800 20 remove_watcher() i=1 2024-09-07T03:32:32.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.470+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94562352880768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.471+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94562352880768] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.471+0000 7f1c94f2e800 20 remove_watcher() i=2 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.471+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94562352883472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x7f1c8c014440 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.472+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94562352883472] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x7f1c8c014440 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.472+0000 7f1c94f2e800 20 remove_watcher() i=3 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.472+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94562352877200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103731cd0 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.473+0000 7f1c914de640 1 -- 172.21.15.120:0/2537758531 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94562352877200] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c8c027070 con 0x560103731cd0 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.473+0000 7f1c94f2e800 20 remove_watcher() i=4 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.473+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94562352888912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.474+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94562352888912] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.474+0000 7f1c94f2e800 20 remove_watcher() i=5 2024-09-07T03:32:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.474+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94562352893712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x560103736d60 2024-09-07T03:32:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.475+0000 7f1c90cdd640 1 -- 172.21.15.120:0/2537758531 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94562352893712] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c800a0070 con 0x560103736d60 2024-09-07T03:32:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.475+0000 7f1c94f2e800 20 remove_watcher() i=6 2024-09-07T03:32:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.475+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94562352886224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560103778460 con 0x7f1c8c014440 2024-09-07T03:32:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.477+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94562352886224] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c7803c040 con 0x7f1c8c014440 2024-09-07T03:32:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.477+0000 7f1c94f2e800 20 remove_watcher() i=7 2024-09-07T03:32:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.477+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560103731cd0 msgr2=0x5601037340c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560103731cd0 0x5601037340c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56010372d800 msgr2=0x56010372fcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56010372d800 0x56010372fcc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1c8c014440 msgr2=0x7f1c8c03bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1c8c014440 0x7f1c8c03bab0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560103736d60 msgr2=0x560103739170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560103736d60 0x560103739170 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b5c03c6e0 msgr2=0x7f1b5c03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b5c03c6e0 0x7f1b5c03eba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c80097990 tx=0x7f1c80086000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 msgr2=0x560103721ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x560103721ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c053d10 tx=0x7f1c8c053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c884dc640 1 -- 172.21.15.120:0/2537758531 reap_dead start 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 shutdown_connections 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/2537758531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010371a6e0 0x560103721ca0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 >> 172.21.15.120:0/2537758531 conn(0x560103716ae0 msgr2=0x560103714cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 shutdown_connections 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/2537758531 wait complete. 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/4245350768 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b6803c780 msgr2=0x7f1b6803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/4245350768 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b6803c780 0x7f1b6803ec40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5601036fe3f0 tx=0x7f1c80084040 comp rx=0 tx=0).stop 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/4245350768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010370dc40 msgr2=0x56010370e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/4245350768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010370dc40 0x56010370e060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c016d20 tx=0x7f1c8c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/4245350768 shutdown_connections 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/4245350768 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b6803c780 0x7f1b6803ec40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/4245350768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56010370dc40 0x56010370e060 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/4245350768 >> 172.21.15.120:0/4245350768 conn(0x560103701ff0 msgr2=0x5601037023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/4245350768 shutdown_connections 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.478+0000 7f1c94f2e800 1 -- 172.21.15.120:0/4245350768 wait complete. 2024-09-07T03:32:32.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5601036fb2b0 msgr2=0x5601036fd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5601036fb2b0 0x5601036fd740 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5601035f8db0 msgr2=0x5601036fa470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5601035f8db0 0x5601036fa470 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7803c730 msgr2=0x7f1b7803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7803c730 0x7f1b7803ebf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c78000c00 tx=0x7f1c780013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 msgr2=0x5601036f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036f2e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c80025da0 tx=0x7f1c80002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 shutdown_connections 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5601036fb2b0 0x5601036fd740 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5601035f8db0 0x5601036fa470 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7803c730 0x7f1b7803ebf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 --2- 172.21.15.120:0/3913130508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5601035f8470 0x5601036f2e20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 >> 172.21.15.120:0/3913130508 conn(0x5601035f41a0 msgr2=0x5601036e5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 shutdown_connections 2024-09-07T03:32:32.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.479+0000 7f1c94f2e800 1 -- 172.21.15.120:0/3913130508 wait complete. 2024-09-07T03:32:32.492 INFO:teuthology.orchestra.run.smithi120.stdout:{"entries":[],"summary":[]} 2024-09-07T03:32:32.493 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-07T03:32:32.493 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-07T03:32:32.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-07T03:32:32.493 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-07T03:32:32.577 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:32.578 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.577+0000 7f32ca411800 1 Processor -- start 2024-09-07T03:32:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.577+0000 7f32ca411800 1 -- start start 2024-09-07T03:32:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.577+0000 7f32ca411800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555e259e8fc0 0x555e259f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.577+0000 7f32ca411800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e25892e40 con 0x555e259e74a0 2024-09-07T03:32:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.577+0000 7f32ca411800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x555e2585d680 con 0x555e259e8fc0 2024-09-07T03:32:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.577+0000 7f32bd321640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555e259e8fc0 0x555e259f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.577+0000 7f32c5b22640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x555e259e74a0 0x555e259e78a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48214/0 (socket says 172.21.15.120:48214) 2024-09-07T03:32:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.577+0000 7f32c5b22640 1 -- 172.21.15.120:0/377196662 learned_addr learned my addr 172.21.15.120:0/377196662 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.578+0000 7f32bd321640 1 -- 172.21.15.120:0/377196662 >> v1:172.21.15.104:6789/0 conn(0x555e259e74a0 legacy=0x555e259e78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.578+0000 7f32c5321640 1 -- 172.21.15.120:0/377196662 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2161002177 0 0) 0x555e25892e40 con 0x555e259e74a0 2024-09-07T03:32:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.578+0000 7f32bd321640 1 -- 172.21.15.120:0/377196662 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e258796b0 con 0x555e259e8fc0 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.579+0000 7f32bd321640 1 --2- 172.21.15.120:0/377196662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e8fc0 0x555e259f1ae0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f32b000a470 tx=0x7f32b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25caeea5c4f015f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.579+0000 7f32c5321640 1 -- 172.21.15.120:0/377196662 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b0053570 con 0x555e259e8fc0 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.580+0000 7f32c5321640 1 -- 172.21.15.120:0/377196662 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b0058070 con 0x555e259e8fc0 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.580+0000 7f32c5321640 1 -- 172.21.15.120:0/377196662 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b0053880 con 0x555e259e8fc0 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.580+0000 7f32ca411800 1 -- 172.21.15.120:0/377196662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e8fc0 msgr2=0x555e259f1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.580+0000 7f32ca411800 1 --2- 172.21.15.120:0/377196662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e8fc0 0x555e259f1ae0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f32b000a470 tx=0x7f32b0045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.580+0000 7f32ca411800 1 -- 172.21.15.120:0/377196662 shutdown_connections 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.580+0000 7f32ca411800 1 --2- 172.21.15.120:0/377196662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e8fc0 0x555e259f1ae0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.580+0000 7f32ca411800 1 -- 172.21.15.120:0/377196662 >> 172.21.15.120:0/377196662 conn(0x555e259e31f0 msgr2=0x555e259e5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.580+0000 7f32ca411800 1 -- 172.21.15.120:0/377196662 shutdown_connections 2024-09-07T03:32:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.580+0000 7f32ca411800 1 -- 172.21.15.120:0/377196662 wait complete. 2024-09-07T03:32:32.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.594+0000 7f32ca411800 1 Processor -- start 2024-09-07T03:32:32.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.594+0000 7f32ca411800 1 -- start start 2024-09-07T03:32:32.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.594+0000 7f32ca411800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ada660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.594+0000 7f32ca411800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e25881dd0 con 0x555e259e74a0 2024-09-07T03:32:32.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.594+0000 7f32c5b22640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ada660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.594+0000 7f32c5b22640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ada660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40950/0 (socket says 172.21.15.120:40950) 2024-09-07T03:32:32.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.594+0000 7f32c5b22640 1 -- 172.21.15.120:0/1739870644 learned_addr learned my addr 172.21.15.120:0/1739870644 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.594+0000 7f32c5b22640 1 -- 172.21.15.120:0/1739870644 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e2589ae10 con 0x555e259e74a0 2024-09-07T03:32:32.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f32c5b22640 1 --2- 172.21.15.120:0/1739870644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ada660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f32b8001ea0 tx=0x7f32b800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1fbd5933155f2d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f31b3e07640 1 -- 172.21.15.120:0/1739870644 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b8008070 con 0x555e259e74a0 2024-09-07T03:32:32.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f31b3e07640 1 -- 172.21.15.120:0/1739870644 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b800d500 con 0x555e259e74a0 2024-09-07T03:32:32.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f31b3e07640 1 -- 172.21.15.120:0/1739870644 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b800d880 con 0x555e259e74a0 2024-09-07T03:32:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f32ca411800 1 -- 172.21.15.120:0/1739870644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 msgr2=0x555e25ada660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f32ca411800 1 --2- 172.21.15.120:0/1739870644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ada660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f32b8001ea0 tx=0x7f32b800b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f32ca411800 1 -- 172.21.15.120:0/1739870644 shutdown_connections 2024-09-07T03:32:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f32ca411800 1 --2- 172.21.15.120:0/1739870644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ada660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f32ca411800 1 -- 172.21.15.120:0/1739870644 >> 172.21.15.120:0/1739870644 conn(0x555e259e31f0 msgr2=0x555e25ad5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f32ca411800 1 -- 172.21.15.120:0/1739870644 shutdown_connections 2024-09-07T03:32:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.595+0000 7f32ca411800 1 -- 172.21.15.120:0/1739870644 wait complete. 2024-09-07T03:32:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.596+0000 7f32ca411800 1 Processor -- start 2024-09-07T03:32:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.596+0000 7f32ca411800 1 -- start start 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.596+0000 7f32ca411800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ae1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.596+0000 7f32ca411800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e259f22f0 con 0x555e259e74a0 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.596+0000 7f32c5b22640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ae1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.596+0000 7f32c5b22640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ae1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40956/0 (socket says 172.21.15.120:40956) 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.596+0000 7f32c5b22640 1 -- 172.21.15.120:0/3778010750 learned_addr learned my addr 172.21.15.120:0/3778010750 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.597+0000 7f32c5b22640 1 -- 172.21.15.120:0/3778010750 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e25ae24e0 con 0x555e259e74a0 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.597+0000 7f32c5b22640 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ae1f80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32b80012f0 tx=0x7f32b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.597+0000 7f31b2604640 1 -- 172.21.15.120:0/3778010750 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b800f9d0 con 0x555e259e74a0 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.597+0000 7f31b2604640 1 -- 172.21.15.120:0/3778010750 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b800fb70 con 0x555e259e74a0 2024-09-07T03:32:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.597+0000 7f31b2604640 1 -- 172.21.15.120:0/3778010750 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b800fe50 con 0x555e259e74a0 2024-09-07T03:32:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.597+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e25ae2770 con 0x555e259e74a0 2024-09-07T03:32:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.597+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e25ae3170 con 0x555e259e74a0 2024-09-07T03:32:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.598+0000 7f31b2604640 1 -- 172.21.15.120:0/3778010750 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f32b8017040 con 0x555e259e74a0 2024-09-07T03:32:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.598+0000 7f31b2604640 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31ac03c920 0x7f31ac03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.598+0000 7f31b2604640 1 -- 172.21.15.120:0/3778010750 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f32b8015020 con 0x555e259e74a0 2024-09-07T03:32:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.598+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e259e8fc0 0x555e25ae95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.598+0000 7f32bd321640 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31ac03c920 0x7f31ac03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.598+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25ae9b10 con 0x555e259e8fc0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.598+0000 7f32c6323640 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e259e8fc0 0x555e25ae95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.598+0000 7f32bd321640 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31ac03c920 0x7f31ac03ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f32b0057000 tx=0x7f32b0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.598+0000 7f32c6323640 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e259e8fc0 0x555e25ae95d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.599+0000 7f32c6323640 1 -- 172.21.15.120:0/3778010750 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32c000a4d0 con 0x555e259e8fc0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.599+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25aea3c0 0x555e25aec880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.599+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25aecff0 con 0x555e25aea3c0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.599+0000 7f32c5b22640 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25aea3c0 0x555e25aec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.599+0000 7f32c5b22640 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25aea3c0 0x555e25aec880 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.600+0000 7f32c5b22640 1 -- 172.21.15.120:0/3778010750 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32b802d070 con 0x555e25aea3c0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.600+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25aee8a0 con 0x555e25aea3c0 2024-09-07T03:32:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.600+0000 7f32c5b22640 1 -- 172.21.15.120:0/3778010750 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32b802d070 con 0x555e25aea3c0 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.600+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25aeda10 con 0x555e25aea3c0 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.600+0000 7f32c5b22640 1 -- 172.21.15.120:0/3778010750 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32b802d070 con 0x555e25aea3c0 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.600+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25aede30 con 0x555e259e8fc0 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.600+0000 7f32c6323640 1 -- 172.21.15.120:0/3778010750 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32c000a4d0 con 0x555e259e8fc0 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.601+0000 7f32ca411800 1 Processor -- start 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.601+0000 7f32ca411800 1 -- start start 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.601+0000 7f32ca411800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25afcd50 0x555e25afd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.601+0000 7f32ca411800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e258dfa00 con 0x555e25afcd50 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.601+0000 7f32c6323640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25afcd50 0x555e25afd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.601+0000 7f32c6323640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25afcd50 0x555e25afd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40962/0 (socket says 172.21.15.120:40962) 2024-09-07T03:32:32.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.601+0000 7f32c6323640 1 -- 172.21.15.120:0/926799448 learned_addr learned my addr 172.21.15.120:0/926799448 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.601+0000 7f32c6323640 1 -- 172.21.15.120:0/926799448 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e25afd7b0 con 0x555e25afcd50 2024-09-07T03:32:32.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.602+0000 7f32c6323640 1 --2- 172.21.15.120:0/926799448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25afcd50 0x555e25afd170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32c0016d20 tx=0x7f32c000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.602+0000 7f31ab7fe640 1 -- 172.21.15.120:0/926799448 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c0017660 con 0x555e25afcd50 2024-09-07T03:32:32.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.602+0000 7f31ab7fe640 1 -- 172.21.15.120:0/926799448 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c001b030 con 0x555e25afcd50 2024-09-07T03:32:32.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.602+0000 7f32ca411800 1 -- 172.21.15.120:0/926799448 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e25afdfe0 con 0x555e25afcd50 2024-09-07T03:32:32.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.602+0000 7f31ab7fe640 1 -- 172.21.15.120:0/926799448 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c0017950 con 0x555e25afcd50 2024-09-07T03:32:32.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.602+0000 7f32ca411800 1 -- 172.21.15.120:0/926799448 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e25afe580 con 0x555e25afcd50 2024-09-07T03:32:32.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.603+0000 7f31ab7fe640 1 -- 172.21.15.120:0/926799448 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f32c0017af0 con 0x555e25afcd50 2024-09-07T03:32:32.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.603+0000 7f31ab7fe640 1 --2- 172.21.15.120:0/926799448 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31a003c780 0x7f31a003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.603+0000 7f31ab7fe640 1 -- 172.21.15.120:0/926799448 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f32c000e040 con 0x555e25afcd50 2024-09-07T03:32:32.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.603+0000 7f32c5b22640 1 --2- 172.21.15.120:0/926799448 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31a003c780 0x7f31a003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.603+0000 7f32ca411800 1 Processor -- start 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.603+0000 7f32ca411800 1 -- start start 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.603+0000 7f32c5b22640 1 --2- 172.21.15.120:0/926799448 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31a003c780 0x7f31a003ec40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x555e25aed530 tx=0x7f32b8001460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.603+0000 7f32ca411800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b09bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.603+0000 7f32ca411800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e25adaeb0 con 0x555e25b097f0 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.604+0000 7f32c6323640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b09bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.604+0000 7f32c6323640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b09bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40972/0 (socket says 172.21.15.120:40972) 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.604+0000 7f32c6323640 1 -- 172.21.15.120:0/3709515121 learned_addr learned my addr 172.21.15.120:0/3709515121 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.604+0000 7f32c6323640 1 -- 172.21.15.120:0/3709515121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e25b0a1e0 con 0x555e25b097f0 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.604+0000 7f32c6323640 1 --2- 172.21.15.120:0/3709515121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b09bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32c0017f20 tx=0x7f32c0028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5431b4e245ef8def server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.604+0000 7f31a97fa640 1 -- 172.21.15.120:0/3709515121 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c00149b0 con 0x555e25b097f0 2024-09-07T03:32:32.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.604+0000 7f31a97fa640 1 -- 172.21.15.120:0/3709515121 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c0028350 con 0x555e25b097f0 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.604+0000 7f31a97fa640 1 -- 172.21.15.120:0/3709515121 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c0014b50 con 0x555e25b097f0 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 -- 172.21.15.120:0/3709515121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 msgr2=0x555e25b09bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 --2- 172.21.15.120:0/3709515121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b09bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32c0017f20 tx=0x7f32c0028e80 comp rx=0 tx=0).stop 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 -- 172.21.15.120:0/3709515121 shutdown_connections 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 --2- 172.21.15.120:0/3709515121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b09bf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 -- 172.21.15.120:0/3709515121 >> 172.21.15.120:0/3709515121 conn(0x555e25b05bf0 msgr2=0x555e25b03e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 -- 172.21.15.120:0/3709515121 shutdown_connections 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 -- 172.21.15.120:0/3709515121 wait complete. 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 Processor -- start 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 -- start start 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b10e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32ca411800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e25b0a800 con 0x555e25b097f0 2024-09-07T03:32:32.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32c6323640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b10e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32c6323640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b10e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40984/0 (socket says 172.21.15.120:40984) 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 learned_addr learned my addr 172.21.15.120:0/3986745064 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.605+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e25b113c0 con 0x555e25b097f0 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.606+0000 7f32c6323640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b10e60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f32c0017f20 tx=0x7f32c0053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.606+0000 7f31977fe640 1 -- 172.21.15.120:0/3986745064 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c004c070 con 0x555e25b097f0 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.606+0000 7f31977fe640 1 -- 172.21.15.120:0/3986745064 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c00129b0 con 0x555e25b097f0 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.606+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e25b11650 con 0x555e25b097f0 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.606+0000 7f31977fe640 1 -- 172.21.15.120:0/3986745064 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32c0012c90 con 0x555e25b097f0 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.606+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e25b11fd0 con 0x555e25b097f0 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.607+0000 7f31977fe640 1 -- 172.21.15.120:0/3986745064 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f32c00135c0 con 0x555e25b097f0 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.607+0000 7f31977fe640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f319003c780 0x7f319003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.607+0000 7f31977fe640 1 -- 172.21.15.120:0/3986745064 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f32c003bb40 con 0x555e25b097f0 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.607+0000 7f32c5b22640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f319003c780 0x7f319003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.607+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.607+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e25b1c900 0x555e25b1edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.607+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b1f510 con 0x555e25b1c900 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.607+0000 7f32bd321640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e25b1c900 0x555e25b1edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.607+0000 7f32c5b22640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f319003c780 0x7f319003ec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f32b800bbf0 tx=0x7f32b8043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32bd321640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e25b1c900 0x555e25b1edc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 20 realm 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b1f940 con 0x555e25b1c900 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b20210 con 0x555e25b1c900 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25b20c30 0x555e25b23020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.608+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b23790 con 0x555e25b20c30 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32c6323640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25b20c30 0x555e25b23020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32c6323640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25b20c30 0x555e25b23020 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32ca411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b24030 con 0x555e25b20c30 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32ca411800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32ca411800 20 searching for the correct realm 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e25b25da0 0x555e25b281f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.609+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b25da0 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.610+0000 7f32c5b22640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e25b25da0 0x555e25b281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.610+0000 7f32c5b22640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e25b25da0 0x555e25b281f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.610+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.610+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b20c30 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.610+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.610+0000 7f32c6323640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f32c0014440 0x7f32c0025060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.610+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x7f32c0014440 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.611+0000 7f32bd321640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f32c0014440 0x7f32c0025060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.611+0000 7f32bd321640 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f32c0014440 0x7f32c0025060 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.611+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.611+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.611+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.611+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.611+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.611+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b25da0 2024-09-07T03:32:32.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.612+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.612+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.612+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.612+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b20c30 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.612+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.612+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b20c30 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.612+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.612+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.613+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.613+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x7f32c0014440 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.613+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.613+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.613+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.613+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x7f32c0014440 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.613+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.613+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b20c30 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.614+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.614+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b25da0 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.614+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.614+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.614+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.614+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b20c30 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.614+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.614+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b25da0 2024-09-07T03:32:32.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b25da0 2024-09-07T03:32:32.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.615+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x7f32c0014440 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.616+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.616+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b1c900 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.616+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.616+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x7f32c0014440 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.616+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.616+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b25da0 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.616+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.616+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x7f32c0014440 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.617+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.617+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b20c30 2024-09-07T03:32:32.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.617+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.617+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b20c30 2024-09-07T03:32:32.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.617+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.617+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b25da0 2024-09-07T03:32:32.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.617+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.617+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b20c30 2024-09-07T03:32:32.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e25b288c0 con 0x555e25b20c30 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b249b0 con 0x555e25b1c900 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b24da0 con 0x555e25b20c30 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.618+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b25210 con 0x555e25b1c900 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 zone default found 2024-09-07T03:32:32.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 4 Realm: () 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 zonegroup default 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b28d90 con 0x7f32c0014440 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2afd0 con 0x555e25b25da0 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2b3a0 con 0x555e25b25da0 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 started sync module instance, tier type = 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.619+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2a460 con 0x555e25b20c30 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.621+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.621+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93862847752272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2bcb0 con 0x555e25b20c30 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.621+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2c500 con 0x555e25b1c900 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.622+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93862847752272] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.622+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.622+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93862847756560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2c8a0 con 0x555e25b1c900 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.622+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2d0f0 con 0x555e25b20c30 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.623+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93862847756560] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.623+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.623+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93862847760544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2d4e0 con 0x555e25b20c30 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.623+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2dd30 con 0x7f32c0014440 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.626+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93862847760544] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.626+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.626+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93862847763680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2ddb0 con 0x7f32c0014440 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.626+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2e600 con 0x555e25b20c30 2024-09-07T03:32:32.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.627+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93862847763680] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.627+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.627+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93862847765216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2e450 con 0x555e25b20c30 2024-09-07T03:32:32.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.628+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2e450 con 0x555e25b25da0 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.628+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.628+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93862847769920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2f7f0 con 0x555e25b25da0 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.628+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b302e0 con 0x555e25b25da0 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.629+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93862847765216] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.629+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93862847769920] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.632+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.632+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93862847774128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b2f240 con 0x555e25b25da0 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.632+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b30cf0 con 0x7f32c0014440 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93862847774128] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93862847766272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b30cf0 con 0x7f32c0014440 2024-09-07T03:32:32.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32ca411800 20 add_watcher() i=0 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32ca411800 20 add_watcher() i=1 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32ca411800 20 add_watcher() i=2 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32ca411800 20 add_watcher() i=3 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32ca411800 20 add_watcher() i=4 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32ca411800 20 add_watcher() i=5 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.637+0000 7f32ca411800 20 add_watcher() i=6 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.638+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93862847766272] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.638+0000 7f32ca411800 20 add_watcher() i=7 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.638+0000 7f32ca411800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.638+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b34030 con 0x555e25b1c900 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.638+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.638+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93862847777200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b31280 con 0x555e25b1c900 2024-09-07T03:32:32.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.639+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93862847777200] v34'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.639+0000 7f3177fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.639+0000 7f32ca411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.639+0000 7f32ca411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.639+0000 7f32ca411800 5 note: GC not initialized 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.639+0000 7f3176ffd640 20 reqs_thread_entry: start 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.640+0000 7f32ca411800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.640+0000 7f32ca411800 20 Filter name: none 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.640+0000 7f3174ff9640 20 reqs_thread_entry: start 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.640+0000 7f32ca411800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.640+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66cc0 con 0x555e25b1c900 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.640+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.640+0000 7f32ca411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.657 INFO:teuthology.orchestra.run.smithi120.stderr:could not fetch user info: no user info saved 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.641+0000 7f3177fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.641+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93862847777200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66c80 con 0x555e25b1c900 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.642+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93862847777200] v34'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.642+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93862847752272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66c80 con 0x555e25b20c30 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.643+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93862847752272] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.643+0000 7f32ca411800 20 remove_watcher() i=0 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.643+0000 7f32ca411800 2 removed watcher, disabling cache 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.643+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93862847756560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66c80 con 0x555e25b1c900 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.644+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93862847756560] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x555e25b1c900 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.644+0000 7f32ca411800 20 remove_watcher() i=1 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.644+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93862847760544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66c80 con 0x555e25b20c30 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.645+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93862847760544] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.645+0000 7f32ca411800 20 remove_watcher() i=2 2024-09-07T03:32:32.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.645+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93862847763680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66c80 con 0x7f32c0014440 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.646+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93862847763680] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.646+0000 7f32ca411800 20 remove_watcher() i=3 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.646+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93862847765216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66c80 con 0x555e25b20c30 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.647+0000 7f32c6323640 1 -- 172.21.15.120:0/3986745064 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93862847765216] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32c0027070 con 0x555e25b20c30 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.647+0000 7f32ca411800 20 remove_watcher() i=4 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.647+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93862847769920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66c80 con 0x555e25b25da0 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.648+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93862847769920] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.648+0000 7f32ca411800 20 remove_watcher() i=5 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.648+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93862847774128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66c80 con 0x555e25b25da0 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.649+0000 7f32c5b22640 1 -- 172.21.15.120:0/3986745064 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93862847774128] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b802d070 con 0x555e25b25da0 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.649+0000 7f32ca411800 20 remove_watcher() i=6 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.649+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93862847766272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e25b66c80 con 0x7f32c0014440 2024-09-07T03:32:32.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93862847766272] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32b0051070 con 0x7f32c0014440 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 20 remove_watcher() i=7 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25b20c30 msgr2=0x555e25b23020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25b20c30 0x555e25b23020 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e25b1c900 msgr2=0x555e25b1edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e25b1c900 0x555e25b1edc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f32c0014440 msgr2=0x7f32c0025060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f32c0014440 0x7f32c0025060 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e25b25da0 msgr2=0x555e25b281f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e25b25da0 0x555e25b281f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f319003c780 msgr2=0x7f319003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f319003c780 0x7f319003ec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f32b800bbf0 tx=0x7f32b8043000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 msgr2=0x555e25b10e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b10e60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f32c0017f20 tx=0x7f32c0053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32bd321640 1 -- 172.21.15.120:0/3986745064 reap_dead start 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 shutdown_connections 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 --2- 172.21.15.120:0/3986745064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25b097f0 0x555e25b10e60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 >> 172.21.15.120:0/3986745064 conn(0x555e25b05bf0 msgr2=0x555e25b03e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 shutdown_connections 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.650+0000 7f32ca411800 1 -- 172.21.15.120:0/3986745064 wait complete. 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/926799448 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31a003c780 msgr2=0x7f31a003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/926799448 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31a003c780 0x7f31a003ec40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x555e25aed530 tx=0x7f32b8001460 comp rx=0 tx=0).stop 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/926799448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25afcd50 msgr2=0x555e25afd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/926799448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25afcd50 0x555e25afd170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32c0016d20 tx=0x7f32c000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/926799448 shutdown_connections 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/926799448 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31a003c780 0x7f31a003ec40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/926799448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e25afcd50 0x555e25afd170 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/926799448 >> 172.21.15.120:0/926799448 conn(0x555e25af1100 msgr2=0x555e25af14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/926799448 shutdown_connections 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/926799448 wait complete. 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25aea3c0 msgr2=0x555e25aec880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25aea3c0 0x555e25aec880 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e259e8fc0 msgr2=0x555e25ae95d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e259e8fc0 0x555e25ae95d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31ac03c920 msgr2=0x7f31ac03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31ac03c920 0x7f31ac03ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f32b0057000 tx=0x7f32b0052000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 msgr2=0x555e25ae1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ae1f80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32b80012f0 tx=0x7f32b8000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 shutdown_connections 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e25aea3c0 0x555e25aec880 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e259e8fc0 0x555e25ae95d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f31ac03c920 0x7f31ac03ede0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 --2- 172.21.15.120:0/3778010750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e259e74a0 0x555e25ae1f80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 >> 172.21.15.120:0/3778010750 conn(0x555e259e31f0 msgr2=0x555e25adb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 shutdown_connections 2024-09-07T03:32:32.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.651+0000 7f32ca411800 1 -- 172.21.15.120:0/3778010750 wait complete. 2024-09-07T03:32:32.663 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-07T03:32:32.664 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-07T03:32:32.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-07T03:32:32.664 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-07T03:32:32.718 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:32.718 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:32.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.718+0000 7f2c2da15800 1 Processor -- start 2024-09-07T03:32:32.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.718+0000 7f2c2da15800 1 -- start start 2024-09-07T03:32:32.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.718+0000 7f2c2da15800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a53bb91e50 0x55a53bb92b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.718+0000 7f2c2da15800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a53ba3ce40 con 0x55a53bb93090 2024-09-07T03:32:32.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.718+0000 7f2c2da15800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a53ba07680 con 0x55a53bb91e50 2024-09-07T03:32:32.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.718+0000 7f2c29192640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a53bb91e50 0x55a53bb92b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.718+0000 7f2c23fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55a53bb93090 0x55a53bb97df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48228/0 (socket says 172.21.15.120:48228) 2024-09-07T03:32:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.718+0000 7f2c29192640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a53bb91e50 0x55a53bb92b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40986/0 (socket says 172.21.15.120:40986) 2024-09-07T03:32:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.718+0000 7f2c23fff640 1 -- 172.21.15.120:0/3545207538 learned_addr learned my addr 172.21.15.120:0/3545207538 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.719+0000 7f2c29192640 1 -- 172.21.15.120:0/3545207538 >> v1:172.21.15.104:6789/0 conn(0x55a53bb93090 legacy=0x55a53bb97df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.719+0000 7f2c29192640 1 -- 172.21.15.120:0/3545207538 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53ba236b0 con 0x55a53bb91e50 2024-09-07T03:32:32.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.719+0000 7f2c28991640 1 -- 172.21.15.120:0/3545207538 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70357117 0 0) 0x55a53ba3ce40 con 0x55a53bb93090 2024-09-07T03:32:32.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c29192640 1 --2- 172.21.15.120:0/3545207538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bb92b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00a470 tx=0x7f2c1c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f960cad69ee868 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c28991640 1 -- 172.21.15.120:0/3545207538 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c1c053570 con 0x55a53bb91e50 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c28991640 1 -- 172.21.15.120:0/3545207538 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1c058070 con 0x55a53bb91e50 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c28991640 1 -- 172.21.15.120:0/3545207538 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c1c053880 con 0x55a53bb91e50 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c2da15800 1 -- 172.21.15.120:0/3545207538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 msgr2=0x55a53bb92b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3545207538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bb92b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00a470 tx=0x7f2c1c045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c2da15800 1 -- 172.21.15.120:0/3545207538 shutdown_connections 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3545207538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bb92b50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c2da15800 1 -- 172.21.15.120:0/3545207538 >> 172.21.15.120:0/3545207538 conn(0x55a53bb8d220 msgr2=0x55a53bb8f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c2da15800 1 -- 172.21.15.120:0/3545207538 shutdown_connections 2024-09-07T03:32:32.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.721+0000 7f2c2da15800 1 -- 172.21.15.120:0/3545207538 wait complete. 2024-09-07T03:32:32.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.735+0000 7f2c2da15800 1 Processor -- start 2024-09-07T03:32:32.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.735+0000 7f2c2da15800 1 -- start start 2024-09-07T03:32:32.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.735+0000 7f2c2da15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc847b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.735+0000 7f2c2da15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a53ba2bdd0 con 0x55a53bb91e50 2024-09-07T03:32:32.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.735+0000 7f2c29192640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.735+0000 7f2c29192640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc847b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40990/0 (socket says 172.21.15.120:40990) 2024-09-07T03:32:32.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.735+0000 7f2c29192640 1 -- 172.21.15.120:0/1046983884 learned_addr learned my addr 172.21.15.120:0/1046983884 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.736+0000 7f2c29192640 1 -- 172.21.15.120:0/1046983884 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53ba44e10 con 0x55a53bb91e50 2024-09-07T03:32:32.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.736+0000 7f2c29192640 1 --2- 172.21.15.120:0/1046983884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc847b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00a470 tx=0x7f2c1c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395f1139bb4c66ea server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.736+0000 7f2b17606640 1 -- 172.21.15.120:0/1046983884 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c1c053570 con 0x55a53bb91e50 2024-09-07T03:32:32.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.736+0000 7f2b17606640 1 -- 172.21.15.120:0/1046983884 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1c063030 con 0x55a53bb91e50 2024-09-07T03:32:32.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.736+0000 7f2b17606640 1 -- 172.21.15.120:0/1046983884 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c1c053840 con 0x55a53bb91e50 2024-09-07T03:32:32.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 -- 172.21.15.120:0/1046983884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 msgr2=0x55a53bc847b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 --2- 172.21.15.120:0/1046983884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc847b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00a470 tx=0x7f2c1c051000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 -- 172.21.15.120:0/1046983884 shutdown_connections 2024-09-07T03:32:32.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 --2- 172.21.15.120:0/1046983884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc847b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 -- 172.21.15.120:0/1046983884 >> 172.21.15.120:0/1046983884 conn(0x55a53bb8d220 msgr2=0x55a53bc7bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 -- 172.21.15.120:0/1046983884 shutdown_connections 2024-09-07T03:32:32.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 -- 172.21.15.120:0/1046983884 wait complete. 2024-09-07T03:32:32.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 Processor -- start 2024-09-07T03:32:32.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 -- start start 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc8c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c2da15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a53bb93780 con 0x55a53bb91e50 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c29192640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc8c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c29192640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc8c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41000/0 (socket says 172.21.15.120:41000) 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.737+0000 7f2c29192640 1 -- 172.21.15.120:0/959440027 learned_addr learned my addr 172.21.15.120:0/959440027 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.738+0000 7f2c29192640 1 -- 172.21.15.120:0/959440027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53bc8c5f0 con 0x55a53bb91e50 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.738+0000 7f2c29192640 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc8c090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00a470 tx=0x7f2c1c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.738+0000 7f2b15e03640 1 -- 172.21.15.120:0/959440027 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c1c078070 con 0x55a53bb91e50 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.738+0000 7f2b15e03640 1 -- 172.21.15.120:0/959440027 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1c068420 con 0x55a53bb91e50 2024-09-07T03:32:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.738+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a53bc8c880 con 0x55a53bb91e50 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.738+0000 7f2b15e03640 1 -- 172.21.15.120:0/959440027 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c1c068700 con 0x55a53bb91e50 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.738+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53bc8d490 con 0x55a53bb91e50 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.739+0000 7f2b15e03640 1 -- 172.21.15.120:0/959440027 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2c1c07b070 con 0x55a53bb91e50 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.739+0000 7f2b15e03640 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b1003c780 0x7f2b1003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.739+0000 7f2b15e03640 1 -- 172.21.15.120:0/959440027 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f2c1c097830 con 0x55a53bb91e50 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.739+0000 7f2c23fff640 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b1003c780 0x7f2b1003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.739+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bb93090 0x55a53bc936e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.739+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bc93c20 con 0x55a53bb93090 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.739+0000 7f2c29993640 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bb93090 0x55a53bc936e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.740+0000 7f2c23fff640 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b1003c780 0x7f2b1003ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c14000c00 tx=0x7f2c140013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.740+0000 7f2c29993640 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bb93090 0x55a53bc936e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.740+0000 7f2c29993640 1 -- 172.21.15.120:0/959440027 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c2400a4d0 con 0x55a53bb93090 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.740+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bc944d0 0x55a53bc96940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.740+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bc970b0 con 0x55a53bc944d0 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.740+0000 7f2c29192640 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bc944d0 0x55a53bc96940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.741+0000 7f2c29192640 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bc944d0 0x55a53bc96940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.741+0000 7f2c29192640 1 -- 172.21.15.120:0/959440027 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c1c07a030 con 0x55a53bc944d0 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.741+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bc98960 con 0x55a53bc944d0 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.741+0000 7f2c29192640 1 -- 172.21.15.120:0/959440027 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c1c07a030 con 0x55a53bc944d0 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.741+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bc979e0 con 0x55a53bc944d0 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.741+0000 7f2c29192640 1 -- 172.21.15.120:0/959440027 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c1c07a030 con 0x55a53bc944d0 2024-09-07T03:32:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.741+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bc97e40 con 0x55a53bb93090 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.742+0000 7f2c29993640 1 -- 172.21.15.120:0/959440027 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c2400a4d0 con 0x55a53bb93090 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.742+0000 7f2c2da15800 1 Processor -- start 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.742+0000 7f2c2da15800 1 -- start start 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.742+0000 7f2c2da15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bca6e40 0x55a53bca7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.742+0000 7f2c2da15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a53ba89a00 con 0x55a53bca6e40 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.742+0000 7f2c29993640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bca6e40 0x55a53bca7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.742+0000 7f2c29993640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bca6e40 0x55a53bca7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41002/0 (socket says 172.21.15.120:41002) 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.742+0000 7f2c29993640 1 -- 172.21.15.120:0/2468901538 learned_addr learned my addr 172.21.15.120:0/2468901538 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.743+0000 7f2c29993640 1 -- 172.21.15.120:0/2468901538 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53bca78a0 con 0x55a53bca6e40 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.743+0000 7f2c29993640 1 --2- 172.21.15.120:0/2468901538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bca6e40 0x55a53bca7260 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c24016d20 tx=0x7f2c2400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.743+0000 7f2b0effd640 1 -- 172.21.15.120:0/2468901538 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c24017660 con 0x55a53bca6e40 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.743+0000 7f2b0effd640 1 -- 172.21.15.120:0/2468901538 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2401b030 con 0x55a53bca6e40 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.743+0000 7f2c2da15800 1 -- 172.21.15.120:0/2468901538 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a53bca80d0 con 0x55a53bca6e40 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.743+0000 7f2b0effd640 1 -- 172.21.15.120:0/2468901538 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c24017950 con 0x55a53bca6e40 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.743+0000 7f2c2da15800 1 -- 172.21.15.120:0/2468901538 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53bca8670 con 0x55a53bca6e40 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.744+0000 7f2b0effd640 1 -- 172.21.15.120:0/2468901538 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2c24017af0 con 0x55a53bca6e40 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.744+0000 7f2b0effd640 1 --2- 172.21.15.120:0/2468901538 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b0003c780 0x7f2b0003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.744+0000 7f2b0effd640 1 -- 172.21.15.120:0/2468901538 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f2c2400e040 con 0x55a53bca6e40 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.744+0000 7f2c29192640 1 --2- 172.21.15.120:0/2468901538 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b0003c780 0x7f2b0003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.744+0000 7f2c2da15800 1 Processor -- start 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.744+0000 7f2c29192640 1 --2- 172.21.15.120:0/2468901538 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b0003c780 0x7f2b0003ec40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55a53bc8d890 tx=0x7f2c1c08b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2c2da15800 1 -- start start 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2c2da15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcb3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2c2da15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a53bc84fa0 con 0x55a53bcb3900 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2c29993640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcb3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2c29993640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcb3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41006/0 (socket says 172.21.15.120:41006) 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2c29993640 1 -- 172.21.15.120:0/3386780198 learned_addr learned my addr 172.21.15.120:0/3386780198 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2c29993640 1 -- 172.21.15.120:0/3386780198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53bcb42f0 con 0x55a53bcb3900 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2c29993640 1 --2- 172.21.15.120:0/3386780198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcb3d00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2c24053e00 tx=0x7f2c24017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4968c760d651554a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2b0cff9640 1 -- 172.21.15.120:0/3386780198 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c24014d40 con 0x55a53bcb3900 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2b0cff9640 1 -- 172.21.15.120:0/3386780198 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c24051070 con 0x55a53bcb3900 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.745+0000 7f2b0cff9640 1 -- 172.21.15.120:0/3386780198 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c240149b0 con 0x55a53bcb3900 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 -- 172.21.15.120:0/3386780198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 msgr2=0x55a53bcb3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3386780198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcb3d00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2c24053e00 tx=0x7f2c24017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 -- 172.21.15.120:0/3386780198 shutdown_connections 2024-09-07T03:32:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3386780198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcb3d00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 -- 172.21.15.120:0/3386780198 >> 172.21.15.120:0/3386780198 conn(0x55a53bcafd20 msgr2=0x55a53bcadf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 -- 172.21.15.120:0/3386780198 shutdown_connections 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 -- 172.21.15.120:0/3386780198 wait complete. 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 Processor -- start 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 -- start start 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcbaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c2da15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a53bcb4910 con 0x55a53bcb3900 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c29993640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcbaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c29993640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcbaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41016/0 (socket says 172.21.15.120:41016) 2024-09-07T03:32:32.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.746+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 learned_addr learned my addr 172.21.15.120:0/3106834313 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.747+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53bcbb4d0 con 0x55a53bcb3900 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.747+0000 7f2c29993640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcbaf70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c24012500 tx=0x7f2c24053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.747+0000 7f2afeffd640 1 -- 172.21.15.120:0/3106834313 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c24012570 con 0x55a53bcb3900 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.747+0000 7f2afeffd640 1 -- 172.21.15.120:0/3106834313 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2402e070 con 0x55a53bcb3900 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.747+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a53bcbb760 con 0x55a53bcb3900 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.747+0000 7f2afeffd640 1 -- 172.21.15.120:0/3106834313 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c24028820 con 0x55a53bcb3900 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.747+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53bcbc0e0 con 0x55a53bcb3900 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.748+0000 7f2afeffd640 1 -- 172.21.15.120:0/3106834313 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2c24039060 con 0x55a53bcb3900 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.748+0000 7f2afeffd640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2af403c730 0x7f2af403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.748+0000 7f2afeffd640 1 -- 172.21.15.120:0/3106834313 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f2c24033c90 con 0x55a53bcb3900 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.748+0000 7f2c29192640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2af403c730 0x7f2af403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.748+0000 7f2c29192640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2af403c730 0x7f2af403ebf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c053da0 tx=0x7f2c1c094000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bcc6ac0 0x55a53bcc8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcc96d0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c23fff640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bcc6ac0 0x55a53bcc8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c23fff640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bcc6ac0 0x55a53bcc8f80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c2da15800 20 realm 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcc5e10 con 0x55a53bcc6ac0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.749+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c2da15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcca1c0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bccafa0 0x55a53bccd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bccda60 con 0x55a53bccafa0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c29993640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bccafa0 0x55a53bccd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.750+0000 7f2c29993640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bccafa0 0x55a53bccd390 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c2da15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcce2b0 con 0x55a53bccafa0 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c2da15800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c2da15800 20 searching for the correct realm 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a53bcd0020 0x55a53bcd2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcd0020 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c29192640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a53bcd0020 0x55a53bcd2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c29192640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a53bcd0020 0x55a53bcd2450 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.751+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bccafa0 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.752+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.752+0000 7f2c29993640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2c2404e050 0x7f2c240127a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.752+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x7f2c2404e050 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.752+0000 7f2c23fff640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2c2404e050 0x7f2c240127a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.752+0000 7f2c23fff640 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2c2404e050 0x7f2c240127a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.752+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x7f2c2404e050 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.752+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.753+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.753+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.753+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.753+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcd0020 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.753+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.753+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.753+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.753+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bccafa0 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.754+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.754+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bccafa0 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.754+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.754+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.754+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.754+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x7f2c2404e050 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.754+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x7f2c2404e050 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.754+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.755+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.755+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x7f2c2404e050 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.755+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c1400f5f0 con 0x7f2c2404e050 2024-09-07T03:32:32.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.755+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bccafa0 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.755+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.755+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcd0020 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.755+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.755+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.756+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.756+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bccafa0 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.756+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.756+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcd0020 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.756+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.756+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcd0020 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x7f2c2404e050 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x7f2c2404e050 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.757+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.758+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.758+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x7f2c2404e050 2024-09-07T03:32:32.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.758+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x7f2c2404e050 2024-09-07T03:32:32.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.758+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcd0020 2024-09-07T03:32:32.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.758+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.758+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x7f2c2404e050 2024-09-07T03:32:32.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.758+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1400f5f0 con 0x7f2c2404e050 2024-09-07T03:32:32.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.758+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bccafa0 2024-09-07T03:32:32.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.759+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.759+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bccafa0 2024-09-07T03:32:32.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.759+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.759+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bcd0020 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.759+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.759+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bccafa0 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd2b20 con 0x55a53bccafa0 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:32.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bccec30 con 0x55a53bcc6ac0 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcce870 con 0x55a53bccafa0 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.760+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bccf070 con 0x55a53bcc6ac0 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 zone default found 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 4 Realm: () 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 zonegroup default 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd3450 con 0x7f2c2404e050 2024-09-07T03:32:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd5690 con 0x55a53bcd0020 2024-09-07T03:32:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd5a30 con 0x55a53bcd0020 2024-09-07T03:32:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 started sync module instance, tier type = 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.761+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd4b20 con 0x55a53bccafa0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.763+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.763+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94168161275664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd6280 con 0x55a53bccafa0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.763+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd6ad0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.764+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.764+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94168161275664] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.764+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94168161280640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd7320 con 0x55a53bcc6ac0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.764+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd5dd0 con 0x55a53bccafa0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.765+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.765+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94168161284896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd7bf0 con 0x55a53bccafa0 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.765+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd85b0 con 0x7f2c2404e050 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.765+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94168161280640] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.766+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.766+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94168161283696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd85b0 con 0x7f2c2404e050 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.766+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd9020 con 0x55a53bccafa0 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.766+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94168161284896] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.767+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94168161283696] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.767+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.767+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94168161290992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd8100 con 0x55a53bccafa0 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.767+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd98f0 con 0x55a53bcd0020 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.768+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.768+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94168161293376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd8100 con 0x55a53bcd0020 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.768+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcda470 con 0x55a53bcd0020 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.768+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94168161290992] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.769+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.769+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94168161296224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcda430 con 0x55a53bcd0020 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.769+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcdaea0 con 0x7f2c2404e050 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.769+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94168161293376] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94168161296224] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94168161285952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcd9860 con 0x7f2c2404e050 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c2da15800 20 add_watcher() i=0 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c2da15800 20 add_watcher() i=1 2024-09-07T03:32:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c2da15800 20 add_watcher() i=2 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c2da15800 20 add_watcher() i=3 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c2da15800 20 add_watcher() i=4 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c2da15800 20 add_watcher() i=5 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.772+0000 7f2c2da15800 20 add_watcher() i=6 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.773+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94168161285952] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.773+0000 7f2c2da15800 20 add_watcher() i=7 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.773+0000 7f2c2da15800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.773+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcdded0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.773+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.773+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94168161298896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bcdb3c0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.774+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94168161298896] v34'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.774+0000 7f2adf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.774+0000 7f2c2da15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.774+0000 7f2c2da15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.774+0000 7f2c2da15800 5 note: GC not initialized 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2ade7e4640 20 reqs_thread_entry: start 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 20 Filter name: none 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2a4ffff640 20 reqs_thread_entry: start 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd10f30 con 0x55a53bcc6ac0 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0f5d0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-07T03:32:32.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.775+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0f5d0 con 0x55a53bcc6ac0 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.776+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.776+0000 7f2c2da15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.776+0000 7f2c2da15800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.776+0000 7f2c2da15800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.776+0000 7f2c2da15800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.776+0000 7f2c2da15800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.776+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd10000 con 0x55a53bcc6ac0 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v34'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c2da15800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c2da15800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c2da15800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:32.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94168161516128 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd14820 con 0x55a53bccafa0 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94168161290992 notify 146028888064 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55a53bcbc0e0 con 0x55a53bccafa0 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2b0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94168161290992 notifier 4288 bl.length()=567 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2b0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2b0cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2b0cff9640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2aec003ea0 con 0x55a53bccafa0 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.4 [notify cookie 94168161516128 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94168161516128 notify 146028888064 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a53bcbb760 con 0x55a53bccafa0 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.777+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0fa60 con 0x55a53bcc6ac0 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c2da15800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-07T03:32:32.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c2da15800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c2da15800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94168161516048 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd14c50 con 0x7f2c2404e050 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== watch-notify(notify (1) cookie 94168161283696 notify 146028888064 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55a53bd103a0 con 0x7f2c2404e050 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2afffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94168161283696 notifier 4288 bl.length()=169 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2afffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2afffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2afffff640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2a5c003400 con 0x7f2c2404e050 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(69 notify.3 [notify cookie 94168161516048 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== watch-notify(notify_complete (2) cookie 94168161516048 notify 146028888064 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a53bd10a70 con 0x7f2c2404e050 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.779+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0fa80 con 0x55a53bcc6ac0 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.780+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.780+0000 7f2c2da15800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.780+0000 7f2c2da15800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.780+0000 7f2c2da15800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.781+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94168161530720 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd15100 con 0x7f2c2404e050 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.781+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== watch-notify(notify (1) cookie 94168161283696 notify 146028888065 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55a53bd10a70 con 0x7f2c2404e050 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.781+0000 7f2b0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94168161283696 notifier 4288 bl.length()=177 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.781+0000 7f2b0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.781+0000 7f2b0cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.781+0000 7f2b0cff9640 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2aec003ea0 con 0x7f2c2404e050 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.781+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(72 notify.3 [notify cookie 94168161530720 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.781+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.781+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== watch-notify(notify_complete (2) cookie 94168161530720 notify 146028888065 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2c14026040 con 0x7f2c2404e050 2024-09-07T03:32:32.804 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.782+0000 7f2adf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.782+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94168161298896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0ed20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.783+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94168161298896] v34'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.783+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94168161275664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0ed20 con 0x55a53bccafa0 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.784+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94168161275664] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.784+0000 7f2c2da15800 20 remove_watcher() i=0 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.784+0000 7f2c2da15800 2 removed watcher, disabling cache 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.784+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94168161280640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0ed20 con 0x55a53bcc6ac0 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.785+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94168161280640] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x55a53bcc6ac0 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.785+0000 7f2c2da15800 20 remove_watcher() i=1 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.785+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94168161284896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0ed20 con 0x55a53bccafa0 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.786+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94168161284896] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.786+0000 7f2c2da15800 20 remove_watcher() i=2 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.786+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94168161283696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0ed20 con 0x7f2c2404e050 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.787+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94168161283696] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.787+0000 7f2c2da15800 20 remove_watcher() i=3 2024-09-07T03:32:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.787+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94168161290992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0ed20 con 0x55a53bccafa0 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.789+0000 7f2c29993640 1 -- 172.21.15.120:0/3106834313 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94168161290992] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c24027070 con 0x55a53bccafa0 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.789+0000 7f2c2da15800 20 remove_watcher() i=4 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.789+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94168161293376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0ed20 con 0x55a53bcd0020 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.790+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94168161293376] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.790+0000 7f2c2da15800 20 remove_watcher() i=5 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.790+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94168161296224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0ed20 con 0x55a53bcd0020 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.790+0000 7f2c29192640 1 -- 172.21.15.120:0/3106834313 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94168161296224] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1c0a0030 con 0x55a53bcd0020 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.791+0000 7f2c2da15800 20 remove_watcher() i=6 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.791+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94168161285952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53bd0ed20 con 0x7f2c2404e050 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.791+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94168161285952] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c1403c040 con 0x7f2c2404e050 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.791+0000 7f2c2da15800 20 remove_watcher() i=7 2024-09-07T03:32:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bccafa0 msgr2=0x55a53bccd390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bccafa0 0x55a53bccd390 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bcc6ac0 msgr2=0x55a53bcc8f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bcc6ac0 0x55a53bcc8f80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2c2404e050 msgr2=0x7f2c240127a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2c2404e050 0x7f2c240127a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a53bcd0020 msgr2=0x55a53bcd2450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a53bcd0020 0x55a53bcd2450 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2af403c730 msgr2=0x7f2af403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2af403c730 0x7f2af403ebf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c053da0 tx=0x7f2c1c094000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 msgr2=0x55a53bcbaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c23fff640 1 -- 172.21.15.120:0/3106834313 reap_dead start 2024-09-07T03:32:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcbaf70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c24012500 tx=0x7f2c24053d60 comp rx=0 tx=0).stop 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 shutdown_connections 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/3106834313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bcb3900 0x55a53bcbaf70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 >> 172.21.15.120:0/3106834313 conn(0x55a53bcafd20 msgr2=0x55a53bcadf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 shutdown_connections 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/3106834313 wait complete. 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/2468901538 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b0003c780 msgr2=0x7f2b0003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/2468901538 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b0003c780 0x7f2b0003ec40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55a53bc8d890 tx=0x7f2c1c08b040 comp rx=0 tx=0).stop 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/2468901538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bca6e40 msgr2=0x55a53bca7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/2468901538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bca6e40 0x55a53bca7260 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c24016d20 tx=0x7f2c2400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/2468901538 shutdown_connections 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/2468901538 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b0003c780 0x7f2b0003ec40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 --2- 172.21.15.120:0/2468901538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bca6e40 0x55a53bca7260 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/2468901538 >> 172.21.15.120:0/2468901538 conn(0x55a53bc9b1f0 msgr2=0x55a53bc9b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/2468901538 shutdown_connections 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.792+0000 7f2c2da15800 1 -- 172.21.15.120:0/2468901538 wait complete. 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bc944d0 msgr2=0x55a53bc96940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bc944d0 0x55a53bc96940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bb93090 msgr2=0x55a53bc936e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bb93090 0x55a53bc936e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b1003c780 msgr2=0x7f2b1003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b1003c780 0x7f2b1003ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c14000c00 tx=0x7f2c140013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 msgr2=0x55a53bc8c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc8c090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00a470 tx=0x7f2c1c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 shutdown_connections 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a53bc944d0 0x55a53bc96940 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a53bb93090 0x55a53bc936e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2b1003c780 0x7f2b1003ec40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 --2- 172.21.15.120:0/959440027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a53bb91e50 0x55a53bc8c090 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 >> 172.21.15.120:0/959440027 conn(0x55a53bb8d220 msgr2=0x55a53bc7a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 shutdown_connections 2024-09-07T03:32:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.793+0000 7f2c2da15800 1 -- 172.21.15.120:0/959440027 wait complete. 2024-09-07T03:32:32.815 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:32.815 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-07T03:32:32.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-07T03:32:32.816 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-07T03:32:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd63e0f800 1 Processor -- start 2024-09-07T03:32:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd63e0f800 1 -- start start 2024-09-07T03:32:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd63e0f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5644a3dd1220 0x5644a3dd6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd63e0f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5644a3c7ae40 con 0x5644a3dcfe10 2024-09-07T03:32:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd63e0f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5644a3c45680 con 0x5644a3dd1220 2024-09-07T03:32:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd610f8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5644a3dd1220 0x5644a3dd6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd610f8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5644a3dd1220 0x5644a3dd6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41022/0 (socket says 172.21.15.120:41022) 2024-09-07T03:32:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd610f8640 1 -- 172.21.15.120:0/1653979140 learned_addr learned my addr 172.21.15.120:0/1653979140 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd618f9640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5644a3dcfe10 0x5644a3dd0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48240/0 (socket says 172.21.15.120:48240) 2024-09-07T03:32:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd610f8640 1 -- 172.21.15.120:0/1653979140 >> v1:172.21.15.104:6789/0 conn(0x5644a3dcfe10 legacy=0x5644a3dd0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.864+0000 7fcd610f8640 1 -- 172.21.15.120:0/1653979140 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a3c616b0 con 0x5644a3dd1220 2024-09-07T03:32:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.866+0000 7fcd610f8640 1 --2- 172.21.15.120:0/1653979140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dd1220 0x5644a3dd6dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00a520 tx=0x7fcd4c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c9f983e5130403 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.866+0000 7fcd608f7640 1 -- 172.21.15.120:0/1653979140 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4c055070 con 0x5644a3dd1220 2024-09-07T03:32:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.866+0000 7fcd608f7640 1 -- 172.21.15.120:0/1653979140 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4c0515b0 con 0x5644a3dd1220 2024-09-07T03:32:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.866+0000 7fcd608f7640 1 -- 172.21.15.120:0/1653979140 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4c0518d0 con 0x5644a3dd1220 2024-09-07T03:32:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.867+0000 7fcd63e0f800 1 -- 172.21.15.120:0/1653979140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dd1220 msgr2=0x5644a3dd6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.867+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/1653979140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dd1220 0x5644a3dd6dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00a520 tx=0x7fcd4c045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.867+0000 7fcd63e0f800 1 -- 172.21.15.120:0/1653979140 shutdown_connections 2024-09-07T03:32:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.867+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/1653979140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dd1220 0x5644a3dd6dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.867+0000 7fcd63e0f800 1 -- 172.21.15.120:0/1653979140 >> 172.21.15.120:0/1653979140 conn(0x5644a3dcb1e0 msgr2=0x5644a3dcd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.867+0000 7fcd63e0f800 1 -- 172.21.15.120:0/1653979140 shutdown_connections 2024-09-07T03:32:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.867+0000 7fcd63e0f800 1 -- 172.21.15.120:0/1653979140 wait complete. 2024-09-07T03:32:32.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.881+0000 7fcd63e0f800 1 Processor -- start 2024-09-07T03:32:32.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.881+0000 7fcd63e0f800 1 -- start start 2024-09-07T03:32:32.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.881+0000 7fcd63e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3d43dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.881+0000 7fcd63e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5644a3c69dd0 con 0x5644a3dcfe10 2024-09-07T03:32:32.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.881+0000 7fcd618f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3d43dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.881+0000 7fcd618f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3d43dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41034/0 (socket says 172.21.15.120:41034) 2024-09-07T03:32:32.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.881+0000 7fcd618f9640 1 -- 172.21.15.120:0/2492573068 learned_addr learned my addr 172.21.15.120:0/2492573068 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.882+0000 7fcd618f9640 1 -- 172.21.15.120:0/2492573068 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a3c82e10 con 0x5644a3dcfe10 2024-09-07T03:32:32.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.882+0000 7fcd618f9640 1 --2- 172.21.15.120:0/2492573068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3d43dd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0016e0 tx=0x7fcd5c001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10df19390a65c86f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.882+0000 7fcc4fe07640 1 -- 172.21.15.120:0/2492573068 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd5c013420 con 0x5644a3dcfe10 2024-09-07T03:32:32.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.882+0000 7fcc4fe07640 1 -- 172.21.15.120:0/2492573068 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd5c0135e0 con 0x5644a3dcfe10 2024-09-07T03:32:32.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.882+0000 7fcc4fe07640 1 -- 172.21.15.120:0/2492573068 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd5c013900 con 0x5644a3dcfe10 2024-09-07T03:32:32.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.882+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2492573068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 msgr2=0x5644a3d43dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.882+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2492573068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3d43dd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0016e0 tx=0x7fcd5c001ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2492573068 shutdown_connections 2024-09-07T03:32:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2492573068 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3d43dd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2492573068 >> 172.21.15.120:0/2492573068 conn(0x5644a3dcb1e0 msgr2=0x5644a3ebaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2492573068 shutdown_connections 2024-09-07T03:32:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2492573068 wait complete. 2024-09-07T03:32:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd63e0f800 1 Processor -- start 2024-09-07T03:32:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd63e0f800 1 -- start start 2024-09-07T03:32:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd63e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3ec0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd63e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5644a3dd1910 con 0x5644a3dcfe10 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd618f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3ec0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd618f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3ec0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41042/0 (socket says 172.21.15.120:41042) 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd618f9640 1 -- 172.21.15.120:0/3976206025 learned_addr learned my addr 172.21.15.120:0/3976206025 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.883+0000 7fcd618f9640 1 -- 172.21.15.120:0/3976206025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a3ec0ea0 con 0x5644a3dcfe10 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.884+0000 7fcd618f9640 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3ec0940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c000f80 tx=0x7fcd5c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.884+0000 7fcc4e604640 1 -- 172.21.15.120:0/3976206025 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd5c022020 con 0x5644a3dcfe10 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.884+0000 7fcc4e604640 1 -- 172.21.15.120:0/3976206025 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd5c006810 con 0x5644a3dcfe10 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.884+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644a3ebf250 con 0x5644a3dcfe10 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.884+0000 7fcc4e604640 1 -- 172.21.15.120:0/3976206025 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd5c004ae0 con 0x5644a3dcfe10 2024-09-07T03:32:32.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.884+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a3ebf810 con 0x5644a3dcfe10 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.885+0000 7fcc4e604640 1 -- 172.21.15.120:0/3976206025 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcd5c025020 con 0x5644a3dcfe10 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.885+0000 7fcc4e604640 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc4803c780 0x7fcc4803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.885+0000 7fcc4e604640 1 -- 172.21.15.120:0/3976206025 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fcd5c018030 con 0x5644a3dcfe10 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.885+0000 7fcd610f8640 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc4803c780 0x7fcc4803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.885+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3dd1220 0x5644a3ed1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.885+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3ed1a70 con 0x5644a3dd1220 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.885+0000 7fcd620fa640 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3dd1220 0x5644a3ed1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.885+0000 7fcd610f8640 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc4803c780 0x7fcc4803ec40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c057000 tx=0x7fcd4c052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.885+0000 7fcd620fa640 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3dd1220 0x5644a3ed1530 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.886+0000 7fcd620fa640 1 -- 172.21.15.120:0/3976206025 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3dd1220 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.886+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3ed2860 0x5644a3ed4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.886+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3ed5290 con 0x5644a3ed2860 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.886+0000 7fcd618f9640 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3ed2860 0x5644a3ed4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.886+0000 7fcd618f9640 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3ed2860 0x5644a3ed4c50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.887+0000 7fcd618f9640 1 -- 172.21.15.120:0/3976206025 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3ed2860 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.887+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3ed6b40 con 0x5644a3ed2860 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.887+0000 7fcd618f9640 1 -- 172.21.15.120:0/3976206025 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3ed2860 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.887+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3ed5c80 con 0x5644a3ed2860 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.887+0000 7fcd618f9640 1 -- 172.21.15.120:0/3976206025 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3ed2860 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.887+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3ed60e0 con 0x5644a3dd1220 2024-09-07T03:32:32.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.887+0000 7fcd620fa640 1 -- 172.21.15.120:0/3976206025 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3dd1220 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.888+0000 7fcd63e0f800 1 Processor -- start 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.888+0000 7fcd63e0f800 1 -- start start 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.888+0000 7fcd63e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ee5070 0x5644a3ee5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.888+0000 7fcd63e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5644a3cc7a00 con 0x5644a3ee5070 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.888+0000 7fcd620fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ee5070 0x5644a3ee5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.888+0000 7fcd620fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ee5070 0x5644a3ee5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41058/0 (socket says 172.21.15.120:41058) 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.888+0000 7fcd620fa640 1 -- 172.21.15.120:0/707304024 learned_addr learned my addr 172.21.15.120:0/707304024 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.889+0000 7fcd620fa640 1 -- 172.21.15.120:0/707304024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a3ee5ad0 con 0x5644a3ee5070 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.889+0000 7fcd620fa640 1 --2- 172.21.15.120:0/707304024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ee5070 0x5644a3ee5490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400aa90 tx=0x7fcd5400af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.889+0000 7fcc477fe640 1 -- 172.21.15.120:0/707304024 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd54007d20 con 0x5644a3ee5070 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.889+0000 7fcc477fe640 1 -- 172.21.15.120:0/707304024 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd54018430 con 0x5644a3ee5070 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.889+0000 7fcc477fe640 1 -- 172.21.15.120:0/707304024 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd54018750 con 0x5644a3ee5070 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.889+0000 7fcd63e0f800 1 -- 172.21.15.120:0/707304024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644a3ee6300 con 0x5644a3ee5070 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.889+0000 7fcd63e0f800 1 -- 172.21.15.120:0/707304024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a3ee68a0 con 0x5644a3ee5070 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.890+0000 7fcc477fe640 1 -- 172.21.15.120:0/707304024 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcd54020020 con 0x5644a3ee5070 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.890+0000 7fcc477fe640 1 --2- 172.21.15.120:0/707304024 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc3c03c780 0x7fcc3c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.890+0000 7fcc477fe640 1 -- 172.21.15.120:0/707304024 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fcd5401e020 con 0x5644a3ee5070 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.890+0000 7fcd618f9640 1 --2- 172.21.15.120:0/707304024 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc3c03c780 0x7fcc3c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.890+0000 7fcd63e0f800 1 Processor -- start 2024-09-07T03:32:32.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.890+0000 7fcd63e0f800 1 -- start start 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.890+0000 7fcd618f9640 1 --2- 172.21.15.120:0/707304024 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc3c03c780 0x7fcc3c03ec40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5644a3ed2020 tx=0x7fcd5c051e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.890+0000 7fcd63e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.890+0000 7fcd63e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5644a3ec3340 con 0x5644a3ef1b70 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.891+0000 7fcd620fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.891+0000 7fcd620fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41066/0 (socket says 172.21.15.120:41066) 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.891+0000 7fcd620fa640 1 -- 172.21.15.120:0/405355144 learned_addr learned my addr 172.21.15.120:0/405355144 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.891+0000 7fcd620fa640 1 -- 172.21.15.120:0/405355144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a3ef2560 con 0x5644a3ef1b70 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.891+0000 7fcd620fa640 1 --2- 172.21.15.120:0/405355144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef1f70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcd54053170 tx=0x7fcd540206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb389e8ff7ae927 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.891+0000 7fcc457fa640 1 -- 172.21.15.120:0/405355144 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd5404a070 con 0x5644a3ef1b70 2024-09-07T03:32:32.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.891+0000 7fcc457fa640 1 -- 172.21.15.120:0/405355144 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd54020b70 con 0x5644a3ef1b70 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.891+0000 7fcc457fa640 1 -- 172.21.15.120:0/405355144 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd54022410 con 0x5644a3ef1b70 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 -- 172.21.15.120:0/405355144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 msgr2=0x5644a3ef1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/405355144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef1f70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcd54053170 tx=0x7fcd540206e0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 -- 172.21.15.120:0/405355144 shutdown_connections 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/405355144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef1f70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 -- 172.21.15.120:0/405355144 >> 172.21.15.120:0/405355144 conn(0x5644a3eedf70 msgr2=0x5644a3eec1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 -- 172.21.15.120:0/405355144 shutdown_connections 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 -- 172.21.15.120:0/405355144 wait complete. 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 Processor -- start 2024-09-07T03:32:32.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 -- start start 2024-09-07T03:32:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd63e0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5644a3ef2b80 con 0x5644a3ef1b70 2024-09-07T03:32:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd620fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd620fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41078/0 (socket says 172.21.15.120:41078) 2024-09-07T03:32:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.892+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 learned_addr learned my addr 172.21.15.120:0/2926300607 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.893+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a3ef96f0 con 0x5644a3ef1b70 2024-09-07T03:32:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.893+0000 7fcd620fa640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef9190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd54051ff0 tx=0x7fcd54053100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.893+0000 7fcc337fe640 1 -- 172.21.15.120:0/2926300607 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd5404a070 con 0x5644a3ef1b70 2024-09-07T03:32:32.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.893+0000 7fcc337fe640 1 -- 172.21.15.120:0/2926300607 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd54032020 con 0x5644a3ef1b70 2024-09-07T03:32:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.893+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644a3ef9980 con 0x5644a3ef1b70 2024-09-07T03:32:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.893+0000 7fcc337fe640 1 -- 172.21.15.120:0/2926300607 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd54022410 con 0x5644a3ef1b70 2024-09-07T03:32:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.893+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a3efa300 con 0x5644a3ef1b70 2024-09-07T03:32:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.894+0000 7fcc337fe640 1 -- 172.21.15.120:0/2926300607 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcd54041040 con 0x5644a3ef1b70 2024-09-07T03:32:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.894+0000 7fcc337fe640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc2c03c6e0 0x7fcc2c03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.894+0000 7fcc337fe640 1 -- 172.21.15.120:0/2926300607 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fcd54033030 con 0x5644a3ef1b70 2024-09-07T03:32:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.894+0000 7fcd618f9640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc2c03c6e0 0x7fcc2c03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.894+0000 7fcd618f9640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc2c03c6e0 0x7fcc2c03eba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c053be0 tx=0x7fcd5c033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3f04ce0 0x5644a3f071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f078f0 con 0x5644a3f04ce0 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd610f8640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3f04ce0 0x5644a3f071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd610f8640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3f04ce0 0x5644a3f071a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd63e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd63e0f800 20 realm 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.895+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f07d20 con 0x5644a3f04ce0 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd63e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd63e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f085f0 con 0x5644a3f04ce0 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd63e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3f09010 0x5644a3f0b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f0bbb0 con 0x5644a3f09010 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd620fa640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3f09010 0x5644a3f0b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.896+0000 7fcd620fa640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3f09010 0x5644a3f0b440 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd63e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f0c400 con 0x5644a3f09010 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd63e0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd63e0f800 20 searching for the correct realm 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5644a3f0e170 0x5644a3f105a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f0e170 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd618f9640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5644a3f0e170 0x5644a3f105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd618f9640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5644a3f0e170 0x5644a3f105a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.897+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f09010 2024-09-07T03:32:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.898+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.898+0000 7fcd620fa640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcd54045050 0x7fcd540489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.898+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x7fcd54045050 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.898+0000 7fcd610f8640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcd54045050 0x7fcd540489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.898+0000 7fcd610f8640 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcd54045050 0x7fcd540489d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.898+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.898+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.899+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.899+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.899+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.899+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f0e170 2024-09-07T03:32:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.899+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.899+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.899+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.899+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f09010 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f09010 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x7fcd54045050 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.900+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x7fcd54045050 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.901+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.901+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f09010 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.901+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.901+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f0e170 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.902+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.902+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.902+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.902+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f09010 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.902+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.902+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f0e170 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.902+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.902+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.903+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.903+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.903+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.903+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.903+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.903+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f0e170 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.903+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.903+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x7fcd54045050 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.903+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.904+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f04ce0 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.904+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.904+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x7fcd54045050 2024-09-07T03:32:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.904+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.904+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f0e170 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.904+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.904+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x7fcd54045050 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.904+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.904+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f09010 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.905+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.905+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f09010 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.905+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.905+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f0e170 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.905+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.905+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f09010 2024-09-07T03:32:32.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.905+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.905+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f10c70 con 0x5644a3f09010 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f0cdb0 con 0x5644a3f04ce0 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f0c9f0 con 0x5644a3f09010 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f0d6d0 con 0x5644a3f04ce0 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.906+0000 7fcd63e0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 zone default found 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 4 Realm: () 2024-09-07T03:32:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 zonegroup default 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f110f0 con 0x7fcd54045050 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f13330 con 0x5644a3f0e170 2024-09-07T03:32:32.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f136d0 con 0x5644a3f0e170 2024-09-07T03:32:32.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 started sync module instance, tier type = 2024-09-07T03:32:32.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:32.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.907+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f127c0 con 0x5644a3f09010 2024-09-07T03:32:32.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.909+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.909+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94852808256704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f127c0 con 0x5644a3f09010 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.909+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f14250 con 0x5644a3f04ce0 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.910+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94852808256704] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.910+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.910+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94852808254224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f12730 con 0x5644a3f04ce0 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.910+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f15110 con 0x5644a3f09010 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.911+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94852808254224] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.911+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.911+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94852808263232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f15110 con 0x5644a3f09010 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.911+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f15b10 con 0x7fcd54045050 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.913+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94852808263232] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.916+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.916+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94852808267296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f15110 con 0x7fcd54045050 2024-09-07T03:32:32.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.916+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f16520 con 0x5644a3f09010 2024-09-07T03:32:32.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.918+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94852808267296] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.921+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.922+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94852808270416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f15110 con 0x5644a3f09010 2024-09-07T03:32:32.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.922+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f16f60 con 0x5644a3f0e170 2024-09-07T03:32:32.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.924+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.924+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94852808272560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f17800 con 0x5644a3f0e170 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.924+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f18280 con 0x5644a3f0e170 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.924+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94852808270416] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.926+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.926+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94852808272560] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.927+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94852808277360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f18240 con 0x5644a3f0e170 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.927+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f18b20 con 0x7fcd54045050 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94852808277360] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94852808274768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f18240 con 0x7fcd54045050 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 20 add_watcher() i=0 2024-09-07T03:32:32.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 20 add_watcher() i=1 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 20 add_watcher() i=2 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 20 add_watcher() i=3 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 20 add_watcher() i=4 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 20 add_watcher() i=5 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 20 add_watcher() i=6 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94852808274768] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 20 add_watcher() i=7 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.928+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f1bc90 con 0x5644a3f04ce0 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.929+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.929+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94852808279664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f191e0 con 0x5644a3f04ce0 2024-09-07T03:32:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.930+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94852808279664] v34'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.930+0000 7fcc137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.930+0000 7fcd63e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.930+0000 7fcd63e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.930+0000 7fcd63e0f800 5 note: GC not initialized 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.930+0000 7fcc127fc640 20 reqs_thread_entry: start 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 20 Filter name: none 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcb83fff640 20 reqs_thread_entry: start 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f4ed00 con 0x7fcd54045050 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.931+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f4d3c0 con 0x5644a3f04ce0 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 20 rados_obj.operate() r=0 bl.length=7 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f4d7b0 con 0x5644a3f04ce0 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.932+0000 7fcd63e0f800 20 get_user_info_from_index found 0 xattrs 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.933+0000 7fcc137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.933+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94852808279664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f00b70 con 0x5644a3f04ce0 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.934+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94852808279664] v34'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.934+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94852808256704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f18670 con 0x5644a3f09010 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.935+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94852808256704] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.935+0000 7fcd63e0f800 20 remove_watcher() i=0 2024-09-07T03:32:32.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.935+0000 7fcd63e0f800 2 removed watcher, disabling cache 2024-09-07T03:32:32.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.935+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94852808254224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f12cc0 con 0x5644a3f04ce0 2024-09-07T03:32:32.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.936+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94852808254224] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x5644a3f04ce0 2024-09-07T03:32:32.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.936+0000 7fcd63e0f800 20 remove_watcher() i=1 2024-09-07T03:32:32.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.936+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94852808263232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f12cc0 con 0x5644a3f09010 2024-09-07T03:32:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.939+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94852808263232] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.939+0000 7fcd63e0f800 20 remove_watcher() i=2 2024-09-07T03:32:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.939+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94852808267296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f14640 con 0x7fcd54045050 2024-09-07T03:32:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.944+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94852808267296] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.944+0000 7fcd63e0f800 20 remove_watcher() i=3 2024-09-07T03:32:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.944+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94852808270416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f12cc0 con 0x5644a3f09010 2024-09-07T03:32:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.946+0000 7fcd620fa640 1 -- 172.21.15.120:0/2926300607 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94852808270416] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd540083e0 con 0x5644a3f09010 2024-09-07T03:32:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.946+0000 7fcd63e0f800 20 remove_watcher() i=4 2024-09-07T03:32:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.946+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94852808272560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f15620 con 0x5644a3f0e170 2024-09-07T03:32:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.946+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94852808272560] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.946+0000 7fcd63e0f800 20 remove_watcher() i=5 2024-09-07T03:32:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.946+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94852808277360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f16250 con 0x5644a3f0e170 2024-09-07T03:32:32.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.948+0000 7fcd618f9640 1 -- 172.21.15.120:0/2926300607 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94852808277360] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5c01b070 con 0x5644a3f0e170 2024-09-07T03:32:32.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.948+0000 7fcd63e0f800 20 remove_watcher() i=6 2024-09-07T03:32:32.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.948+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94852808274768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5644a3f12cc0 con 0x7fcd54045050 2024-09-07T03:32:32.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94852808274768] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4c057030 con 0x7fcd54045050 2024-09-07T03:32:32.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 20 remove_watcher() i=7 2024-09-07T03:32:32.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3f09010 msgr2=0x5644a3f0b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3f09010 0x5644a3f0b440 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3f04ce0 msgr2=0x5644a3f071a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3f04ce0 0x5644a3f071a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcd54045050 msgr2=0x7fcd540489d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcd54045050 0x7fcd540489d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5644a3f0e170 msgr2=0x5644a3f105a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5644a3f0e170 0x5644a3f105a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc2c03c6e0 msgr2=0x7fcc2c03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc2c03c6e0 0x7fcc2c03eba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c053be0 tx=0x7fcd5c033000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 msgr2=0x5644a3ef9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef9190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd54051ff0 tx=0x7fcd54053100 comp rx=0 tx=0).stop 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd610f8640 1 -- 172.21.15.120:0/2926300607 reap_dead start 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 shutdown_connections 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/2926300607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ef1b70 0x5644a3ef9190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 >> 172.21.15.120:0/2926300607 conn(0x5644a3eedf70 msgr2=0x5644a3eec180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 shutdown_connections 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.949+0000 7fcd63e0f800 1 -- 172.21.15.120:0/2926300607 wait complete. 2024-09-07T03:32:32.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/707304024 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc3c03c780 msgr2=0x7fcc3c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/707304024 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc3c03c780 0x7fcc3c03ec40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5644a3ed2020 tx=0x7fcd5c051e70 comp rx=0 tx=0).stop 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/707304024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ee5070 msgr2=0x5644a3ee5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/707304024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ee5070 0x5644a3ee5490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400aa90 tx=0x7fcd5400af50 comp rx=0 tx=0).stop 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/707304024 shutdown_connections 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/707304024 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc3c03c780 0x7fcc3c03ec40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/707304024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3ee5070 0x5644a3ee5490 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/707304024 >> 172.21.15.120:0/707304024 conn(0x5644a3ed9420 msgr2=0x5644a3ed9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/707304024 shutdown_connections 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/707304024 wait complete. 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3ed2860 msgr2=0x5644a3ed4c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3ed2860 0x5644a3ed4c50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3dd1220 msgr2=0x5644a3ed1530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3dd1220 0x5644a3ed1530 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc4803c780 msgr2=0x7fcc4803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc4803c780 0x7fcc4803ec40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c057000 tx=0x7fcd4c052000 comp rx=0 tx=0).stop 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 msgr2=0x5644a3ec0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3ec0940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c000f80 tx=0x7fcd5c001250 comp rx=0 tx=0).stop 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 shutdown_connections 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5644a3ed2860 0x5644a3ed4c50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5644a3dd1220 0x5644a3ed1530 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcc4803c780 0x7fcc4803ec40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 --2- 172.21.15.120:0/3976206025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5644a3dcfe10 0x5644a3ec0940 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 >> 172.21.15.120:0/3976206025 conn(0x5644a3dcb1e0 msgr2=0x5644a3eb96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:32.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 shutdown_connections 2024-09-07T03:32:32.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:32.950+0000 7fcd63e0f800 1 -- 172.21.15.120:0/3976206025 wait complete. 2024-09-07T03:32:32.959 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-07T03:32:32.960 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-07T03:32:32.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-07T03:32:32.960 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-07T03:32:33.004 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:33.004 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:33.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.004+0000 7faf97098800 1 Processor -- start 2024-09-07T03:32:33.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.004+0000 7faf97098800 1 -- start start 2024-09-07T03:32:33.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.004+0000 7faf97098800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d8ca69e1f0 0x55d8ca6a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.004+0000 7faf97098800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8ca543e40 con 0x55d8ca69a5f0 2024-09-07T03:32:33.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.004+0000 7faf97098800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d8ca50e680 con 0x55d8ca69e1f0 2024-09-07T03:32:33.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.004+0000 7faf94381640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d8ca69e1f0 0x55d8ca6a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.004+0000 7faf94b82640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55d8ca69a5f0 0x55d8ca69c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48248/0 (socket says 172.21.15.120:48248) 2024-09-07T03:32:33.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.004+0000 7faf94b82640 1 -- 172.21.15.120:0/2148330347 learned_addr learned my addr 172.21.15.120:0/2148330347 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:33.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.004+0000 7faf94381640 1 -- 172.21.15.120:0/2148330347 >> v1:172.21.15.104:6789/0 conn(0x55d8ca69a5f0 legacy=0x55d8ca69c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.005+0000 7faf93b80640 1 -- 172.21.15.120:0/2148330347 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190324022 0 0) 0x55d8ca543e40 con 0x55d8ca69a5f0 2024-09-07T03:32:33.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.005+0000 7faf94381640 1 -- 172.21.15.120:0/2148330347 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ca52a6b0 con 0x55d8ca69e1f0 2024-09-07T03:32:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.006+0000 7faf94381640 1 --2- 172.21.15.120:0/2148330347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69e1f0 0x55d8ca6a06b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00a470 tx=0x7faf7c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a796409a54813a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.006+0000 7faf93b80640 1 -- 172.21.15.120:0/2148330347 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf7c053570 con 0x55d8ca69e1f0 2024-09-07T03:32:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.006+0000 7faf93b80640 1 -- 172.21.15.120:0/2148330347 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c058070 con 0x55d8ca69e1f0 2024-09-07T03:32:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.007+0000 7faf93b80640 1 -- 172.21.15.120:0/2148330347 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf7c053880 con 0x55d8ca69e1f0 2024-09-07T03:32:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.007+0000 7faf97098800 1 -- 172.21.15.120:0/2148330347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69e1f0 msgr2=0x55d8ca6a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.007+0000 7faf97098800 1 --2- 172.21.15.120:0/2148330347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69e1f0 0x55d8ca6a06b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00a470 tx=0x7faf7c045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.007+0000 7faf97098800 1 -- 172.21.15.120:0/2148330347 shutdown_connections 2024-09-07T03:32:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.007+0000 7faf97098800 1 --2- 172.21.15.120:0/2148330347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69e1f0 0x55d8ca6a06b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.007+0000 7faf97098800 1 -- 172.21.15.120:0/2148330347 >> 172.21.15.120:0/2148330347 conn(0x55d8ca6941b0 msgr2=0x55d8ca696610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.007+0000 7faf97098800 1 -- 172.21.15.120:0/2148330347 shutdown_connections 2024-09-07T03:32:33.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.007+0000 7faf97098800 1 -- 172.21.15.120:0/2148330347 wait complete. 2024-09-07T03:32:33.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.021+0000 7faf97098800 1 Processor -- start 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.021+0000 7faf97098800 1 -- start start 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.021+0000 7faf97098800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca699d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.021+0000 7faf97098800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8ca532dd0 con 0x55d8ca69a5f0 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.022+0000 7faf94b82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca699d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.022+0000 7faf94b82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca699d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41098/0 (socket says 172.21.15.120:41098) 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.022+0000 7faf94b82640 1 -- 172.21.15.120:0/61006410 learned_addr learned my addr 172.21.15.120:0/61006410 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.022+0000 7faf94b82640 1 -- 172.21.15.120:0/61006410 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ca54be10 con 0x55d8ca69a5f0 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.022+0000 7faf94b82640 1 --2- 172.21.15.120:0/61006410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca699d60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf8c001ea0 tx=0x7faf8c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a098957a80a7a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.022+0000 7fae82e0d640 1 -- 172.21.15.120:0/61006410 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf8c008070 con 0x55d8ca69a5f0 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.022+0000 7fae82e0d640 1 -- 172.21.15.120:0/61006410 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c00d500 con 0x55d8ca69a5f0 2024-09-07T03:32:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.022+0000 7fae82e0d640 1 -- 172.21.15.120:0/61006410 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf8c00d880 con 0x55d8ca69a5f0 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.023+0000 7faf97098800 1 -- 172.21.15.120:0/61006410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 msgr2=0x55d8ca699d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.023+0000 7faf97098800 1 --2- 172.21.15.120:0/61006410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca699d60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf8c001ea0 tx=0x7faf8c00b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.023+0000 7faf97098800 1 -- 172.21.15.120:0/61006410 shutdown_connections 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.023+0000 7faf97098800 1 --2- 172.21.15.120:0/61006410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca699d60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.023+0000 7faf97098800 1 -- 172.21.15.120:0/61006410 >> 172.21.15.120:0/61006410 conn(0x55d8ca6941b0 msgr2=0x55d8ca784e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.023+0000 7faf97098800 1 -- 172.21.15.120:0/61006410 shutdown_connections 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.023+0000 7faf97098800 1 -- 172.21.15.120:0/61006410 wait complete. 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.023+0000 7faf97098800 1 Processor -- start 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.023+0000 7faf97098800 1 -- start start 2024-09-07T03:32:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7faf97098800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca793000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7faf97098800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8ca6a1030 con 0x55d8ca69a5f0 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7faf94b82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca793000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7faf94b82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca793000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41100/0 (socket says 172.21.15.120:41100) 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7faf94b82640 1 -- 172.21.15.120:0/2256971724 learned_addr learned my addr 172.21.15.120:0/2256971724 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7faf94b82640 1 -- 172.21.15.120:0/2256971724 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ca793560 con 0x55d8ca69a5f0 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7faf94b82640 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca793000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0012f0 tx=0x7faf8c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7fae8160a640 1 -- 172.21.15.120:0/2256971724 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf8c00f9d0 con 0x55d8ca69a5f0 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7fae8160a640 1 -- 172.21.15.120:0/2256971724 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c00fb70 con 0x55d8ca69a5f0 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8ca7937f0 con 0x55d8ca69a5f0 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.024+0000 7fae8160a640 1 -- 172.21.15.120:0/2256971724 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf8c00fe50 con 0x55d8ca69a5f0 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.025+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ca7941f0 con 0x55d8ca69a5f0 2024-09-07T03:32:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.025+0000 7fae8160a640 1 -- 172.21.15.120:0/2256971724 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faf8c017040 con 0x55d8ca69a5f0 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7fae8160a640 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae7c03c8d0 0x7fae7c03ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7fae8160a640 1 -- 172.21.15.120:0/2256971724 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7faf8c015020 con 0x55d8ca69a5f0 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7faf94381640 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae7c03c8d0 0x7fae7c03ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca69e1f0 0x55d8ca79a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca79ab90 con 0x55d8ca69e1f0 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7faf95383640 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca69e1f0 0x55d8ca79a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7faf94381640 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae7c03c8d0 0x7fae7c03ed90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf7c057000 tx=0x7faf7c052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7faf95383640 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca69e1f0 0x55d8ca79a650 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7faf95383640 1 -- 172.21.15.120:0/2256971724 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf8400a4d0 con 0x55d8ca69e1f0 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca79b440 0x55d8ca79d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.026+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca79e070 con 0x55d8ca79b440 2024-09-07T03:32:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.027+0000 7faf94b82640 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca79b440 0x55d8ca79d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.027+0000 7faf94b82640 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca79b440 0x55d8ca79d900 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.027+0000 7faf94b82640 1 -- 172.21.15.120:0/2256971724 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca79b440 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.027+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca79f920 con 0x55d8ca79b440 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.027+0000 7faf94b82640 1 -- 172.21.15.120:0/2256971724 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca79b440 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.027+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca79ea30 con 0x55d8ca79b440 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.028+0000 7faf94b82640 1 -- 172.21.15.120:0/2256971724 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca79b440 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.028+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca79ee90 con 0x55d8ca69e1f0 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.028+0000 7faf95383640 1 -- 172.21.15.120:0/2256971724 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faf8400a4d0 con 0x55d8ca69e1f0 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.028+0000 7faf97098800 1 Processor -- start 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.028+0000 7faf97098800 1 -- start start 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.028+0000 7faf97098800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7addc0 0x55d8ca7ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.028+0000 7faf97098800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8ca590a00 con 0x55d8ca7addc0 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7faf95383640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7addc0 0x55d8ca7ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7faf95383640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7addc0 0x55d8ca7ae1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41112/0 (socket says 172.21.15.120:41112) 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7faf95383640 1 -- 172.21.15.120:0/353191650 learned_addr learned my addr 172.21.15.120:0/353191650 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7faf95383640 1 -- 172.21.15.120:0/353191650 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ca7ae820 con 0x55d8ca7addc0 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7faf95383640 1 --2- 172.21.15.120:0/353191650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7addc0 0x55d8ca7ae1e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf84016d20 tx=0x7faf8400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7fae7a7fc640 1 -- 172.21.15.120:0/353191650 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf84017660 con 0x55d8ca7addc0 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7fae7a7fc640 1 -- 172.21.15.120:0/353191650 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8401b030 con 0x55d8ca7addc0 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7faf97098800 1 -- 172.21.15.120:0/353191650 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8ca7af050 con 0x55d8ca7addc0 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7fae7a7fc640 1 -- 172.21.15.120:0/353191650 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf84017950 con 0x55d8ca7addc0 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.029+0000 7faf97098800 1 -- 172.21.15.120:0/353191650 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ca7af5f0 con 0x55d8ca7addc0 2024-09-07T03:32:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.030+0000 7fae7a7fc640 1 -- 172.21.15.120:0/353191650 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faf84017af0 con 0x55d8ca7addc0 2024-09-07T03:32:33.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.030+0000 7fae7a7fc640 1 --2- 172.21.15.120:0/353191650 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6c03c780 0x7fae6c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.030+0000 7fae7a7fc640 1 -- 172.21.15.120:0/353191650 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7faf8400e040 con 0x55d8ca7addc0 2024-09-07T03:32:33.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf94b82640 1 --2- 172.21.15.120:0/353191650 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6c03c780 0x7fae6c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf97098800 1 Processor -- start 2024-09-07T03:32:33.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf94b82640 1 --2- 172.21.15.120:0/353191650 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6c03c780 0x7fae6c03ec40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55d8ca79e010 tx=0x7faf8c052690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf97098800 1 -- start start 2024-09-07T03:32:33.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf97098800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf97098800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8ca698600 con 0x55d8ca7ba860 2024-09-07T03:32:33.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf95383640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf95383640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41120/0 (socket says 172.21.15.120:41120) 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf95383640 1 -- 172.21.15.120:0/2016040877 learned_addr learned my addr 172.21.15.120:0/2016040877 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.031+0000 7faf95383640 1 -- 172.21.15.120:0/2016040877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ca7bb250 con 0x55d8ca7ba860 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf95383640 1 --2- 172.21.15.120:0/2016040877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7bac60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf84054030 tx=0x7faf84054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94761a29d98971f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7fae6bfff640 1 -- 172.21.15.120:0/2016040877 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf84014d40 con 0x55d8ca7ba860 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7fae6bfff640 1 -- 172.21.15.120:0/2016040877 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf840149b0 con 0x55d8ca7ba860 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7fae6bfff640 1 -- 172.21.15.120:0/2016040877 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf84028350 con 0x55d8ca7ba860 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf97098800 1 -- 172.21.15.120:0/2016040877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 msgr2=0x55d8ca7bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf97098800 1 --2- 172.21.15.120:0/2016040877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7bac60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf84054030 tx=0x7faf84054060 comp rx=0 tx=0).stop 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf97098800 1 -- 172.21.15.120:0/2016040877 shutdown_connections 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf97098800 1 --2- 172.21.15.120:0/2016040877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7bac60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf97098800 1 -- 172.21.15.120:0/2016040877 >> 172.21.15.120:0/2016040877 conn(0x55d8ca7b6c60 msgr2=0x55d8ca7b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf97098800 1 -- 172.21.15.120:0/2016040877 shutdown_connections 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf97098800 1 -- 172.21.15.120:0/2016040877 wait complete. 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf97098800 1 Processor -- start 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.032+0000 7faf97098800 1 -- start start 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7faf97098800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7faf97098800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d8ca7bb840 con 0x55d8ca7ba860 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7faf95383640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7faf95383640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7c1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41136/0 (socket says 172.21.15.120:41136) 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 learned_addr learned my addr 172.21.15.120:0/1479309660 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8ca7c23b0 con 0x55d8ca7ba860 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7faf95383640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7c1e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf84053d10 tx=0x7faf84053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7fae6a7fc640 1 -- 172.21.15.120:0/1479309660 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf84012570 con 0x55d8ca7ba860 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7fae6a7fc640 1 -- 172.21.15.120:0/1479309660 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf84005500 con 0x55d8ca7ba860 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8ca7c2640 con 0x55d8ca7ba860 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7fae6a7fc640 1 -- 172.21.15.120:0/1479309660 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf84055570 con 0x55d8ca7ba860 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.033+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8ca7c31d0 con 0x55d8ca7ba860 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.034+0000 7fae6a7fc640 1 -- 172.21.15.120:0/1479309660 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faf840127a0 con 0x55d8ca7ba860 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.034+0000 7fae6a7fc640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6003c730 0x7fae6003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.034+0000 7fae6a7fc640 1 -- 172.21.15.120:0/1479309660 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7faf84048920 con 0x55d8ca7ba860 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.034+0000 7faf94b82640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6003c730 0x7fae6003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.034+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf97098800 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca7cd980 0x55d8ca7cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d0590 con 0x55d8ca7cd980 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf94381640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca7cd980 0x55d8ca7cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf94b82640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6003c730 0x7fae6003ebf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf8c054480 tx=0x7faf8c048000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf94381640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca7cd980 0x55d8ca7cfe40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf97098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf97098800 20 realm 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d09c0 con 0x55d8ca7cd980 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf97098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.035+0000 7faf97098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d1290 con 0x55d8ca7cd980 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf97098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf97098800 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca7d1cb0 0x55d8ca7d40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d4810 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf95383640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca7d1cb0 0x55d8ca7d40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf95383640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca7d1cb0 0x55d8ca7d40a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf97098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.036+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d50b0 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.037+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.037+0000 7faf97098800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.037+0000 7faf97098800 20 searching for the correct realm 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.037+0000 7faf97098800 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d8ca7d6e20 0x55d8ca7d9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.037+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d6e20 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.037+0000 7faf94b82640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d8ca7d6e20 0x55d8ca7d9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.037+0000 7faf94b82640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d8ca7d6e20 0x55d8ca7d9230 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.037+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.037+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.038+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.038+0000 7faf95383640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faf84014440 0x7faf8403bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.038+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x7faf84014440 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.038+0000 7faf94381640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faf84014440 0x7faf8403bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.038+0000 7faf94381640 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faf84014440 0x7faf8403bab0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.038+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.038+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.038+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.038+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.039+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.039+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d6e20 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.039+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.039+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.039+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.039+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x7faf84014440 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.040+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x7faf84014440 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.041+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.041+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.041+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.041+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d6e20 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.041+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.041+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.041+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.041+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.042+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.042+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d6e20 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.042+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.042+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.042+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.042+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.042+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.042+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.043+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.043+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d6e20 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.043+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.043+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x7faf84014440 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.043+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.043+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7cd980 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.043+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.043+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x7faf84014440 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d6e20 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x7faf84014440 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.044+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d6e20 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9900 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d5a00 con 0x55d8ca7cd980 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.045+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d5df0 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d6250 con 0x55d8ca7cd980 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 20 zone default found 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 4 Realm: () 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 20 zonegroup default 2024-09-07T03:32:33.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7d9dd0 con 0x7faf84014440 2024-09-07T03:32:33.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.046+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7dc090 con 0x55d8ca7d6e20 2024-09-07T03:32:33.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.047+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.047+0000 7faf97098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.047+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.047+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7dc460 con 0x55d8ca7d6e20 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.047+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.047+0000 7faf97098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.047+0000 7faf97098800 20 started sync module instance, tier type = 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.047+0000 7faf97098800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.047+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7db520 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.048+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.048+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94389598533904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7db180 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.048+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7dd370 con 0x55d8ca7cd980 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.049+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.049+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94389598539456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7ddbc0 con 0x55d8ca7cd980 2024-09-07T03:32:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.049+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7de6b0 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.049+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94389598533904] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.050+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94389598539456] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.050+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.050+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94389598544256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7dd710 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.050+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7def80 con 0x7faf84014440 2024-09-07T03:32:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.051+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.051+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94389598546640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7df3a0 con 0x7faf84014440 2024-09-07T03:32:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.051+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7dfbf0 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.052+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94389598544256] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.053+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94389598546640] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.053+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.053+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94389598547696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7df7c0 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.053+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e0490 con 0x55d8ca7d6e20 2024-09-07T03:32:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.054+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.054+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94389598552032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7df7c0 con 0x55d8ca7d6e20 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.054+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e13c0 con 0x55d8ca7d6e20 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.054+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94389598547696] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.055+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.055+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94389598555824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e17b0 con 0x55d8ca7d6e20 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.055+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e21f0 con 0x7faf84014440 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.055+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94389598552032] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94389598555824] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94389598548752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e21b0 con 0x7faf84014440 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf97098800 20 add_watcher() i=0 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf97098800 20 add_watcher() i=1 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf97098800 20 add_watcher() i=2 2024-09-07T03:32:33.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf97098800 20 add_watcher() i=3 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf97098800 20 add_watcher() i=4 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf97098800 20 add_watcher() i=5 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.056+0000 7faf97098800 20 add_watcher() i=6 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.057+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94389598548752] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.057+0000 7faf97098800 20 add_watcher() i=7 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.057+0000 7faf97098800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.057+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e0830 con 0x55d8ca7cd980 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.058+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.058+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94389598559424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e0830 con 0x55d8ca7cd980 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.059+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94389598559424] v34'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.059+0000 7fae4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.059+0000 7faf97098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.059+0000 7faf97098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.059+0000 7faf97098800 5 note: GC not initialized 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.059+0000 7fae4a7e4640 20 reqs_thread_entry: start 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.059+0000 7faf97098800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.059+0000 7faf97098800 20 Filter name: none 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.059+0000 7fae437fe640 20 reqs_thread_entry: start 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.060+0000 7faf97098800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.060+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca817d10 con 0x55d8ca7cd980 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.060+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.060+0000 7faf97098800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:33.082 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.061+0000 7fae4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.061+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94389598559424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca816ba0 con 0x55d8ca7cd980 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.062+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94389598559424] v34'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.062+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94389598533904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e1cc0 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.063+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94389598533904] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.063+0000 7faf97098800 20 remove_watcher() i=0 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.063+0000 7faf97098800 2 removed watcher, disabling cache 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.063+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94389598539456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e1cc0 con 0x55d8ca7cd980 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.063+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94389598539456] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x55d8ca7cd980 2024-09-07T03:32:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.064+0000 7faf97098800 20 remove_watcher() i=1 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.064+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94389598544256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e1cc0 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.066+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94389598544256] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.066+0000 7faf97098800 20 remove_watcher() i=2 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.066+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94389598546640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7de180 con 0x7faf84014440 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.067+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94389598546640] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.067+0000 7faf97098800 20 remove_watcher() i=3 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.067+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94389598547696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e1cc0 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.068+0000 7faf95383640 1 -- 172.21.15.120:0/1479309660 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94389598547696] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf84027070 con 0x55d8ca7d1cb0 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.068+0000 7faf97098800 20 remove_watcher() i=4 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.068+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94389598552032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7de180 con 0x55d8ca7d6e20 2024-09-07T03:32:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.069+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94389598552032] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.069+0000 7faf97098800 20 remove_watcher() i=5 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.069+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94389598555824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7e1cc0 con 0x55d8ca7d6e20 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.070+0000 7faf94b82640 1 -- 172.21.15.120:0/1479309660 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94389598555824] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf8c02d070 con 0x55d8ca7d6e20 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.070+0000 7faf97098800 20 remove_watcher() i=6 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.070+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94389598548752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8ca7dffe0 con 0x7faf84014440 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94389598548752] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf7c051070 con 0x7faf84014440 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 20 remove_watcher() i=7 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca7d1cb0 msgr2=0x55d8ca7d40a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca7d1cb0 0x55d8ca7d40a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca7cd980 msgr2=0x55d8ca7cfe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca7cd980 0x55d8ca7cfe40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faf84014440 msgr2=0x7faf8403bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faf84014440 0x7faf8403bab0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d8ca7d6e20 msgr2=0x55d8ca7d9230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d8ca7d6e20 0x55d8ca7d9230 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6003c730 msgr2=0x7fae6003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6003c730 0x7fae6003ebf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf8c054480 tx=0x7faf8c048000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 msgr2=0x55d8ca7c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/1479309660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7ba860 0x55d8ca7c1e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf84053d10 tx=0x7faf84053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 reap_dead start 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf94381640 1 -- 172.21.15.120:0/1479309660 reap_dead start 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 shutdown_connections 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 >> 172.21.15.120:0/1479309660 conn(0x55d8ca7b6c60 msgr2=0x55d8ca7b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 shutdown_connections 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/1479309660 wait complete. 2024-09-07T03:32:33.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/353191650 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6c03c780 msgr2=0x7fae6c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/353191650 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6c03c780 0x7fae6c03ec40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55d8ca79e010 tx=0x7faf8c052690 comp rx=0 tx=0).stop 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/353191650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7addc0 msgr2=0x55d8ca7ae1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/353191650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7addc0 0x55d8ca7ae1e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf84016d20 tx=0x7faf8400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/353191650 shutdown_connections 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/353191650 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae6c03c780 0x7fae6c03ec40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 --2- 172.21.15.120:0/353191650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca7addc0 0x55d8ca7ae1e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.071+0000 7faf97098800 1 -- 172.21.15.120:0/353191650 >> 172.21.15.120:0/353191650 conn(0x55d8ca7a2170 msgr2=0x55d8ca7a2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/353191650 shutdown_connections 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/353191650 wait complete. 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca79b440 msgr2=0x55d8ca79d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca79b440 0x55d8ca79d900 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca69e1f0 msgr2=0x55d8ca79a650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca69e1f0 0x55d8ca79a650 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae7c03c8d0 msgr2=0x7fae7c03ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae7c03c8d0 0x7fae7c03ed90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf7c057000 tx=0x7faf7c052000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 msgr2=0x55d8ca793000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca793000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0012f0 tx=0x7faf8c000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 shutdown_connections 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d8ca79b440 0x55d8ca79d900 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d8ca69e1f0 0x55d8ca79a650 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fae7c03c8d0 0x7fae7c03ed90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 --2- 172.21.15.120:0/2256971724 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d8ca69a5f0 0x55d8ca793000 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 >> 172.21.15.120:0/2256971724 conn(0x55d8ca6941b0 msgr2=0x55d8ca7849a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 shutdown_connections 2024-09-07T03:32:33.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.072+0000 7faf97098800 1 -- 172.21.15.120:0/2256971724 wait complete. 2024-09-07T03:32:33.092 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:33.093 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-07T03:32:33.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-07T03:32:33.093 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-07T03:32:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.136+0000 7fb9ca726800 1 Processor -- start 2024-09-07T03:32:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.136+0000 7fb9ca726800 1 -- start start 2024-09-07T03:32:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.136+0000 7fb9ca726800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5600f7bce600 0x5600f7bd09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.137+0000 7fb9ca726800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5600f7a77e40 con 0x5600f7bd1020 2024-09-07T03:32:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.137+0000 7fb9ca726800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5600f7a42680 con 0x5600f7bce600 2024-09-07T03:32:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.137+0000 7fb9c63d9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5600f7bce600 0x5600f7bd09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.137+0000 7fb9bffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5600f7bd1020 0x5600f7bd34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48252/0 (socket says 172.21.15.120:48252) 2024-09-07T03:32:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.137+0000 7fb9bffff640 1 -- 172.21.15.120:0/1807882658 learned_addr learned my addr 172.21.15.120:0/1807882658 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.137+0000 7fb9c63d9640 1 -- 172.21.15.120:0/1807882658 >> v1:172.21.15.104:6789/0 conn(0x5600f7bd1020 legacy=0x5600f7bd34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.137+0000 7fb9c63d9640 1 -- 172.21.15.120:0/1807882658 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f7a5e6b0 con 0x5600f7bce600 2024-09-07T03:32:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.137+0000 7fb9c5bd8640 1 -- 172.21.15.120:0/1807882658 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885350922 0 0) 0x5600f7a77e40 con 0x5600f7bd1020 2024-09-07T03:32:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.139+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/1807882658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7bd09f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800a470 tx=0x7fb9b8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec767683f8e792d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.139+0000 7fb9c5bd8640 1 -- 172.21.15.120:0/1807882658 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9b8053570 con 0x5600f7bce600 2024-09-07T03:32:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.139+0000 7fb9c5bd8640 1 -- 172.21.15.120:0/1807882658 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b8058070 con 0x5600f7bce600 2024-09-07T03:32:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.139+0000 7fb9c5bd8640 1 -- 172.21.15.120:0/1807882658 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9b8053880 con 0x5600f7bce600 2024-09-07T03:32:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.139+0000 7fb9ca726800 1 -- 172.21.15.120:0/1807882658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 msgr2=0x5600f7bd09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.140+0000 7fb9ca726800 1 --2- 172.21.15.120:0/1807882658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7bd09f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800a470 tx=0x7fb9b8045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.140+0000 7fb9ca726800 1 -- 172.21.15.120:0/1807882658 shutdown_connections 2024-09-07T03:32:33.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.140+0000 7fb9ca726800 1 --2- 172.21.15.120:0/1807882658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7bd09f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.140+0000 7fb9ca726800 1 -- 172.21.15.120:0/1807882658 >> 172.21.15.120:0/1807882658 conn(0x5600f7bc81c0 msgr2=0x5600f7bca620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.140+0000 7fb9ca726800 1 -- 172.21.15.120:0/1807882658 shutdown_connections 2024-09-07T03:32:33.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.140+0000 7fb9ca726800 1 -- 172.21.15.120:0/1807882658 wait complete. 2024-09-07T03:32:33.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.153+0000 7fb9ca726800 1 Processor -- start 2024-09-07T03:32:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.153+0000 7fb9ca726800 1 -- start start 2024-09-07T03:32:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.153+0000 7fb9ca726800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7bcdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.153+0000 7fb9ca726800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5600f7a66dd0 con 0x5600f7bce600 2024-09-07T03:32:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.154+0000 7fb9c63d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7bcdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.154+0000 7fb9c63d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7bcdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41142/0 (socket says 172.21.15.120:41142) 2024-09-07T03:32:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.154+0000 7fb9c63d9640 1 -- 172.21.15.120:0/1670081758 learned_addr learned my addr 172.21.15.120:0/1670081758 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.154+0000 7fb9c63d9640 1 -- 172.21.15.120:0/1670081758 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f7a7fe10 con 0x5600f7bce600 2024-09-07T03:32:33.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.154+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/1670081758 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7bcdd70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8025c20 tx=0x7fb9b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623aa7f568e898d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.154+0000 7fb8b4608640 1 -- 172.21.15.120:0/1670081758 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9b8053a20 con 0x5600f7bce600 2024-09-07T03:32:33.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.154+0000 7fb8b4608640 1 -- 172.21.15.120:0/1670081758 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b8063070 con 0x5600f7bce600 2024-09-07T03:32:33.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.154+0000 7fb8b4608640 1 -- 172.21.15.120:0/1670081758 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9b8053d30 con 0x5600f7bce600 2024-09-07T03:32:33.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.155+0000 7fb9ca726800 1 -- 172.21.15.120:0/1670081758 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 msgr2=0x5600f7bcdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.155+0000 7fb9ca726800 1 --2- 172.21.15.120:0/1670081758 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7bcdd70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8025c20 tx=0x7fb9b8051000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.155+0000 7fb9ca726800 1 -- 172.21.15.120:0/1670081758 shutdown_connections 2024-09-07T03:32:33.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.155+0000 7fb9ca726800 1 --2- 172.21.15.120:0/1670081758 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7bcdd70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.155+0000 7fb9ca726800 1 -- 172.21.15.120:0/1670081758 >> 172.21.15.120:0/1670081758 conn(0x5600f7bc81c0 msgr2=0x5600f7cb8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.155+0000 7fb9ca726800 1 -- 172.21.15.120:0/1670081758 shutdown_connections 2024-09-07T03:32:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.155+0000 7fb9ca726800 1 -- 172.21.15.120:0/1670081758 wait complete. 2024-09-07T03:32:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.155+0000 7fb9ca726800 1 Processor -- start 2024-09-07T03:32:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.156+0000 7fb9ca726800 1 -- start start 2024-09-07T03:32:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.156+0000 7fb9ca726800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7cc6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.156+0000 7fb9ca726800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5600f7bd5040 con 0x5600f7bce600 2024-09-07T03:32:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.156+0000 7fb9c63d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7cc6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.156+0000 7fb9c63d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7cc6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41156/0 (socket says 172.21.15.120:41156) 2024-09-07T03:32:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.156+0000 7fb9c63d9640 1 -- 172.21.15.120:0/2999142322 learned_addr learned my addr 172.21.15.120:0/2999142322 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.156+0000 7fb9c63d9640 1 -- 172.21.15.120:0/2999142322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f7cc7460 con 0x5600f7bce600 2024-09-07T03:32:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.156+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7cc6f00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8025c20 tx=0x7fb9b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.157+0000 7fb8b2e05640 1 -- 172.21.15.120:0/2999142322 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9b8078070 con 0x5600f7bce600 2024-09-07T03:32:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.157+0000 7fb8b2e05640 1 -- 172.21.15.120:0/2999142322 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b8073470 con 0x5600f7bce600 2024-09-07T03:32:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.157+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600f7cc76f0 con 0x5600f7bce600 2024-09-07T03:32:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.157+0000 7fb8b2e05640 1 -- 172.21.15.120:0/2999142322 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9b8073750 con 0x5600f7bce600 2024-09-07T03:32:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.157+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600f7cc8300 con 0x5600f7bce600 2024-09-07T03:32:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.157+0000 7fb8b2e05640 1 -- 172.21.15.120:0/2999142322 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb9b807b070 con 0x5600f7bce600 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb8b2e05640 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8ac03c780 0x7fb8ac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb8b2e05640 1 -- 172.21.15.120:0/2999142322 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fb9b8097cb0 con 0x5600f7bce600 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb9bffff640 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8ac03c780 0x7fb8ac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7bd1020 0x5600f7cce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7cc8cc0 con 0x5600f7bd1020 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb9c6bda640 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7bd1020 0x5600f7cce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb9bffff640 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8ac03c780 0x7fb8ac03ec40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0000c00 tx=0x7fb9b00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb9c6bda640 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7bd1020 0x5600f7cce550 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb9c6bda640 1 -- 172.21.15.120:0/2999142322 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9c000a4d0 con 0x5600f7bd1020 2024-09-07T03:32:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7ccf450 0x5600f7cd1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.158+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7cd1e30 con 0x5600f7ccf450 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.159+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7ccf450 0x5600f7cd1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.159+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7ccf450 0x5600f7cd1840 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.159+0000 7fb9c63d9640 1 -- 172.21.15.120:0/2999142322 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7ccf450 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.159+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7cd36e0 con 0x5600f7ccf450 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.160+0000 7fb9c63d9640 1 -- 172.21.15.120:0/2999142322 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7ccf450 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.160+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7cd2850 con 0x5600f7ccf450 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.160+0000 7fb9c63d9640 1 -- 172.21.15.120:0/2999142322 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7ccf450 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.160+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7cd2c70 con 0x5600f7bd1020 2024-09-07T03:32:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.160+0000 7fb9c6bda640 1 -- 172.21.15.120:0/2999142322 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb9c000a4d0 con 0x5600f7bd1020 2024-09-07T03:32:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.160+0000 7fb9ca726800 1 Processor -- start 2024-09-07T03:32:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.160+0000 7fb9ca726800 1 -- start start 2024-09-07T03:32:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb9ca726800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7ce1bc0 0x5600f7ce1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb9ca726800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5600f7ac4a00 con 0x5600f7ce1bc0 2024-09-07T03:32:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb9c6bda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7ce1bc0 0x5600f7ce1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb9c6bda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7ce1bc0 0x5600f7ce1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41162/0 (socket says 172.21.15.120:41162) 2024-09-07T03:32:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb9c6bda640 1 -- 172.21.15.120:0/3079244452 learned_addr learned my addr 172.21.15.120:0/3079244452 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb9c6bda640 1 -- 172.21.15.120:0/3079244452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f7ce2620 con 0x5600f7ce1bc0 2024-09-07T03:32:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb9c6bda640 1 --2- 172.21.15.120:0/3079244452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7ce1bc0 0x5600f7ce1fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0016d20 tx=0x7fb9c000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb8abfff640 1 -- 172.21.15.120:0/3079244452 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0017660 con 0x5600f7ce1bc0 2024-09-07T03:32:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb8abfff640 1 -- 172.21.15.120:0/3079244452 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c001b030 con 0x5600f7ce1bc0 2024-09-07T03:32:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb9ca726800 1 -- 172.21.15.120:0/3079244452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600f7ce2e50 con 0x5600f7ce1bc0 2024-09-07T03:32:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb8abfff640 1 -- 172.21.15.120:0/3079244452 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0017950 con 0x5600f7ce1bc0 2024-09-07T03:32:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.161+0000 7fb9ca726800 1 -- 172.21.15.120:0/3079244452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600f7ce33f0 con 0x5600f7ce1bc0 2024-09-07T03:32:33.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.162+0000 7fb8abfff640 1 -- 172.21.15.120:0/3079244452 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb9c0017af0 con 0x5600f7ce1bc0 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.162+0000 7fb8abfff640 1 --2- 172.21.15.120:0/3079244452 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8a003c780 0x7fb8a003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.162+0000 7fb8abfff640 1 -- 172.21.15.120:0/3079244452 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fb9c000e040 con 0x5600f7ce1bc0 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.162+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/3079244452 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8a003c780 0x7fb8a003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.163+0000 7fb9ca726800 1 Processor -- start 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.163+0000 7fb9ca726800 1 -- start start 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.163+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/3079244452 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8a003c780 0x7fb8a003ec40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5600f7cd2370 tx=0x7fb9b808d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.163+0000 7fb9ca726800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7ceeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.163+0000 7fb9ca726800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5600f7bcc610 con 0x5600f7cee6c0 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.163+0000 7fb9c6bda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7ceeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.163+0000 7fb9c6bda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7ceeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41176/0 (socket says 172.21.15.120:41176) 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.163+0000 7fb9c6bda640 1 -- 172.21.15.120:0/3028998202 learned_addr learned my addr 172.21.15.120:0/3028998202 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.163+0000 7fb9c6bda640 1 -- 172.21.15.120:0/3028998202 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f7cef0b0 con 0x5600f7cee6c0 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9c6bda640 1 --2- 172.21.15.120:0/3028998202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7ceeac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0053e00 tx=0x7fb9c0017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dec3d0c8988b3b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb8a9ffb640 1 -- 172.21.15.120:0/3028998202 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0014d40 con 0x5600f7cee6c0 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb8a9ffb640 1 -- 172.21.15.120:0/3028998202 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c0051070 con 0x5600f7cee6c0 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb8a9ffb640 1 -- 172.21.15.120:0/3028998202 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c00149b0 con 0x5600f7cee6c0 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9ca726800 1 -- 172.21.15.120:0/3028998202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 msgr2=0x5600f7ceeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9ca726800 1 --2- 172.21.15.120:0/3028998202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7ceeac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0053e00 tx=0x7fb9c0017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9ca726800 1 -- 172.21.15.120:0/3028998202 shutdown_connections 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9ca726800 1 --2- 172.21.15.120:0/3028998202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7ceeac0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9ca726800 1 -- 172.21.15.120:0/3028998202 >> 172.21.15.120:0/3028998202 conn(0x5600f7ceaac0 msgr2=0x5600f7ce8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9ca726800 1 -- 172.21.15.120:0/3028998202 shutdown_connections 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9ca726800 1 -- 172.21.15.120:0/3028998202 wait complete. 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9ca726800 1 Processor -- start 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.164+0000 7fb9ca726800 1 -- start start 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb9ca726800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7cf5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb9ca726800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5600f7cef6d0 con 0x5600f7cee6c0 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb9c6bda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7cf5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb9c6bda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7cf5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41184/0 (socket says 172.21.15.120:41184) 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 learned_addr learned my addr 172.21.15.120:0/83167312 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f7cf6290 con 0x5600f7cee6c0 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb9c6bda640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7cf5d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0012500 tx=0x7fb9c0053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb897fff640 1 -- 172.21.15.120:0/83167312 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0012570 con 0x5600f7cee6c0 2024-09-07T03:32:33.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb897fff640 1 -- 172.21.15.120:0/83167312 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c002e070 con 0x5600f7cee6c0 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb897fff640 1 -- 172.21.15.120:0/83167312 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c0028820 con 0x5600f7cee6c0 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600f7cf6520 con 0x5600f7cee6c0 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.165+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600f7cf6ea0 con 0x5600f7cee6c0 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.166+0000 7fb897fff640 1 -- 172.21.15.120:0/83167312 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb9c0039060 con 0x5600f7cee6c0 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.167+0000 7fb897fff640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb89003c780 0x7fb89003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.167+0000 7fb897fff640 1 -- 172.21.15.120:0/83167312 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fb9c0033d10 con 0x5600f7cee6c0 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.167+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb89003c780 0x7fb89003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.167+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.167+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7d01890 0x5600f7d03d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.167+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d044a0 con 0x5600f7d01890 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.167+0000 7fb9bffff640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7d01890 0x5600f7d03d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.167+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb89003c780 0x7fb89003ec40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb9b807cdf0 tx=0x7fb9b8098000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.167+0000 7fb9bffff640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7d01890 0x5600f7d03d50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 20 realm 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d00be0 con 0x5600f7d01890 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d04f90 con 0x5600f7d01890 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7d05d70 0x5600f7d08160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.168+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d08830 con 0x5600f7d05d70 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9c6bda640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7d05d70 0x5600f7d08160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9c6bda640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7d05d70 0x5600f7d08160 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9ca726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d09080 con 0x5600f7d05d70 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9ca726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9ca726800 20 searching for the correct realm 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5600f7d0adf0 0x5600f7d0d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d0adf0 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.169+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5600f7d0adf0 0x5600f7d0d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.170+0000 7fb9c63d9640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5600f7d0adf0 0x5600f7d0d220 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.170+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.170+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d05d70 2024-09-07T03:32:33.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.170+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.170+0000 7fb9c6bda640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb9c004e050 0x7fb9c00127a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.170+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x7fb9c004e050 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.171+0000 7fb9bffff640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb9c004e050 0x7fb9c00127a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.171+0000 7fb9bffff640 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb9c004e050 0x7fb9c00127a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.171+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x7fb9c004e050 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.171+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.171+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.171+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.171+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.171+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d0adf0 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.172+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.172+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.172+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.172+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d05d70 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.172+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.172+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d05d70 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.172+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.172+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.173+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.173+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x7fb9c004e050 2024-09-07T03:32:33.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.173+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x7fb9c004e050 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.173+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.173+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.173+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x7fb9c004e050 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.173+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb9b000f5f0 con 0x7fb9c004e050 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.174+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d05d70 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.174+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.174+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d0adf0 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.174+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.174+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.174+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.174+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d05d70 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.175+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.175+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d0adf0 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.175+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.175+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.175+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.175+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.175+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.175+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.175+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.176+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d0adf0 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.176+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.176+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x7fb9c004e050 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.176+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x7fb9c004e050 2024-09-07T03:32:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.176+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d01890 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.176+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x5600f7d01890 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.176+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x7fb9c004e050 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.176+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x7fb9c004e050 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.176+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d0adf0 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.177+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.177+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x7fb9c004e050 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.177+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000f5f0 con 0x7fb9c004e050 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.177+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d05d70 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.177+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.177+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d05d70 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.177+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.177+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d0adf0 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d05d70 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0d8f0 con 0x5600f7d05d70 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:33.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d09a00 con 0x5600f7d01890 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.178+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d09640 con 0x5600f7d05d70 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d09e40 con 0x5600f7d01890 2024-09-07T03:32:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 20 zone default found 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 4 Realm: () 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 20 zonegroup default 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0e220 con 0x7fb9c004e050 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x7fb9c004e050 2024-09-07T03:32:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.179+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d10460 con 0x5600f7d0adf0 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.180+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.180+0000 7fb9ca726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.180+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.180+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d10800 con 0x5600f7d0adf0 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.180+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.180+0000 7fb9ca726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.180+0000 7fb9ca726800 20 started sync module instance, tier type = 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.180+0000 7fb9ca726800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.180+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d0f8a0 con 0x5600f7d05d70 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.181+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.181+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94562157657232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d100b0 con 0x5600f7d05d70 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.181+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d111e0 con 0x5600f7d01890 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.182+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.182+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94562157663696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d11ea0 con 0x5600f7d01890 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.182+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d128f0 con 0x5600f7d05d70 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.182+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94562157657232] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.183+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94562157663696] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.183+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.183+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94562157667296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d119f0 con 0x5600f7d05d70 2024-09-07T03:32:33.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.183+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d131c0 con 0x7fb9c004e050 2024-09-07T03:32:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.184+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x7fb9c004e050 2024-09-07T03:32:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.184+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94562157669648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d135e0 con 0x7fb9c004e050 2024-09-07T03:32:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.184+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d13e30 con 0x5600f7d05d70 2024-09-07T03:32:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.185+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94562157667296] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.187+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94562157669648] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x7fb9c004e050 2024-09-07T03:32:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.187+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.187+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94562157670704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d13a00 con 0x5600f7d05d70 2024-09-07T03:32:33.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.187+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d146d0 con 0x5600f7d0adf0 2024-09-07T03:32:33.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.188+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.188+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94562157675040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d13a00 con 0x5600f7d0adf0 2024-09-07T03:32:33.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.188+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d151f0 con 0x5600f7d0adf0 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.188+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94562157670704] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.189+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94562157675040] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.189+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.189+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94562157677760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d13550 con 0x5600f7d0adf0 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.189+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d15a90 con 0x7fb9c004e050 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94562157677760] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x7fb9c004e050 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94562157676096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d13550 con 0x7fb9c004e050 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9ca726800 20 add_watcher() i=0 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9ca726800 20 add_watcher() i=1 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9ca726800 20 add_watcher() i=2 2024-09-07T03:32:33.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9ca726800 20 add_watcher() i=3 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9ca726800 20 add_watcher() i=4 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9ca726800 20 add_watcher() i=5 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.190+0000 7fb9ca726800 20 add_watcher() i=6 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.191+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94562157676096] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x7fb9c004e050 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.191+0000 7fb9ca726800 20 add_watcher() i=7 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.191+0000 7fb9ca726800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.191+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d18be0 con 0x5600f7d01890 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.192+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.192+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94562157680096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d16100 con 0x5600f7d01890 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94562157680096] v34'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb87cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb9ca726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb9ca726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb9ca726800 5 note: GC not initialized 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb7f77fe640 20 reqs_thread_entry: start 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb9ca726800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb9ca726800 20 Filter name: none 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb7f57fa640 20 reqs_thread_entry: start 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb9ca726800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb9ca726800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.193+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d4bc50 con 0x5600f7d01890 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.194+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.194+0000 7fb9ca726800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.194+0000 7fb9ca726800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.194+0000 7fb9ca726800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.194+0000 7fb9ca726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.194+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d4e580 con 0x7fb9c004e050 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.194+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x7fb9c004e050 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.194+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d51cb0 con 0x5600f7d01890 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.195+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v34'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.195+0000 7fb9ca726800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.195+0000 7fb9ca726800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.195+0000 7fb9ca726800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.195+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94562157926016 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d4d570 con 0x5600f7d05d70 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.196+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94562157670704 notify 146028888065 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5600f7cf6ea0 con 0x5600f7d05d70 2024-09-07T03:32:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.196+0000 7fb8a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94562157670704 notifier 4309 bl.length()=567 2024-09-07T03:32:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.196+0000 7fb8a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.196+0000 7fb8a9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.196+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(65 notify.4 [notify cookie 94562157926016 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.196+0000 7fb8a9ffb640 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb88c003ea0 con 0x5600f7d05d70 2024-09-07T03:32:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.196+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.196+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94562157926016 notify 146028888065 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5600f7cf6520 con 0x5600f7d05d70 2024-09-07T03:32:33.216 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:33.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.197+0000 7fb87cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.197+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94562157680096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d49af0 con 0x5600f7d01890 2024-09-07T03:32:33.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.198+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94562157680096] v34'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.198+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94562157657232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d49af0 con 0x5600f7d05d70 2024-09-07T03:32:33.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.199+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94562157657232] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.199+0000 7fb9ca726800 20 remove_watcher() i=0 2024-09-07T03:32:33.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.199+0000 7fb9ca726800 2 removed watcher, disabling cache 2024-09-07T03:32:33.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.199+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94562157663696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d49af0 con 0x5600f7d01890 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.200+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94562157663696] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x5600f7d01890 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.200+0000 7fb9ca726800 20 remove_watcher() i=1 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.200+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94562157667296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d49af0 con 0x5600f7d05d70 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.202+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94562157667296] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.202+0000 7fb9ca726800 20 remove_watcher() i=2 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.202+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94562157669648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d49af0 con 0x7fb9c004e050 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.203+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94562157669648] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x7fb9c004e050 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.203+0000 7fb9ca726800 20 remove_watcher() i=3 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.203+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94562157670704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d49af0 con 0x5600f7d05d70 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.204+0000 7fb9c6bda640 1 -- 172.21.15.120:0/83167312 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94562157670704] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c0027070 con 0x5600f7d05d70 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.204+0000 7fb9ca726800 20 remove_watcher() i=4 2024-09-07T03:32:33.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.204+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94562157675040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d49af0 con 0x5600f7d0adf0 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.205+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94562157675040] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.205+0000 7fb9ca726800 20 remove_watcher() i=5 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.205+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94562157677760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d49af0 con 0x5600f7d0adf0 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.206+0000 7fb9c63d9640 1 -- 172.21.15.120:0/83167312 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94562157677760] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b807a030 con 0x5600f7d0adf0 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.206+0000 7fb9ca726800 20 remove_watcher() i=6 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.206+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94562157676096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600f7d49af0 con 0x7fb9c004e050 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94562157676096] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b003c040 con 0x7fb9c004e050 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 20 remove_watcher() i=7 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7d05d70 msgr2=0x5600f7d08160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7d05d70 0x5600f7d08160 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7d01890 msgr2=0x5600f7d03d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7d01890 0x5600f7d03d50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb9c004e050 msgr2=0x7fb9c00127a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb9c004e050 0x7fb9c00127a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5600f7d0adf0 msgr2=0x5600f7d0d220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5600f7d0adf0 0x5600f7d0d220 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb89003c780 msgr2=0x7fb89003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb89003c780 0x7fb89003ec40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb9b807cdf0 tx=0x7fb9b8098000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 msgr2=0x5600f7cf5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.207+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7cf5d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0012500 tx=0x7fb9c0053d60 comp rx=0 tx=0).stop 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9bffff640 1 -- 172.21.15.120:0/83167312 reap_dead start 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 shutdown_connections 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 --2- 172.21.15.120:0/83167312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7cee6c0 0x5600f7cf5d30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 >> 172.21.15.120:0/83167312 conn(0x5600f7ceaac0 msgr2=0x5600f7ce8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 shutdown_connections 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/83167312 wait complete. 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/3079244452 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8a003c780 msgr2=0x7fb8a003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 --2- 172.21.15.120:0/3079244452 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8a003c780 0x7fb8a003ec40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5600f7cd2370 tx=0x7fb9b808d040 comp rx=0 tx=0).stop 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/3079244452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7ce1bc0 msgr2=0x5600f7ce1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 --2- 172.21.15.120:0/3079244452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7ce1bc0 0x5600f7ce1fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0016d20 tx=0x7fb9c000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/3079244452 shutdown_connections 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 --2- 172.21.15.120:0/3079244452 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8a003c780 0x7fb8a003ec40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 --2- 172.21.15.120:0/3079244452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7ce1bc0 0x5600f7ce1fe0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/3079244452 >> 172.21.15.120:0/3079244452 conn(0x5600f7cd5f70 msgr2=0x5600f7cd6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/3079244452 shutdown_connections 2024-09-07T03:32:33.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/3079244452 wait complete. 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7ccf450 msgr2=0x5600f7cd1840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7ccf450 0x5600f7cd1840 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7bd1020 msgr2=0x5600f7cce550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7bd1020 0x5600f7cce550 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8ac03c780 msgr2=0x7fb8ac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8ac03c780 0x7fb8ac03ec40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0000c00 tx=0x7fb9b00013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 msgr2=0x5600f7cc6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.208+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7cc6f00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8025c20 tx=0x7fb9b8002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.209+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 shutdown_connections 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.209+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5600f7ccf450 0x5600f7cd1840 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.209+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5600f7bd1020 0x5600f7cce550 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.209+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb8ac03c780 0x7fb8ac03ec40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.209+0000 7fb9ca726800 1 --2- 172.21.15.120:0/2999142322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5600f7bce600 0x5600f7cc6f00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.209+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 >> 172.21.15.120:0/2999142322 conn(0x5600f7bc81c0 msgr2=0x5600f7cb89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.209+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 shutdown_connections 2024-09-07T03:32:33.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.209+0000 7fb9ca726800 1 -- 172.21.15.120:0/2999142322 wait complete. 2024-09-07T03:32:33.228 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:33.228 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-07T03:32:33.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-07T03:32:33.228 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-07T03:32:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.272+0000 7fe6cb60e800 1 Processor -- start 2024-09-07T03:32:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.273+0000 7fe6cb60e800 1 -- start start 2024-09-07T03:32:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.273+0000 7fe6cb60e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55ca96d64df0 0x55ca96d65af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.273+0000 7fe6cb60e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca96c0fe40 con 0x55ca96d66030 2024-09-07T03:32:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.273+0000 7fe6cb60e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55ca96bda680 con 0x55ca96d64df0 2024-09-07T03:32:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.273+0000 7fe6c6dbc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55ca96d64df0 0x55ca96d65af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.273+0000 7fe6c65bb640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55ca96d66030 0x55ca96d6ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48258/0 (socket says 172.21.15.120:48258) 2024-09-07T03:32:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.273+0000 7fe6c65bb640 1 -- 172.21.15.120:0/1660112656 learned_addr learned my addr 172.21.15.120:0/1660112656 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.273+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/1660112656 >> v1:172.21.15.104:6789/0 conn(0x55ca96d66030 legacy=0x55ca96d6ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.273+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/1660112656 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca96bf66b0 con 0x55ca96d64df0 2024-09-07T03:32:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.275+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/1660112656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96d65af0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800a470 tx=0x7fe6b8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b8a2278a59c403 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.275+0000 7fe6c5dba640 1 -- 172.21.15.120:0/1660112656 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8053570 con 0x55ca96d64df0 2024-09-07T03:32:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.275+0000 7fe6c5dba640 1 -- 172.21.15.120:0/1660112656 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8058070 con 0x55ca96d64df0 2024-09-07T03:32:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.275+0000 7fe6c5dba640 1 -- 172.21.15.120:0/1660112656 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8053880 con 0x55ca96d64df0 2024-09-07T03:32:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.276+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1660112656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 msgr2=0x55ca96d65af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.276+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/1660112656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96d65af0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800a470 tx=0x7fe6b8045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:33.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.276+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1660112656 shutdown_connections 2024-09-07T03:32:33.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.276+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/1660112656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96d65af0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.276+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1660112656 >> 172.21.15.120:0/1660112656 conn(0x55ca96d601c0 msgr2=0x55ca96d62620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.276+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1660112656 shutdown_connections 2024-09-07T03:32:33.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.276+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1660112656 wait complete. 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.289+0000 7fe6cb60e800 1 Processor -- start 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.290+0000 7fe6cb60e800 1 -- start start 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.290+0000 7fe6cb60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e54560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.290+0000 7fe6cb60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ca96bfedd0 con 0x55ca96d64df0 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.290+0000 7fe6c6dbc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e54560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.290+0000 7fe6c6dbc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e54560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41208/0 (socket says 172.21.15.120:41208) 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.290+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/1585826171 learned_addr learned my addr 172.21.15.120:0/1585826171 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.290+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/1585826171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca96c17e10 con 0x55ca96d64df0 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.290+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/1585826171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e54560 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8025c20 tx=0x7fe6b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29907916f1e68f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe5b4e09640 1 -- 172.21.15.120:0/1585826171 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8053a20 con 0x55ca96d64df0 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe5b4e09640 1 -- 172.21.15.120:0/1585826171 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8063070 con 0x55ca96d64df0 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe5b4e09640 1 -- 172.21.15.120:0/1585826171 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8053cf0 con 0x55ca96d64df0 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1585826171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 msgr2=0x55ca96e54560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/1585826171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e54560 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8025c20 tx=0x7fe6b8051000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1585826171 shutdown_connections 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/1585826171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e54560 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1585826171 >> 172.21.15.120:0/1585826171 conn(0x55ca96d601c0 msgr2=0x55ca96e4fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1585826171 shutdown_connections 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.291+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1585826171 wait complete. 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.292+0000 7fe6cb60e800 1 Processor -- start 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.292+0000 7fe6cb60e800 1 -- start start 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.292+0000 7fe6cb60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e5cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.292+0000 7fe6cb60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ca96d66720 con 0x55ca96d64df0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.292+0000 7fe6c6dbc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e5cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.292+0000 7fe6c6dbc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e5cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41216/0 (socket says 172.21.15.120:41216) 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.292+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/655618922 learned_addr learned my addr 172.21.15.120:0/655618922 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.292+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/655618922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca96e5d4a0 con 0x55ca96d64df0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.292+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e5cf40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8025c20 tx=0x7fe6b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.293+0000 7fe5b3606640 1 -- 172.21.15.120:0/655618922 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8068660 con 0x55ca96d64df0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.293+0000 7fe5b3606640 1 -- 172.21.15.120:0/655618922 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8068800 con 0x55ca96d64df0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.293+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca96e5d730 con 0x55ca96d64df0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.293+0000 7fe5b3606640 1 -- 172.21.15.120:0/655618922 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b8068ae0 con 0x55ca96d64df0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.293+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca96e5e340 con 0x55ca96d64df0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.293+0000 7fe5b3606640 1 -- 172.21.15.120:0/655618922 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe6b8068c80 con 0x55ca96d64df0 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe5b3606640 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5ac03c780 0x7fe5ac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe5b3606640 1 -- 172.21.15.120:0/655618922 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fe6b80982b0 con 0x55ca96d64df0 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe6c65bb640 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5ac03c780 0x7fe5ac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96d66030 0x55ca96e64590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96e5ed00 con 0x55ca96d66030 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe6c75bd640 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96d66030 0x55ca96e64590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe6c65bb640 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5ac03c780 0x7fe5ac03ec40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc001d70 tx=0x7fe6bc0012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe6c75bd640 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96d66030 0x55ca96e64590 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe6c75bd640 1 -- 172.21.15.120:0/655618922 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6c000a4d0 con 0x55ca96d66030 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.294+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e65500 0x55ca96e678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.295+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96e67f50 con 0x55ca96e65500 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.295+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e65500 0x55ca96e678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.295+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e65500 0x55ca96e678f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.295+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/655618922 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6b8051070 con 0x55ca96e65500 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.295+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96e69800 con 0x55ca96e65500 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.296+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/655618922 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6b8051070 con 0x55ca96e65500 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.296+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96e68940 con 0x55ca96e65500 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.296+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/655618922 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6b8051070 con 0x55ca96e65500 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.296+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96e68da0 con 0x55ca96d66030 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.296+0000 7fe6c75bd640 1 -- 172.21.15.120:0/655618922 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe6c000a4d0 con 0x55ca96d66030 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.296+0000 7fe6cb60e800 1 Processor -- start 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.297+0000 7fe6cb60e800 1 -- start start 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.297+0000 7fe6cb60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e5a0b0 0x55ca96e58920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.297+0000 7fe6cb60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ca96c5ca00 con 0x55ca96e5a0b0 2024-09-07T03:32:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.297+0000 7fe6c75bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e5a0b0 0x55ca96e58920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.297+0000 7fe6c75bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e5a0b0 0x55ca96e58920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41230/0 (socket says 172.21.15.120:41230) 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.297+0000 7fe6c75bd640 1 -- 172.21.15.120:0/4283204370 learned_addr learned my addr 172.21.15.120:0/4283204370 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.297+0000 7fe6c75bd640 1 -- 172.21.15.120:0/4283204370 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca96e5a5d0 con 0x55ca96e5a0b0 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.298+0000 7fe6c75bd640 1 --2- 172.21.15.120:0/4283204370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e5a0b0 0x55ca96e58920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0016d20 tx=0x7fe6c000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.298+0000 7fe5b0e01640 1 -- 172.21.15.120:0/4283204370 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c0017660 con 0x55ca96e5a0b0 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.298+0000 7fe5b0e01640 1 -- 172.21.15.120:0/4283204370 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c001b030 con 0x55ca96e5a0b0 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.298+0000 7fe6cb60e800 1 -- 172.21.15.120:0/4283204370 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca96e58e60 con 0x55ca96e5a0b0 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.298+0000 7fe5b0e01640 1 -- 172.21.15.120:0/4283204370 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c0017950 con 0x55ca96e5a0b0 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.298+0000 7fe6cb60e800 1 -- 172.21.15.120:0/4283204370 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca96e59400 con 0x55ca96e5a0b0 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.299+0000 7fe5b0e01640 1 -- 172.21.15.120:0/4283204370 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe6c0017b40 con 0x55ca96e5a0b0 2024-09-07T03:32:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.299+0000 7fe5b0e01640 1 --2- 172.21.15.120:0/4283204370 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5a003c730 0x7fe5a003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.299+0000 7fe5b0e01640 1 -- 172.21.15.120:0/4283204370 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fe6c000e040 con 0x55ca96e5a0b0 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.299+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/4283204370 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5a003c730 0x7fe5a003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.299+0000 7fe6cb60e800 1 Processor -- start 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.299+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/4283204370 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5a003c730 0x7fe5a003ebf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55ca96e64cc0 tx=0x7fe6b8045e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.299+0000 7fe6cb60e800 1 -- start start 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.299+0000 7fe6cb60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e86db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.299+0000 7fe6cb60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ca96e54d50 con 0x55ca96e869b0 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.300+0000 7fe6c75bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e86db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.300+0000 7fe6c75bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e86db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41242/0 (socket says 172.21.15.120:41242) 2024-09-07T03:32:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.300+0000 7fe6c75bd640 1 -- 172.21.15.120:0/1571500749 learned_addr learned my addr 172.21.15.120:0/1571500749 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.300+0000 7fe6c75bd640 1 -- 172.21.15.120:0/1571500749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca96e873a0 con 0x55ca96e869b0 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.300+0000 7fe6c75bd640 1 --2- 172.21.15.120:0/1571500749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e86db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0005cf0 tx=0x7fe6c00134e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84aa030f58f31fc server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.300+0000 7fe5aa7fc640 1 -- 172.21.15.120:0/1571500749 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c0052020 con 0x55ca96e869b0 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.300+0000 7fe5aa7fc640 1 -- 172.21.15.120:0/1571500749 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c0014e70 con 0x55ca96e869b0 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.300+0000 7fe5aa7fc640 1 -- 172.21.15.120:0/1571500749 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c0014ae0 con 0x55ca96e869b0 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1571500749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 msgr2=0x55ca96e86db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/1571500749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e86db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0005cf0 tx=0x7fe6c00134e0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1571500749 shutdown_connections 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/1571500749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e86db0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1571500749 >> 172.21.15.120:0/1571500749 conn(0x55ca96e82db0 msgr2=0x55ca96e80ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1571500749 shutdown_connections 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 -- 172.21.15.120:0/1571500749 wait complete. 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 Processor -- start 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 -- start start 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e8dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6cb60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ca96e879c0 con 0x55ca96e869b0 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6c75bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e8dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6c75bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e8dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41246/0 (socket says 172.21.15.120:41246) 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.301+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 learned_addr learned my addr 172.21.15.120:0/428222268 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.302+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca96e8e540 con 0x55ca96e869b0 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.302+0000 7fe6c75bd640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e8dfe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0053d10 tx=0x7fe6c0053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.302+0000 7fe5a8ff9640 1 -- 172.21.15.120:0/428222268 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c0012570 con 0x55ca96e869b0 2024-09-07T03:32:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.302+0000 7fe5a8ff9640 1 -- 172.21.15.120:0/428222268 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c0005520 con 0x55ca96e869b0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.302+0000 7fe5a8ff9640 1 -- 172.21.15.120:0/428222268 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c0055590 con 0x55ca96e869b0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.302+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca96e8e7d0 con 0x55ca96e869b0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.302+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca96e8f150 con 0x55ca96e869b0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.303+0000 7fe5a8ff9640 1 -- 172.21.15.120:0/428222268 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe6c0055730 con 0x55ca96e869b0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.303+0000 7fe5a8ff9640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe59003c780 0x7fe59003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.303+0000 7fe5a8ff9640 1 -- 172.21.15.120:0/428222268 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fe6c0045a00 con 0x55ca96e869b0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.303+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.303+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe59003c780 0x7fe59003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.303+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96e999d0 0x55ca96e9be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.303+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96e9c5b0 con 0x55ca96e999d0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.303+0000 7fe6c65bb640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96e999d0 0x55ca96e9be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe59003c780 0x7fe59003ec40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8096900 tx=0x7fe6b808b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6c65bb640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96e999d0 0x55ca96e9be60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6bc009050 con 0x55ca96e999d0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 20 realm 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96e98d80 con 0x55ca96e999d0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6bc009050 con 0x55ca96e999d0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96e9d090 con 0x55ca96e999d0 2024-09-07T03:32:33.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6bc009050 con 0x55ca96e999d0 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e9de70 0x55ca96ea0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.304+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea0930 con 0x55ca96e9de70 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6c75bd640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e9de70 0x55ca96ea0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6c75bd640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e9de70 0x55ca96ea0260 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6cb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea11d0 con 0x55ca96e9de70 2024-09-07T03:32:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6cb60e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6cb60e800 20 searching for the correct realm 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ca96ea2f40 0x55ca96ea5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.305+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96ea2f40 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.306+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ca96ea2f40 0x55ca96ea5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.306+0000 7fe6c6dbc640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ca96ea2f40 0x55ca96ea5350 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.306+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.306+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e9de70 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.306+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.306+0000 7fe6c75bd640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe6c0014440 0x7fe6c0007990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.306+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x7fe6c0014440 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.306+0000 7fe6c65bb640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe6c0014440 0x7fe6c0007990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.307+0000 7fe6c65bb640 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe6c0014440 0x7fe6c0007990 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.307+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc009050 con 0x7fe6c0014440 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.307+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.307+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc009050 con 0x55ca96e999d0 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.307+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.307+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.307+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96ea2f40 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.308+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.308+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.308+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.308+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e9de70 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.308+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.308+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e9de70 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.308+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.308+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.309+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.309+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x7fe6c0014440 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.309+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.309+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.309+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.309+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x7fe6c0014440 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.309+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.309+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e9de70 2024-09-07T03:32:33.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.310+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.310+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96ea2f40 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.310+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.310+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.310+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.310+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e9de70 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.310+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.310+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96ea2f40 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.310+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.311+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.311+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.311+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.311+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.311+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.311+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.311+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96ea2f40 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.311+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.311+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x7fe6c0014440 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.312+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.312+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e999d0 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.312+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.312+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x7fe6c0014440 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.312+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.312+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96ea2f40 2024-09-07T03:32:33.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.312+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.312+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x7fe6c0014440 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.313+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.313+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e9de70 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.313+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.313+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e9de70 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.313+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.313+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96ea2f40 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.313+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.313+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e9de70 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea5a20 con 0x55ca96e9de70 2024-09-07T03:32:33.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea1b20 con 0x55ca96e999d0 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea1f70 con 0x55ca96e9de70 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.314+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea23d0 con 0x55ca96e999d0 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 zone default found 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 4 Realm: () 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:33.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 zonegroup default 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea16c0 con 0x7fe6c0014440 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea8130 con 0x55ca96ea2f40 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea85c0 con 0x55ca96ea2f40 2024-09-07T03:32:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 started sync module instance, tier type = 2024-09-07T03:32:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.315+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea6f30 con 0x55ca96e9de70 2024-09-07T03:32:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.316+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.316+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94328603702048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea6b90 con 0x55ca96e9de70 2024-09-07T03:32:33.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.316+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea94f0 con 0x55ca96e999d0 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.318+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.318+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94328603702048] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.318+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94328603709504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea94a0 con 0x55ca96e999d0 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.318+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea8a20 con 0x55ca96e9de70 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.320+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94328603709504] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.321+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.321+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94328603711712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ea8a20 con 0x55ca96e9de70 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.321+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eaaa80 con 0x7fe6c0014440 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.322+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.322+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94328603715024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eaaea0 con 0x7fe6c0014440 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.322+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eab980 con 0x55ca96e9de70 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.325+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94328603711712] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.327+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94328603715024] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.327+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.327+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94328603718800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eaa9f0 con 0x55ca96e9de70 2024-09-07T03:32:33.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.327+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eac220 con 0x55ca96ea2f40 2024-09-07T03:32:33.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.328+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.328+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94328603721072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eaa9f0 con 0x55ca96ea2f40 2024-09-07T03:32:33.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.328+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eacd70 con 0x55ca96ea2f40 2024-09-07T03:32:33.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.328+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94328603718800] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.331+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94328603721072] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.331+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.331+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94328603722128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eacd30 con 0x55ca96ea2f40 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.331+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ead610 con 0x7fe6c0014440 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94328603726176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eada30 con 0x7fe6c0014440 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6cb60e800 20 add_watcher() i=0 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6cb60e800 20 add_watcher() i=1 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6cb60e800 20 add_watcher() i=2 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6cb60e800 20 add_watcher() i=3 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6cb60e800 20 add_watcher() i=4 2024-09-07T03:32:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6cb60e800 20 add_watcher() i=5 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94328603722128] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.332+0000 7fe6cb60e800 20 add_watcher() i=6 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.333+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94328603726176] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.333+0000 7fe6cb60e800 20 add_watcher() i=7 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.333+0000 7fe6cb60e800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.333+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eb0a60 con 0x55ca96e999d0 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.333+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.333+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94328603727232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96eade50 con 0x55ca96e999d0 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.334+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94328603727232] v34'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.334+0000 7fe57dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.334+0000 7fe6cb60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.334+0000 7fe6cb60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.335+0000 7fe6cb60e800 5 note: GC not initialized 2024-09-07T03:32:33.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.335+0000 7fe57cfe1640 20 reqs_thread_entry: start 2024-09-07T03:32:33.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.335+0000 7fe6cb60e800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:33.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.335+0000 7fe6cb60e800 20 Filter name: none 2024-09-07T03:32:33.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.335+0000 7fe575ffb640 20 reqs_thread_entry: start 2024-09-07T03:32:33.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.335+0000 7fe6cb60e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.335+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee33c0 con 0x55ca96e999d0 2024-09-07T03:32:33.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.335+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.336+0000 7fe6cb60e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:33.358 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:33.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.336+0000 7fe57dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.336+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94328603727232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee2230 con 0x55ca96e999d0 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.337+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94328603727232] v34'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.337+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94328603702048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee12c0 con 0x55ca96e9de70 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.338+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94328603702048] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.338+0000 7fe6cb60e800 20 remove_watcher() i=0 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.338+0000 7fe6cb60e800 2 removed watcher, disabling cache 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.338+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94328603709504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee12c0 con 0x55ca96e999d0 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.339+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94328603709504] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x55ca96e999d0 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.339+0000 7fe6cb60e800 20 remove_watcher() i=1 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.339+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94328603711712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee12c0 con 0x55ca96e9de70 2024-09-07T03:32:33.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.341+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94328603711712] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.341+0000 7fe6cb60e800 20 remove_watcher() i=2 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.341+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94328603715024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee12c0 con 0x7fe6c0014440 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.344+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94328603715024] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.344+0000 7fe6cb60e800 20 remove_watcher() i=3 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.344+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94328603718800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee12c0 con 0x55ca96e9de70 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.345+0000 7fe6c75bd640 1 -- 172.21.15.120:0/428222268 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94328603718800] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0027070 con 0x55ca96e9de70 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.345+0000 7fe6cb60e800 20 remove_watcher() i=4 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.345+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94328603721072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee12c0 con 0x55ca96ea2f40 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.346+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94328603721072] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.346+0000 7fe6cb60e800 20 remove_watcher() i=5 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.346+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94328603722128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee12c0 con 0x55ca96ea2f40 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.347+0000 7fe6c6dbc640 1 -- 172.21.15.120:0/428222268 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94328603722128] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b8089030 con 0x55ca96ea2f40 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.347+0000 7fe6cb60e800 20 remove_watcher() i=6 2024-09-07T03:32:33.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.347+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94328603726176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca96ee12c0 con 0x7fe6c0014440 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94328603726176] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc028040 con 0x7fe6c0014440 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 20 remove_watcher() i=7 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e9de70 msgr2=0x55ca96ea0260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e9de70 0x55ca96ea0260 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96e999d0 msgr2=0x55ca96e9be60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96e999d0 0x55ca96e9be60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe6c0014440 msgr2=0x7fe6c0007990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe6c0014440 0x7fe6c0007990 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ca96ea2f40 msgr2=0x55ca96ea5350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ca96ea2f40 0x55ca96ea5350 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe59003c780 msgr2=0x7fe59003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe59003c780 0x7fe59003ec40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8096900 tx=0x7fe6b808b000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 msgr2=0x55ca96e8dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/428222268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e869b0 0x55ca96e8dfe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0053d10 tx=0x7fe6c0053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.348+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 reap_dead start 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6c65bb640 1 -- 172.21.15.120:0/428222268 reap_dead start 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 shutdown_connections 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 >> 172.21.15.120:0/428222268 conn(0x55ca96e82db0 msgr2=0x55ca96e80fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 shutdown_connections 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/428222268 wait complete. 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/4283204370 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5a003c730 msgr2=0x7fe5a003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/4283204370 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5a003c730 0x7fe5a003ebf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55ca96e64cc0 tx=0x7fe6b8045e60 comp rx=0 tx=0).stop 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/4283204370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e5a0b0 msgr2=0x55ca96e58920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/4283204370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e5a0b0 0x55ca96e58920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0016d20 tx=0x7fe6c000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/4283204370 shutdown_connections 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/4283204370 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5a003c730 0x7fe5a003ebf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/4283204370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96e5a0b0 0x55ca96e58920 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/4283204370 >> 172.21.15.120:0/4283204370 conn(0x55ca96e6c0e0 msgr2=0x55ca96e6c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/4283204370 shutdown_connections 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/4283204370 wait complete. 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e65500 msgr2=0x55ca96e678f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e65500 0x55ca96e678f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96d66030 msgr2=0x55ca96e64590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96d66030 0x55ca96e64590 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5ac03c780 msgr2=0x7fe5ac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5ac03c780 0x7fe5ac03ec40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc001d70 tx=0x7fe6bc0012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 msgr2=0x55ca96e5cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e5cf40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8025c20 tx=0x7fe6b8002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 shutdown_connections 2024-09-07T03:32:33.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ca96e65500 0x55ca96e678f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.349+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ca96d66030 0x55ca96e64590 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.350+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe5ac03c780 0x7fe5ac03ec40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.350+0000 7fe6cb60e800 1 --2- 172.21.15.120:0/655618922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ca96d64df0 0x55ca96e5cf40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.350+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 >> 172.21.15.120:0/655618922 conn(0x55ca96d601c0 msgr2=0x55ca96e4e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.350+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 shutdown_connections 2024-09-07T03:32:33.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.350+0000 7fe6cb60e800 1 -- 172.21.15.120:0/655618922 wait complete. 2024-09-07T03:32:33.370 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:33.370 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-07T03:32:33.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-07T03:32:33.371 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-07T03:32:33.417 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:33.417 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:33.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.416+0000 7f1df7f0a800 1 Processor -- start 2024-09-07T03:32:33.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.416+0000 7f1df7f0a800 1 -- start start 2024-09-07T03:32:33.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1df7f0a800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5624bcaabfc0 0x5624bcab4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1df7f0a800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5624bc955e40 con 0x5624bcaaa4a0 2024-09-07T03:32:33.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1df7f0a800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5624bc920680 con 0x5624bcaabfc0 2024-09-07T03:32:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1deffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5624bcaabfc0 0x5624bcab4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1deffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5624bcaabfc0 0x5624bcab4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41248/0 (socket says 172.21.15.120:41248) 2024-09-07T03:32:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1deffff640 1 -- 172.21.15.120:0/2859430061 learned_addr learned my addr 172.21.15.120:0/2859430061 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1df59f4640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5624bcaaa4a0 0x5624bcaaa8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48272/0 (socket says 172.21.15.120:48272) 2024-09-07T03:32:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1deffff640 1 -- 172.21.15.120:0/2859430061 >> v1:172.21.15.104:6789/0 conn(0x5624bcaaa4a0 legacy=0x5624bcaaa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1deffff640 1 -- 172.21.15.120:0/2859430061 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bc93c6b0 con 0x5624bcaabfc0 2024-09-07T03:32:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.417+0000 7f1df51f3640 1 -- 172.21.15.120:0/2859430061 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634595612 0 0) 0x5624bc955e40 con 0x5624bcaaa4a0 2024-09-07T03:32:33.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.419+0000 7f1deffff640 1 --2- 172.21.15.120:0/2859430061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaabfc0 0x5624bcab4ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1de000a520 tx=0x7f1de0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b8caea65430747 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.419+0000 7f1df51f3640 1 -- 172.21.15.120:0/2859430061 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de0055070 con 0x5624bcaabfc0 2024-09-07T03:32:33.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.419+0000 7f1df51f3640 1 -- 172.21.15.120:0/2859430061 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de00515b0 con 0x5624bcaabfc0 2024-09-07T03:32:33.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.419+0000 7f1df51f3640 1 -- 172.21.15.120:0/2859430061 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de00518d0 con 0x5624bcaabfc0 2024-09-07T03:32:33.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.420+0000 7f1df7f0a800 1 -- 172.21.15.120:0/2859430061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaabfc0 msgr2=0x5624bcab4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.420+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/2859430061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaabfc0 0x5624bcab4ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1de000a520 tx=0x7f1de0045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.420+0000 7f1df7f0a800 1 -- 172.21.15.120:0/2859430061 shutdown_connections 2024-09-07T03:32:33.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.420+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/2859430061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaabfc0 0x5624bcab4ae0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.420+0000 7f1df7f0a800 1 -- 172.21.15.120:0/2859430061 >> 172.21.15.120:0/2859430061 conn(0x5624bcaa61f0 msgr2=0x5624bcaa8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.420+0000 7f1df7f0a800 1 -- 172.21.15.120:0/2859430061 shutdown_connections 2024-09-07T03:32:33.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.420+0000 7f1df7f0a800 1 -- 172.21.15.120:0/2859430061 wait complete. 2024-09-07T03:32:33.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.434+0000 7f1df7f0a800 1 Processor -- start 2024-09-07T03:32:33.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.434+0000 7f1df7f0a800 1 -- start start 2024-09-07T03:32:33.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.434+0000 7f1df7f0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcb9d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.434+0000 7f1df7f0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5624bc944dd0 con 0x5624bcaaa4a0 2024-09-07T03:32:33.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.434+0000 7f1df59f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcb9d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.434+0000 7f1df59f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcb9d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41262/0 (socket says 172.21.15.120:41262) 2024-09-07T03:32:33.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.434+0000 7f1df59f4640 1 -- 172.21.15.120:0/53381879 learned_addr learned my addr 172.21.15.120:0/53381879 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.434+0000 7f1df59f4640 1 -- 172.21.15.120:0/53381879 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bc95de10 con 0x5624bcaaa4a0 2024-09-07T03:32:33.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.435+0000 7f1df59f4640 1 --2- 172.21.15.120:0/53381879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcb9d660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1de8001ea0 tx=0x7f1de800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efde889c364ebde server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.435+0000 7f1ce3e07640 1 -- 172.21.15.120:0/53381879 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de8008070 con 0x5624bcaaa4a0 2024-09-07T03:32:33.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.435+0000 7f1ce3e07640 1 -- 172.21.15.120:0/53381879 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de800d500 con 0x5624bcaaa4a0 2024-09-07T03:32:33.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.435+0000 7f1ce3e07640 1 -- 172.21.15.120:0/53381879 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de800d880 con 0x5624bcaaa4a0 2024-09-07T03:32:33.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.435+0000 7f1df7f0a800 1 -- 172.21.15.120:0/53381879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 msgr2=0x5624bcb9d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.435+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/53381879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcb9d660 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1de8001ea0 tx=0x7f1de800b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df7f0a800 1 -- 172.21.15.120:0/53381879 shutdown_connections 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/53381879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcb9d660 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df7f0a800 1 -- 172.21.15.120:0/53381879 >> 172.21.15.120:0/53381879 conn(0x5624bcaa61f0 msgr2=0x5624bcb98fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df7f0a800 1 -- 172.21.15.120:0/53381879 shutdown_connections 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df7f0a800 1 -- 172.21.15.120:0/53381879 wait complete. 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df7f0a800 1 Processor -- start 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df7f0a800 1 -- start start 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df7f0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcba4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df7f0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5624bcab52f0 con 0x5624bcaaa4a0 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df59f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcba4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df59f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcba4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41276/0 (socket says 172.21.15.120:41276) 2024-09-07T03:32:33.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.436+0000 7f1df59f4640 1 -- 172.21.15.120:0/875734296 learned_addr learned my addr 172.21.15.120:0/875734296 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.437+0000 7f1df59f4640 1 -- 172.21.15.120:0/875734296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bcba54e0 con 0x5624bcaaa4a0 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.437+0000 7f1df59f4640 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcba4f80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1de80012f0 tx=0x7f1de8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.437+0000 7f1ce2604640 1 -- 172.21.15.120:0/875734296 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de800f9d0 con 0x5624bcaaa4a0 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.437+0000 7f1ce2604640 1 -- 172.21.15.120:0/875734296 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de800fb70 con 0x5624bcaaa4a0 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.437+0000 7f1ce2604640 1 -- 172.21.15.120:0/875734296 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1de800fe50 con 0x5624bcaaa4a0 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.437+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624bcba5770 con 0x5624bcaaa4a0 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.437+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624bcba6170 con 0x5624bcaaa4a0 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.438+0000 7f1ce2604640 1 -- 172.21.15.120:0/875734296 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1de8017040 con 0x5624bcaaa4a0 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.438+0000 7f1ce2604640 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c920 0x7f1cdc03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.438+0000 7f1ce2604640 1 -- 172.21.15.120:0/875734296 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1de8015020 con 0x5624bcaaa4a0 2024-09-07T03:32:33.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.438+0000 7f1deffff640 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c920 0x7f1cdc03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.438+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcaabfc0 0x5624bcbac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.438+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbacb10 con 0x5624bcaabfc0 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.438+0000 7f1df61f5640 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcaabfc0 0x5624bcbac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.438+0000 7f1deffff640 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c920 0x7f1cdc03ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1de0057000 tx=0x7f1de0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.439+0000 7f1df61f5640 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcaabfc0 0x5624bcbac5d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.439+0000 7f1df61f5640 1 -- 172.21.15.120:0/875734296 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1df000a4d0 con 0x5624bcaabfc0 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.439+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbad3c0 0x5624bcbaf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.439+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbafff0 con 0x5624bcbad3c0 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.439+0000 7f1df59f4640 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbad3c0 0x5624bcbaf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.439+0000 7f1df59f4640 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbad3c0 0x5624bcbaf880 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.440+0000 7f1df59f4640 1 -- 172.21.15.120:0/875734296 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbad3c0 2024-09-07T03:32:33.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.440+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbb18a0 con 0x5624bcbad3c0 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.440+0000 7f1df59f4640 1 -- 172.21.15.120:0/875734296 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbad3c0 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.440+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbb0a10 con 0x5624bcbad3c0 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.440+0000 7f1df59f4640 1 -- 172.21.15.120:0/875734296 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbad3c0 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.441+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbb0e30 con 0x5624bcaabfc0 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.441+0000 7f1df61f5640 1 -- 172.21.15.120:0/875734296 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1df000a4d0 con 0x5624bcaabfc0 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.441+0000 7f1df7f0a800 1 Processor -- start 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.441+0000 7f1df7f0a800 1 -- start start 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.441+0000 7f1df7f0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbbfd50 0x5624bcbc0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.441+0000 7f1df7f0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5624bc9a2a00 con 0x5624bcbbfd50 2024-09-07T03:32:33.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1df61f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbbfd50 0x5624bcbc0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1df61f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbbfd50 0x5624bcbc0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41280/0 (socket says 172.21.15.120:41280) 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1df61f5640 1 -- 172.21.15.120:0/136260877 learned_addr learned my addr 172.21.15.120:0/136260877 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1df61f5640 1 -- 172.21.15.120:0/136260877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bcbc07b0 con 0x5624bcbbfd50 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1df61f5640 1 --2- 172.21.15.120:0/136260877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbbfd50 0x5624bcbc0170 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1df0016d20 tx=0x7f1df000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1cdb7fe640 1 -- 172.21.15.120:0/136260877 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df0017660 con 0x5624bcbbfd50 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1cdb7fe640 1 -- 172.21.15.120:0/136260877 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df001b030 con 0x5624bcbbfd50 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1cdb7fe640 1 -- 172.21.15.120:0/136260877 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df0017950 con 0x5624bcbbfd50 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1df7f0a800 1 -- 172.21.15.120:0/136260877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624bcbc0fe0 con 0x5624bcbbfd50 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.442+0000 7f1df7f0a800 1 -- 172.21.15.120:0/136260877 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624bcbc1580 con 0x5624bcbbfd50 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.443+0000 7f1cdb7fe640 1 -- 172.21.15.120:0/136260877 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1df0017b40 con 0x5624bcbbfd50 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.443+0000 7f1cdb7fe640 1 --2- 172.21.15.120:0/136260877 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cd003c730 0x7f1cd003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.443+0000 7f1cdb7fe640 1 -- 172.21.15.120:0/136260877 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1df000e040 con 0x5624bcbbfd50 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.443+0000 7f1df59f4640 1 --2- 172.21.15.120:0/136260877 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cd003c730 0x7f1cd003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df7f0a800 1 Processor -- start 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df59f4640 1 --2- 172.21.15.120:0/136260877 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cd003c730 0x7f1cd003ebf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5624bcbb0530 tx=0x7f1de800ed70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df7f0a800 1 -- start start 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df7f0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df7f0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5624bcb9deb0 con 0x5624bcbcc7f0 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df61f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df61f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41290/0 (socket says 172.21.15.120:41290) 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df61f5640 1 -- 172.21.15.120:0/97267276 learned_addr learned my addr 172.21.15.120:0/97267276 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df61f5640 1 -- 172.21.15.120:0/97267276 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bcbcd1e0 con 0x5624bcbcc7f0 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1df61f5640 1 --2- 172.21.15.120:0/97267276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbccbf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013450 tx=0x7f1df0013480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f7bc191edf8f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1cd97fa640 1 -- 172.21.15.120:0/97267276 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df0014a00 con 0x5624bcbcc7f0 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1cd97fa640 1 -- 172.21.15.120:0/97267276 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df0049070 con 0x5624bcbcc7f0 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.444+0000 7f1cd97fa640 1 -- 172.21.15.120:0/97267276 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df0028350 con 0x5624bcbcc7f0 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 -- 172.21.15.120:0/97267276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 msgr2=0x5624bcbccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/97267276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbccbf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013450 tx=0x7f1df0013480 comp rx=0 tx=0).stop 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 -- 172.21.15.120:0/97267276 shutdown_connections 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/97267276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbccbf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 -- 172.21.15.120:0/97267276 >> 172.21.15.120:0/97267276 conn(0x5624bcbc8bf0 msgr2=0x5624bcbc6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 -- 172.21.15.120:0/97267276 shutdown_connections 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 -- 172.21.15.120:0/97267276 wait complete. 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 Processor -- start 2024-09-07T03:32:33.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 -- start start 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbd3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.445+0000 7f1df7f0a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5624bcbcd800 con 0x5624bcbcc7f0 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1df61f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbd3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1df61f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbd3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41296/0 (socket says 172.21.15.120:41296) 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 learned_addr learned my addr 172.21.15.120:0/4101269814 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bcbd4380 con 0x5624bcbcc7f0 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1df61f5640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbd3e20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1df0053d60 tx=0x7f1df0053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1cc77fe640 1 -- 172.21.15.120:0/4101269814 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df0005370 con 0x5624bcbcc7f0 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1cc77fe640 1 -- 172.21.15.120:0/4101269814 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df002e070 con 0x5624bcbcc7f0 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624bcbd4610 con 0x5624bcbcc7f0 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1cc77fe640 1 -- 172.21.15.120:0/4101269814 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df00127a0 con 0x5624bcbcc7f0 2024-09-07T03:32:33.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.446+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624bcbd4f90 con 0x5624bcbcc7f0 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.447+0000 7f1cc77fe640 1 -- 172.21.15.120:0/4101269814 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1df0012940 con 0x5624bcbcc7f0 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.447+0000 7f1cc77fe640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cc003c780 0x7f1cc003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.447+0000 7f1cc77fe640 1 -- 172.21.15.120:0/4101269814 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1df0052d50 con 0x5624bcbcc7f0 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.447+0000 7f1df59f4640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cc003c780 0x7f1cc003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.447+0000 7f1df59f4640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cc003c780 0x7f1cc003ec40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1de8054380 tx=0x7f1de803f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.448+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.448+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcbdf8c0 0x5624bcbe1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.448+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbe24d0 con 0x5624bcbdf8c0 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.448+0000 7f1deffff640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcbdf8c0 0x5624bcbe1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.448+0000 7f1deffff640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcbdf8c0 0x5624bcbe1d80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.448+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 20 realm 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbe2900 con 0x5624bcbdf8c0 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbe31d0 con 0x5624bcbdf8c0 2024-09-07T03:32:33.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbe3bf0 0x5624bcbe6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbe6790 con 0x5624bcbe3bf0 2024-09-07T03:32:33.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df61f5640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbe3bf0 0x5624bcbe6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.449+0000 7f1df61f5640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbe3bf0 0x5624bcbe6020 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df7f0a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbe6fe0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df7f0a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df7f0a800 20 searching for the correct realm 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5624bcbe8d50 0x5624bcbeb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe8d50 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df59f4640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5624bcbe8d50 0x5624bcbeb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.450+0000 7f1df59f4640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5624bcbe8d50 0x5624bcbeb1a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.451+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.451+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe3bf0 2024-09-07T03:32:33.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.451+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.451+0000 7f1df61f5640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1df0008ba0 0x7f1df003c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.451+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x7f1df0008ba0 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.451+0000 7f1deffff640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1df0008ba0 0x7f1df003c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.451+0000 7f1deffff640 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1df0008ba0 0x7f1df003c680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.452+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.452+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.452+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.452+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.452+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.452+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe8d50 2024-09-07T03:32:33.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.452+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.452+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.452+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.453+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe3bf0 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.453+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.453+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe3bf0 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.453+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.453+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.453+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.453+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x7f1df0008ba0 2024-09-07T03:32:33.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.453+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.453+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.454+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.454+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x7f1df0008ba0 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.454+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.454+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe3bf0 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.454+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.454+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe8d50 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.454+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.454+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.455+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.455+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe3bf0 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.455+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.455+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe8d50 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.455+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.455+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.455+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.455+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.456+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.456+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.456+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.456+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe8d50 2024-09-07T03:32:33.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.456+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.456+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x7f1df0008ba0 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.456+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.456+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbdf8c0 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x7f1df0008ba0 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe8d50 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x7f1df0008ba0 2024-09-07T03:32:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe3bf0 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.457+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe3bf0 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe8d50 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe3bf0 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeb870 con 0x5624bcbe3bf0 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df7f0a800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df7f0a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df7f0a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df7f0a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df7f0a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df7f0a800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.458+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbe7960 con 0x5624bcbdf8c0 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbe75a0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbe8280 con 0x5624bcbdf8c0 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 zone default found 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 4 Realm: () 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 zonegroup default 2024-09-07T03:32:33.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbebcf0 con 0x7f1df0008ba0 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.459+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbedf30 con 0x5624bcbe8d50 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.460+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.460+0000 7f1df7f0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.460+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.460+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbee380 con 0x5624bcbe8d50 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.460+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.460+0000 7f1df7f0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.460+0000 7f1df7f0a800 20 started sync module instance, tier type = 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.460+0000 7f1df7f0a800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.460+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbed3c0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.461+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.461+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94715785435328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbed3c0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.461+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbeee00 con 0x5624bcbdf8c0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.462+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.462+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94715785439568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbef690 con 0x5624bcbdf8c0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.462+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf01a0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.462+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94715785435328] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.463+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94715785439568] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.463+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.463+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94715785444432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbef1a0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.464+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf0780 con 0x7f1df0008ba0 2024-09-07T03:32:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.465+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94715785444432] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.465+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.465+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94715785432848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf0780 con 0x7f1df0008ba0 2024-09-07T03:32:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.465+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf11d0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.467+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94715785432848] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.468+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.468+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94715785448672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf0780 con 0x5624bcbe3bf0 2024-09-07T03:32:33.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.468+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf1be0 con 0x5624bcbe8d50 2024-09-07T03:32:33.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.470+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94715785448672] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.470+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.470+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94715785446096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf06f0 con 0x5624bcbe8d50 2024-09-07T03:32:33.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.470+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf2aa0 con 0x5624bcbe8d50 2024-09-07T03:32:33.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.472+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94715785446096] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.473+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.473+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94715785455088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf2a10 con 0x5624bcbe8d50 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.473+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf3830 con 0x7f1df0008ba0 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94715785458496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf3cd0 con 0x7f1df0008ba0 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1df7f0a800 20 add_watcher() i=0 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1df7f0a800 20 add_watcher() i=1 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1df7f0a800 20 add_watcher() i=2 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1df7f0a800 20 add_watcher() i=3 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1df7f0a800 20 add_watcher() i=4 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1df7f0a800 20 add_watcher() i=5 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94715785455088] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1df7f0a800 20 add_watcher() i=6 2024-09-07T03:32:33.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.474+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94715785458496] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.475+0000 7f1df7f0a800 20 add_watcher() i=7 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.475+0000 7f1df7f0a800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.475+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf2e90 con 0x5624bcbdf8c0 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.475+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.475+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94715785459616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcbf2e90 con 0x5624bcbdf8c0 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.476+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94715785459616] v34'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.476+0000 7f1ca77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.476+0000 7f1df7f0a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.476+0000 7f1df7f0a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.476+0000 7f1df7f0a800 5 note: GC not initialized 2024-09-07T03:32:33.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.476+0000 7f1ca67fc640 20 reqs_thread_entry: start 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 20 Filter name: none 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1c17fff640 20 reqs_thread_entry: start 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc29d60 con 0x5624bcbdf8c0 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:33.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc2c690 con 0x7f1df0008ba0 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.477+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc2fda0 con 0x5624bcbdf8c0 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v34'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1df7f0a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1df7f0a800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1df7f0a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94715785705312 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc2b680 con 0x5624bcbe3bf0 2024-09-07T03:32:33.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94715785448672 notify 146028888066 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5624bcbd4f90 con 0x5624bcbe3bf0 2024-09-07T03:32:33.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1cd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94715785448672 notifier 4323 bl.length()=567 2024-09-07T03:32:33.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(65 notify.4 [notify cookie 94715785705312 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1cd97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:33.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1cd97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:33.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1cd97fa640 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1cb8003ea0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.479+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.480+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94715785705312 notify 146028888066 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1df006e020 con 0x5624bcbe3bf0 2024-09-07T03:32:33.497 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:33.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.480+0000 7f1ca77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.480+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94715785459616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc27bc0 con 0x5624bcbdf8c0 2024-09-07T03:32:33.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.481+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94715785459616] v34'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.481+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94715785435328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc27bc0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.482+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94715785435328] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.482+0000 7f1df7f0a800 20 remove_watcher() i=0 2024-09-07T03:32:33.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.482+0000 7f1df7f0a800 2 removed watcher, disabling cache 2024-09-07T03:32:33.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.482+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94715785439568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc27bc0 con 0x5624bcbdf8c0 2024-09-07T03:32:33.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.483+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94715785439568] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x5624bcbdf8c0 2024-09-07T03:32:33.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.483+0000 7f1df7f0a800 20 remove_watcher() i=1 2024-09-07T03:32:33.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.483+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94715785444432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc27bc0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.484+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94715785444432] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.484+0000 7f1df7f0a800 20 remove_watcher() i=2 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.484+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94715785432848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc27bc0 con 0x7f1df0008ba0 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.486+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94715785432848] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.486+0000 7f1df7f0a800 20 remove_watcher() i=3 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.486+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94715785448672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc27bc0 con 0x5624bcbe3bf0 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.487+0000 7f1df61f5640 1 -- 172.21.15.120:0/4101269814 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94715785448672] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df0027070 con 0x5624bcbe3bf0 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.487+0000 7f1df7f0a800 20 remove_watcher() i=4 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.487+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94715785446096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc27bc0 con 0x5624bcbe8d50 2024-09-07T03:32:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.488+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94715785446096] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.488+0000 7f1df7f0a800 20 remove_watcher() i=5 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.488+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94715785455088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc27bc0 con 0x5624bcbe8d50 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.489+0000 7f1df59f4640 1 -- 172.21.15.120:0/4101269814 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94715785455088] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de802d070 con 0x5624bcbe8d50 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.489+0000 7f1df7f0a800 20 remove_watcher() i=6 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.489+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94715785458496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5624bcc27bc0 con 0x7f1df0008ba0 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94715785458496] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1de0057030 con 0x7f1df0008ba0 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 20 remove_watcher() i=7 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbe3bf0 msgr2=0x5624bcbe6020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbe3bf0 0x5624bcbe6020 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcbdf8c0 msgr2=0x5624bcbe1d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcbdf8c0 0x5624bcbe1d80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1df0008ba0 msgr2=0x7f1df003c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1df0008ba0 0x7f1df003c680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5624bcbe8d50 msgr2=0x5624bcbeb1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5624bcbe8d50 0x5624bcbeb1a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cc003c780 msgr2=0x7f1cc003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cc003c780 0x7f1cc003ec40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1de8054380 tx=0x7f1de803f000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 msgr2=0x5624bcbd3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/4101269814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbcc7f0 0x5624bcbd3e20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1df0053d60 tx=0x7f1df0053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 reap_dead start 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1deffff640 1 -- 172.21.15.120:0/4101269814 reap_dead start 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 shutdown_connections 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 >> 172.21.15.120:0/4101269814 conn(0x5624bcbc8bf0 msgr2=0x5624bcbc6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 shutdown_connections 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/4101269814 wait complete. 2024-09-07T03:32:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/136260877 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cd003c730 msgr2=0x7f1cd003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/136260877 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cd003c730 0x7f1cd003ebf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5624bcbb0530 tx=0x7f1de800ed70 comp rx=0 tx=0).stop 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/136260877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbbfd50 msgr2=0x5624bcbc0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/136260877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbbfd50 0x5624bcbc0170 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1df0016d20 tx=0x7f1df000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 -- 172.21.15.120:0/136260877 shutdown_connections 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/136260877 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cd003c730 0x7f1cd003ebf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.490+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/136260877 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcbbfd50 0x5624bcbc0170 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/136260877 >> 172.21.15.120:0/136260877 conn(0x5624bcbb4100 msgr2=0x5624bcbb44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/136260877 shutdown_connections 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/136260877 wait complete. 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbad3c0 msgr2=0x5624bcbaf880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbad3c0 0x5624bcbaf880 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcaabfc0 msgr2=0x5624bcbac5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcaabfc0 0x5624bcbac5d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c920 msgr2=0x7f1cdc03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c920 0x7f1cdc03ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1de0057000 tx=0x7f1de0052000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 msgr2=0x5624bcba4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcba4f80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1de80012f0 tx=0x7f1de8000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 shutdown_connections 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5624bcbad3c0 0x5624bcbaf880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5624bcaabfc0 0x5624bcbac5d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c920 0x7f1cdc03ede0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 --2- 172.21.15.120:0/875734296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5624bcaaa4a0 0x5624bcba4f80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 >> 172.21.15.120:0/875734296 conn(0x5624bcaa61f0 msgr2=0x5624bcb9e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 shutdown_connections 2024-09-07T03:32:33.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.491+0000 7f1df7f0a800 1 -- 172.21.15.120:0/875734296 wait complete. 2024-09-07T03:32:33.510 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:33.510 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-07T03:32:33.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-07T03:32:33.510 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-07T03:32:33.554 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:33.554 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:33.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.554+0000 7f8240b21800 1 Processor -- start 2024-09-07T03:32:33.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.554+0000 7f8240b21800 1 -- start start 2024-09-07T03:32:33.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.554+0000 7f8240b21800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56313b51f200 0x56313b524da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.554+0000 7f8240b21800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56313b3c8e40 con 0x56313b51ddf0 2024-09-07T03:32:33.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.554+0000 7f8240b21800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56313b393680 con 0x56313b51f200 2024-09-07T03:32:33.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.555+0000 7f8237fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56313b51f200 0x56313b524da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.555+0000 7f8237fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56313b51f200 0x56313b524da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41300/0 (socket says 172.21.15.120:41300) 2024-09-07T03:32:33.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.555+0000 7f823c80c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56313b51ddf0 0x56313b51eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48278/0 (socket says 172.21.15.120:48278) 2024-09-07T03:32:33.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.555+0000 7f8237fff640 1 -- 172.21.15.120:0/2567705255 learned_addr learned my addr 172.21.15.120:0/2567705255 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.555+0000 7f8237fff640 1 -- 172.21.15.120:0/2567705255 >> v1:172.21.15.104:6789/0 conn(0x56313b51ddf0 legacy=0x56313b51eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.555+0000 7f8237fff640 1 -- 172.21.15.120:0/2567705255 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313b3af6b0 con 0x56313b51f200 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f8237fff640 1 --2- 172.21.15.120:0/2567705255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51f200 0x56313b524da0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f822800a520 tx=0x7f8228045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9413ffab899f0d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f82377fe640 1 -- 172.21.15.120:0/2567705255 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8228055070 con 0x56313b51f200 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f82377fe640 1 -- 172.21.15.120:0/2567705255 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82280515b0 con 0x56313b51f200 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f82377fe640 1 -- 172.21.15.120:0/2567705255 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82280518d0 con 0x56313b51f200 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f8240b21800 1 -- 172.21.15.120:0/2567705255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51f200 msgr2=0x56313b524da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f8240b21800 1 --2- 172.21.15.120:0/2567705255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51f200 0x56313b524da0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f822800a520 tx=0x7f8228045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f8240b21800 1 -- 172.21.15.120:0/2567705255 shutdown_connections 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f8240b21800 1 --2- 172.21.15.120:0/2567705255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51f200 0x56313b524da0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f8240b21800 1 -- 172.21.15.120:0/2567705255 >> 172.21.15.120:0/2567705255 conn(0x56313b5191c0 msgr2=0x56313b51b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f8240b21800 1 -- 172.21.15.120:0/2567705255 shutdown_connections 2024-09-07T03:32:33.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.557+0000 7f8240b21800 1 -- 172.21.15.120:0/2567705255 wait complete. 2024-09-07T03:32:33.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.571+0000 7f8240b21800 1 Processor -- start 2024-09-07T03:32:33.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.571+0000 7f8240b21800 1 -- start start 2024-09-07T03:32:33.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.571+0000 7f8240b21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b491db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.571+0000 7f8240b21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56313b3b7dd0 con 0x56313b51ddf0 2024-09-07T03:32:33.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.572+0000 7f823c80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b491db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.572+0000 7f823c80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b491db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41304/0 (socket says 172.21.15.120:41304) 2024-09-07T03:32:33.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.572+0000 7f823c80c640 1 -- 172.21.15.120:0/2027400485 learned_addr learned my addr 172.21.15.120:0/2027400485 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.572+0000 7f823c80c640 1 -- 172.21.15.120:0/2027400485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313b3d0e10 con 0x56313b51ddf0 2024-09-07T03:32:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.572+0000 7f823c80c640 1 --2- 172.21.15.120:0/2027400485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b491db0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8230001eb0 tx=0x7f823000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5e181eaf8c4ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.572+0000 7f812ae05640 1 -- 172.21.15.120:0/2027400485 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f823000e5c0 con 0x56313b51ddf0 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.572+0000 7f812ae05640 1 -- 172.21.15.120:0/2027400485 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8230006070 con 0x56313b51ddf0 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.572+0000 7f812ae05640 1 -- 172.21.15.120:0/2027400485 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f823000e8b0 con 0x56313b51ddf0 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 -- 172.21.15.120:0/2027400485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 msgr2=0x56313b491db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 --2- 172.21.15.120:0/2027400485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b491db0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8230001eb0 tx=0x7f823000b6c0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 -- 172.21.15.120:0/2027400485 shutdown_connections 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 --2- 172.21.15.120:0/2027400485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b491db0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 -- 172.21.15.120:0/2027400485 >> 172.21.15.120:0/2027400485 conn(0x56313b5191c0 msgr2=0x56313b608ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 -- 172.21.15.120:0/2027400485 shutdown_connections 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 -- 172.21.15.120:0/2027400485 wait complete. 2024-09-07T03:32:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 Processor -- start 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 -- start start 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.573+0000 7f8240b21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b60e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f8240b21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56313b51f8f0 con 0x56313b51ddf0 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f823c80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b60e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f823c80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b60e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41308/0 (socket says 172.21.15.120:41308) 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f823c80c640 1 -- 172.21.15.120:0/2524540956 learned_addr learned my addr 172.21.15.120:0/2524540956 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f823c80c640 1 -- 172.21.15.120:0/2524540956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313b60ee80 con 0x56313b51ddf0 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f823c80c640 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b60e920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f823000b700 tx=0x7f8230000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f8129602640 1 -- 172.21.15.120:0/2524540956 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f823001a7c0 con 0x56313b51ddf0 2024-09-07T03:32:33.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f8129602640 1 -- 172.21.15.120:0/2524540956 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823001a960 con 0x56313b51ddf0 2024-09-07T03:32:33.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56313b60d230 con 0x56313b51ddf0 2024-09-07T03:32:33.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f8129602640 1 -- 172.21.15.120:0/2524540956 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f823001acc0 con 0x56313b51ddf0 2024-09-07T03:32:33.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.574+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56313b60d7f0 con 0x56313b51ddf0 2024-09-07T03:32:33.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.575+0000 7f8129602640 1 -- 172.21.15.120:0/2524540956 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8230017070 con 0x56313b51ddf0 2024-09-07T03:32:33.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.575+0000 7f8129602640 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f812403c730 0x7f812403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.575+0000 7f8129602640 1 -- 172.21.15.120:0/2524540956 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8230015020 con 0x56313b51ddf0 2024-09-07T03:32:33.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.575+0000 7f8237fff640 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f812403c730 0x7f812403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.576+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b51f200 0x56313b61f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.576+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b61fa90 con 0x56313b51f200 2024-09-07T03:32:33.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.576+0000 7f823d00d640 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b51f200 0x56313b61f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.576+0000 7f8237fff640 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f812403c730 0x7f812403ebf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8228057000 tx=0x7f8228052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.576+0000 7f823d00d640 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b51f200 0x56313b61f510 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.576+0000 7f823d00d640 1 -- 172.21.15.120:0/2524540956 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f823800a4d0 con 0x56313b51f200 2024-09-07T03:32:33.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.576+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b620840 0x56313b622c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.576+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b623270 con 0x56313b620840 2024-09-07T03:32:33.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.577+0000 7f823c80c640 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b620840 0x56313b622c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.577+0000 7f823c80c640 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b620840 0x56313b622c30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.577+0000 7f823c80c640 1 -- 172.21.15.120:0/2524540956 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f823002e070 con 0x56313b620840 2024-09-07T03:32:33.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.577+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b624b20 con 0x56313b620840 2024-09-07T03:32:33.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.578+0000 7f823c80c640 1 -- 172.21.15.120:0/2524540956 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f823002e070 con 0x56313b620840 2024-09-07T03:32:33.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.578+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b623c60 con 0x56313b620840 2024-09-07T03:32:33.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.578+0000 7f823c80c640 1 -- 172.21.15.120:0/2524540956 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f823002e070 con 0x56313b620840 2024-09-07T03:32:33.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.578+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b624080 con 0x56313b51f200 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.578+0000 7f823d00d640 1 -- 172.21.15.120:0/2524540956 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f823800a4d0 con 0x56313b51f200 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.578+0000 7f8240b21800 1 Processor -- start 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.579+0000 7f8240b21800 1 -- start start 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.579+0000 7f8240b21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b633020 0x56313b633440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.579+0000 7f8240b21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56313b415a00 con 0x56313b633020 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.579+0000 7f823d00d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b633020 0x56313b633440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.579+0000 7f823d00d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b633020 0x56313b633440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41316/0 (socket says 172.21.15.120:41316) 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.579+0000 7f823d00d640 1 -- 172.21.15.120:0/255244258 learned_addr learned my addr 172.21.15.120:0/255244258 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.579+0000 7f823d00d640 1 -- 172.21.15.120:0/255244258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313b633a80 con 0x56313b633020 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.579+0000 7f823d00d640 1 --2- 172.21.15.120:0/255244258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b633020 0x56313b633440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8238016d20 tx=0x7f823800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.580+0000 7f81227fc640 1 -- 172.21.15.120:0/255244258 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8238017660 con 0x56313b633020 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.580+0000 7f81227fc640 1 -- 172.21.15.120:0/255244258 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823801b030 con 0x56313b633020 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.580+0000 7f81227fc640 1 -- 172.21.15.120:0/255244258 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8238017950 con 0x56313b633020 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.580+0000 7f8240b21800 1 -- 172.21.15.120:0/255244258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56313b6342b0 con 0x56313b633020 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.580+0000 7f8240b21800 1 -- 172.21.15.120:0/255244258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56313b634850 con 0x56313b633020 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.580+0000 7f81227fc640 1 -- 172.21.15.120:0/255244258 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8238017af0 con 0x56313b633020 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f81227fc640 1 --2- 172.21.15.120:0/255244258 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f811403c780 0x7f811403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f81227fc640 1 -- 172.21.15.120:0/255244258 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f823800e040 con 0x56313b633020 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f823c80c640 1 --2- 172.21.15.120:0/255244258 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f811403c780 0x7f811403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f8240b21800 1 Processor -- start 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f823c80c640 1 --2- 172.21.15.120:0/255244258 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f811403c780 0x7f811403ec40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56313b623780 tx=0x7f8230052630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f8240b21800 1 -- start start 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f8240b21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b63fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f8240b21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56313b611320 con 0x56313b63faa0 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f823d00d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b63fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f823d00d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b63fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41320/0 (socket says 172.21.15.120:41320) 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.581+0000 7f823d00d640 1 -- 172.21.15.120:0/3674860216 learned_addr learned my addr 172.21.15.120:0/3674860216 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f823d00d640 1 -- 172.21.15.120:0/3674860216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313b640490 con 0x56313b63faa0 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f823d00d640 1 --2- 172.21.15.120:0/3674860216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b63fea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8238054030 tx=0x7f8238054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad967a182e30a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8113fff640 1 -- 172.21.15.120:0/3674860216 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8238014d40 con 0x56313b63faa0 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8113fff640 1 -- 172.21.15.120:0/3674860216 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82380149b0 con 0x56313b63faa0 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8113fff640 1 -- 172.21.15.120:0/3674860216 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8238028350 con 0x56313b63faa0 2024-09-07T03:32:33.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8240b21800 1 -- 172.21.15.120:0/3674860216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 msgr2=0x56313b63fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8240b21800 1 --2- 172.21.15.120:0/3674860216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b63fea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8238054030 tx=0x7f8238054060 comp rx=0 tx=0).stop 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8240b21800 1 -- 172.21.15.120:0/3674860216 shutdown_connections 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8240b21800 1 --2- 172.21.15.120:0/3674860216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b63fea0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8240b21800 1 -- 172.21.15.120:0/3674860216 >> 172.21.15.120:0/3674860216 conn(0x56313b63bec0 msgr2=0x56313b63a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8240b21800 1 -- 172.21.15.120:0/3674860216 shutdown_connections 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.582+0000 7f8240b21800 1 -- 172.21.15.120:0/3674860216 wait complete. 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f8240b21800 1 Processor -- start 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f8240b21800 1 -- start start 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f8240b21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b6470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f8240b21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56313b640a80 con 0x56313b63faa0 2024-09-07T03:32:33.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f823d00d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b6470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f823d00d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b6470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41324/0 (socket says 172.21.15.120:41324) 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 learned_addr learned my addr 172.21.15.120:0/950700140 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56313b647630 con 0x56313b63faa0 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f823d00d640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b6470d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8238012500 tx=0x7f8238053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f81127fc640 1 -- 172.21.15.120:0/950700140 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8238012570 con 0x56313b63faa0 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f81127fc640 1 -- 172.21.15.120:0/950700140 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8238005500 con 0x56313b63faa0 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f81127fc640 1 -- 172.21.15.120:0/950700140 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8238055570 con 0x56313b63faa0 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.583+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56313b6478c0 con 0x56313b63faa0 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.584+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56313b648450 con 0x56313b63faa0 2024-09-07T03:32:33.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.584+0000 7f81127fc640 1 -- 172.21.15.120:0/950700140 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f82380127a0 con 0x56313b63faa0 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.585+0000 7f81127fc640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f810803c6e0 0x7f810803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.585+0000 7f81127fc640 1 -- 172.21.15.120:0/950700140 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f82380489a0 con 0x56313b63faa0 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.585+0000 7f823c80c640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f810803c6e0 0x7f810803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.585+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.585+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b652bb0 0x56313b655040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.585+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b655790 con 0x56313b652bb0 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.585+0000 7f8237fff640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b652bb0 0x56313b655040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.585+0000 7f823c80c640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f810803c6e0 0x7f810803eba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f823000efd0 tx=0x7f8230048000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.585+0000 7f8237fff640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b652bb0 0x56313b655040 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 20 realm 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b655bc0 con 0x56313b652bb0 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b656490 con 0x56313b652bb0 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b656eb0 0x56313b6592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b659a10 con 0x56313b656eb0 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.586+0000 7f823d00d640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b656eb0 0x56313b6592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f823d00d640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b656eb0 0x56313b6592a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f8240b21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b65a2b0 con 0x56313b656eb0 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f8240b21800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:33.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f8240b21800 20 searching for the correct realm 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56313b65c020 0x56313b65e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b65c020 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.587+0000 7f823c80c640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56313b65c020 0x56313b65e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.588+0000 7f823c80c640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56313b65c020 0x56313b65e470 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.588+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.588+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b656eb0 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.588+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.588+0000 7f823d00d640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8238014440 0x7f8238012a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.588+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x7f8238014440 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.588+0000 7f8237fff640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8238014440 0x7f8238012a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.589+0000 7f8237fff640 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8238014440 0x7f8238012a90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.589+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.589+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.589+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.589+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.589+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.589+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b65c020 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b656eb0 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b656eb0 2024-09-07T03:32:33.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.590+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x7f8238014440 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.591+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.591+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.591+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.591+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x7f8238014440 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.591+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.591+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b656eb0 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.591+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.591+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b65c020 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.592+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.592+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.592+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.592+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b656eb0 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.592+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.592+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b65c020 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.592+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.592+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b65c020 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x7f8238014440 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.593+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b652bb0 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.594+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.594+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x7f8238014440 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.594+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.594+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b65c020 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.594+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.594+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x7f8238014440 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.594+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.594+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b656eb0 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.595+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.595+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b656eb0 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.595+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.595+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b65c020 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.595+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.595+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b656eb0 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56313b65eb40 con 0x56313b656eb0 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:33.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b65ac30 con 0x56313b652bb0 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b65b080 con 0x56313b656eb0 2024-09-07T03:32:33.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.596+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b65b4e0 con 0x56313b652bb0 2024-09-07T03:32:33.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:33.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 zone default found 2024-09-07T03:32:33.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 4 Realm: () 2024-09-07T03:32:33.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 zonegroup default 2024-09-07T03:32:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b65a7b0 con 0x7f8238014440 2024-09-07T03:32:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b661220 con 0x56313b65c020 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b6616e0 con 0x56313b65c020 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 started sync module instance, tier type = 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.597+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b660020 con 0x56313b656eb0 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.598+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.599+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94769449925792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b6607a0 con 0x56313b656eb0 2024-09-07T03:32:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.599+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b662260 con 0x56313b652bb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.599+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.600+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94769449925792] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.600+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94769449934224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b662b30 con 0x56313b652bb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.600+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b660230 con 0x56313b656eb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.600+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94769449934224] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.601+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.601+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94769449936512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b662aa0 con 0x56313b656eb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.601+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b663b90 con 0x7f8238014440 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.602+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.602+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94769449940704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b663b00 con 0x7f8238014440 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.602+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b664af0 con 0x56313b656eb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.602+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94769449936512] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.603+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94769449940704] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.604+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.604+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94769449942912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b664af0 con 0x56313b656eb0 2024-09-07T03:32:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.604+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b665390 con 0x56313b65c020 2024-09-07T03:32:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.605+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.605+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94769449946848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b664af0 con 0x56313b65c020 2024-09-07T03:32:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.605+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b666290 con 0x56313b65c020 2024-09-07T03:32:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.605+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94769449942912] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.606+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.606+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94769449950592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b6666b0 con 0x56313b65c020 2024-09-07T03:32:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.606+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b6670b0 con 0x7f8238014440 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.606+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94769449946848] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94769449950592] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94769449939136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b666bc0 con 0x7f8238014440 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f8240b21800 20 add_watcher() i=0 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f8240b21800 20 add_watcher() i=1 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f8240b21800 20 add_watcher() i=2 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f8240b21800 20 add_watcher() i=3 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f8240b21800 20 add_watcher() i=4 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f8240b21800 20 add_watcher() i=5 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.607+0000 7f8240b21800 20 add_watcher() i=6 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.608+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94769449939136] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.608+0000 7f8240b21800 20 add_watcher() i=7 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.608+0000 7f8240b21800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.608+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b6670d0 con 0x56313b652bb0 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.608+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.608+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94769449948976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b667930 con 0x56313b652bb0 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.609+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94769449948976] v34'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.609+0000 7f80f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.609+0000 7f8240b21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.609+0000 7f8240b21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.609+0000 7f8240b21800 5 note: GC not initialized 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.610+0000 7f80f1fe3640 20 reqs_thread_entry: start 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.610+0000 7f8240b21800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:33.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.610+0000 7f8240b21800 20 Filter name: none 2024-09-07T03:32:33.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.610+0000 7f80637fe640 20 reqs_thread_entry: start 2024-09-07T03:32:33.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.610+0000 7f8240b21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.610+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56313b69cf40 con 0x56313b652bb0 2024-09-07T03:32:33.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.610+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.610+0000 7f8240b21800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:33.631 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:33.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.611+0000 7f80f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.611+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94769449948976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b69bdd0 con 0x56313b652bb0 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.612+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94769449948976] v34'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.612+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94769449925792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b69ae60 con 0x56313b656eb0 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.613+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94769449925792] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.613+0000 7f8240b21800 20 remove_watcher() i=0 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.613+0000 7f8240b21800 2 removed watcher, disabling cache 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.613+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94769449934224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b69ae60 con 0x56313b652bb0 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.614+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94769449934224] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8228057030 con 0x56313b652bb0 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.614+0000 7f8240b21800 20 remove_watcher() i=1 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.614+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94769449936512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b69ae60 con 0x56313b656eb0 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.615+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94769449936512] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.615+0000 7f8240b21800 20 remove_watcher() i=2 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.615+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94769449940704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b69ae60 con 0x7f8238014440 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.616+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94769449940704] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.616+0000 7f8240b21800 20 remove_watcher() i=3 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.616+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94769449942912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b69ae60 con 0x56313b656eb0 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.617+0000 7f823d00d640 1 -- 172.21.15.120:0/950700140 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94769449942912] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8238027070 con 0x56313b656eb0 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.617+0000 7f8240b21800 20 remove_watcher() i=4 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.617+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94769449946848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b69ae60 con 0x56313b65c020 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.618+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94769449946848] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.618+0000 7f8240b21800 20 remove_watcher() i=5 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.618+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94769449950592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b69ae60 con 0x56313b65c020 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.619+0000 7f823c80c640 1 -- 172.21.15.120:0/950700140 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94769449950592] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f823002e070 con 0x56313b65c020 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.619+0000 7f8240b21800 20 remove_watcher() i=6 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.619+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94769449939136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56313b69ae60 con 0x7f8238014440 2024-09-07T03:32:33.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94769449939136] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8228057030 con 0x7f8238014440 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 20 remove_watcher() i=7 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b656eb0 msgr2=0x56313b6592a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b656eb0 0x56313b6592a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b652bb0 msgr2=0x56313b655040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b652bb0 0x56313b655040 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8238014440 msgr2=0x7f8238012a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8238014440 0x7f8238012a90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56313b65c020 msgr2=0x56313b65e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56313b65c020 0x56313b65e470 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f810803c6e0 msgr2=0x7f810803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f810803c6e0 0x7f810803eba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f823000efd0 tx=0x7f8230048000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8237fff640 1 -- 172.21.15.120:0/950700140 reap_dead start 2024-09-07T03:32:33.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 msgr2=0x56313b6470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.620+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b6470d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8238012500 tx=0x7f8238053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 shutdown_connections 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 --2- 172.21.15.120:0/950700140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b63faa0 0x56313b6470d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 >> 172.21.15.120:0/950700140 conn(0x56313b63bec0 msgr2=0x56313b63a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 shutdown_connections 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/950700140 wait complete. 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/255244258 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f811403c780 msgr2=0x7f811403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 --2- 172.21.15.120:0/255244258 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f811403c780 0x7f811403ec40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56313b623780 tx=0x7f8230052630 comp rx=0 tx=0).stop 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/255244258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b633020 msgr2=0x56313b633440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 --2- 172.21.15.120:0/255244258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b633020 0x56313b633440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8238016d20 tx=0x7f823800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/255244258 shutdown_connections 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 --2- 172.21.15.120:0/255244258 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f811403c780 0x7f811403ec40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 --2- 172.21.15.120:0/255244258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b633020 0x56313b633440 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/255244258 >> 172.21.15.120:0/255244258 conn(0x56313b6273d0 msgr2=0x56313b6277b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/255244258 shutdown_connections 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/255244258 wait complete. 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b620840 msgr2=0x56313b622c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b620840 0x56313b622c30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b51f200 msgr2=0x56313b61f510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b51f200 0x56313b61f510 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f812403c730 msgr2=0x7f812403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f812403c730 0x7f812403ebf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8228057000 tx=0x7f8228052000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 msgr2=0x56313b60e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.621+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b60e920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f823000b700 tx=0x7f8230000bc0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.622+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 shutdown_connections 2024-09-07T03:32:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.622+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56313b620840 0x56313b622c30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.622+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56313b51f200 0x56313b61f510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.622+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f812403c730 0x7f812403ebf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.622+0000 7f8240b21800 1 --2- 172.21.15.120:0/2524540956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56313b51ddf0 0x56313b60e920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.622+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 >> 172.21.15.120:0/2524540956 conn(0x56313b5191c0 msgr2=0x56313b6076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.622+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 shutdown_connections 2024-09-07T03:32:33.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.622+0000 7f8240b21800 1 -- 172.21.15.120:0/2524540956 wait complete. 2024-09-07T03:32:33.646 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:33.646 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-07T03:32:33.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-07T03:32:33.647 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-07T03:32:33.695 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:33.696 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:33.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7fecfa440800 1 Processor -- start 2024-09-07T03:32:33.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7fecfa440800 1 -- start start 2024-09-07T03:32:33.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7fecfa440800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56484d7b2fe0 0x56484d7bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7fecfa440800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56484d65ce40 con 0x56484d7b14c0 2024-09-07T03:32:33.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7fecfa440800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56484d627680 con 0x56484d7b2fe0 2024-09-07T03:32:33.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7feceffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56484d7b2fe0 0x56484d7bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7fecf7f2a640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56484d7b14c0 0x56484d7b18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48294/0 (socket says 172.21.15.120:48294) 2024-09-07T03:32:33.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7fecf7f2a640 1 -- 172.21.15.120:0/2538941585 learned_addr learned my addr 172.21.15.120:0/2538941585 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:33.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7feceffff640 1 -- 172.21.15.120:0/2538941585 >> v1:172.21.15.104:6789/0 conn(0x56484d7b14c0 legacy=0x56484d7b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.695+0000 7feceffff640 1 -- 172.21.15.120:0/2538941585 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484d6436b0 con 0x56484d7b2fe0 2024-09-07T03:32:33.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.697+0000 7feceffff640 1 --2- 172.21.15.120:0/2538941585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 0x56484d7bbb00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fece000a470 tx=0x7fece0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ba85272e10cfa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.697+0000 7fecf7729640 1 -- 172.21.15.120:0/2538941585 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece0053570 con 0x56484d7b2fe0 2024-09-07T03:32:33.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.697+0000 7fecf7729640 1 -- 172.21.15.120:0/2538941585 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece0058070 con 0x56484d7b2fe0 2024-09-07T03:32:33.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.697+0000 7fecf7729640 1 -- 172.21.15.120:0/2538941585 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece0053880 con 0x56484d7b2fe0 2024-09-07T03:32:33.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.698+0000 7fecfa440800 1 -- 172.21.15.120:0/2538941585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 msgr2=0x56484d7bbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.698+0000 7fecfa440800 1 --2- 172.21.15.120:0/2538941585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 0x56484d7bbb00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fece000a470 tx=0x7fece0045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:33.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.698+0000 7fecfa440800 1 -- 172.21.15.120:0/2538941585 shutdown_connections 2024-09-07T03:32:33.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.698+0000 7fecfa440800 1 --2- 172.21.15.120:0/2538941585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 0x56484d7bbb00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.698+0000 7fecfa440800 1 -- 172.21.15.120:0/2538941585 >> 172.21.15.120:0/2538941585 conn(0x56484d7ad210 msgr2=0x56484d7af650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.698+0000 7fecfa440800 1 -- 172.21.15.120:0/2538941585 shutdown_connections 2024-09-07T03:32:33.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.698+0000 7fecfa440800 1 -- 172.21.15.120:0/2538941585 wait complete. 2024-09-07T03:32:33.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.712+0000 7fecfa440800 1 Processor -- start 2024-09-07T03:32:33.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.712+0000 7fecfa440800 1 -- start start 2024-09-07T03:32:33.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.712+0000 7fecfa440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b14c0 0x56484d8a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.712+0000 7fecfa440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56484d64bdd0 con 0x56484d7b14c0 2024-09-07T03:32:33.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.712+0000 7fecf7f2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b14c0 0x56484d8a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.712+0000 7fecf7f2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b14c0 0x56484d8a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41352/0 (socket says 172.21.15.120:41352) 2024-09-07T03:32:33.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.712+0000 7fecf7f2a640 1 -- 172.21.15.120:0/73472958 learned_addr learned my addr 172.21.15.120:0/73472958 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.712+0000 7fecf7f2a640 1 -- 172.21.15.120:0/73472958 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484d664e10 con 0x56484d7b14c0 2024-09-07T03:32:33.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.713+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/73472958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b14c0 0x56484d8a48e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fece8001e40 tx=0x7fece8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf0a5a942597516 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.713+0000 7febe5e0b640 1 -- 172.21.15.120:0/73472958 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece8012020 con 0x56484d7b14c0 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.713+0000 7febe5e0b640 1 -- 172.21.15.120:0/73472958 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece800e5a0 con 0x56484d7b14c0 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.713+0000 7febe5e0b640 1 -- 172.21.15.120:0/73472958 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece800e8a0 con 0x56484d7b14c0 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.713+0000 7fecfa440800 1 -- 172.21.15.120:0/73472958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b14c0 msgr2=0x56484d8a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.713+0000 7fecfa440800 1 --2- 172.21.15.120:0/73472958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b14c0 0x56484d8a48e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fece8001e40 tx=0x7fece8001e70 comp rx=0 tx=0).stop 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecfa440800 1 -- 172.21.15.120:0/73472958 shutdown_connections 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecfa440800 1 --2- 172.21.15.120:0/73472958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b14c0 0x56484d8a48e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecfa440800 1 -- 172.21.15.120:0/73472958 >> 172.21.15.120:0/73472958 conn(0x56484d7ad210 msgr2=0x56484d8a0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecfa440800 1 -- 172.21.15.120:0/73472958 shutdown_connections 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecfa440800 1 -- 172.21.15.120:0/73472958 wait complete. 2024-09-07T03:32:33.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecfa440800 1 Processor -- start 2024-09-07T03:32:33.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecfa440800 1 -- start start 2024-09-07T03:32:33.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecfa440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 0x56484d8ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecfa440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56484d7bc310 con 0x56484d7b2fe0 2024-09-07T03:32:33.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecf7f2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 0x56484d8ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecf7f2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 0x56484d8ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41364/0 (socket says 172.21.15.120:41364) 2024-09-07T03:32:33.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.714+0000 7fecf7f2a640 1 -- 172.21.15.120:0/648033782 learned_addr learned my addr 172.21.15.120:0/648033782 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.715+0000 7fecf7f2a640 1 -- 172.21.15.120:0/648033782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484d8aca20 con 0x56484d7b2fe0 2024-09-07T03:32:33.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.715+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 0x56484d8ac4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fece800c010 tx=0x7fece8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.715+0000 7febdffff640 1 -- 172.21.15.120:0/648033782 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece8012030 con 0x56484d7b2fe0 2024-09-07T03:32:33.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.715+0000 7febdffff640 1 -- 172.21.15.120:0/648033782 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece80014a0 con 0x56484d7b2fe0 2024-09-07T03:32:33.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.715+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56484d8accb0 con 0x56484d7b2fe0 2024-09-07T03:32:33.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.715+0000 7febdffff640 1 -- 172.21.15.120:0/648033782 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fece801a700 con 0x56484d7b2fe0 2024-09-07T03:32:33.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.715+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484d8ad6b0 con 0x56484d7b2fe0 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.716+0000 7febdffff640 1 -- 172.21.15.120:0/648033782 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fece8015020 con 0x56484d7b2fe0 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.716+0000 7febdffff640 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febe003c730 0x7febe003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.716+0000 7febdffff640 1 -- 172.21.15.120:0/648033782 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fece8020030 con 0x56484d7b2fe0 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.716+0000 7feceffff640 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febe003c730 0x7febe003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.716+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8ae1b0 0x56484d8b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.716+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8b4050 con 0x56484d8ae1b0 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.716+0000 7fecf872b640 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8ae1b0 0x56484d8b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.717+0000 7feceffff640 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febe003c730 0x7febe003ebf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fece0057000 tx=0x7fece0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.717+0000 7fecf872b640 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8ae1b0 0x56484d8b3b10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.717+0000 7fecf872b640 1 -- 172.21.15.120:0/648033782 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecf000a4d0 con 0x56484d8ae1b0 2024-09-07T03:32:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.717+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8b4e20 0x56484d8b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.717+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8b7850 con 0x56484d8b4e20 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.717+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8b4e20 0x56484d8b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.718+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8b4e20 0x56484d8b7210 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.718+0000 7fecf7f2a640 1 -- 172.21.15.120:0/648033782 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fece80187b0 con 0x56484d8b4e20 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.718+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8b9100 con 0x56484d8b4e20 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.718+0000 7fecf7f2a640 1 -- 172.21.15.120:0/648033782 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fece80187b0 con 0x56484d8b4e20 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.718+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8b8210 con 0x56484d8b4e20 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.718+0000 7fecf7f2a640 1 -- 172.21.15.120:0/648033782 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fece80187b0 con 0x56484d8b4e20 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.718+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8b8630 con 0x56484d8ae1b0 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.719+0000 7fecf872b640 1 -- 172.21.15.120:0/648033782 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fecf000a4d0 con 0x56484d8ae1b0 2024-09-07T03:32:33.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.719+0000 7fecfa440800 1 Processor -- start 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.719+0000 7fecfa440800 1 -- start start 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.719+0000 7fecfa440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8c75c0 0x56484d8c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.719+0000 7fecfa440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56484d6a9a00 con 0x56484d8c75c0 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.719+0000 7fecf872b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8c75c0 0x56484d8c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.719+0000 7fecf872b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8c75c0 0x56484d8c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41366/0 (socket says 172.21.15.120:41366) 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.719+0000 7fecf872b640 1 -- 172.21.15.120:0/2427011471 learned_addr learned my addr 172.21.15.120:0/2427011471 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.720+0000 7fecf872b640 1 -- 172.21.15.120:0/2427011471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484d8c8020 con 0x56484d8c75c0 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.720+0000 7fecf872b640 1 --2- 172.21.15.120:0/2427011471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8c75c0 0x56484d8c79e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fecf0016d20 tx=0x7fecf000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.720+0000 7febdd7fa640 1 -- 172.21.15.120:0/2427011471 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf0017660 con 0x56484d8c75c0 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.720+0000 7febdd7fa640 1 -- 172.21.15.120:0/2427011471 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf001b030 con 0x56484d8c75c0 2024-09-07T03:32:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.720+0000 7fecfa440800 1 -- 172.21.15.120:0/2427011471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56484d8c8850 con 0x56484d8c75c0 2024-09-07T03:32:33.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.720+0000 7febdd7fa640 1 -- 172.21.15.120:0/2427011471 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf0017950 con 0x56484d8c75c0 2024-09-07T03:32:33.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.720+0000 7fecfa440800 1 -- 172.21.15.120:0/2427011471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484d8c8df0 con 0x56484d8c75c0 2024-09-07T03:32:33.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.721+0000 7febdd7fa640 1 -- 172.21.15.120:0/2427011471 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fecf0017b40 con 0x56484d8c75c0 2024-09-07T03:32:33.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.721+0000 7febdd7fa640 1 --2- 172.21.15.120:0/2427011471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febd003c730 0x7febd003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.721+0000 7febdd7fa640 1 -- 172.21.15.120:0/2427011471 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fecf000e040 con 0x56484d8c75c0 2024-09-07T03:32:33.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.721+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/2427011471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febd003c730 0x7febd003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.721+0000 7fecfa440800 1 Processor -- start 2024-09-07T03:32:33.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.721+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/2427011471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febd003c730 0x7febd003ebf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x56484d8b7d30 tx=0x7fece8043040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.721+0000 7fecfa440800 1 -- start start 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7fecfa440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8d44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7fecfa440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56484d8a5130 con 0x56484d8d40e0 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7fecf872b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8d44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7fecf872b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8d44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41382/0 (socket says 172.21.15.120:41382) 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7fecf872b640 1 -- 172.21.15.120:0/390663159 learned_addr learned my addr 172.21.15.120:0/390663159 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7fecf872b640 1 -- 172.21.15.120:0/390663159 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484d8d4ad0 con 0x56484d8d40e0 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7fecf872b640 1 --2- 172.21.15.120:0/390663159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8d44e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fecf0053e70 tx=0x7fecf0054040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c678d0db323767 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7febd6ffd640 1 -- 172.21.15.120:0/390663159 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf0048020 con 0x56484d8d40e0 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7febd6ffd640 1 -- 172.21.15.120:0/390663159 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf0051030 con 0x56484d8d40e0 2024-09-07T03:32:33.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.722+0000 7febd6ffd640 1 -- 172.21.15.120:0/390663159 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf0014a00 con 0x56484d8d40e0 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 -- 172.21.15.120:0/390663159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 msgr2=0x56484d8d44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 --2- 172.21.15.120:0/390663159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8d44e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fecf0053e70 tx=0x7fecf0054040 comp rx=0 tx=0).stop 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 -- 172.21.15.120:0/390663159 shutdown_connections 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 --2- 172.21.15.120:0/390663159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8d44e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 -- 172.21.15.120:0/390663159 >> 172.21.15.120:0/390663159 conn(0x56484d8d04e0 msgr2=0x56484d8ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 -- 172.21.15.120:0/390663159 shutdown_connections 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 -- 172.21.15.120:0/390663159 wait complete. 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 Processor -- start 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 -- start start 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8db6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecfa440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56484d8d50f0 con 0x56484d8d40e0 2024-09-07T03:32:33.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecf872b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8db6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecf872b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8db6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41396/0 (socket says 172.21.15.120:41396) 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.723+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 learned_addr learned my addr 172.21.15.120:0/3467571602 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.724+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484d8dbc30 con 0x56484d8d40e0 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.724+0000 7fecf872b640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8db6d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fecf0012500 tx=0x7fecf0053dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.724+0000 7febd57fa640 1 -- 172.21.15.120:0/3467571602 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf0028480 con 0x56484d8d40e0 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.724+0000 7febd57fa640 1 -- 172.21.15.120:0/3467571602 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf0028620 con 0x56484d8d40e0 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.724+0000 7febd57fa640 1 -- 172.21.15.120:0/3467571602 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf0028900 con 0x56484d8d40e0 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.724+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56484d8dbec0 con 0x56484d8d40e0 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.724+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484d8dc840 con 0x56484d8d40e0 2024-09-07T03:32:33.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.725+0000 7febd57fa640 1 -- 172.21.15.120:0/3467571602 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fecf004b020 con 0x56484d8d40e0 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.725+0000 7febd57fa640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febc003c730 0x7febc003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.725+0000 7febd57fa640 1 -- 172.21.15.120:0/3467571602 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fecf0030070 con 0x56484d8d40e0 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.725+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febc003c730 0x7febc003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.725+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febc003c730 0x7febc003ebf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fece8016720 tx=0x7fece804d420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.725+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.725+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8e71d0 0x56484d8e9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.725+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8e9de0 con 0x56484d8e71d0 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7feceffff640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8e71d0 0x56484d8e9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7feceffff640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8e71d0 0x56484d8e9690 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7fecfa440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7fecfa440800 20 realm 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8ea210 con 0x56484d8e71d0 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7fecfa440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7fecfa440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.726+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8eaae0 con 0x56484d8e71d0 2024-09-07T03:32:33.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecfa440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8eb500 0x56484d8ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8ee0a0 con 0x56484d8eb500 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecf872b640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8eb500 0x56484d8ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecf872b640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8eb500 0x56484d8ed930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecfa440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.727+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8ee8f0 con 0x56484d8eb500 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecfa440800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecfa440800 20 searching for the correct realm 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56484d8f0660 0x56484d8f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8f0660 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56484d8f0660 0x56484d8f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecf7f2a640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56484d8f0660 0x56484d8f2a90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8eb500 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.728+0000 7fecf872b640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fecf004d040 0x7fecf004d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.729+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x7fecf004d040 2024-09-07T03:32:33.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.729+0000 7feceffff640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fecf004d040 0x7fecf004d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.729+0000 7feceffff640 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fecf004d040 0x7fecf004d8a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.729+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.729+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.729+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.729+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.729+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.729+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8f0660 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.730+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.730+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.730+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.730+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8eb500 2024-09-07T03:32:33.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.730+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.730+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8eb500 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.730+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.730+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.731+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.731+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x7fecf004d040 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.731+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.731+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.731+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.731+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x7fecf004d040 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.731+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.731+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8eb500 2024-09-07T03:32:33.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.732+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.732+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8f0660 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.732+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.732+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.732+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.732+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8eb500 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.732+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.732+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8f0660 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8f0660 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.733+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x7fecf004d040 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.734+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.734+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8e71d0 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.734+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.734+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x7fecf004d040 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.734+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.734+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8f0660 2024-09-07T03:32:33.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.734+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.734+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x7fecf004d040 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.735+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.735+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8eb500 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.735+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.735+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8eb500 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.735+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.735+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8f0660 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.735+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.735+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8eb500 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3160 con 0x56484d8eb500 2024-09-07T03:32:33.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8ef270 con 0x56484d8e71d0 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8eee50 con 0x56484d8eb500 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8efbe0 con 0x56484d8e71d0 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.736+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 zone default found 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 4 Realm: () 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 zonegroup default 2024-09-07T03:32:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f3a90 con 0x7fecf004d040 2024-09-07T03:32:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f5cd0 con 0x56484d8f0660 2024-09-07T03:32:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f6070 con 0x56484d8f0660 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 started sync module instance, tier type = 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.737+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f5110 con 0x56484d8eb500 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.738+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.738+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94868538873392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f5110 con 0x56484d8eb500 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.738+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f6a30 con 0x56484d8e71d0 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.739+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94868538873392] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.739+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.739+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94868538870880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f5080 con 0x56484d8e71d0 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.739+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f78f0 con 0x56484d8eb500 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.740+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94868538870880] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.740+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.741+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94868538879520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f78f0 con 0x56484d8eb500 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.741+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f8340 con 0x7fecf004d040 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.742+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94868538879520] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.742+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.742+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94868538883664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f78f0 con 0x7fecf004d040 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.742+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f8db0 con 0x56484d8eb500 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.743+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.743+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94868538886304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f8d70 con 0x56484d8eb500 2024-09-07T03:32:33.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.743+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8f9d10 con 0x56484d8f0660 2024-09-07T03:32:33.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.743+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94868538883664] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.744+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.744+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94868538890272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8fa130 con 0x56484d8f0660 2024-09-07T03:32:33.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.744+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8faaf0 con 0x56484d8f0660 2024-09-07T03:32:33.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.745+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94868538886304] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.745+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94868538890272] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.745+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.745+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94868538888608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8faaf0 con 0x56484d8f0660 2024-09-07T03:32:33.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.745+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8fb380 con 0x7fecf004d040 2024-09-07T03:32:33.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94868538895088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8faf90 con 0x7fecf004d040 2024-09-07T03:32:33.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7fecfa440800 20 add_watcher() i=0 2024-09-07T03:32:33.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7fecfa440800 20 add_watcher() i=1 2024-09-07T03:32:33.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7fecfa440800 20 add_watcher() i=2 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7fecfa440800 20 add_watcher() i=3 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7fecfa440800 20 add_watcher() i=4 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7fecfa440800 20 add_watcher() i=5 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94868538888608] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.746+0000 7fecfa440800 20 add_watcher() i=6 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.747+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94868538895088] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.747+0000 7fecfa440800 20 add_watcher() i=7 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.747+0000 7fecfa440800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.747+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d8fa640 con 0x56484d8e71d0 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.747+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.747+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94868538898144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d8fa640 con 0x56484d8e71d0 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.748+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94868538898144] v34'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.748+0000 7febadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.748+0000 7fecfa440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.748+0000 7fecfa440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 5 note: GC not initialized 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7febacfe1640 20 reqs_thread_entry: start 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 20 Filter name: none 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7feb267fc640 20 reqs_thread_entry: start 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d9319d0 con 0x56484d8e71d0 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:33.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.749+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d9322e0 con 0x56484d8f0660 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.750+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.750+0000 7fecfa440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.750+0000 7fecfa440800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.750+0000 7fecfa440800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.750+0000 7fecfa440800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.750+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d937c50 con 0x56484d8e71d0 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v34'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7fecfa440800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7fecfa440800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7fecfa440800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94868539143760 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d933330 con 0x56484d8eb500 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94868538886304 notify 146028888067 ret 0) ==== 720+0+0 (crc 0 0 0) 0x56484d8dc840 con 0x56484d8eb500 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7febd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94868538886304 notifier 4337 bl.length()=678 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(65 notify.4 [notify cookie 94868539143760 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7febd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7febd6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.751+0000 7febd6ffd640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7febbc003ea0 con 0x56484d8eb500 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.752+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.752+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94868539143760 notify 146028888067 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56484d8dbec0 con 0x56484d8eb500 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.752+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d937650 con 0x56484d8f0660 2024-09-07T03:32:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7fecfa440800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7fecfa440800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7fecfa440800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94868539143760 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56484d930030 con 0x56484d8eb500 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== watch-notify(notify (1) cookie 94868538879520 notify 146028888068 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56484d8dbec0 con 0x56484d8eb500 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(68 notify.2 [notify cookie 94868539143760 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7febd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888068 cookie 94868538879520 notifier 4337 bl.length()=177 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7febd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7febd6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7febd6ffd640 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7febbc003ea0 con 0x56484d8eb500 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.753+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== watch-notify(notify_complete (2) cookie 94868539143760 notify 146028888068 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56484d8dbc30 con 0x56484d8eb500 2024-09-07T03:32:33.779 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-07T03:32:33.751107Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:33.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.754+0000 7febadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.754+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94868538898144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d933760 con 0x56484d8e71d0 2024-09-07T03:32:33.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.755+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94868538898144] v34'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.755+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94868538873392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d92f7a0 con 0x56484d8eb500 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.756+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94868538873392] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.756+0000 7fecfa440800 20 remove_watcher() i=0 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.756+0000 7fecfa440800 2 removed watcher, disabling cache 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.756+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94868538870880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d92f7a0 con 0x56484d8e71d0 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.757+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94868538870880] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece0051070 con 0x56484d8e71d0 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.757+0000 7fecfa440800 20 remove_watcher() i=1 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.757+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94868538879520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d92f7a0 con 0x56484d8eb500 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.758+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94868538879520] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.758+0000 7fecfa440800 20 remove_watcher() i=2 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.758+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94868538883664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d92f7a0 con 0x7fecf004d040 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.759+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94868538883664] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.759+0000 7fecfa440800 20 remove_watcher() i=3 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.759+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94868538886304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d92f7a0 con 0x56484d8eb500 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.760+0000 7fecf872b640 1 -- 172.21.15.120:0/3467571602 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94868538886304] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf003a020 con 0x56484d8eb500 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.760+0000 7fecfa440800 20 remove_watcher() i=4 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.760+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94868538890272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d92f7a0 con 0x56484d8f0660 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.761+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94868538890272] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.761+0000 7fecfa440800 20 remove_watcher() i=5 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.761+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94868538888608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d92f7a0 con 0x56484d8f0660 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.762+0000 7fecf7f2a640 1 -- 172.21.15.120:0/3467571602 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94868538888608] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece805a040 con 0x56484d8f0660 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.762+0000 7fecfa440800 20 remove_watcher() i=6 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.762+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94868538895088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56484d92f7a0 con 0x7fecf004d040 2024-09-07T03:32:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94868538895088] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fece0051070 con 0x7fecf004d040 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 20 remove_watcher() i=7 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8eb500 msgr2=0x56484d8ed930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8eb500 0x56484d8ed930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8e71d0 msgr2=0x56484d8e9690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8e71d0 0x56484d8e9690 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fecf004d040 msgr2=0x7fecf004d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fecf004d040 0x7fecf004d8a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56484d8f0660 msgr2=0x56484d8f2a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56484d8f0660 0x56484d8f2a90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febc003c730 msgr2=0x7febc003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febc003c730 0x7febc003ebf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fece8016720 tx=0x7fece804d420 comp rx=0 tx=0).stop 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 msgr2=0x56484d8db6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8db6d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fecf0012500 tx=0x7fecf0053dd0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7feceffff640 1 -- 172.21.15.120:0/3467571602 reap_dead start 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 shutdown_connections 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 --2- 172.21.15.120:0/3467571602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8d40e0 0x56484d8db6d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 >> 172.21.15.120:0/3467571602 conn(0x56484d8d04e0 msgr2=0x56484d8ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 shutdown_connections 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/3467571602 wait complete. 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/2427011471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febd003c730 msgr2=0x7febd003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 --2- 172.21.15.120:0/2427011471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febd003c730 0x7febd003ebf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x56484d8b7d30 tx=0x7fece8043040 comp rx=0 tx=0).stop 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 -- 172.21.15.120:0/2427011471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8c75c0 msgr2=0x56484d8c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.763+0000 7fecfa440800 1 --2- 172.21.15.120:0/2427011471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8c75c0 0x56484d8c79e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fecf0016d20 tx=0x7fecf000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/2427011471 shutdown_connections 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/2427011471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febd003c730 0x7febd003ebf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/2427011471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d8c75c0 0x56484d8c79e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/2427011471 >> 172.21.15.120:0/2427011471 conn(0x56484d8bb970 msgr2=0x56484d8bbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/2427011471 shutdown_connections 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/2427011471 wait complete. 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8b4e20 msgr2=0x56484d8b7210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8b4e20 0x56484d8b7210 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8ae1b0 msgr2=0x56484d8b3b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8ae1b0 0x56484d8b3b10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febe003c730 msgr2=0x7febe003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febe003c730 0x7febe003ebf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fece0057000 tx=0x7fece0052000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 msgr2=0x56484d8ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 0x56484d8ac4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fece800c010 tx=0x7fece8000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 shutdown_connections 2024-09-07T03:32:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56484d8b4e20 0x56484d8b7210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56484d8ae1b0 0x56484d8b3b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7febe003c730 0x7febe003ebf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 --2- 172.21.15.120:0/648033782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56484d7b2fe0 0x56484d8ac4c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 >> 172.21.15.120:0/648033782 conn(0x56484d7ad210 msgr2=0x56484d8a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 shutdown_connections 2024-09-07T03:32:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.764+0000 7fecfa440800 1 -- 172.21.15.120:0/648033782 wait complete. 2024-09-07T03:32:33.790 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-07T03:32:33.751107Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:33.790 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-07T03:32:33.790 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-07T03:32:33.791 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-07T03:32:33.835 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:33.835 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:33.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc27b121800 1 Processor -- start 2024-09-07T03:32:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc27b121800 1 -- start start 2024-09-07T03:32:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc27b121800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c8dcf2eff0 0x55c8dcf2fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc27b121800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c8dcdd8e40 con 0x55c8dcf300f0 2024-09-07T03:32:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc27b121800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55c8dcda3680 con 0x55c8dcf2eff0 2024-09-07T03:32:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc276e0c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c8dcf2eff0 0x55c8dcf2fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc26ffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55c8dcf300f0 0x55c8dcf34e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48310/0 (socket says 172.21.15.120:48310) 2024-09-07T03:32:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc26ffff640 1 -- 172.21.15.120:0/1498213178 learned_addr learned my addr 172.21.15.120:0/1498213178 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc276e0c640 1 -- 172.21.15.120:0/1498213178 >> v1:172.21.15.104:6789/0 conn(0x55c8dcf300f0 legacy=0x55c8dcf34e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.835+0000 7fc276e0c640 1 -- 172.21.15.120:0/1498213178 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8dcdbf6b0 con 0x55c8dcf2eff0 2024-09-07T03:32:33.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.837+0000 7fc276e0c640 1 --2- 172.21.15.120:0/1498213178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dcf2fbb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc26800a470 tx=0x7fc268045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cff43af816cbea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.837+0000 7fc27660b640 1 -- 172.21.15.120:0/1498213178 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc268053570 con 0x55c8dcf2eff0 2024-09-07T03:32:33.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.837+0000 7fc27660b640 1 -- 172.21.15.120:0/1498213178 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc268058070 con 0x55c8dcf2eff0 2024-09-07T03:32:33.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.837+0000 7fc27660b640 1 -- 172.21.15.120:0/1498213178 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc268053880 con 0x55c8dcf2eff0 2024-09-07T03:32:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.838+0000 7fc27b121800 1 -- 172.21.15.120:0/1498213178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 msgr2=0x55c8dcf2fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.838+0000 7fc27b121800 1 --2- 172.21.15.120:0/1498213178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dcf2fbb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc26800a470 tx=0x7fc268045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.838+0000 7fc27b121800 1 -- 172.21.15.120:0/1498213178 shutdown_connections 2024-09-07T03:32:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.838+0000 7fc27b121800 1 --2- 172.21.15.120:0/1498213178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dcf2fbb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.838+0000 7fc27b121800 1 -- 172.21.15.120:0/1498213178 >> 172.21.15.120:0/1498213178 conn(0x55c8dcf2a3c0 msgr2=0x55c8dcf2c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.838+0000 7fc27b121800 1 -- 172.21.15.120:0/1498213178 shutdown_connections 2024-09-07T03:32:33.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.838+0000 7fc27b121800 1 -- 172.21.15.120:0/1498213178 wait complete. 2024-09-07T03:32:33.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.852+0000 7fc27b121800 1 Processor -- start 2024-09-07T03:32:33.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.852+0000 7fc27b121800 1 -- start start 2024-09-07T03:32:33.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.852+0000 7fc27b121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dd01e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.852+0000 7fc27b121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c8dcdc7dd0 con 0x55c8dcf2eff0 2024-09-07T03:32:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.852+0000 7fc276e0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dd01e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.852+0000 7fc276e0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dd01e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41416/0 (socket says 172.21.15.120:41416) 2024-09-07T03:32:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.852+0000 7fc276e0c640 1 -- 172.21.15.120:0/3367950195 learned_addr learned my addr 172.21.15.120:0/3367950195 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.852+0000 7fc276e0c640 1 -- 172.21.15.120:0/3367950195 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8dcde0e10 con 0x55c8dcf2eff0 2024-09-07T03:32:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.853+0000 7fc276e0c640 1 --2- 172.21.15.120:0/3367950195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dd01e5f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc268025c20 tx=0x7fc268051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec5bd0b54e64b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.853+0000 7fc164e09640 1 -- 172.21.15.120:0/3367950195 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc268053a20 con 0x55c8dcf2eff0 2024-09-07T03:32:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.853+0000 7fc164e09640 1 -- 172.21.15.120:0/3367950195 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc268063070 con 0x55c8dcf2eff0 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.853+0000 7fc164e09640 1 -- 172.21.15.120:0/3367950195 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc268053cf0 con 0x55c8dcf2eff0 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.853+0000 7fc27b121800 1 -- 172.21.15.120:0/3367950195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 msgr2=0x55c8dd01e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.853+0000 7fc27b121800 1 --2- 172.21.15.120:0/3367950195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dd01e5f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc268025c20 tx=0x7fc268051000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc27b121800 1 -- 172.21.15.120:0/3367950195 shutdown_connections 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc27b121800 1 --2- 172.21.15.120:0/3367950195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dd01e5f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc27b121800 1 -- 172.21.15.120:0/3367950195 >> 172.21.15.120:0/3367950195 conn(0x55c8dcf2a3c0 msgr2=0x55c8dd019f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc27b121800 1 -- 172.21.15.120:0/3367950195 shutdown_connections 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc27b121800 1 -- 172.21.15.120:0/3367950195 wait complete. 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc27b121800 1 Processor -- start 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc27b121800 1 -- start start 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc27b121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dcea4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc27b121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c8dcf307e0 con 0x55c8dcf2eff0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc276e0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dcea4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc276e0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dcea4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41424/0 (socket says 172.21.15.120:41424) 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc276e0c640 1 -- 172.21.15.120:0/1145950777 learned_addr learned my addr 172.21.15.120:0/1145950777 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.854+0000 7fc276e0c640 1 -- 172.21.15.120:0/1145950777 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8dcea4bc0 con 0x55c8dcf2eff0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.855+0000 7fc276e0c640 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dcea4660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc268025c20 tx=0x7fc268002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.855+0000 7fc163606640 1 -- 172.21.15.120:0/1145950777 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc26806c030 con 0x55c8dcf2eff0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.855+0000 7fc163606640 1 -- 172.21.15.120:0/1145950777 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc268068660 con 0x55c8dcf2eff0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.855+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8dcea2f70 con 0x55c8dcf2eff0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.855+0000 7fc163606640 1 -- 172.21.15.120:0/1145950777 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc268068940 con 0x55c8dcf2eff0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.855+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8dcea3530 con 0x55c8dcf2eff0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.856+0000 7fc163606640 1 -- 172.21.15.120:0/1145950777 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc268068ae0 con 0x55c8dcf2eff0 2024-09-07T03:32:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.856+0000 7fc163606640 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15c03c730 0x7fc15c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.856+0000 7fc163606640 1 -- 172.21.15.120:0/1145950777 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fc268097fe0 con 0x55c8dcf2eff0 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.856+0000 7fc26ffff640 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15c03c730 0x7fc15c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.856+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dcf300f0 0x55c8dd02f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.856+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd02f850 con 0x55c8dcf300f0 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.856+0000 7fc27760d640 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dcf300f0 0x55c8dd02f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.856+0000 7fc26ffff640 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15c03c730 0x7fc15c03ebf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc260001d70 tx=0x7fc2600012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.856+0000 7fc27760d640 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dcf300f0 0x55c8dd02f310 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.857+0000 7fc27760d640 1 -- 172.21.15.120:0/1145950777 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc27000a4d0 con 0x55c8dcf300f0 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.857+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd030620 0x55c8dd032a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.857+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd033070 con 0x55c8dd030620 2024-09-07T03:32:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.857+0000 7fc276e0c640 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd030620 0x55c8dd032a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.857+0000 7fc276e0c640 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd030620 0x55c8dd032a10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.858+0000 7fc276e0c640 1 -- 172.21.15.120:0/1145950777 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd030620 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.858+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd034920 con 0x55c8dd030620 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.858+0000 7fc276e0c640 1 -- 172.21.15.120:0/1145950777 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd030620 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.858+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd033a60 con 0x55c8dd030620 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.858+0000 7fc276e0c640 1 -- 172.21.15.120:0/1145950777 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd030620 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.858+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd033ec0 con 0x55c8dcf300f0 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.859+0000 7fc27760d640 1 -- 172.21.15.120:0/1145950777 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc27000a4d0 con 0x55c8dcf300f0 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.859+0000 7fc27b121800 1 Processor -- start 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.859+0000 7fc27b121800 1 -- start start 2024-09-07T03:32:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.859+0000 7fc27b121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd042e20 0x55c8dd043240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.859+0000 7fc27b121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c8dce25a00 con 0x55c8dd042e20 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.859+0000 7fc27760d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd042e20 0x55c8dd043240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.859+0000 7fc27760d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd042e20 0x55c8dd043240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41430/0 (socket says 172.21.15.120:41430) 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.859+0000 7fc27760d640 1 -- 172.21.15.120:0/1113857794 learned_addr learned my addr 172.21.15.120:0/1113857794 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.860+0000 7fc27760d640 1 -- 172.21.15.120:0/1113857794 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8dd043880 con 0x55c8dd042e20 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.860+0000 7fc27760d640 1 --2- 172.21.15.120:0/1113857794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd042e20 0x55c8dd043240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc270016d20 tx=0x7fc27000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.860+0000 7fc160e01640 1 -- 172.21.15.120:0/1113857794 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc270017660 con 0x55c8dd042e20 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.860+0000 7fc160e01640 1 -- 172.21.15.120:0/1113857794 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc27001b030 con 0x55c8dd042e20 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.860+0000 7fc160e01640 1 -- 172.21.15.120:0/1113857794 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc270017950 con 0x55c8dd042e20 2024-09-07T03:32:33.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.860+0000 7fc27b121800 1 -- 172.21.15.120:0/1113857794 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8dd0440b0 con 0x55c8dd042e20 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.860+0000 7fc27b121800 1 -- 172.21.15.120:0/1113857794 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8dd044650 con 0x55c8dd042e20 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.861+0000 7fc160e01640 1 -- 172.21.15.120:0/1113857794 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc270017b40 con 0x55c8dd042e20 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.861+0000 7fc160e01640 1 --2- 172.21.15.120:0/1113857794 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15003c730 0x7fc15003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.861+0000 7fc160e01640 1 -- 172.21.15.120:0/1113857794 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fc27000e040 con 0x55c8dd042e20 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.861+0000 7fc276e0c640 1 --2- 172.21.15.120:0/1113857794 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15003c730 0x7fc15003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.861+0000 7fc27b121800 1 Processor -- start 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.861+0000 7fc276e0c640 1 --2- 172.21.15.120:0/1113857794 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15003c730 0x7fc15003ebf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55c8dd02fde0 tx=0x7fc268081040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.861+0000 7fc27b121800 1 -- start start 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.861+0000 7fc27b121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd04fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.861+0000 7fc27b121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c8dd01ede0 con 0x55c8dd04f8a0 2024-09-07T03:32:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27760d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd04fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27760d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd04fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41434/0 (socket says 172.21.15.120:41434) 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27760d640 1 -- 172.21.15.120:0/3252087070 learned_addr learned my addr 172.21.15.120:0/3252087070 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27760d640 1 -- 172.21.15.120:0/3252087070 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8dd050290 con 0x55c8dd04f8a0 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27760d640 1 --2- 172.21.15.120:0/3252087070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd04fca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc270013450 tx=0x7fc270053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea32450b6c00e9f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc15a7fc640 1 -- 172.21.15.120:0/3252087070 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc270014a00 con 0x55c8dd04f8a0 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc15a7fc640 1 -- 172.21.15.120:0/3252087070 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc270051070 con 0x55c8dd04f8a0 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc15a7fc640 1 -- 172.21.15.120:0/3252087070 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc270028350 con 0x55c8dd04f8a0 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27b121800 1 -- 172.21.15.120:0/3252087070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 msgr2=0x55c8dd04fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27b121800 1 --2- 172.21.15.120:0/3252087070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd04fca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc270013450 tx=0x7fc270053f40 comp rx=0 tx=0).stop 2024-09-07T03:32:33.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27b121800 1 -- 172.21.15.120:0/3252087070 shutdown_connections 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27b121800 1 --2- 172.21.15.120:0/3252087070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd04fca0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.862+0000 7fc27b121800 1 -- 172.21.15.120:0/3252087070 >> 172.21.15.120:0/3252087070 conn(0x55c8dd04bca0 msgr2=0x55c8dd049ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27b121800 1 -- 172.21.15.120:0/3252087070 shutdown_connections 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27b121800 1 -- 172.21.15.120:0/3252087070 wait complete. 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27b121800 1 Processor -- start 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27b121800 1 -- start start 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27b121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd056f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27b121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c8dd0508b0 con 0x55c8dd04f8a0 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27760d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd056f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27760d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd056f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41442/0 (socket says 172.21.15.120:41442) 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 learned_addr learned my addr 172.21.15.120:0/620212603 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.863+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8dd0574a0 con 0x55c8dd04f8a0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.864+0000 7fc27760d640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd056f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc270053f80 tx=0x7fc270053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.864+0000 7fc158ff9640 1 -- 172.21.15.120:0/620212603 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc270005030 con 0x55c8dd04f8a0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.864+0000 7fc158ff9640 1 -- 172.21.15.120:0/620212603 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2700051d0 con 0x55c8dd04f8a0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.864+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8dd057730 con 0x55c8dd04f8a0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.864+0000 7fc158ff9640 1 -- 172.21.15.120:0/620212603 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc270005510 con 0x55c8dd04f8a0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.864+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8dd0580b0 con 0x55c8dd04f8a0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.864+0000 7fc158ff9640 1 -- 172.21.15.120:0/620212603 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc270055240 con 0x55c8dd04f8a0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.865+0000 7fc158ff9640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc14003c730 0x7fc14003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.865+0000 7fc158ff9640 1 -- 172.21.15.120:0/620212603 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fc270055040 con 0x55c8dd04f8a0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.865+0000 7fc276e0c640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc14003c730 0x7fc14003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.865+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.865+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dd062920 0x55c8dd064de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.865+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd065530 con 0x55c8dd062920 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.865+0000 7fc26ffff640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dd062920 0x55c8dd064de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.865+0000 7fc276e0c640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc14003c730 0x7fc14003ebf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc268098300 tx=0x7fc268083000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.865+0000 7fc26ffff640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dd062920 0x55c8dd064de0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc260009050 con 0x55c8dd062920 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 20 realm 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd061cc0 con 0x55c8dd062920 2024-09-07T03:32:33.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc260009050 con 0x55c8dd062920 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd066010 con 0x55c8dd062920 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc260009050 con 0x55c8dd062920 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd066df0 0x55c8dd0691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0698b0 con 0x55c8dd066df0 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27760d640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd066df0 0x55c8dd0691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.866+0000 7fc27760d640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd066df0 0x55c8dd0691e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc27b121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06a150 con 0x55c8dd066df0 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc27b121800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc27b121800 20 searching for the correct realm 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c8dd06bec0 0x55c8dd06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd06bec0 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc276e0c640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c8dd06bec0 0x55c8dd06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.867+0000 7fc276e0c640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c8dd06bec0 0x55c8dd06e2d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.868+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.868+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd066df0 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.868+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.868+0000 7fc27760d640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc270020a20 0x7fc270052170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.868+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x7fc270020a20 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.868+0000 7fc26ffff640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc270020a20 0x7fc270052170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.869+0000 7fc26ffff640 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc270020a20 0x7fc270052170 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.869+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260009050 con 0x7fc270020a20 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.869+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.869+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260009050 con 0x55c8dd062920 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.869+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.869+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.869+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd06bec0 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.869+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.870+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.870+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.870+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd066df0 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.870+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.870+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd066df0 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.870+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.870+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.871+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.871+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x7fc270020a20 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.871+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.871+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.871+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.871+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x7fc270020a20 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.871+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.871+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd066df0 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.872+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.872+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd06bec0 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.872+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.872+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.872+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.872+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd066df0 2024-09-07T03:32:33.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.873+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.873+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd06bec0 2024-09-07T03:32:33.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.873+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.873+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.873+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.873+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.873+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.873+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.873+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.874+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd06bec0 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.874+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.874+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x7fc270020a20 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.874+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.874+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd062920 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.874+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.874+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x7fc270020a20 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.874+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.874+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd06bec0 2024-09-07T03:32:33.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.875+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.875+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x7fc270020a20 2024-09-07T03:32:33.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.875+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.875+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd066df0 2024-09-07T03:32:33.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.875+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.875+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd066df0 2024-09-07T03:32:33.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd06bec0 2024-09-07T03:32:33.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd066df0 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06e9a0 con 0x55c8dd066df0 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27b121800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27b121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27b121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27b121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27b121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27b121800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06aad0 con 0x55c8dd062920 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.876+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06af20 con 0x55c8dd066df0 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06b380 con 0x55c8dd062920 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 zone default found 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 4 Realm: () 2024-09-07T03:32:33.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 zonegroup default 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd06ee70 con 0x7fc270020a20 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.877+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd071150 con 0x55c8dd06bec0 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.878+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.878+0000 7fc27b121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.878+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.878+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd071540 con 0x55c8dd06bec0 2024-09-07T03:32:33.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.878+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.878+0000 7fc27b121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.878+0000 7fc27b121800 20 started sync module instance, tier type = 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.878+0000 7fc27b121800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.878+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0705e0 con 0x55c8dd066df0 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.879+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.879+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94321190046160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd071e50 con 0x55c8dd066df0 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.879+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0726a0 con 0x55c8dd062920 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.880+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.880+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94321190051408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd072920 con 0x55c8dd062920 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.880+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd073440 con 0x55c8dd066df0 2024-09-07T03:32:33.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.880+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94321190046160] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.881+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94321190051408] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.881+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.881+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94321190055696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd073400 con 0x55c8dd066df0 2024-09-07T03:32:33.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.881+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd073ce0 con 0x7fc270020a20 2024-09-07T03:32:33.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.882+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94321190055696] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.882+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.882+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94321190050208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd073400 con 0x7fc270020a20 2024-09-07T03:32:33.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.882+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0743f0 con 0x55c8dd066df0 2024-09-07T03:32:33.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.883+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94321190050208] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.884+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.884+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94321190059728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0743f0 con 0x55c8dd066df0 2024-09-07T03:32:33.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.884+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd074e00 con 0x55c8dd06bec0 2024-09-07T03:32:33.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.885+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.885+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94321190062416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd074d70 con 0x55c8dd06bec0 2024-09-07T03:32:33.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.885+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd075db0 con 0x55c8dd06bec0 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.885+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94321190059728] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.886+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94321190062416] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.887+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.887+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94321190064624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd075db0 con 0x55c8dd06bec0 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.887+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd076650 con 0x7fc270020a20 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94321190064624] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94321190057440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd075db0 con 0x7fc270020a20 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc27b121800 20 add_watcher() i=0 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc27b121800 20 add_watcher() i=1 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc27b121800 20 add_watcher() i=2 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc27b121800 20 add_watcher() i=3 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc27b121800 20 add_watcher() i=4 2024-09-07T03:32:33.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc27b121800 20 add_watcher() i=5 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.888+0000 7fc27b121800 20 add_watcher() i=6 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.889+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94321190057440] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.889+0000 7fc27b121800 20 add_watcher() i=7 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.889+0000 7fc27b121800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.889+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0797c0 con 0x55c8dd062920 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.890+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.890+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94321190068640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd076d10 con 0x55c8dd062920 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.891+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94321190068640] v34'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.891+0000 7fc12d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.891+0000 7fc27b121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.891+0000 7fc27b121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.891+0000 7fc27b121800 5 note: GC not initialized 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.891+0000 7fc0a7fff640 20 reqs_thread_entry: start 2024-09-07T03:32:33.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.891+0000 7fc27b121800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:33.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.891+0000 7fc27b121800 20 Filter name: none 2024-09-07T03:32:33.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.892+0000 7fc0a5ffb640 20 reqs_thread_entry: start 2024-09-07T03:32:33.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.892+0000 7fc27b121800 20 rados->read ofs=0 len=0 2024-09-07T03:32:33.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.892+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0ac390 con 0x55c8dd062920 2024-09-07T03:32:33.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.892+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.892+0000 7fc27b121800 20 rados_obj.operate() r=0 bl.length=502 2024-09-07T03:32:33.915 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-07T03:32:33.751107Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.893+0000 7fc12d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.893+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94321190068640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0aaea0 con 0x55c8dd062920 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.894+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94321190068640] v34'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.894+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94321190046160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0761a0 con 0x55c8dd066df0 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.895+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94321190046160] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.895+0000 7fc27b121800 20 remove_watcher() i=0 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.895+0000 7fc27b121800 2 removed watcher, disabling cache 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.895+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94321190051408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0709d0 con 0x55c8dd062920 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.896+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94321190051408] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc260028040 con 0x55c8dd062920 2024-09-07T03:32:33.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.896+0000 7fc27b121800 20 remove_watcher() i=1 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.896+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94321190055696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd071e50 con 0x55c8dd066df0 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.897+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94321190055696] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.897+0000 7fc27b121800 20 remove_watcher() i=2 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.897+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94321190050208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd072f10 con 0x7fc270020a20 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.898+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94321190050208] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.898+0000 7fc27b121800 20 remove_watcher() i=3 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.898+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94321190059728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0719a0 con 0x55c8dd066df0 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.899+0000 7fc27760d640 1 -- 172.21.15.120:0/620212603 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94321190059728] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc270027070 con 0x55c8dd066df0 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.899+0000 7fc27b121800 20 remove_watcher() i=4 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.899+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94321190062416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0719a0 con 0x55c8dd06bec0 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.900+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94321190062416] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.900+0000 7fc27b121800 20 remove_watcher() i=5 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.900+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94321190064624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd074950 con 0x55c8dd06bec0 2024-09-07T03:32:33.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.901+0000 7fc276e0c640 1 -- 172.21.15.120:0/620212603 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94321190064624] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc268051070 con 0x55c8dd06bec0 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.901+0000 7fc27b121800 20 remove_watcher() i=6 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.901+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94321190057440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c8dd0719a0 con 0x7fc270020a20 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94321190057440] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc260028040 con 0x7fc270020a20 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 20 remove_watcher() i=7 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd066df0 msgr2=0x55c8dd0691e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd066df0 0x55c8dd0691e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dd062920 msgr2=0x55c8dd064de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dd062920 0x55c8dd064de0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc270020a20 msgr2=0x7fc270052170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc270020a20 0x7fc270052170 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c8dd06bec0 msgr2=0x55c8dd06e2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c8dd06bec0 0x55c8dd06e2d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc14003c730 msgr2=0x7fc14003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc14003c730 0x7fc14003ebf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc268098300 tx=0x7fc268083000 comp rx=0 tx=0).stop 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 msgr2=0x55c8dd056f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd056f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc270053f80 tx=0x7fc270053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc26ffff640 1 -- 172.21.15.120:0/620212603 reap_dead start 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 shutdown_connections 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/620212603 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd04f8a0 0x55c8dd056f40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 >> 172.21.15.120:0/620212603 conn(0x55c8dd04bca0 msgr2=0x55c8dd049eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 shutdown_connections 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/620212603 wait complete. 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/1113857794 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15003c730 msgr2=0x7fc15003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/1113857794 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15003c730 0x7fc15003ebf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55c8dd02fde0 tx=0x7fc268081040 comp rx=0 tx=0).stop 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/1113857794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd042e20 msgr2=0x55c8dd043240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/1113857794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd042e20 0x55c8dd043240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc270016d20 tx=0x7fc27000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/1113857794 shutdown_connections 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/1113857794 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15003c730 0x7fc15003ebf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 --2- 172.21.15.120:0/1113857794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dd042e20 0x55c8dd043240 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/1113857794 >> 172.21.15.120:0/1113857794 conn(0x55c8dd0371d0 msgr2=0x55c8dd0375b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/1113857794 shutdown_connections 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.902+0000 7fc27b121800 1 -- 172.21.15.120:0/1113857794 wait complete. 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd030620 msgr2=0x55c8dd032a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd030620 0x55c8dd032a10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dcf300f0 msgr2=0x55c8dd02f310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dcf300f0 0x55c8dd02f310 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15c03c730 msgr2=0x7fc15c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15c03c730 0x7fc15c03ebf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc260001d70 tx=0x7fc2600012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 msgr2=0x55c8dcea4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dcea4660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc268025c20 tx=0x7fc268002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 shutdown_connections 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c8dd030620 0x55c8dd032a10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c8dcf300f0 0x55c8dd02f310 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc15c03c730 0x7fc15c03ebf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 --2- 172.21.15.120:0/1145950777 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c8dcf2eff0 0x55c8dcea4660 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 >> 172.21.15.120:0/1145950777 conn(0x55c8dcf2a3c0 msgr2=0x55c8dd018760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 shutdown_connections 2024-09-07T03:32:33.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.903+0000 7fc27b121800 1 -- 172.21.15.120:0/1145950777 wait complete. 2024-09-07T03:32:33.926 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-07T03:32:33.751107Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:33.926 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-07T03:32:33.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-07T03:32:33.926 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-07T03:32:33.973 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:33.973 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:33.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.972+0000 7f8b63e1b800 1 Processor -- start 2024-09-07T03:32:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.972+0000 7f8b63e1b800 1 -- start start 2024-09-07T03:32:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.973+0000 7f8b63e1b800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56505f1cef80 0x56505f1cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.973+0000 7f8b63e1b800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56505f104e40 con 0x56505f1cf8c0 2024-09-07T03:32:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.973+0000 7f8b63e1b800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56505f0cf680 con 0x56505f1cef80 2024-09-07T03:32:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.973+0000 7f8b5f5eb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56505f1cef80 0x56505f1cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.973+0000 7f8b5edea640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56505f1cf8c0 0x56505f262af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48324/0 (socket says 172.21.15.120:48324) 2024-09-07T03:32:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.973+0000 7f8b5edea640 1 -- 172.21.15.120:0/3094490490 learned_addr learned my addr 172.21.15.120:0/3094490490 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.973+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3094490490 >> v1:172.21.15.104:6789/0 conn(0x56505f1cf8c0 legacy=0x56505f262af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.973+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3094490490 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505f0eb6b0 con 0x56505f1cef80 2024-09-07T03:32:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.975+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/3094490490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f1cf380 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8b50005fd0 tx=0x7f8b50045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b810e71ddb3d700 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.975+0000 7f8b5e5e9640 1 -- 172.21.15.120:0/3094490490 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50058530 con 0x56505f1cef80 2024-09-07T03:32:33.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.975+0000 7f8b5e5e9640 1 -- 172.21.15.120:0/3094490490 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b500586d0 con 0x56505f1cef80 2024-09-07T03:32:33.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.975+0000 7f8b5e5e9640 1 -- 172.21.15.120:0/3094490490 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b500589d0 con 0x56505f1cef80 2024-09-07T03:32:33.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.976+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3094490490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 msgr2=0x56505f1cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:33.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.976+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3094490490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f1cf380 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8b50005fd0 tx=0x7f8b50045c30 comp rx=0 tx=0).stop 2024-09-07T03:32:33.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.976+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3094490490 shutdown_connections 2024-09-07T03:32:33.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.976+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3094490490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f1cf380 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:33.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.976+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3094490490 >> 172.21.15.120:0/3094490490 conn(0x56505f2563d0 msgr2=0x56505f258830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:33.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.976+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3094490490 shutdown_connections 2024-09-07T03:32:33.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.976+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3094490490 wait complete. 2024-09-07T03:32:33.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.990+0000 7f8b63e1b800 1 Processor -- start 2024-09-07T03:32:33.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.990+0000 7f8b63e1b800 1 -- start start 2024-09-07T03:32:33.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.990+0000 7f8b63e1b800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f34c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:33.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.990+0000 7f8b63e1b800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56505f0f3dd0 con 0x56505f1cef80 2024-09-07T03:32:33.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.990+0000 7f8b5f5eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f34c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:33.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.990+0000 7f8b5f5eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f34c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41460/0 (socket says 172.21.15.120:41460) 2024-09-07T03:32:33.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.990+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/2560411072 learned_addr learned my addr 172.21.15.120:0/2560411072 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:33.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.991+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/2560411072 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505f10ce10 con 0x56505f1cef80 2024-09-07T03:32:33.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.991+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/2560411072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f34c8c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b50025a60 tx=0x7f8b50051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6258e033ea582d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.991+0000 7f8a4d60a640 1 -- 172.21.15.120:0/2560411072 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b500589b0 con 0x56505f1cef80 2024-09-07T03:32:34.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.991+0000 7f8a4d60a640 1 -- 172.21.15.120:0/2560411072 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50068070 con 0x56505f1cef80 2024-09-07T03:32:34.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.991+0000 7f8a4d60a640 1 -- 172.21.15.120:0/2560411072 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50058c80 con 0x56505f1cef80 2024-09-07T03:32:34.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2560411072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 msgr2=0x56505f34c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2560411072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f34c8c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b50025a60 tx=0x7f8b50051000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2560411072 shutdown_connections 2024-09-07T03:32:34.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2560411072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f34c8c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2560411072 >> 172.21.15.120:0/2560411072 conn(0x56505f2563d0 msgr2=0x56505f348240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2560411072 shutdown_connections 2024-09-07T03:32:34.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2560411072 wait complete. 2024-09-07T03:32:34.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 Processor -- start 2024-09-07T03:32:34.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 -- start start 2024-09-07T03:32:34.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f354060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b63e1b800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56505f264420 con 0x56505f1cef80 2024-09-07T03:32:34.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b5f5eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f354060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b5f5eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f354060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41470/0 (socket says 172.21.15.120:41470) 2024-09-07T03:32:34.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.992+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/2732387927 learned_addr learned my addr 172.21.15.120:0/2732387927 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.993+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/2732387927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505f3545c0 con 0x56505f1cef80 2024-09-07T03:32:34.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.993+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f354060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8b50025a60 tx=0x7f8b50003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.993+0000 7f8a4be07640 1 -- 172.21.15.120:0/2732387927 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b500635f0 con 0x56505f1cef80 2024-09-07T03:32:34.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.993+0000 7f8a4be07640 1 -- 172.21.15.120:0/2732387927 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50063790 con 0x56505f1cef80 2024-09-07T03:32:34.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.993+0000 7f8a4be07640 1 -- 172.21.15.120:0/2732387927 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50063a90 con 0x56505f1cef80 2024-09-07T03:32:34.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.993+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56505f354850 con 0x56505f1cef80 2024-09-07T03:32:34.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.993+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505f355250 con 0x56505f1cef80 2024-09-07T03:32:34.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.994+0000 7f8a4be07640 1 -- 172.21.15.120:0/2732387927 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8b50075020 con 0x56505f1cef80 2024-09-07T03:32:34.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.994+0000 7f8a4be07640 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a4403c730 0x7f8a4403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.994+0000 7f8a4be07640 1 -- 172.21.15.120:0/2732387927 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8b50097f60 con 0x56505f1cef80 2024-09-07T03:32:34.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.994+0000 7f8b5edea640 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a4403c730 0x7f8a4403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.994+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f1cf8c0 0x56505f35b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.994+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f35bbf0 con 0x56505f1cf8c0 2024-09-07T03:32:34.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.994+0000 7f8b5fdec640 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f1cf8c0 0x56505f35b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.995+0000 7f8b5edea640 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a4403c730 0x7f8a4403ebf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8b54001d70 tx=0x7f8b540012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.995+0000 7f8b5fdec640 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f1cf8c0 0x56505f35b6b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.995+0000 7f8b5fdec640 1 -- 172.21.15.120:0/2732387927 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f1cf8c0 2024-09-07T03:32:34.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.995+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f35c4a0 0x56505f35e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.995+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f35f0b0 con 0x56505f35c4a0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.995+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f35c4a0 0x56505f35e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.995+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f35c4a0 0x56505f35e940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.996+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/2732387927 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f35c4a0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.996+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f360960 con 0x56505f35c4a0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.996+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/2732387927 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f35c4a0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.996+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f35faa0 con 0x56505f35c4a0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.996+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/2732387927 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f35c4a0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.996+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f35ff00 con 0x56505f1cf8c0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.997+0000 7f8b5fdec640 1 -- 172.21.15.120:0/2732387927 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f1cf8c0 2024-09-07T03:32:34.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.997+0000 7f8b63e1b800 1 Processor -- start 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.997+0000 7f8b63e1b800 1 -- start start 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.997+0000 7f8b63e1b800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f36ee30 0x56505f36f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.997+0000 7f8b63e1b800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56505f151a00 con 0x56505f36ee30 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.997+0000 7f8b5fdec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f36ee30 0x56505f36f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.997+0000 7f8b5fdec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f36ee30 0x56505f36f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41486/0 (socket says 172.21.15.120:41486) 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.997+0000 7f8b5fdec640 1 -- 172.21.15.120:0/2977702346 learned_addr learned my addr 172.21.15.120:0/2977702346 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.998+0000 7f8b5fdec640 1 -- 172.21.15.120:0/2977702346 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505f36f890 con 0x56505f36ee30 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.998+0000 7f8b5fdec640 1 --2- 172.21.15.120:0/2977702346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f36ee30 0x56505f36f250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800aa90 tx=0x7f8b5800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.998+0000 7f8a49602640 1 -- 172.21.15.120:0/2977702346 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b58007d70 con 0x56505f36ee30 2024-09-07T03:32:34.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.998+0000 7f8a49602640 1 -- 172.21.15.120:0/2977702346 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b58018430 con 0x56505f36ee30 2024-09-07T03:32:34.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.998+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2977702346 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56505f3700c0 con 0x56505f36ee30 2024-09-07T03:32:34.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.998+0000 7f8a49602640 1 -- 172.21.15.120:0/2977702346 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b58018750 con 0x56505f36ee30 2024-09-07T03:32:34.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.998+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2977702346 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505f370660 con 0x56505f36ee30 2024-09-07T03:32:34.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.999+0000 7f8a49602640 1 -- 172.21.15.120:0/2977702346 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8b58020020 con 0x56505f36ee30 2024-09-07T03:32:34.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.999+0000 7f8a49602640 1 --2- 172.21.15.120:0/2977702346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a3803c730 0x7f8a3803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.999+0000 7f8a49602640 1 -- 172.21.15.120:0/2977702346 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8b5801e020 con 0x56505f36ee30 2024-09-07T03:32:34.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.999+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/2977702346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a3803c730 0x7f8a3803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.999+0000 7f8b63e1b800 1 Processor -- start 2024-09-07T03:32:34.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.999+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/2977702346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a3803c730 0x7f8a3803ebf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x56505f355790 tx=0x7f8b50089040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:33.999+0000 7f8b63e1b800 1 -- start start 2024-09-07T03:32:34.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8b63e1b800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f37bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8b63e1b800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56505f34d050 con 0x56505f37b8d0 2024-09-07T03:32:34.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8b5fdec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f37bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8b5fdec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f37bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41502/0 (socket says 172.21.15.120:41502) 2024-09-07T03:32:34.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3540386173 learned_addr learned my addr 172.21.15.120:0/3540386173 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3540386173 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505f37c2a0 con 0x56505f37b8d0 2024-09-07T03:32:34.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8b5fdec640 1 --2- 172.21.15.120:0/3540386173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f37bcb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8b58053240 tx=0x7f8b58018ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7c3bf4829b38f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8a42ffd640 1 -- 172.21.15.120:0/3540386173 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b58020b60 con 0x56505f37b8d0 2024-09-07T03:32:34.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8a42ffd640 1 -- 172.21.15.120:0/3540386173 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b58016330 con 0x56505f37b8d0 2024-09-07T03:32:34.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.000+0000 7f8a42ffd640 1 -- 172.21.15.120:0/3540386173 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5804c530 con 0x56505f37b8d0 2024-09-07T03:32:34.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3540386173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 msgr2=0x56505f37bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3540386173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f37bcb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8b58053240 tx=0x7f8b58018ef0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3540386173 shutdown_connections 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3540386173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f37bcb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3540386173 >> 172.21.15.120:0/3540386173 conn(0x56505f377cd0 msgr2=0x56505f375f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3540386173 shutdown_connections 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3540386173 wait complete. 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 Processor -- start 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 -- start start 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f382ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b63e1b800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56505f37c8e0 con 0x56505f37b8d0 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b5fdec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f382ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b5fdec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f382ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41514/0 (socket says 172.21.15.120:41514) 2024-09-07T03:32:34.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.001+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 learned_addr learned my addr 172.21.15.120:0/3602811168 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.002+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505f383400 con 0x56505f37b8d0 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.002+0000 7f8b5fdec640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f382ea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8b58007790 tx=0x7f8b580531a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.002+0000 7f8a417fa640 1 -- 172.21.15.120:0/3602811168 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b58020b60 con 0x56505f37b8d0 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.002+0000 7f8a417fa640 1 -- 172.21.15.120:0/3602811168 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b58032070 con 0x56505f37b8d0 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.002+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56505f383690 con 0x56505f37b8d0 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.002+0000 7f8a417fa640 1 -- 172.21.15.120:0/3602811168 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b58020950 con 0x56505f37b8d0 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.002+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505f384010 con 0x56505f37b8d0 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.003+0000 7f8a417fa640 1 -- 172.21.15.120:0/3602811168 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8b58016040 con 0x56505f37b8d0 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.003+0000 7f8a417fa640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a2803c730 0x7f8a2803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.003+0000 7f8a417fa640 1 -- 172.21.15.120:0/3602811168 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8b5804b040 con 0x56505f37b8d0 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.003+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a2803c730 0x7f8a2803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.003+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a2803c730 0x7f8a2803ebf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8b5006b8d0 tx=0x7f8b5008d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f38e9b0 0x56505f390e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f3915c0 con 0x56505f38e9b0 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b5edea640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f38e9b0 0x56505f390e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b5edea640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f38e9b0 0x56505f390e70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b54009050 con 0x56505f38e9b0 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 20 realm 2024-09-07T03:32:34.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f38dd00 con 0x56505f38e9b0 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b54009050 con 0x56505f38e9b0 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.004+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f3920b0 con 0x56505f38e9b0 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b54009050 con 0x56505f38e9b0 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b63e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f392e90 0x56505f395280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f395950 con 0x56505f392e90 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b5fdec640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f392e90 0x56505f395280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b5fdec640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f392e90 0x56505f395280 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b63e1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.005+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f3961a0 con 0x56505f392e90 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.006+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.006+0000 7f8b63e1b800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.006+0000 7f8b63e1b800 20 searching for the correct realm 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.006+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56505f397f10 0x56505f39a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.006+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aa30 con 0x56505f397f10 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.006+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56505f397f10 0x56505f39a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.006+0000 7f8b5f5eb640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56505f397f10 0x56505f39a360 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.006+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.006+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aa30 con 0x56505f392e90 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.007+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.007+0000 7f8b5fdec640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8b580148b0 0x7f8b5801b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.007+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aa30 con 0x7f8b580148b0 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.007+0000 7f8b5edea640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8b580148b0 0x7f8b5801b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.007+0000 7f8b5edea640 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8b580148b0 0x7f8b5801b0d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.007+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54009050 con 0x7f8b580148b0 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.007+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aa30 con 0x56505f38e9b0 2024-09-07T03:32:34.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.008+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54009050 con 0x56505f38e9b0 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.008+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aa30 con 0x56505f38e9b0 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.008+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.008+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aa30 con 0x56505f397f10 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.008+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.008+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aa30 con 0x56505f38e9b0 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.008+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.008+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aa30 con 0x56505f392e90 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aa30 con 0x56505f392e90 2024-09-07T03:32:34.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f38e9b0 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x7f8b580148b0 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f38e9b0 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.009+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x7f8b580148b0 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.010+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.010+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f392e90 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.010+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.010+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f397f10 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.010+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.010+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f38e9b0 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.010+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.010+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f392e90 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.011+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.011+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f397f10 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.011+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.011+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f38e9b0 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.011+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.011+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f38e9b0 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.011+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.011+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f38e9b0 2024-09-07T03:32:34.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f397f10 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x7f8b580148b0 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f38e9b0 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x7f8b580148b0 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.012+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f397f10 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.013+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.013+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x7f8b580148b0 2024-09-07T03:32:34.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.013+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.013+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f392e90 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.013+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.013+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f392e90 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.013+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.013+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f397f10 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f392e90 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8b58066040 con 0x56505f392e90 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f3969f0 con 0x56505f38e9b0 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.014+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f396de0 con 0x56505f392e90 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b580083e0 con 0x56505f392e90 2024-09-07T03:32:34.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f396de0 con 0x56505f38e9b0 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 zone default found 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 4 Realm: () 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 zonegroup default 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f39aeb0 con 0x7f8b580148b0 2024-09-07T03:32:34.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f39cc40 con 0x56505f397f10 2024-09-07T03:32:34.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.015+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f39d100 con 0x56505f397f10 2024-09-07T03:32:34.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.016+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.016+0000 7f8b63e1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.016+0000 7f8b63e1b800 20 started sync module instance, tier type = 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.016+0000 7f8b63e1b800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.016+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39c0e0 con 0x56505f392e90 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.017+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.017+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903194994144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39c0e0 con 0x56505f392e90 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.017+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39dc10 con 0x56505f38e9b0 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.018+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.018+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94903194994144] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.018+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903194991664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39dbd0 con 0x56505f38e9b0 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.018+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39e690 con 0x56505f392e90 2024-09-07T03:32:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.019+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94903194991664] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.019+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.019+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94903195001248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39e690 con 0x56505f392e90 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.019+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39f160 con 0x7f8b580148b0 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.020+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94903195001248] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.020+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.020+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94903195003984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39f120 con 0x7f8b580148b0 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.021+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39fba0 con 0x56505f392e90 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.022+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94903195003984] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.022+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.022+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903194998496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39fba0 con 0x56505f392e90 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.022+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39fba0 con 0x56505f397f10 2024-09-07T03:32:34.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.023+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.023+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903195009280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3a0a70 con 0x56505f397f10 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.023+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3a1570 con 0x56505f397f10 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.023+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94903194998496] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.024+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94903195009280] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.024+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.024+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94903195010336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f39f6f0 con 0x56505f397f10 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.024+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3a1b50 con 0x7f8b580148b0 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94903195010336] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94903195013216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3a1b50 con 0x7f8b580148b0 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b63e1b800 20 add_watcher() i=0 2024-09-07T03:32:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b63e1b800 20 add_watcher() i=1 2024-09-07T03:32:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b63e1b800 20 add_watcher() i=2 2024-09-07T03:32:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b63e1b800 20 add_watcher() i=3 2024-09-07T03:32:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b63e1b800 20 add_watcher() i=4 2024-09-07T03:32:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b63e1b800 20 add_watcher() i=5 2024-09-07T03:32:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.025+0000 7f8b63e1b800 20 add_watcher() i=6 2024-09-07T03:32:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.026+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94903195013216] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.026+0000 7f8b63e1b800 20 add_watcher() i=7 2024-09-07T03:32:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.026+0000 7f8b63e1b800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.026+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f3a4fb0 con 0x56505f38e9b0 2024-09-07T03:32:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.027+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.027+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94903195015280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3a2500 con 0x56505f38e9b0 2024-09-07T03:32:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.028+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94903195015280] v34'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.028+0000 7f8a15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.028+0000 7f8b63e1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.028+0000 7f8b63e1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.028+0000 7f8b63e1b800 5 note: GC not initialized 2024-09-07T03:32:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.028+0000 7f8a14fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.028+0000 7f8b63e1b800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b63e1b800 20 Filter name: none 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f898e7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b63e1b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b63e1b800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d8070 con 0x56505f38e9b0 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b63e1b800 20 rados_obj.operate() r=0 bl.length=502 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b63e1b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b63e1b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b63e1b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.029+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3de550 con 0x56505f38e9b0 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.030+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.030+0000 7f8b63e1b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.030+0000 7f8b63e1b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.030+0000 7f8b63e1b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.030+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94903195262864 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d9bf0 con 0x56505f392e90 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.030+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94903194998496 notify 146028888069 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56505f384010 con 0x56505f392e90 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.031+0000 7f8a42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888069 cookie 94903194998496 notifier 4351 bl.length()=567 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.031+0000 7f8a42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.031+0000 7f8a42ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.031+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94903195262864 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.031+0000 7f8a42ffd640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8a24003ea0 con 0x56505f392e90 2024-09-07T03:32:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.031+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.031+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94903195262864 notify 146028888069 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56505f383690 con 0x56505f392e90 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.031+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3ddf90 con 0x56505f397f10 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.032+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.032+0000 7f8b63e1b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.032+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94903195262864 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d9bf0 con 0x56505f392e90 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.032+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== watch-notify(notify (1) cookie 94903195001248 notify 146028888070 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56505f383690 con 0x56505f392e90 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.032+0000 7f8a42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94903195001248 notifier 4351 bl.length()=170 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.032+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(67 notify.2 [notify cookie 94903195262864 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.032+0000 7f8a42ffd640 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8a24003ea0 con 0x56505f392e90 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.032+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.032+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== watch-notify(notify_complete (2) cookie 94903195262864 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56505f383400 con 0x56505f392e90 2024-09-07T03:32:34.055 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:34.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.033+0000 7f8a15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.033+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94903195015280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d5ec0 con 0x56505f38e9b0 2024-09-07T03:32:34.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.034+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94903195015280] v34'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.034+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94903194994144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d5ec0 con 0x56505f392e90 2024-09-07T03:32:34.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.035+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94903194994144] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.035+0000 7f8b63e1b800 20 remove_watcher() i=0 2024-09-07T03:32:34.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.035+0000 7f8b63e1b800 2 removed watcher, disabling cache 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.035+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94903194991664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d5ec0 con 0x56505f38e9b0 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.036+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94903194991664] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x56505f38e9b0 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.036+0000 7f8b63e1b800 20 remove_watcher() i=1 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.036+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94903195001248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d5ec0 con 0x56505f392e90 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.037+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94903195001248] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.037+0000 7f8b63e1b800 20 remove_watcher() i=2 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.037+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94903195003984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d5ec0 con 0x7f8b580148b0 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.038+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94903195003984] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.038+0000 7f8b63e1b800 20 remove_watcher() i=3 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.038+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94903194998496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d5ec0 con 0x56505f392e90 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.039+0000 7f8b5fdec640 1 -- 172.21.15.120:0/3602811168 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94903194998496] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b58073040 con 0x56505f392e90 2024-09-07T03:32:34.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.039+0000 7f8b63e1b800 20 remove_watcher() i=4 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.039+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94903195009280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d5ec0 con 0x56505f397f10 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.040+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94903195009280] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.040+0000 7f8b63e1b800 20 remove_watcher() i=5 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.040+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94903195010336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d5ec0 con 0x56505f397f10 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.041+0000 7f8b5f5eb640 1 -- 172.21.15.120:0/3602811168 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94903195010336] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b5006dd00 con 0x56505f397f10 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.041+0000 7f8b63e1b800 20 remove_watcher() i=6 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.041+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94903195013216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56505f3d5ec0 con 0x7f8b580148b0 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94903195013216] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b54028040 con 0x7f8b580148b0 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 20 remove_watcher() i=7 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f392e90 msgr2=0x56505f395280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f392e90 0x56505f395280 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f38e9b0 msgr2=0x56505f390e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f38e9b0 0x56505f390e70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8b580148b0 msgr2=0x7f8b5801b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8b580148b0 0x7f8b5801b0d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56505f397f10 msgr2=0x56505f39a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56505f397f10 0x56505f39a360 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a2803c730 msgr2=0x7f8a2803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a2803c730 0x7f8a2803ebf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8b5006b8d0 tx=0x7f8b5008d000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 msgr2=0x56505f382ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/3602811168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f37b8d0 0x56505f382ea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8b58007790 tx=0x7f8b580531a0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 reap_dead start 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b5edea640 1 -- 172.21.15.120:0/3602811168 reap_dead start 2024-09-07T03:32:34.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 shutdown_connections 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 >> 172.21.15.120:0/3602811168 conn(0x56505f377cd0 msgr2=0x56505f375ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 shutdown_connections 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.042+0000 7f8b63e1b800 1 -- 172.21.15.120:0/3602811168 wait complete. 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2977702346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a3803c730 msgr2=0x7f8a3803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2977702346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a3803c730 0x7f8a3803ebf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x56505f355790 tx=0x7f8b50089040 comp rx=0 tx=0).stop 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2977702346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f36ee30 msgr2=0x56505f36f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2977702346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f36ee30 0x56505f36f250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800aa90 tx=0x7f8b5800af50 comp rx=0 tx=0).stop 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2977702346 shutdown_connections 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2977702346 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a3803c730 0x7f8a3803ebf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2977702346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f36ee30 0x56505f36f250 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2977702346 >> 172.21.15.120:0/2977702346 conn(0x56505f3631e0 msgr2=0x56505f3635c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2977702346 shutdown_connections 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2977702346 wait complete. 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f35c4a0 msgr2=0x56505f35e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f35c4a0 0x56505f35e940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f1cf8c0 msgr2=0x56505f35b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f1cf8c0 0x56505f35b6b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a4403c730 msgr2=0x7f8a4403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a4403c730 0x7f8a4403ebf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8b54001d70 tx=0x7f8b540012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 msgr2=0x56505f354060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f354060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8b50025a60 tx=0x7f8b50003330 comp rx=0 tx=0).stop 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 shutdown_connections 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56505f35c4a0 0x56505f35e940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56505f1cf8c0 0x56505f35b6b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8a4403c730 0x7f8a4403ebf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 --2- 172.21.15.120:0/2732387927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56505f1cef80 0x56505f354060 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 >> 172.21.15.120:0/2732387927 conn(0x56505f2563d0 msgr2=0x56505f346a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 shutdown_connections 2024-09-07T03:32:34.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.043+0000 7f8b63e1b800 1 -- 172.21.15.120:0/2732387927 wait complete. 2024-09-07T03:32:34.066 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:34.066 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-07T03:32:34.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-07T03:32:34.066 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-07T03:32:34.113 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:34.113 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:34.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.112+0000 7fec33920800 1 Processor -- start 2024-09-07T03:32:34.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.112+0000 7fec33920800 1 -- start start 2024-09-07T03:32:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.113+0000 7fec33920800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5620ad39d730 0x5620ad39fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.113+0000 7fec33920800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5620ad246e40 con 0x5620ad3a0060 2024-09-07T03:32:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.113+0000 7fec33920800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5620ad211680 con 0x5620ad39d730 2024-09-07T03:32:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.113+0000 7fec2f668640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5620ad39d730 0x5620ad39fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.113+0000 7fec2ee67640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5620ad3a0060 0x5620ad3a24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48332/0 (socket says 172.21.15.120:48332) 2024-09-07T03:32:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.113+0000 7fec2f668640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5620ad39d730 0x5620ad39fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41516/0 (socket says 172.21.15.120:41516) 2024-09-07T03:32:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.113+0000 7fec2ee67640 1 -- 172.21.15.120:0/1726872345 learned_addr learned my addr 172.21.15.120:0/1726872345 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.113+0000 7fec2f668640 1 -- 172.21.15.120:0/1726872345 >> v1:172.21.15.104:6789/0 conn(0x5620ad3a0060 legacy=0x5620ad3a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.113+0000 7fec2f668640 1 -- 172.21.15.120:0/1726872345 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ad22d6b0 con 0x5620ad39d730 2024-09-07T03:32:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.115+0000 7fec2f668640 1 --2- 172.21.15.120:0/1726872345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad39fb20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fec2000a470 tx=0x7fec20045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b1ed3dc7d70dde server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.115+0000 7fec2e666640 1 -- 172.21.15.120:0/1726872345 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec20053570 con 0x5620ad39d730 2024-09-07T03:32:34.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.115+0000 7fec2e666640 1 -- 172.21.15.120:0/1726872345 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec20058070 con 0x5620ad39d730 2024-09-07T03:32:34.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.115+0000 7fec2e666640 1 -- 172.21.15.120:0/1726872345 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec20053880 con 0x5620ad39d730 2024-09-07T03:32:34.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.116+0000 7fec33920800 1 -- 172.21.15.120:0/1726872345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 msgr2=0x5620ad39fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.116+0000 7fec33920800 1 --2- 172.21.15.120:0/1726872345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad39fb20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fec2000a470 tx=0x7fec20045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:34.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.116+0000 7fec33920800 1 -- 172.21.15.120:0/1726872345 shutdown_connections 2024-09-07T03:32:34.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.116+0000 7fec33920800 1 --2- 172.21.15.120:0/1726872345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad39fb20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.116+0000 7fec33920800 1 -- 172.21.15.120:0/1726872345 >> 172.21.15.120:0/1726872345 conn(0x5620ad3971d0 msgr2=0x5620ad399630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.116+0000 7fec33920800 1 -- 172.21.15.120:0/1726872345 shutdown_connections 2024-09-07T03:32:34.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.116+0000 7fec33920800 1 -- 172.21.15.120:0/1726872345 wait complete. 2024-09-07T03:32:34.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.130+0000 7fec33920800 1 Processor -- start 2024-09-07T03:32:34.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.130+0000 7fec33920800 1 -- start start 2024-09-07T03:32:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.130+0000 7fec33920800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad48c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.130+0000 7fec33920800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5620ad235dd0 con 0x5620ad39d730 2024-09-07T03:32:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.130+0000 7fec2f668640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad48c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.130+0000 7fec2f668640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad48c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41530/0 (socket says 172.21.15.120:41530) 2024-09-07T03:32:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.130+0000 7fec2f668640 1 -- 172.21.15.120:0/3896006193 learned_addr learned my addr 172.21.15.120:0/3896006193 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.131+0000 7fec2f668640 1 -- 172.21.15.120:0/3896006193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ad24ee10 con 0x5620ad39d730 2024-09-07T03:32:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.131+0000 7fec2f668640 1 --2- 172.21.15.120:0/3896006193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad48c690 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fec20025c20 tx=0x7fec20051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecb8551cc0f4a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.131+0000 7feb1d60a640 1 -- 172.21.15.120:0/3896006193 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec20053a20 con 0x5620ad39d730 2024-09-07T03:32:34.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.131+0000 7feb1d60a640 1 -- 172.21.15.120:0/3896006193 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec20063070 con 0x5620ad39d730 2024-09-07T03:32:34.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.131+0000 7feb1d60a640 1 -- 172.21.15.120:0/3896006193 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec20053cf0 con 0x5620ad39d730 2024-09-07T03:32:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 -- 172.21.15.120:0/3896006193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 msgr2=0x5620ad48c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 --2- 172.21.15.120:0/3896006193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad48c690 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fec20025c20 tx=0x7fec20051000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 -- 172.21.15.120:0/3896006193 shutdown_connections 2024-09-07T03:32:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 --2- 172.21.15.120:0/3896006193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad48c690 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 -- 172.21.15.120:0/3896006193 >> 172.21.15.120:0/3896006193 conn(0x5620ad3971d0 msgr2=0x5620ad488010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 -- 172.21.15.120:0/3896006193 shutdown_connections 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 -- 172.21.15.120:0/3896006193 wait complete. 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 Processor -- start 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 -- start start 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad39ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec33920800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5620ad3a4050 con 0x5620ad39d730 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.132+0000 7fec2f668640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad39ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.133+0000 7fec2f668640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad39ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41534/0 (socket says 172.21.15.120:41534) 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.133+0000 7fec2f668640 1 -- 172.21.15.120:0/958577757 learned_addr learned my addr 172.21.15.120:0/958577757 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.133+0000 7fec2f668640 1 -- 172.21.15.120:0/958577757 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ad39d3b0 con 0x5620ad39d730 2024-09-07T03:32:34.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.133+0000 7fec2f668640 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad39ce50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fec20025c20 tx=0x7fec20002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.133+0000 7feb1be07640 1 -- 172.21.15.120:0/958577757 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec20068660 con 0x5620ad39d730 2024-09-07T03:32:34.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.133+0000 7feb1be07640 1 -- 172.21.15.120:0/958577757 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec20068800 con 0x5620ad39d730 2024-09-07T03:32:34.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.133+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620ad39b760 con 0x5620ad39d730 2024-09-07T03:32:34.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.133+0000 7feb1be07640 1 -- 172.21.15.120:0/958577757 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec20068ae0 con 0x5620ad39d730 2024-09-07T03:32:34.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.133+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620ad39bd80 con 0x5620ad39d730 2024-09-07T03:32:34.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.134+0000 7feb1be07640 1 -- 172.21.15.120:0/958577757 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fec20068c80 con 0x5620ad39d730 2024-09-07T03:32:34.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.134+0000 7feb1be07640 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb1403c780 0x7feb1403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.134+0000 7feb1be07640 1 -- 172.21.15.120:0/958577757 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fec200982b0 con 0x5620ad39d730 2024-09-07T03:32:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.134+0000 7fec2ee67640 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb1403c780 0x7feb1403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.134+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad3a0060 0x5620ad49d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.134+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad49d9e0 con 0x5620ad3a0060 2024-09-07T03:32:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.135+0000 7fec2fe69640 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad3a0060 0x5620ad49d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.135+0000 7fec2ee67640 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb1403c780 0x7feb1403ec40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fec24001d70 tx=0x7fec240012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.135+0000 7fec2fe69640 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad3a0060 0x5620ad49d4a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.135+0000 7fec2fe69640 1 -- 172.21.15.120:0/958577757 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec2800a4d0 con 0x5620ad3a0060 2024-09-07T03:32:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.135+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad49e770 0x5620ad4a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.135+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4a1190 con 0x5620ad49e770 2024-09-07T03:32:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.135+0000 7fec2f668640 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad49e770 0x5620ad4a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.136+0000 7fec2f668640 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad49e770 0x5620ad4a0b60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.136+0000 7fec2f668640 1 -- 172.21.15.120:0/958577757 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec20051070 con 0x5620ad49e770 2024-09-07T03:32:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.136+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4a2a40 con 0x5620ad49e770 2024-09-07T03:32:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.136+0000 7fec2f668640 1 -- 172.21.15.120:0/958577757 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec20051070 con 0x5620ad49e770 2024-09-07T03:32:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.136+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4a1b80 con 0x5620ad49e770 2024-09-07T03:32:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.136+0000 7fec2f668640 1 -- 172.21.15.120:0/958577757 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec20051070 con 0x5620ad49e770 2024-09-07T03:32:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.136+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4a1fe0 con 0x5620ad3a0060 2024-09-07T03:32:34.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.137+0000 7fec2fe69640 1 -- 172.21.15.120:0/958577757 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec2800a4d0 con 0x5620ad3a0060 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.137+0000 7fec33920800 1 Processor -- start 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.137+0000 7fec33920800 1 -- start start 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.137+0000 7fec33920800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4b0f30 0x5620ad4b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.137+0000 7fec33920800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5620ad293a00 con 0x5620ad4b0f30 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.137+0000 7fec2fe69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4b0f30 0x5620ad4b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.137+0000 7fec2fe69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4b0f30 0x5620ad4b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41542/0 (socket says 172.21.15.120:41542) 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.137+0000 7fec2fe69640 1 -- 172.21.15.120:0/3040335682 learned_addr learned my addr 172.21.15.120:0/3040335682 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.138+0000 7fec2fe69640 1 -- 172.21.15.120:0/3040335682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ad4b1990 con 0x5620ad4b0f30 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.138+0000 7fec2fe69640 1 --2- 172.21.15.120:0/3040335682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4b0f30 0x5620ad4b1350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fec28016d20 tx=0x7fec2800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.138+0000 7feb19602640 1 -- 172.21.15.120:0/3040335682 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28017660 con 0x5620ad4b0f30 2024-09-07T03:32:34.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.138+0000 7feb19602640 1 -- 172.21.15.120:0/3040335682 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2801b030 con 0x5620ad4b0f30 2024-09-07T03:32:34.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.138+0000 7feb19602640 1 -- 172.21.15.120:0/3040335682 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28017950 con 0x5620ad4b0f30 2024-09-07T03:32:34.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.138+0000 7fec33920800 1 -- 172.21.15.120:0/3040335682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620ad4b21c0 con 0x5620ad4b0f30 2024-09-07T03:32:34.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.138+0000 7fec33920800 1 -- 172.21.15.120:0/3040335682 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620ad4b2700 con 0x5620ad4b0f30 2024-09-07T03:32:34.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.139+0000 7feb19602640 1 -- 172.21.15.120:0/3040335682 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fec28017af0 con 0x5620ad4b0f30 2024-09-07T03:32:34.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.139+0000 7feb19602640 1 --2- 172.21.15.120:0/3040335682 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb0803c780 0x7feb0803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.139+0000 7feb19602640 1 -- 172.21.15.120:0/3040335682 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fec2800e040 con 0x5620ad4b0f30 2024-09-07T03:32:34.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.139+0000 7fec2f668640 1 --2- 172.21.15.120:0/3040335682 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb0803c780 0x7feb0803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.139+0000 7fec33920800 1 Processor -- start 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.139+0000 7fec2f668640 1 --2- 172.21.15.120:0/3040335682 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb0803c780 0x7feb0803ec40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5620ad49df30 tx=0x7fec20045e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.139+0000 7fec33920800 1 -- start start 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7fec33920800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7fec33920800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5620ad48ce80 con 0x5620ad4bd970 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7fec2fe69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7fec2fe69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4bdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41548/0 (socket says 172.21.15.120:41548) 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7fec2fe69640 1 -- 172.21.15.120:0/2720877983 learned_addr learned my addr 172.21.15.120:0/2720877983 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7fec2fe69640 1 -- 172.21.15.120:0/2720877983 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ad4be360 con 0x5620ad4bd970 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7fec2fe69640 1 --2- 172.21.15.120:0/2720877983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4bdd70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fec28054030 tx=0x7fec28054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7665a144bae8aea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7feb12ffd640 1 -- 172.21.15.120:0/2720877983 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28014d40 con 0x5620ad4bd970 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7feb12ffd640 1 -- 172.21.15.120:0/2720877983 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec280149b0 con 0x5620ad4bd970 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.140+0000 7feb12ffd640 1 -- 172.21.15.120:0/2720877983 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28028350 con 0x5620ad4bd970 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.141+0000 7fec33920800 1 -- 172.21.15.120:0/2720877983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 msgr2=0x5620ad4bdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.141+0000 7fec33920800 1 --2- 172.21.15.120:0/2720877983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4bdd70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fec28054030 tx=0x7fec28054060 comp rx=0 tx=0).stop 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.141+0000 7fec33920800 1 -- 172.21.15.120:0/2720877983 shutdown_connections 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.141+0000 7fec33920800 1 --2- 172.21.15.120:0/2720877983 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4bdd70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.141+0000 7fec33920800 1 -- 172.21.15.120:0/2720877983 >> 172.21.15.120:0/2720877983 conn(0x5620ad4b9d90 msgr2=0x5620ad4b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.141+0000 7fec33920800 1 -- 172.21.15.120:0/2720877983 shutdown_connections 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.141+0000 7fec33920800 1 -- 172.21.15.120:0/2720877983 wait complete. 2024-09-07T03:32:34.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.141+0000 7fec33920800 1 Processor -- start 2024-09-07T03:32:34.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.141+0000 7fec33920800 1 -- start start 2024-09-07T03:32:34.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.142+0000 7fec33920800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.142+0000 7fec33920800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5620ad4be950 con 0x5620ad4bd970 2024-09-07T03:32:34.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.142+0000 7fec2fe69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.142+0000 7fec2fe69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41562/0 (socket says 172.21.15.120:41562) 2024-09-07T03:32:34.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.142+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 learned_addr learned my addr 172.21.15.120:0/2059843406 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.142+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ad4c5510 con 0x5620ad4bd970 2024-09-07T03:32:34.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.142+0000 7fec2fe69640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4c4fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec28053d10 tx=0x7fec28053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.143+0000 7feb117fa640 1 -- 172.21.15.120:0/2059843406 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28012570 con 0x5620ad4bd970 2024-09-07T03:32:34.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.143+0000 7feb117fa640 1 -- 172.21.15.120:0/2059843406 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec28005500 con 0x5620ad4bd970 2024-09-07T03:32:34.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.143+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620ad4c57a0 con 0x5620ad4bd970 2024-09-07T03:32:34.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.143+0000 7feb117fa640 1 -- 172.21.15.120:0/2059843406 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28055570 con 0x5620ad4bd970 2024-09-07T03:32:34.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.143+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620ad4c6330 con 0x5620ad4bd970 2024-09-07T03:32:34.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.143+0000 7feb117fa640 1 -- 172.21.15.120:0/2059843406 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fec280127a0 con 0x5620ad4bd970 2024-09-07T03:32:34.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.144+0000 7feb117fa640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feaf803c730 0x7feaf803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.144+0000 7feb117fa640 1 -- 172.21.15.120:0/2059843406 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fec28048920 con 0x5620ad4bd970 2024-09-07T03:32:34.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.144+0000 7fec2f668640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feaf803c730 0x7feaf803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.144+0000 7fec2f668640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feaf803c730 0x7feaf803ebf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec20096900 tx=0x7fec2008b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.144+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad4d0ab0 0x5620ad4d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4d36c0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec2ee67640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad4d0ab0 0x5620ad4d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec2ee67640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad4d0ab0 0x5620ad4d2f70 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec24009050 con 0x5620ad4d0ab0 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 20 realm 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4cfe00 con 0x5620ad4d0ab0 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec24009050 con 0x5620ad4d0ab0 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.145+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4d41b0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec24009050 con 0x5620ad4d0ab0 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec33920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad4d4f90 0x5620ad4d7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4d7a50 con 0x5620ad4d4f90 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec2fe69640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad4d4f90 0x5620ad4d7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec2fe69640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad4d4f90 0x5620ad4d7380 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec33920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.146+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4d82a0 con 0x5620ad4d4f90 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.147+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.147+0000 7fec33920800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.147+0000 7fec33920800 20 searching for the correct realm 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.147+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5620ad4da010 0x5620ad4dc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.147+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4da010 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.147+0000 7fec2f668640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5620ad4da010 0x5620ad4dc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.147+0000 7fec2f668640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5620ad4da010 0x5620ad4dc440 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.147+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.147+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.148+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.148+0000 7fec2fe69640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fec28014440 0x7fec2803bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.148+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x7fec28014440 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.148+0000 7fec2ee67640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fec28014440 0x7fec2803bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.148+0000 7fec2ee67640 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fec28014440 0x7fec2803bab0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.148+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24009050 con 0x7fec28014440 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.148+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.148+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24009050 con 0x5620ad4d0ab0 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.148+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.149+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.149+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4da010 2024-09-07T03:32:34.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.149+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.149+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.149+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.149+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.149+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.149+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.150+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.150+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.150+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.150+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x7fec28014440 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.150+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.150+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.150+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.150+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x7fec28014440 2024-09-07T03:32:34.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.151+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.151+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.151+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.151+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4da010 2024-09-07T03:32:34.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.151+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.151+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.151+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.151+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4da010 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.152+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4da010 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.153+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.153+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x7fec28014440 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.153+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.153+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d0ab0 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.153+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.153+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x7fec28014440 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.153+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.153+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4da010 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.154+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.154+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x7fec28014440 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.154+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.154+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.154+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.154+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.154+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.154+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4da010 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dcb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:34.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4d8bf0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.155+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4d8830 con 0x5620ad4d4f90 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4d9030 con 0x5620ad4d0ab0 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 zone default found 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 4 Realm: () 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 zonegroup default 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dd440 con 0x7fec28014440 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4df680 con 0x5620ad4da010 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.156+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4dfa20 con 0x5620ad4da010 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.157+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.157+0000 7fec33920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.157+0000 7fec33920800 20 started sync module instance, tier type = 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.157+0000 7fec33920800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.157+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4deb10 con 0x5620ad4d4f90 2024-09-07T03:32:34.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.158+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.158+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94698346508032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4de770 con 0x5620ad4d4f90 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.158+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e08e0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.159+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94698346508032] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.159+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.159+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94698346511888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e08e0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.159+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e1350 con 0x5620ad4d4f90 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.160+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94698346511888] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.160+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.160+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94698346516032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e08e0 con 0x5620ad4d4f90 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.160+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e1e40 con 0x7fec28014440 2024-09-07T03:32:34.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.162+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.162+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94698346518800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e1e00 con 0x7fec28014440 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.162+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e2de0 con 0x5620ad4d4f90 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.162+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94698346516032] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.163+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94698346518800] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.163+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.163+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94698346521136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e2930 con 0x5620ad4d4f90 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.163+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e36b0 con 0x5620ad4da010 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.164+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.164+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94698346525184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e2930 con 0x5620ad4da010 2024-09-07T03:32:34.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.164+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e4220 con 0x5620ad4da010 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.164+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94698346521136] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.165+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94698346525184] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.165+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.165+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94698346526240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e41e0 con 0x5620ad4da010 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.165+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e4ac0 con 0x7fec28014440 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94698346530320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e41e0 con 0x7fec28014440 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec33920800 20 add_watcher() i=0 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec33920800 20 add_watcher() i=1 2024-09-07T03:32:34.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec33920800 20 add_watcher() i=2 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec33920800 20 add_watcher() i=3 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94698346526240] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec33920800 20 add_watcher() i=4 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec33920800 20 add_watcher() i=5 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.166+0000 7fec33920800 20 add_watcher() i=6 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.167+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94698346530320] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.167+0000 7fec33920800 20 add_watcher() i=7 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.167+0000 7fec33920800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.167+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e3cf0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.168+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.168+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94698346531376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad4e3cf0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.169+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94698346531376] v34'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.169+0000 7feae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.169+0000 7fec33920800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.169+0000 7fec33920800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.169+0000 7fec33920800 5 note: GC not initialized 2024-09-07T03:32:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.169+0000 7feae4fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.169+0000 7fec33920800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 20 Filter name: none 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fea5e7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad51ac50 con 0x5620ad4d0ab0 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.170+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad51a6a0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.171+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.171+0000 7fec33920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.171+0000 7fec33920800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.171+0000 7fec33920800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.171+0000 7fec33920800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.171+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad521230 con 0x5620ad4d0ab0 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.172+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.172+0000 7fec33920800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.172+0000 7fec33920800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.172+0000 7fec33920800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:34.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.172+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94698346777648 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad51fd50 con 0x5620ad4d4f90 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.172+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94698346521136 notify 146028888071 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5620ad4c6330 con 0x5620ad4d4f90 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.172+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(65 notify.4 [notify cookie 94698346777648 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.172+0000 7feb12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94698346521136 notifier 4358 bl.length()=732 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.173+0000 7feb12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.173+0000 7feb12ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.173+0000 7feb12ffd640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7feaf4003ea0 con 0x5620ad4d4f90 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.173+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.173+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94698346777648 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fec28069020 con 0x5620ad4d4f90 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.173+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad520c30 con 0x5620ad4d0ab0 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7fec33920800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7fec33920800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7fec33920800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94698346777648 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620ad51f8a0 con 0x5620ad4d4f90 2024-09-07T03:32:34.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== watch-notify(notify (1) cookie 94698346508032 notify 146028888072 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fec28069020 con 0x5620ad4d4f90 2024-09-07T03:32:34.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7feb12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94698346508032 notifier 4358 bl.length()=166 2024-09-07T03:32:34.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7feb12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-07T03:32:34.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7feb12ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-07T03:32:34.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(68 notify.0 [notify cookie 94698346777648 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7feb12ffd640 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7feaf4003ea0 con 0x5620ad4d4f90 2024-09-07T03:32:34.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.175+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.176+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== watch-notify(notify_complete (2) cookie 94698346777648 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5620ad4c57a0 con 0x5620ad4d4f90 2024-09-07T03:32:34.196 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"A5bMBR0my5HX2DVT5fsj1mIs664Dz2n4d7TUkTHx","active":true,"create_date":"2024-09-07T03:32:34.171983Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:34.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.176+0000 7feae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.176+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94698346531376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad518ab0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.177+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94698346531376] v34'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.177+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94698346508032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad518ab0 con 0x5620ad4d4f90 2024-09-07T03:32:34.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.178+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94698346508032] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.178+0000 7fec33920800 20 remove_watcher() i=0 2024-09-07T03:32:34.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.178+0000 7fec33920800 2 removed watcher, disabling cache 2024-09-07T03:32:34.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.178+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94698346511888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad518ab0 con 0x5620ad4d0ab0 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.179+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94698346511888] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec24028040 con 0x5620ad4d0ab0 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.179+0000 7fec33920800 20 remove_watcher() i=1 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.179+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94698346516032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad518ab0 con 0x5620ad4d4f90 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.180+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94698346516032] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.180+0000 7fec33920800 20 remove_watcher() i=2 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.181+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94698346518800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad518ab0 con 0x7fec28014440 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.181+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94698346518800] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.181+0000 7fec33920800 20 remove_watcher() i=3 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.181+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94698346521136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad518ab0 con 0x5620ad4d4f90 2024-09-07T03:32:34.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.183+0000 7fec2fe69640 1 -- 172.21.15.120:0/2059843406 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94698346521136] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28027070 con 0x5620ad4d4f90 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.183+0000 7fec33920800 20 remove_watcher() i=4 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.183+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94698346525184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad518ab0 con 0x5620ad4da010 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.184+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94698346525184] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.184+0000 7fec33920800 20 remove_watcher() i=5 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.184+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94698346526240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad518ab0 con 0x5620ad4da010 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.185+0000 7fec2f668640 1 -- 172.21.15.120:0/2059843406 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94698346526240] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec20089030 con 0x5620ad4da010 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.185+0000 7fec33920800 20 remove_watcher() i=6 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.185+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94698346530320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620ad518ab0 con 0x7fec28014440 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94698346530320] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec24028040 con 0x7fec28014440 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 20 remove_watcher() i=7 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad4d4f90 msgr2=0x5620ad4d7380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad4d4f90 0x5620ad4d7380 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad4d0ab0 msgr2=0x5620ad4d2f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad4d0ab0 0x5620ad4d2f70 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fec28014440 msgr2=0x7fec2803bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fec28014440 0x7fec2803bab0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5620ad4da010 msgr2=0x5620ad4dc440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5620ad4da010 0x5620ad4dc440 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feaf803c730 msgr2=0x7feaf803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feaf803c730 0x7feaf803ebf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fec20096900 tx=0x7fec2008b000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 msgr2=0x5620ad4c4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec2ee67640 1 -- 172.21.15.120:0/2059843406 reap_dead start 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4c4fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec28053d10 tx=0x7fec28053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 shutdown_connections 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/2059843406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4bd970 0x5620ad4c4fb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 >> 172.21.15.120:0/2059843406 conn(0x5620ad4b9d90 msgr2=0x5620ad4b7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 shutdown_connections 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/2059843406 wait complete. 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/3040335682 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb0803c780 msgr2=0x7feb0803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/3040335682 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb0803c780 0x7feb0803ec40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5620ad49df30 tx=0x7fec20045e60 comp rx=0 tx=0).stop 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/3040335682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4b0f30 msgr2=0x5620ad4b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/3040335682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4b0f30 0x5620ad4b1350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fec28016d20 tx=0x7fec2800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/3040335682 shutdown_connections 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/3040335682 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb0803c780 0x7feb0803ec40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 --2- 172.21.15.120:0/3040335682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad4b0f30 0x5620ad4b1350 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/3040335682 >> 172.21.15.120:0/3040335682 conn(0x5620ad4a52e0 msgr2=0x5620ad4a56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/3040335682 shutdown_connections 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.186+0000 7fec33920800 1 -- 172.21.15.120:0/3040335682 wait complete. 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad49e770 msgr2=0x5620ad4a0b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad49e770 0x5620ad4a0b60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad3a0060 msgr2=0x5620ad49d4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad3a0060 0x5620ad49d4a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb1403c780 msgr2=0x7feb1403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb1403c780 0x7feb1403ec40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fec24001d70 tx=0x7fec240012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 msgr2=0x5620ad39ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad39ce50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fec20025c20 tx=0x7fec20002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 shutdown_connections 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5620ad49e770 0x5620ad4a0b60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5620ad3a0060 0x5620ad49d4a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7feb1403c780 0x7feb1403ec40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 --2- 172.21.15.120:0/958577757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5620ad39d730 0x5620ad39ce50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 >> 172.21.15.120:0/958577757 conn(0x5620ad3971d0 msgr2=0x5620ad486800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 shutdown_connections 2024-09-07T03:32:34.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.187+0000 7fec33920800 1 -- 172.21.15.120:0/958577757 wait complete. 2024-09-07T03:32:34.207 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'A5bMBR0my5HX2DVT5fsj1mIs664Dz2n4d7TUkTHx', 'active': True, 'create_date': '2024-09-07T03:32:34.171983Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:34.207 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-07T03:32:34.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-07T03:32:34.207 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-07T03:32:34.256 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:34.256 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:34.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.255+0000 7f1a6eb26800 1 Processor -- start 2024-09-07T03:32:34.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.255+0000 7f1a6eb26800 1 -- start start 2024-09-07T03:32:34.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.255+0000 7f1a6eb26800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cfac23c4c0 0x55cfac23c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.255+0000 7f1a6eb26800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cfac0e7e40 con 0x55cfac23ce00 2024-09-07T03:32:34.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.255+0000 7f1a6eb26800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55cfac0b2680 con 0x55cfac23c4c0 2024-09-07T03:32:34.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.256+0000 7f1a6a709640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cfac23c4c0 0x55cfac23c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.256+0000 7f1a69f08640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55cfac23ce00 0x55cfac23d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48336/0 (socket says 172.21.15.120:48336) 2024-09-07T03:32:34.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.256+0000 7f1a6a709640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cfac23c4c0 0x55cfac23c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41570/0 (socket says 172.21.15.120:41570) 2024-09-07T03:32:34.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.256+0000 7f1a69f08640 1 -- 172.21.15.120:0/3803194287 learned_addr learned my addr 172.21.15.120:0/3803194287 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:34.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.256+0000 7f1a6a709640 1 -- 172.21.15.120:0/3803194287 >> v1:172.21.15.104:6789/0 conn(0x55cfac23ce00 legacy=0x55cfac23d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.256+0000 7f1a6a709640 1 -- 172.21.15.120:0/3803194287 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfac0ce6b0 con 0x55cfac23c4c0 2024-09-07T03:32:34.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.258+0000 7f1a6a709640 1 --2- 172.21.15.120:0/3803194287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac23c8c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c005fd0 tx=0x7f1a5c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829a347aa971331 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.258+0000 7f1a69707640 1 -- 172.21.15.120:0/3803194287 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c058530 con 0x55cfac23c4c0 2024-09-07T03:32:34.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.258+0000 7f1a69707640 1 -- 172.21.15.120:0/3803194287 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0586d0 con 0x55cfac23c4c0 2024-09-07T03:32:34.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.258+0000 7f1a69707640 1 -- 172.21.15.120:0/3803194287 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c0589d0 con 0x55cfac23c4c0 2024-09-07T03:32:34.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.259+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3803194287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 msgr2=0x55cfac23c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.259+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3803194287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac23c8c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c005fd0 tx=0x7f1a5c045c30 comp rx=0 tx=0).stop 2024-09-07T03:32:34.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.259+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3803194287 shutdown_connections 2024-09-07T03:32:34.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.259+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3803194287 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac23c8c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.259+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3803194287 >> 172.21.15.120:0/3803194287 conn(0x55cfac238210 msgr2=0x55cfac23a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.259+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3803194287 shutdown_connections 2024-09-07T03:32:34.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.259+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3803194287 wait complete. 2024-09-07T03:32:34.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.273+0000 7f1a6eb26800 1 Processor -- start 2024-09-07T03:32:34.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.273+0000 7f1a6eb26800 1 -- start start 2024-09-07T03:32:34.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.273+0000 7f1a6eb26800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac32f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.273+0000 7f1a6eb26800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cfac0d6dd0 con 0x55cfac23c4c0 2024-09-07T03:32:34.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.273+0000 7f1a6a709640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac32f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.273+0000 7f1a6a709640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac32f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41582/0 (socket says 172.21.15.120:41582) 2024-09-07T03:32:34.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.273+0000 7f1a6a709640 1 -- 172.21.15.120:0/2764425907 learned_addr learned my addr 172.21.15.120:0/2764425907 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.273+0000 7f1a6a709640 1 -- 172.21.15.120:0/2764425907 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfac0efe10 con 0x55cfac23c4c0 2024-09-07T03:32:34.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.274+0000 7f1a6a709640 1 --2- 172.21.15.120:0/2764425907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac32f910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c025a60 tx=0x7f1a5c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0c6bdc8cca56d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.274+0000 7f1958608640 1 -- 172.21.15.120:0/2764425907 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c0589b0 con 0x55cfac23c4c0 2024-09-07T03:32:34.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.274+0000 7f1958608640 1 -- 172.21.15.120:0/2764425907 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c068070 con 0x55cfac23c4c0 2024-09-07T03:32:34.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.274+0000 7f1958608640 1 -- 172.21.15.120:0/2764425907 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c058c80 con 0x55cfac23c4c0 2024-09-07T03:32:34.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.274+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2764425907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 msgr2=0x55cfac32f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.274+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/2764425907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac32f910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c025a60 tx=0x7f1a5c051000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.274+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2764425907 shutdown_connections 2024-09-07T03:32:34.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.274+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/2764425907 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac32f910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.274+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2764425907 >> 172.21.15.120:0/2764425907 conn(0x55cfac238210 msgr2=0x55cfac32b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2764425907 shutdown_connections 2024-09-07T03:32:34.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2764425907 wait complete. 2024-09-07T03:32:34.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6eb26800 1 Processor -- start 2024-09-07T03:32:34.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6eb26800 1 -- start start 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6eb26800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac337160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6eb26800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cfac23dd80 con 0x55cfac23c4c0 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6a709640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac337160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6a709640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac337160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41598/0 (socket says 172.21.15.120:41598) 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6a709640 1 -- 172.21.15.120:0/3564864205 learned_addr learned my addr 172.21.15.120:0/3564864205 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.275+0000 7f1a6a709640 1 -- 172.21.15.120:0/3564864205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfac3376c0 con 0x55cfac23c4c0 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.276+0000 7f1a6a709640 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac337160 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c025a60 tx=0x7f1a5c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.276+0000 7f1956e05640 1 -- 172.21.15.120:0/3564864205 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c063650 con 0x55cfac23c4c0 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.276+0000 7f1956e05640 1 -- 172.21.15.120:0/3564864205 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0637f0 con 0x55cfac23c4c0 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.276+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfac337950 con 0x55cfac23c4c0 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.276+0000 7f1956e05640 1 -- 172.21.15.120:0/3564864205 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a5c063af0 con 0x55cfac23c4c0 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.276+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfac338560 con 0x55cfac23c4c0 2024-09-07T03:32:34.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.277+0000 7f1956e05640 1 -- 172.21.15.120:0/3564864205 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1a5c063c90 con 0x55cfac23c4c0 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.277+0000 7f1956e05640 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f195003c730 0x7f195003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.277+0000 7f1956e05640 1 -- 172.21.15.120:0/3564864205 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1a5c097cf0 con 0x55cfac23c4c0 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.277+0000 7f1a69f08640 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f195003c730 0x7f195003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.277+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac23ce00 0x55cfac33e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.277+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac33ecf0 con 0x55cfac23ce00 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.277+0000 7f1a6af0a640 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac23ce00 0x55cfac33e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.277+0000 7f1a69f08640 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f195003c730 0x7f195003ebf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a54001d70 tx=0x7f1a540012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.277+0000 7f1a6af0a640 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac23ce00 0x55cfac33e7b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.278+0000 7f1a6af0a640 1 -- 172.21.15.120:0/3564864205 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a640083e0 con 0x55cfac23ce00 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.278+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac33f5f0 0x55cfac341a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.278+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac342200 con 0x55cfac33f5f0 2024-09-07T03:32:34.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.278+0000 7f1a6a709640 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac33f5f0 0x55cfac341a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.278+0000 7f1a6a709640 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac33f5f0 0x55cfac341a90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.279+0000 7f1a6a709640 1 -- 172.21.15.120:0/3564864205 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac33f5f0 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.279+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac343ab0 con 0x55cfac33f5f0 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.279+0000 7f1a6a709640 1 -- 172.21.15.120:0/3564864205 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac33f5f0 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.279+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac342bc0 con 0x55cfac33f5f0 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.279+0000 7f1a6a709640 1 -- 172.21.15.120:0/3564864205 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac33f5f0 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.279+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac342fe0 con 0x55cfac23ce00 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.279+0000 7f1a6af0a640 1 -- 172.21.15.120:0/3564864205 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1a640083e0 con 0x55cfac23ce00 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.280+0000 7f1a6eb26800 1 Processor -- start 2024-09-07T03:32:34.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.280+0000 7f1a6eb26800 1 -- start start 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.280+0000 7f1a6eb26800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac351f70 0x55cfac352390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.280+0000 7f1a6eb26800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cfac134a00 con 0x55cfac351f70 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.280+0000 7f1a6af0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac351f70 0x55cfac352390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.280+0000 7f1a6af0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac351f70 0x55cfac352390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41614/0 (socket says 172.21.15.120:41614) 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.280+0000 7f1a6af0a640 1 -- 172.21.15.120:0/4056397833 learned_addr learned my addr 172.21.15.120:0/4056397833 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.280+0000 7f1a6af0a640 1 -- 172.21.15.120:0/4056397833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfac3529d0 con 0x55cfac351f70 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.280+0000 7f1a6af0a640 1 --2- 172.21.15.120:0/4056397833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac351f70 0x55cfac352390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400aa90 tx=0x7f1a6400af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.281+0000 7f194ffff640 1 -- 172.21.15.120:0/4056397833 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a64007d70 con 0x55cfac351f70 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.281+0000 7f194ffff640 1 -- 172.21.15.120:0/4056397833 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a64018430 con 0x55cfac351f70 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.281+0000 7f1a6eb26800 1 -- 172.21.15.120:0/4056397833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfac353200 con 0x55cfac351f70 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.281+0000 7f194ffff640 1 -- 172.21.15.120:0/4056397833 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a64018750 con 0x55cfac351f70 2024-09-07T03:32:34.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.281+0000 7f1a6eb26800 1 -- 172.21.15.120:0/4056397833 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfac3537a0 con 0x55cfac351f70 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.281+0000 7f194ffff640 1 -- 172.21.15.120:0/4056397833 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1a64020020 con 0x55cfac351f70 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f194ffff640 1 --2- 172.21.15.120:0/4056397833 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f194403c780 0x7f194403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f194ffff640 1 -- 172.21.15.120:0/4056397833 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1a6401e020 con 0x55cfac351f70 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f1a6a709640 1 --2- 172.21.15.120:0/4056397833 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f194403c780 0x7f194403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f1a6eb26800 1 Processor -- start 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f1a6a709640 1 --2- 172.21.15.120:0/4056397833 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f194403c780 0x7f194403ec40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55cfac3426e0 tx=0x7f1a5c08a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f1a6eb26800 1 -- start start 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f1a6eb26800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac35ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f1a6eb26800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cfac3300a0 con 0x55cfac35ea90 2024-09-07T03:32:34.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f1a6af0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac35ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f1a6af0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac35ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41624/0 (socket says 172.21.15.120:41624) 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.282+0000 7f1a6af0a640 1 -- 172.21.15.120:0/2766782765 learned_addr learned my addr 172.21.15.120:0/2766782765 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f1a6af0a640 1 -- 172.21.15.120:0/2766782765 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfac35f480 con 0x55cfac35ea90 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f1a6af0a640 1 --2- 172.21.15.120:0/2766782765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac35ee90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1a640531c0 tx=0x7f1a640208c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57566c28788030b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f194dffb640 1 -- 172.21.15.120:0/2766782765 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a64049020 con 0x55cfac35ea90 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f194dffb640 1 -- 172.21.15.120:0/2766782765 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a64050070 con 0x55cfac35ea90 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f194dffb640 1 -- 172.21.15.120:0/2766782765 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a64020310 con 0x55cfac35ea90 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2766782765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 msgr2=0x55cfac35ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/2766782765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac35ee90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1a640531c0 tx=0x7f1a640208c0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2766782765 shutdown_connections 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/2766782765 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac35ee90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2766782765 >> 172.21.15.120:0/2766782765 conn(0x55cfac35ae90 msgr2=0x55cfac3590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2766782765 shutdown_connections 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.283+0000 7f1a6eb26800 1 -- 172.21.15.120:0/2766782765 wait complete. 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f1a6eb26800 1 Processor -- start 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f1a6eb26800 1 -- start start 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f1a6eb26800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac3660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f1a6eb26800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cfac35faa0 con 0x55cfac35ea90 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f1a6af0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac3660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f1a6af0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac3660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41636/0 (socket says 172.21.15.120:41636) 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 learned_addr learned my addr 172.21.15.120:0/600933274 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfac366610 con 0x55cfac35ea90 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f1a6af0a640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac3660b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a64017a50 tx=0x7f1a64053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f193bfff640 1 -- 172.21.15.120:0/600933274 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a64031020 con 0x55cfac35ea90 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f193bfff640 1 -- 172.21.15.120:0/600933274 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a640152c0 con 0x55cfac35ea90 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.284+0000 7f193bfff640 1 -- 172.21.15.120:0/600933274 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a64017e60 con 0x55cfac35ea90 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.285+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfac3668a0 con 0x55cfac35ea90 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.285+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfac367220 con 0x55cfac35ea90 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.285+0000 7f193bfff640 1 -- 172.21.15.120:0/600933274 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1a64034020 con 0x55cfac35ea90 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.285+0000 7f193bfff640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f193403c730 0x7f193403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.285+0000 7f193bfff640 1 -- 172.21.15.120:0/600933274 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1a64013040 con 0x55cfac35ea90 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.286+0000 7f1a6a709640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f193403c730 0x7f193403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.286+0000 7f1a6a709640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f193403c730 0x7f193403ebf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c04e880 tx=0x7f1a5c093000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.286+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.286+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac371bd0 0x55cfac374090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.286+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3747e0 con 0x55cfac371bd0 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.286+0000 7f1a69f08640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac371bd0 0x55cfac374090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a69f08640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac371bd0 0x55cfac374090 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a54009050 con 0x55cfac371bd0 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 20 realm 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac370f20 con 0x55cfac371bd0 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a54009050 con 0x55cfac371bd0 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3752d0 con 0x55cfac371bd0 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a54009050 con 0x55cfac371bd0 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac3760b0 0x55cfac3784a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.287+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac378b70 con 0x55cfac3760b0 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6af0a640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac3760b0 0x55cfac3784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6af0a640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac3760b0 0x55cfac3784a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6eb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3793c0 con 0x55cfac3760b0 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6eb26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6eb26800 20 searching for the correct realm 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cfac37b130 0x55cfac37d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37dc50 con 0x55cfac37b130 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.288+0000 7f1a6a709640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cfac37b130 0x55cfac37d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.289+0000 7f1a6a709640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cfac37b130 0x55cfac37d580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.289+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.289+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37dc50 con 0x55cfac3760b0 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.289+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.289+0000 7f1a6af0a640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1a64036020 0x7f1a640216b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.289+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3793c0 con 0x7f1a64036020 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.289+0000 7f1a69f08640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1a64036020 0x7f1a640216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.290+0000 7f1a69f08640 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1a64036020 0x7f1a640216b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.290+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54009050 con 0x7f1a64036020 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.290+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3793c0 con 0x55cfac371bd0 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.290+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54009050 con 0x55cfac371bd0 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.290+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3793c0 con 0x55cfac371bd0 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.290+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.290+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3793c0 con 0x55cfac37b130 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.291+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.291+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3793c0 con 0x55cfac371bd0 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.291+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.291+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3793c0 con 0x55cfac3760b0 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.291+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.291+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3793c0 con 0x55cfac3760b0 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.292+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.292+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac371bd0 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.292+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.292+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x7f1a64036020 2024-09-07T03:32:34.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.292+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.292+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac371bd0 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.293+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.293+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x7f1a64036020 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.293+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.293+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac3760b0 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.293+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.293+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac37b130 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.293+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.293+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac371bd0 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.294+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.294+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac3760b0 2024-09-07T03:32:34.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.294+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.294+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac37b130 2024-09-07T03:32:34.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.294+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.294+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac371bd0 2024-09-07T03:32:34.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.294+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.294+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac371bd0 2024-09-07T03:32:34.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac371bd0 2024-09-07T03:32:34.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac37b130 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x7f1a64036020 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac371bd0 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.295+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x7f1a64036020 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.296+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.296+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac37b130 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.296+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.296+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x7f1a64036020 2024-09-07T03:32:34.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.296+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.296+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac3760b0 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.296+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.296+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac3760b0 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac37b130 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac3760b0 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1a64066040 con 0x55cfac3760b0 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6eb26800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6eb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:34.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6eb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6eb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6eb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6eb26800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.297+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac379870 con 0x55cfac371bd0 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac379c60 con 0x55cfac3760b0 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a6404b030 con 0x55cfac3760b0 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac379c60 con 0x55cfac371bd0 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 20 zone default found 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 4 Realm: () 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 20 zonegroup default 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.298+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37a530 con 0x7f1a64036020 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37fac0 con 0x55cfac37b130 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37ff10 con 0x55cfac37b130 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 20 started sync module instance, tier type = 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.299+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37ef60 con 0x55cfac3760b0 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.300+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.301+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94350435939456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37ef60 con 0x55cfac3760b0 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.301+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac380a40 con 0x55cfac371bd0 2024-09-07T03:32:34.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.301+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94350435939456] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.302+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.302+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94350435943696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37ef60 con 0x55cfac371bd0 2024-09-07T03:32:34.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.302+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3814d0 con 0x55cfac3760b0 2024-09-07T03:32:34.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.303+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94350435943696] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.303+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.303+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94350435946400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37ef60 con 0x55cfac3760b0 2024-09-07T03:32:34.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.303+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac381f80 con 0x7f1a64036020 2024-09-07T03:32:34.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.304+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.304+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94350435949152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac381f80 con 0x7f1a64036020 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.304+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac382f20 con 0x55cfac3760b0 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.305+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94350435946400] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.305+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.305+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94350435953136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac382ee0 con 0x55cfac3760b0 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.305+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94350435949152] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.305+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac383950 con 0x55cfac37b130 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.306+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.306+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94350435951552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac383cf0 con 0x55cfac37b130 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.306+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac384710 con 0x55cfac37b130 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.306+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94350435953136] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.307+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94350435951552] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.307+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.307+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94350435955840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac37eab0 con 0x55cfac37b130 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.307+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac384fe0 con 0x7f1a64036020 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94350435955840] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94350435959296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac384fe0 con 0x7f1a64036020 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a6eb26800 20 add_watcher() i=0 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a6eb26800 20 add_watcher() i=1 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a6eb26800 20 add_watcher() i=2 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a6eb26800 20 add_watcher() i=3 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a6eb26800 20 add_watcher() i=4 2024-09-07T03:32:34.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a6eb26800 20 add_watcher() i=5 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.310+0000 7f1a6eb26800 20 add_watcher() i=6 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.311+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94350435959296] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.311+0000 7f1a6eb26800 20 add_watcher() i=7 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.311+0000 7f1a6eb26800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.311+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3884c0 con 0x55cfac371bd0 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.312+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.312+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94350435962112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3859e0 con 0x55cfac371bd0 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94350435962112] v34'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f1920fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f1a6eb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f1a6eb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:34.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f1a6eb26800 5 note: GC not initialized 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f189b7fe640 20 reqs_thread_entry: start 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f1a6eb26800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f1a6eb26800 20 Filter name: none 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f18997fa640 20 reqs_thread_entry: start 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.313+0000 7f1a6eb26800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.314+0000 7f1a6eb26800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.314+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3bb5d0 con 0x55cfac371bd0 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.314+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.314+0000 7f1a6eb26800 20 rados_obj.operate() r=0 bl.length=556 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.314+0000 7f1a6eb26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.314+0000 7f1a6eb26800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.314+0000 7f1a6eb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.314+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3c1be0 con 0x55cfac371bd0 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.315+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.315+0000 7f1a6eb26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.315+0000 7f1a6eb26800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.315+0000 7f1a6eb26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.315+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94350436210144 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3bd260 con 0x55cfac3760b0 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.315+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94350435953136 notify 146028888073 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55cfac367220 con 0x55cfac3760b0 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.316+0000 7f194dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94350435953136 notifier 4365 bl.length()=732 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.316+0000 7f194dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:34.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.316+0000 7f194dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.316+0000 7f194dffb640 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1930003ea0 con 0x55cfac3760b0 2024-09-07T03:32:34.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.316+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94350436210144 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.316+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.316+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94350436210144 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cfac3668a0 con 0x55cfac3760b0 2024-09-07T03:32:34.335 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:34.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.317+0000 7f1920fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.317+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94350435962112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3bcdb0 con 0x55cfac371bd0 2024-09-07T03:32:34.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.318+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94350435962112] v34'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.318+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94350435939456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3b9430 con 0x55cfac3760b0 2024-09-07T03:32:34.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.319+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94350435939456] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.319+0000 7f1a6eb26800 20 remove_watcher() i=0 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.319+0000 7f1a6eb26800 2 removed watcher, disabling cache 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.319+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94350435943696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3b9430 con 0x55cfac371bd0 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.322+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94350435943696] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x55cfac371bd0 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.322+0000 7f1a6eb26800 20 remove_watcher() i=1 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.322+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94350435946400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3b9430 con 0x55cfac3760b0 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.324+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94350435946400] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.324+0000 7f1a6eb26800 20 remove_watcher() i=2 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.324+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94350435949152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3b9430 con 0x7f1a64036020 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.327+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94350435949152] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.327+0000 7f1a6eb26800 20 remove_watcher() i=3 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.327+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94350435953136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3b9430 con 0x55cfac3760b0 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.329+0000 7f1a6af0a640 1 -- 172.21.15.120:0/600933274 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94350435953136] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a64073040 con 0x55cfac3760b0 2024-09-07T03:32:34.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.329+0000 7f1a6eb26800 20 remove_watcher() i=4 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.329+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94350435951552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3b9430 con 0x55cfac37b130 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.330+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94350435951552] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.330+0000 7f1a6eb26800 20 remove_watcher() i=5 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.330+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94350435955840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3b9430 con 0x55cfac37b130 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.332+0000 7f1a6a709640 1 -- 172.21.15.120:0/600933274 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94350435955840] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a5c0743e0 con 0x55cfac37b130 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.332+0000 7f1a6eb26800 20 remove_watcher() i=6 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.332+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94350435959296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfac3b9430 con 0x7f1a64036020 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94350435959296] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a54028040 con 0x7f1a64036020 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 20 remove_watcher() i=7 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac3760b0 msgr2=0x55cfac3784a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac3760b0 0x55cfac3784a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac371bd0 msgr2=0x55cfac374090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac371bd0 0x55cfac374090 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1a64036020 msgr2=0x7f1a640216b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1a64036020 0x7f1a640216b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cfac37b130 msgr2=0x55cfac37d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cfac37b130 0x55cfac37d580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f193403c730 msgr2=0x7f193403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f193403c730 0x7f193403ebf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c04e880 tx=0x7f1a5c093000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 msgr2=0x55cfac3660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/600933274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac35ea90 0x55cfac3660b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a64017a50 tx=0x7f1a64053150 comp rx=0 tx=0).stop 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 reap_dead start 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a69f08640 1 -- 172.21.15.120:0/600933274 reap_dead start 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 shutdown_connections 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 >> 172.21.15.120:0/600933274 conn(0x55cfac35ae90 msgr2=0x55cfac3590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 shutdown_connections 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/600933274 wait complete. 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/4056397833 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f194403c780 msgr2=0x7f194403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/4056397833 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f194403c780 0x7f194403ec40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55cfac3426e0 tx=0x7f1a5c08a040 comp rx=0 tx=0).stop 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/4056397833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac351f70 msgr2=0x55cfac352390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/4056397833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac351f70 0x55cfac352390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400aa90 tx=0x7f1a6400af50 comp rx=0 tx=0).stop 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/4056397833 shutdown_connections 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/4056397833 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f194403c780 0x7f194403ec40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/4056397833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac351f70 0x55cfac352390 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/4056397833 >> 172.21.15.120:0/4056397833 conn(0x55cfac346320 msgr2=0x55cfac346700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/4056397833 shutdown_connections 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.333+0000 7f1a6eb26800 1 -- 172.21.15.120:0/4056397833 wait complete. 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac33f5f0 msgr2=0x55cfac341a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac33f5f0 0x55cfac341a90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac23ce00 msgr2=0x55cfac33e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac23ce00 0x55cfac33e7b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f195003c730 msgr2=0x7f195003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f195003c730 0x7f195003ebf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a54001d70 tx=0x7f1a540012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 msgr2=0x55cfac337160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac337160 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c025a60 tx=0x7f1a5c003330 comp rx=0 tx=0).stop 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 shutdown_connections 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cfac33f5f0 0x55cfac341a90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cfac23ce00 0x55cfac33e7b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f195003c730 0x7f195003ebf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 --2- 172.21.15.120:0/3564864205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cfac23c4c0 0x55cfac337160 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 >> 172.21.15.120:0/3564864205 conn(0x55cfac238210 msgr2=0x55cfac329a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 shutdown_connections 2024-09-07T03:32:34.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.334+0000 7f1a6eb26800 1 -- 172.21.15.120:0/3564864205 wait complete. 2024-09-07T03:32:34.346 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:34.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-07T03:32:34.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-07T03:32:34.347 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-07T03:32:34.391 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:34.391 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:34.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.391+0000 7f1273926800 1 Processor -- start 2024-09-07T03:32:34.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.391+0000 7f1273926800 1 -- start start 2024-09-07T03:32:34.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.391+0000 7f1273926800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555807fedde0 0x555807feeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.391+0000 7f1273926800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555807e98e40 con 0x555807fef020 2024-09-07T03:32:34.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.391+0000 7f1273926800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x555807e63680 con 0x555807fedde0 2024-09-07T03:32:34.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.391+0000 7f126f5d9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555807fedde0 0x555807feeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.391+0000 7f126edd8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x555807fef020 0x555807ff3d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48342/0 (socket says 172.21.15.120:48342) 2024-09-07T03:32:34.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.391+0000 7f126edd8640 1 -- 172.21.15.120:0/103080573 learned_addr learned my addr 172.21.15.120:0/103080573 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:34.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.392+0000 7f126f5d9640 1 -- 172.21.15.120:0/103080573 >> v1:172.21.15.104:6789/0 conn(0x555807fef020 legacy=0x555807ff3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.392+0000 7f126f5d9640 1 -- 172.21.15.120:0/103080573 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555807e7f6b0 con 0x555807fedde0 2024-09-07T03:32:34.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.393+0000 7f126f5d9640 1 --2- 172.21.15.120:0/103080573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x555807feeae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1268005fd0 tx=0x7f1268045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109bd9eb8d90d343 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f126e5d7640 1 -- 172.21.15.120:0/103080573 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1268058530 con 0x555807fedde0 2024-09-07T03:32:34.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f126e5d7640 1 -- 172.21.15.120:0/103080573 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12680586d0 con 0x555807fedde0 2024-09-07T03:32:34.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f126e5d7640 1 -- 172.21.15.120:0/103080573 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12680589d0 con 0x555807fedde0 2024-09-07T03:32:34.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f1273926800 1 -- 172.21.15.120:0/103080573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 msgr2=0x555807feeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f1273926800 1 --2- 172.21.15.120:0/103080573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x555807feeae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1268005fd0 tx=0x7f1268045c30 comp rx=0 tx=0).stop 2024-09-07T03:32:34.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f1273926800 1 -- 172.21.15.120:0/103080573 shutdown_connections 2024-09-07T03:32:34.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f1273926800 1 --2- 172.21.15.120:0/103080573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x555807feeae0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f1273926800 1 -- 172.21.15.120:0/103080573 >> 172.21.15.120:0/103080573 conn(0x555807fe91b0 msgr2=0x555807feb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f1273926800 1 -- 172.21.15.120:0/103080573 shutdown_connections 2024-09-07T03:32:34.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.394+0000 7f1273926800 1 -- 172.21.15.120:0/103080573 wait complete. 2024-09-07T03:32:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.408+0000 7f1273926800 1 Processor -- start 2024-09-07T03:32:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.408+0000 7f1273926800 1 -- start start 2024-09-07T03:32:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.408+0000 7f1273926800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x555807f62550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.408+0000 7f1273926800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555807e87dd0 con 0x555807fedde0 2024-09-07T03:32:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.408+0000 7f126f5d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x555807f62550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.408+0000 7f126f5d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x555807f62550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41662/0 (socket says 172.21.15.120:41662) 2024-09-07T03:32:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.408+0000 7f126f5d9640 1 -- 172.21.15.120:0/1660575544 learned_addr learned my addr 172.21.15.120:0/1660575544 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.408+0000 7f126f5d9640 1 -- 172.21.15.120:0/1660575544 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555807ea0e10 con 0x555807fedde0 2024-09-07T03:32:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.408+0000 7f126f5d9640 1 --2- 172.21.15.120:0/1660575544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x555807f62550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1268025a60 tx=0x7f1268051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208033bbff88ccfb server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f115d60a640 1 -- 172.21.15.120:0/1660575544 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12680589b0 con 0x555807fedde0 2024-09-07T03:32:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f115d60a640 1 -- 172.21.15.120:0/1660575544 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1268068070 con 0x555807fedde0 2024-09-07T03:32:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f115d60a640 1 -- 172.21.15.120:0/1660575544 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1268058c80 con 0x555807fedde0 2024-09-07T03:32:34.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f1273926800 1 -- 172.21.15.120:0/1660575544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 msgr2=0x555807f62550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f1273926800 1 --2- 172.21.15.120:0/1660575544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x555807f62550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1268025a60 tx=0x7f1268051000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f1273926800 1 -- 172.21.15.120:0/1660575544 shutdown_connections 2024-09-07T03:32:34.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f1273926800 1 --2- 172.21.15.120:0/1660575544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x555807f62550 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f1273926800 1 -- 172.21.15.120:0/1660575544 >> 172.21.15.120:0/1660575544 conn(0x555807fe91b0 msgr2=0x5558080d8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f1273926800 1 -- 172.21.15.120:0/1660575544 shutdown_connections 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.409+0000 7f1273926800 1 -- 172.21.15.120:0/1660575544 wait complete. 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.410+0000 7f1273926800 1 Processor -- start 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.410+0000 7f1273926800 1 -- start start 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.410+0000 7f1273926800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x5558080de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.410+0000 7f1273926800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555807fef710 con 0x555807fedde0 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.410+0000 7f126f5d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x5558080de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.410+0000 7f126f5d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x5558080de9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41668/0 (socket says 172.21.15.120:41668) 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.410+0000 7f126f5d9640 1 -- 172.21.15.120:0/901257323 learned_addr learned my addr 172.21.15.120:0/901257323 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.410+0000 7f126f5d9640 1 -- 172.21.15.120:0/901257323 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558080def50 con 0x555807fedde0 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.410+0000 7f126f5d9640 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x5558080de9f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1268025a60 tx=0x7f1268003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.411+0000 7f115be07640 1 -- 172.21.15.120:0/901257323 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12680635f0 con 0x555807fedde0 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.411+0000 7f115be07640 1 -- 172.21.15.120:0/901257323 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1268063790 con 0x555807fedde0 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.411+0000 7f115be07640 1 -- 172.21.15.120:0/901257323 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1268063a90 con 0x555807fedde0 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.411+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558080dd300 con 0x555807fedde0 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.411+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558080dd8c0 con 0x555807fedde0 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.411+0000 7f115be07640 1 -- 172.21.15.120:0/901257323 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1268075020 con 0x555807fedde0 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f115be07640 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f115403c730 0x7f115403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f115be07640 1 -- 172.21.15.120:0/901257323 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1268097fe0 con 0x555807fedde0 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f126edd8640 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f115403c730 0x7f115403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555807fef020 0x5558080ef330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5558080ef870 con 0x555807fef020 2024-09-07T03:32:34.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f126fdda640 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555807fef020 0x5558080ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f126edd8640 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f115403c730 0x7f115403ebf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1258001d70 tx=0x7f12580012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f126fdda640 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555807fef020 0x5558080ef330 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f126fdda640 1 -- 172.21.15.120:0/901257323 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555807fef020 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5558080f0600 0x5558080f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.412+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5558080f3050 con 0x5558080f0600 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.413+0000 7f126f5d9640 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5558080f0600 0x5558080f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.413+0000 7f126f5d9640 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5558080f0600 0x5558080f29f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.413+0000 7f126f5d9640 1 -- 172.21.15.120:0/901257323 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f126806dd00 con 0x5558080f0600 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.413+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5558080f4900 con 0x5558080f0600 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.413+0000 7f126f5d9640 1 -- 172.21.15.120:0/901257323 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f126806dd00 con 0x5558080f0600 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.414+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5558080f3a70 con 0x5558080f0600 2024-09-07T03:32:34.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.414+0000 7f126f5d9640 1 -- 172.21.15.120:0/901257323 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f126806dd00 con 0x5558080f0600 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.414+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5558080f3e90 con 0x555807fef020 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.414+0000 7f126fdda640 1 -- 172.21.15.120:0/901257323 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f12600083e0 con 0x555807fef020 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.414+0000 7f1273926800 1 Processor -- start 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.414+0000 7f1273926800 1 -- start start 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f1273926800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555808102de0 0x555808103200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f1273926800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555807ee5a00 con 0x555808102de0 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f126fdda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555808102de0 0x555808103200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f126fdda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555808102de0 0x555808103200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41670/0 (socket says 172.21.15.120:41670) 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f126fdda640 1 -- 172.21.15.120:0/1367540942 learned_addr learned my addr 172.21.15.120:0/1367540942 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f126fdda640 1 -- 172.21.15.120:0/1367540942 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555808103840 con 0x555808102de0 2024-09-07T03:32:34.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f126fdda640 1 --2- 172.21.15.120:0/1367540942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555808102de0 0x555808103200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f126000aa90 tx=0x7f126000af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f1159602640 1 -- 172.21.15.120:0/1367540942 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1260007d70 con 0x555808102de0 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f1159602640 1 -- 172.21.15.120:0/1367540942 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1260018430 con 0x555808102de0 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f1159602640 1 -- 172.21.15.120:0/1367540942 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1260018750 con 0x555808102de0 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f1273926800 1 -- 172.21.15.120:0/1367540942 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555808104070 con 0x555808102de0 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.415+0000 7f1273926800 1 -- 172.21.15.120:0/1367540942 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555808104610 con 0x555808102de0 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.416+0000 7f1159602640 1 -- 172.21.15.120:0/1367540942 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1260020020 con 0x555808102de0 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.416+0000 7f1159602640 1 --2- 172.21.15.120:0/1367540942 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f114803c780 0x7f114803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.416+0000 7f1159602640 1 -- 172.21.15.120:0/1367540942 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f126001e020 con 0x555808102de0 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.416+0000 7f126f5d9640 1 --2- 172.21.15.120:0/1367540942 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f114803c780 0x7f114803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f1273926800 1 Processor -- start 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f1273926800 1 -- start start 2024-09-07T03:32:34.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f126f5d9640 1 --2- 172.21.15.120:0/1367540942 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f114803c780 0x7f114803ec40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5558080f3590 tx=0x7f1268089040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f1273926800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x55580810fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f1273926800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5558080e12e0 con 0x55580810f8e0 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f126fdda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x55580810fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f126fdda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x55580810fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41674/0 (socket says 172.21.15.120:41674) 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f126fdda640 1 -- 172.21.15.120:0/1253268458 learned_addr learned my addr 172.21.15.120:0/1253268458 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f126fdda640 1 -- 172.21.15.120:0/1253268458 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558081102d0 con 0x55580810f8e0 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.417+0000 7f126fdda640 1 --2- 172.21.15.120:0/1253268458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x55580810fce0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f12600531c0 tx=0x7f12600206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0103989d23ba33 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1152ffd640 1 -- 172.21.15.120:0/1253268458 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1260020b70 con 0x55580810f8e0 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1152ffd640 1 -- 172.21.15.120:0/1253268458 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1260022410 con 0x55580810f8e0 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1152ffd640 1 -- 172.21.15.120:0/1253268458 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126004c590 con 0x55580810f8e0 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1273926800 1 -- 172.21.15.120:0/1253268458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 msgr2=0x55580810fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1273926800 1 --2- 172.21.15.120:0/1253268458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x55580810fce0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f12600531c0 tx=0x7f12600206e0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1273926800 1 -- 172.21.15.120:0/1253268458 shutdown_connections 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1273926800 1 --2- 172.21.15.120:0/1253268458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x55580810fce0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1273926800 1 -- 172.21.15.120:0/1253268458 >> 172.21.15.120:0/1253268458 conn(0x55580810bce0 msgr2=0x555808109f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1273926800 1 -- 172.21.15.120:0/1253268458 shutdown_connections 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1273926800 1 -- 172.21.15.120:0/1253268458 wait complete. 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1273926800 1 Processor -- start 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.418+0000 7f1273926800 1 -- start start 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f1273926800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x555808116ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f1273926800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5558081108f0 con 0x55580810f8e0 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f126fdda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x555808116ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f126fdda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x555808116ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41684/0 (socket says 172.21.15.120:41684) 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 learned_addr learned my addr 172.21.15.120:0/3205660137 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555808117440 con 0x55580810f8e0 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f126fdda640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x555808116ee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1260020d60 tx=0x7f1260053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f11517fa640 1 -- 172.21.15.120:0/3205660137 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1260017e60 con 0x55580810f8e0 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f11517fa640 1 -- 172.21.15.120:0/3205660137 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1260031020 con 0x55580810f8e0 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f11517fa640 1 -- 172.21.15.120:0/3205660137 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1260020b70 con 0x55580810f8e0 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558081176d0 con 0x55580810f8e0 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.419+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555808118260 con 0x55580810f8e0 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.420+0000 7f11517fa640 1 -- 172.21.15.120:0/3205660137 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1260016040 con 0x55580810f8e0 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.420+0000 7f11517fa640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f113803c750 0x7f113803ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.420+0000 7f11517fa640 1 -- 172.21.15.120:0/3205660137 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1260032030 con 0x55580810f8e0 2024-09-07T03:32:34.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.420+0000 7f126f5d9640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f113803c750 0x7f113803ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.420+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.420+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5558081229e0 0x555808124ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5558081255f0 con 0x5558081229e0 2024-09-07T03:32:34.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f126edd8640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5558081229e0 0x555808124ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f126f5d9640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f113803c750 0x7f113803ec10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f126806d010 tx=0x7f126808d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f126edd8640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5558081229e0 0x555808124ea0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1258009050 con 0x5558081229e0 2024-09-07T03:32:34.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f1273926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f1273926800 20 realm 2024-09-07T03:32:34.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555808121d30 con 0x5558081229e0 2024-09-07T03:32:34.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1258009050 con 0x5558081229e0 2024-09-07T03:32:34.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f1273926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f1273926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.421+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5558081260d0 con 0x5558081229e0 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.422+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1258009050 con 0x5558081229e0 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.422+0000 7f1273926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.422+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.422+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555808126eb0 0x5558081292a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.422+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555808129970 con 0x555808126eb0 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.422+0000 7f126fdda640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555808126eb0 0x5558081292a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.422+0000 7f126fdda640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555808126eb0 0x5558081292a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f1273926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55580812a210 con 0x555808126eb0 2024-09-07T03:32:34.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f1273926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:34.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f1273926800 20 searching for the correct realm 2024-09-07T03:32:34.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55580812bf80 0x55580812e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x55580812bf80 2024-09-07T03:32:34.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f126f5d9640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55580812bf80 0x55580812e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f126f5d9640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55580812bf80 0x55580812e3b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.423+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x555808126eb0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.424+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.424+0000 7f126fdda640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f126004cbe0 0x7f126001f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.424+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x7f126004cbe0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.424+0000 7f126edd8640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f126004cbe0 0x7f126001f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.424+0000 7f126edd8640 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f126004cbe0 0x7f126001f2c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258009050 con 0x7f126004cbe0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258009050 con 0x5558081229e0 2024-09-07T03:32:34.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x55580812bf80 2024-09-07T03:32:34.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.425+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x555808126eb0 2024-09-07T03:32:34.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.426+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.426+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x555808126eb0 2024-09-07T03:32:34.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.426+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.426+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.426+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.426+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x7f126004cbe0 2024-09-07T03:32:34.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.426+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.426+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.427+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.427+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x7f126004cbe0 2024-09-07T03:32:34.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.427+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.427+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x555808126eb0 2024-09-07T03:32:34.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.427+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.427+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x55580812bf80 2024-09-07T03:32:34.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.427+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.427+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.428+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.428+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x555808126eb0 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.428+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.428+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x55580812bf80 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.428+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.428+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.428+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.428+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x55580812bf80 2024-09-07T03:32:34.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x7f126004cbe0 2024-09-07T03:32:34.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x5558081229e0 2024-09-07T03:32:34.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.429+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x7f126004cbe0 2024-09-07T03:32:34.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.430+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.430+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x55580812bf80 2024-09-07T03:32:34.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.430+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.430+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x7f126004cbe0 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.430+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.430+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55580812ea80 con 0x555808126eb0 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.430+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.430+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1260068040 con 0x555808126eb0 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1260068040 con 0x55580812bf80 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1260068040 con 0x555808126eb0 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1260068040 con 0x555808126eb0 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f1273926800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f1273926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f1273926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f1273926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f1273926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f1273926800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.431+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55580812aa60 con 0x5558081229e0 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55580812ae50 con 0x555808126eb0 2024-09-07T03:32:34.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55580812ae50 con 0x5558081229e0 2024-09-07T03:32:34.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 zone default found 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 4 Realm: () 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 zonegroup default 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55580812a640 con 0x7f126004cbe0 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.432+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555808130a40 con 0x55580812bf80 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.433+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.433+0000 7f1273926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.433+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.433+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555808130e80 con 0x55580812bf80 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.433+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.433+0000 7f1273926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.433+0000 7f1273926800 20 started sync module instance, tier type = 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.433+0000 7f1273926800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.433+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55580812fde0 con 0x555808126eb0 2024-09-07T03:32:34.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.434+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.434+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93836580946384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55580812fde0 con 0x555808126eb0 2024-09-07T03:32:34.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.434+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808131790 con 0x5558081229e0 2024-09-07T03:32:34.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.435+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93836580946384] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.435+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.435+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93836580944448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808131790 con 0x5558081229e0 2024-09-07T03:32:34.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.435+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808132150 con 0x555808126eb0 2024-09-07T03:32:34.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.438+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93836580944448] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.441+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.441+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93836580951232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808132150 con 0x555808126eb0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.441+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808132b50 con 0x7f126004cbe0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.442+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93836580951232] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.447+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.447+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93836580953248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808132cf0 con 0x7f126004cbe0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.447+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808133540 con 0x555808126eb0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.448+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93836580953248] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.451+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.451+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93836580956736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5558081333d0 con 0x555808126eb0 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.451+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808133f80 con 0x55580812bf80 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.453+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.453+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93836580960976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808133ef0 con 0x55580812bf80 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.453+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808134ee0 con 0x55580812bf80 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.456+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93836580960976] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.456+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93836580956736] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.456+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.456+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93836580963184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808134ee0 con 0x55580812bf80 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.456+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808135780 con 0x7f126004cbe0 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93836580963184] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93836580964800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808134ee0 con 0x7f126004cbe0 2024-09-07T03:32:34.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f1273926800 20 add_watcher() i=0 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f1273926800 20 add_watcher() i=1 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f1273926800 20 add_watcher() i=2 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f1273926800 20 add_watcher() i=3 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f1273926800 20 add_watcher() i=4 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f1273926800 20 add_watcher() i=5 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.457+0000 7f1273926800 20 add_watcher() i=6 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.458+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93836580964800] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.458+0000 7f1273926800 20 add_watcher() i=7 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.458+0000 7f1273926800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.458+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5558081388a0 con 0x5558081229e0 2024-09-07T03:32:34.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.458+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.458+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93836580967120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808135e00 con 0x5558081229e0 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93836580967120] v34'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f1125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f1273926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f1273926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f1273926800 5 note: GC not initialized 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f1124fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f1273926800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f1273926800 20 Filter name: none 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f109e7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f1273926800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.460+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55580816b4b0 con 0x5558081229e0 2024-09-07T03:32:34.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.461+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.461+0000 7f1273926800 20 rados_obj.operate() r=0 bl.length=556 2024-09-07T03:32:34.473 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.462+0000 7f1125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.462+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93836580967120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808169fa0 con 0x5558081229e0 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.463+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93836580967120] v34'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.463+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93836580946384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5558081352d0 con 0x555808126eb0 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.464+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93836580946384] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.464+0000 7f1273926800 20 remove_watcher() i=0 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.464+0000 7f1273926800 2 removed watcher, disabling cache 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.464+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93836580944448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5558081352d0 con 0x5558081229e0 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.465+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93836580944448] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1258028040 con 0x5558081229e0 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.465+0000 7f1273926800 20 remove_watcher() i=1 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.465+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93836580951232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5558081352d0 con 0x555808126eb0 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.468+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93836580951232] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.468+0000 7f1273926800 20 remove_watcher() i=2 2024-09-07T03:32:34.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.468+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93836580953248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5558081314c0 con 0x7f126004cbe0 2024-09-07T03:32:34.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.470+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93836580953248] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.470+0000 7f1273926800 20 remove_watcher() i=3 2024-09-07T03:32:34.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.470+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93836580956736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5558081352d0 con 0x555808126eb0 2024-09-07T03:32:34.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.473+0000 7f126fdda640 1 -- 172.21.15.120:0/3205660137 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93836580956736] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12600083e0 con 0x555808126eb0 2024-09-07T03:32:34.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.473+0000 7f1273926800 20 remove_watcher() i=4 2024-09-07T03:32:34.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.473+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93836580960976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808131ca0 con 0x55580812bf80 2024-09-07T03:32:34.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.474+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93836580960976] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.474+0000 7f1273926800 20 remove_watcher() i=5 2024-09-07T03:32:34.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.474+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93836580963184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555808132a40 con 0x55580812bf80 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.475+0000 7f126f5d9640 1 -- 172.21.15.120:0/3205660137 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93836580963184] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126806dd00 con 0x55580812bf80 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.475+0000 7f1273926800 20 remove_watcher() i=6 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.475+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93836580964800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5558081352d0 con 0x7f126004cbe0 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93836580964800] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1258028040 con 0x7f126004cbe0 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 20 remove_watcher() i=7 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555808126eb0 msgr2=0x5558081292a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555808126eb0 0x5558081292a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5558081229e0 msgr2=0x555808124ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5558081229e0 0x555808124ea0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f126004cbe0 msgr2=0x7f126001f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f126004cbe0 0x7f126001f2c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55580812bf80 msgr2=0x55580812e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55580812bf80 0x55580812e3b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f113803c750 msgr2=0x7f113803ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f113803c750 0x7f113803ec10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f126806d010 tx=0x7f126808d000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 msgr2=0x555808116ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f126edd8640 1 -- 172.21.15.120:0/3205660137 reap_dead start 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x555808116ee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1260020d60 tx=0x7f1260053150 comp rx=0 tx=0).stop 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 shutdown_connections 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 --2- 172.21.15.120:0/3205660137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55580810f8e0 0x555808116ee0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 >> 172.21.15.120:0/3205660137 conn(0x55580810bce0 msgr2=0x555808109ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 shutdown_connections 2024-09-07T03:32:34.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.476+0000 7f1273926800 1 -- 172.21.15.120:0/3205660137 wait complete. 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/1367540942 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f114803c780 msgr2=0x7f114803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/1367540942 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f114803c780 0x7f114803ec40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5558080f3590 tx=0x7f1268089040 comp rx=0 tx=0).stop 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/1367540942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555808102de0 msgr2=0x555808103200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/1367540942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555808102de0 0x555808103200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f126000aa90 tx=0x7f126000af50 comp rx=0 tx=0).stop 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/1367540942 shutdown_connections 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/1367540942 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f114803c780 0x7f114803ec40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/1367540942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555808102de0 0x555808103200 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/1367540942 >> 172.21.15.120:0/1367540942 conn(0x5558080f7190 msgr2=0x5558080f7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/1367540942 shutdown_connections 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/1367540942 wait complete. 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5558080f0600 msgr2=0x5558080f29f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5558080f0600 0x5558080f29f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555807fef020 msgr2=0x5558080ef330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555807fef020 0x5558080ef330 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f115403c730 msgr2=0x7f115403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f115403c730 0x7f115403ebf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1258001d70 tx=0x7f12580012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 msgr2=0x5558080de9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x5558080de9f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1268025a60 tx=0x7f1268003330 comp rx=0 tx=0).stop 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 shutdown_connections 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5558080f0600 0x5558080f29f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555807fef020 0x5558080ef330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f115403c730 0x7f115403ebf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 --2- 172.21.15.120:0/901257323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555807fedde0 0x5558080de9f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 >> 172.21.15.120:0/901257323 conn(0x555807fe91b0 msgr2=0x5558080d7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 shutdown_connections 2024-09-07T03:32:34.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.477+0000 7f1273926800 1 -- 172.21.15.120:0/901257323 wait complete. 2024-09-07T03:32:34.487 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:34.487 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-07T03:32:34.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-07T03:32:34.488 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-07T03:32:34.531 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:34.531 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:34.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.531+0000 7f7948c0f800 1 Processor -- start 2024-09-07T03:32:34.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.531+0000 7f7948c0f800 1 -- start start 2024-09-07T03:32:34.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.531+0000 7f7948c0f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564ae9da14a0 0x564ae9da18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.531+0000 7f7948c0f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ae9c4ce40 con 0x564ae9da1de0 2024-09-07T03:32:34.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.531+0000 7f7948c0f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x564ae9c17680 con 0x564ae9da14a0 2024-09-07T03:32:34.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.531+0000 7f7944322640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564ae9da14a0 0x564ae9da18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.531+0000 7f7944322640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x564ae9da14a0 0x564ae9da18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41690/0 (socket says 172.21.15.120:41690) 2024-09-07T03:32:34.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.531+0000 7f7944322640 1 -- 172.21.15.120:0/966151581 learned_addr learned my addr 172.21.15.120:0/966151581 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.531+0000 7f793bfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x564ae9da1de0 0x564ae9da2290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48346/0 (socket says 172.21.15.120:48346) 2024-09-07T03:32:34.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.532+0000 7f7944322640 1 -- 172.21.15.120:0/966151581 >> v1:172.21.15.104:6789/0 conn(0x564ae9da1de0 legacy=0x564ae9da2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.532+0000 7f7944322640 1 -- 172.21.15.120:0/966151581 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae9c336b0 con 0x564ae9da14a0 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.533+0000 7f7944322640 1 --2- 172.21.15.120:0/966151581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9da18a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f793400a520 tx=0x7f7934045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc524360887dd96 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7943b21640 1 -- 172.21.15.120:0/966151581 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7934055070 con 0x564ae9da14a0 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7943b21640 1 -- 172.21.15.120:0/966151581 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79340515b0 con 0x564ae9da14a0 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7943b21640 1 -- 172.21.15.120:0/966151581 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79340518d0 con 0x564ae9da14a0 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7948c0f800 1 -- 172.21.15.120:0/966151581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 msgr2=0x564ae9da18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7948c0f800 1 --2- 172.21.15.120:0/966151581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9da18a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f793400a520 tx=0x7f7934045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7948c0f800 1 -- 172.21.15.120:0/966151581 shutdown_connections 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7948c0f800 1 --2- 172.21.15.120:0/966151581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9da18a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7948c0f800 1 -- 172.21.15.120:0/966151581 >> 172.21.15.120:0/966151581 conn(0x564ae9d9d1f0 msgr2=0x564ae9d9f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7948c0f800 1 -- 172.21.15.120:0/966151581 shutdown_connections 2024-09-07T03:32:34.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.534+0000 7f7948c0f800 1 -- 172.21.15.120:0/966151581 wait complete. 2024-09-07T03:32:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.548+0000 7f7948c0f800 1 Processor -- start 2024-09-07T03:32:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.548+0000 7f7948c0f800 1 -- start start 2024-09-07T03:32:34.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.548+0000 7f7948c0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e94810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.548+0000 7f7948c0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564ae9c3bdd0 con 0x564ae9da14a0 2024-09-07T03:32:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.548+0000 7f7944322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e94810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.548+0000 7f7944322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e94810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41706/0 (socket says 172.21.15.120:41706) 2024-09-07T03:32:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.548+0000 7f7944322640 1 -- 172.21.15.120:0/2350834293 learned_addr learned my addr 172.21.15.120:0/2350834293 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.549+0000 7f7944322640 1 -- 172.21.15.120:0/2350834293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae9c54e10 con 0x564ae9da14a0 2024-09-07T03:32:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.549+0000 7f7944322640 1 --2- 172.21.15.120:0/2350834293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e94810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7934025da0 tx=0x7f7934051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e227dff5c7251794 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.549+0000 7f783260c640 1 -- 172.21.15.120:0/2350834293 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7934051ac0 con 0x564ae9da14a0 2024-09-07T03:32:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.549+0000 7f783260c640 1 -- 172.21.15.120:0/2350834293 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7934051c60 con 0x564ae9da14a0 2024-09-07T03:32:34.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.549+0000 7f783260c640 1 -- 172.21.15.120:0/2350834293 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f793405a450 con 0x564ae9da14a0 2024-09-07T03:32:34.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 -- 172.21.15.120:0/2350834293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 msgr2=0x564ae9e94810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 --2- 172.21.15.120:0/2350834293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e94810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7934025da0 tx=0x7f7934051000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 -- 172.21.15.120:0/2350834293 shutdown_connections 2024-09-07T03:32:34.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 --2- 172.21.15.120:0/2350834293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e94810 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 -- 172.21.15.120:0/2350834293 >> 172.21.15.120:0/2350834293 conn(0x564ae9d9d1f0 msgr2=0x564ae9e90190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 -- 172.21.15.120:0/2350834293 shutdown_connections 2024-09-07T03:32:34.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 -- 172.21.15.120:0/2350834293 wait complete. 2024-09-07T03:32:34.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 Processor -- start 2024-09-07T03:32:34.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 -- start start 2024-09-07T03:32:34.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e9c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.550+0000 7f7948c0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564ae9da2d60 con 0x564ae9da14a0 2024-09-07T03:32:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7944322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e9c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7944322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e9c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41722/0 (socket says 172.21.15.120:41722) 2024-09-07T03:32:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7944322640 1 -- 172.21.15.120:0/1837743951 learned_addr learned my addr 172.21.15.120:0/1837743951 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7944322640 1 -- 172.21.15.120:0/1837743951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae9e9c560 con 0x564ae9da14a0 2024-09-07T03:32:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7944322640 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e9c000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7934067040 tx=0x7f7934002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7830e09640 1 -- 172.21.15.120:0/1837743951 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7934073070 con 0x564ae9da14a0 2024-09-07T03:32:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7830e09640 1 -- 172.21.15.120:0/1837743951 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793405a600 con 0x564ae9da14a0 2024-09-07T03:32:34.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ae9e9c7f0 con 0x564ae9da14a0 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7830e09640 1 -- 172.21.15.120:0/1837743951 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f793405a8e0 con 0x564ae9da14a0 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.551+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ae9e9d400 con 0x564ae9da14a0 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.552+0000 7f7830e09640 1 -- 172.21.15.120:0/1837743951 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7934076070 con 0x564ae9da14a0 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.552+0000 7f7830e09640 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f782c03c730 0x7f782c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.552+0000 7f7830e09640 1 -- 172.21.15.120:0/1837743951 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f7934062070 con 0x564ae9da14a0 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.552+0000 7f793bfff640 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f782c03c730 0x7f782c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.552+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9da1de0 0x564ae9ea3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.553+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ea3b90 con 0x564ae9da1de0 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.553+0000 7f7944b23640 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9da1de0 0x564ae9ea3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.553+0000 7f793bfff640 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f782c03c730 0x7f782c03ebf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f792c001e30 tx=0x7f792c001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.553+0000 7f7944b23640 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9da1de0 0x564ae9ea3650 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.553+0000 7f7944b23640 1 -- 172.21.15.120:0/1837743951 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f793c00a4d0 con 0x564ae9da1de0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.553+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9ea45b0 0x564ae9ea69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.553+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ea7110 con 0x564ae9ea45b0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.553+0000 7f7944322640 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9ea45b0 0x564ae9ea69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.554+0000 7f7944322640 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9ea45b0 0x564ae9ea69a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.554+0000 7f7944322640 1 -- 172.21.15.120:0/1837743951 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f793407f070 con 0x564ae9ea45b0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.554+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ea89c0 con 0x564ae9ea45b0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.554+0000 7f7944322640 1 -- 172.21.15.120:0/1837743951 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f793407f070 con 0x564ae9ea45b0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.554+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ea7b00 con 0x564ae9ea45b0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.555+0000 7f7944322640 1 -- 172.21.15.120:0/1837743951 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f793407f070 con 0x564ae9ea45b0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.555+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ea7f60 con 0x564ae9da1de0 2024-09-07T03:32:34.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.555+0000 7f7944b23640 1 -- 172.21.15.120:0/1837743951 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f793c00a4d0 con 0x564ae9da1de0 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.555+0000 7f7948c0f800 1 Processor -- start 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.555+0000 7f7948c0f800 1 -- start start 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.555+0000 7f7948c0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9eb6eb0 0x564ae9eb72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.555+0000 7f7948c0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564ae9c99a00 con 0x564ae9eb6eb0 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7944b23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9eb6eb0 0x564ae9eb72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7944b23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9eb6eb0 0x564ae9eb72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41730/0 (socket says 172.21.15.120:41730) 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7944b23640 1 -- 172.21.15.120:0/3594235704 learned_addr learned my addr 172.21.15.120:0/3594235704 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7944b23640 1 -- 172.21.15.120:0/3594235704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae9eb7910 con 0x564ae9eb6eb0 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7944b23640 1 --2- 172.21.15.120:0/3594235704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9eb6eb0 0x564ae9eb72d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f793c016d20 tx=0x7f793c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7829ffb640 1 -- 172.21.15.120:0/3594235704 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f793c017660 con 0x564ae9eb6eb0 2024-09-07T03:32:34.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7829ffb640 1 -- 172.21.15.120:0/3594235704 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c01b030 con 0x564ae9eb6eb0 2024-09-07T03:32:34.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7829ffb640 1 -- 172.21.15.120:0/3594235704 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f793c017950 con 0x564ae9eb6eb0 2024-09-07T03:32:34.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7948c0f800 1 -- 172.21.15.120:0/3594235704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ae9eb8140 con 0x564ae9eb6eb0 2024-09-07T03:32:34.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.556+0000 7f7948c0f800 1 -- 172.21.15.120:0/3594235704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ae9eb86e0 con 0x564ae9eb6eb0 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.557+0000 7f7829ffb640 1 -- 172.21.15.120:0/3594235704 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f793c017af0 con 0x564ae9eb6eb0 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.557+0000 7f7829ffb640 1 --2- 172.21.15.120:0/3594235704 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f781c03c780 0x7f781c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.557+0000 7f7829ffb640 1 -- 172.21.15.120:0/3594235704 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f793c00e040 con 0x564ae9eb6eb0 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.557+0000 7f7944322640 1 --2- 172.21.15.120:0/3594235704 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f781c03c780 0x7f781c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.557+0000 7f7948c0f800 1 Processor -- start 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f7944322640 1 --2- 172.21.15.120:0/3594235704 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f781c03c780 0x7f781c03ec40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x564ae9e9d800 tx=0x7f793408a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f7948c0f800 1 -- start start 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f7948c0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ec3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f7948c0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564ae9e94fa0 con 0x564ae9ec3950 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f7944b23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ec3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f7944b23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ec3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41734/0 (socket says 172.21.15.120:41734) 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f7944b23640 1 -- 172.21.15.120:0/1882430095 learned_addr learned my addr 172.21.15.120:0/1882430095 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f7944b23640 1 -- 172.21.15.120:0/1882430095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae9ec4340 con 0x564ae9ec3950 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f7944b23640 1 --2- 172.21.15.120:0/1882430095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ec3d50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f793c054030 tx=0x7f793c054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f303815b0baacc server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f781b7fe640 1 -- 172.21.15.120:0/1882430095 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f793c014d40 con 0x564ae9ec3950 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f781b7fe640 1 -- 172.21.15.120:0/1882430095 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c0149b0 con 0x564ae9ec3950 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.558+0000 7f781b7fe640 1 -- 172.21.15.120:0/1882430095 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f793c028350 con 0x564ae9ec3950 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 -- 172.21.15.120:0/1882430095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 msgr2=0x564ae9ec3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1882430095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ec3d50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f793c054030 tx=0x7f793c054060 comp rx=0 tx=0).stop 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 -- 172.21.15.120:0/1882430095 shutdown_connections 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1882430095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ec3d50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 -- 172.21.15.120:0/1882430095 >> 172.21.15.120:0/1882430095 conn(0x564ae9ebfd50 msgr2=0x564ae9ebdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 -- 172.21.15.120:0/1882430095 shutdown_connections 2024-09-07T03:32:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 -- 172.21.15.120:0/1882430095 wait complete. 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 Processor -- start 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 -- start start 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ecaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7948c0f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x564ae9ec4930 con 0x564ae9ec3950 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.559+0000 7f7944b23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ecaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.560+0000 7f7944b23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ecaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41750/0 (socket says 172.21.15.120:41750) 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.560+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 learned_addr learned my addr 172.21.15.120:0/1474240410 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.560+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae9ecb470 con 0x564ae9ec3950 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.560+0000 7f7944b23640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ecaf10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f793c053d10 tx=0x7f793c053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.560+0000 7f7819ffb640 1 -- 172.21.15.120:0/1474240410 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f793c012570 con 0x564ae9ec3950 2024-09-07T03:32:34.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.560+0000 7f7819ffb640 1 -- 172.21.15.120:0/1474240410 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c005500 con 0x564ae9ec3950 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.560+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ae9ecb700 con 0x564ae9ec3950 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.560+0000 7f7819ffb640 1 -- 172.21.15.120:0/1474240410 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f793c055570 con 0x564ae9ec3950 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.560+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ae9ecc290 con 0x564ae9ec3950 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.561+0000 7f7819ffb640 1 -- 172.21.15.120:0/1474240410 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f793c0127a0 con 0x564ae9ec3950 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.561+0000 7f7819ffb640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f780c03c730 0x7f780c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.561+0000 7f7819ffb640 1 -- 172.21.15.120:0/1474240410 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f793c048920 con 0x564ae9ec3950 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.561+0000 7f7944322640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f780c03c730 0x7f780c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9ed6a20 0x564ae9ed8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ed9630 con 0x564ae9ed6a20 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f793bfff640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9ed6a20 0x564ae9ed8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f7944322640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f780c03c730 0x7f780c03ebf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79340965b0 tx=0x7f7934094000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f793bfff640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9ed6a20 0x564ae9ed8ee0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f7948c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f7948c0f800 20 realm 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.562+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ed5d70 con 0x564ae9ed6a20 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7948c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7948c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9eda110 con 0x564ae9ed6a20 2024-09-07T03:32:34.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7948c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9edaef0 0x564ae9edd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9edd9b0 con 0x564ae9edaef0 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7944b23640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9edaef0 0x564ae9edd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.563+0000 7f7944b23640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9edaef0 0x564ae9edd2e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7948c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ede250 con 0x564ae9edaef0 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7948c0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7948c0f800 20 searching for the correct realm 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x564ae9edffc0 0x564ae9ee23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edffc0 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7944322640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x564ae9edffc0 0x564ae9ee23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.564+0000 7f7944322640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x564ae9edffc0 0x564ae9ee23d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.565+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.565+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edaef0 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.565+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.565+0000 7f7944b23640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f793c014440 0x7f793c03bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.565+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x7f793c014440 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.565+0000 7f793bfff640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f793c014440 0x7f793c03bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.565+0000 7f793bfff640 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f793c014440 0x7f793c03bab0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x7f793c014440 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edffc0 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.566+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edaef0 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.567+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.567+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edaef0 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.567+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.567+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.567+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.567+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x7f793c014440 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.568+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x7f793c014440 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.568+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.568+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.568+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x7f793c014440 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.568+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f792c00f610 con 0x7f793c014440 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.568+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edaef0 2024-09-07T03:32:34.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.568+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.568+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edffc0 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.569+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.569+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.569+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.569+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edaef0 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.569+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.569+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edffc0 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.569+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.569+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.570+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.570+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.570+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.570+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.570+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.570+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edffc0 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.570+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.570+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x7f793c014440 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x7f793c014440 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9ed6a20 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x564ae9ed6a20 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x7f793c014440 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x7f793c014440 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edffc0 2024-09-07T03:32:34.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x7f793c014440 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f792c00f610 con 0x7f793c014440 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.571+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edaef0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.572+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.572+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edaef0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.572+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.572+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edffc0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.572+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.572+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edaef0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.572+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.572+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee2aa0 con 0x564ae9edaef0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9edeba0 con 0x564ae9ed6a20 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x564ae9ed6a20 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9edeff0 con 0x564ae9edaef0 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.573+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9edf450 con 0x564ae9ed6a20 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f792c03c040 con 0x564ae9ed6a20 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 zone default found 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 4 Realm: () 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 zonegroup default 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ede720 con 0x7f793c014440 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x7f793c014440 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee51a0 con 0x564ae9edffc0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee5660 con 0x564ae9edffc0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 started sync module instance, tier type = 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.574+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee3fa0 con 0x564ae9edaef0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.575+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.575+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94879752274832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee5f70 con 0x564ae9edaef0 2024-09-07T03:32:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.575+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee67c0 con 0x564ae9ed6a20 2024-09-07T03:32:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.576+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94879752274832] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.577+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x564ae9ed6a20 2024-09-07T03:32:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.577+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94879752280768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee6b60 con 0x564ae9ed6a20 2024-09-07T03:32:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.577+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee73b0 con 0x564ae9edaef0 2024-09-07T03:32:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.580+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94879752280768] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x564ae9ed6a20 2024-09-07T03:32:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.580+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.580+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94879752285024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee77a0 con 0x564ae9edaef0 2024-09-07T03:32:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.580+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee7ff0 con 0x7f793c014440 2024-09-07T03:32:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.583+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94879752285024] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.585+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x7f793c014440 2024-09-07T03:32:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.585+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94879752288160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee8070 con 0x7f793c014440 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.585+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee8900 con 0x564ae9edaef0 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.588+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94879752288160] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x7f793c014440 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.591+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.591+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94879752289216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee8490 con 0x564ae9edaef0 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.591+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee9310 con 0x564ae9edffc0 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.592+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.592+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94879752293984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee9bb0 con 0x564ae9edffc0 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.592+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9eea680 con 0x564ae9edffc0 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.593+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.593+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94879752298864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9eea680 con 0x564ae9edffc0 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.593+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9eeb660 con 0x7f793c014440 2024-09-07T03:32:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.593+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94879752289216] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.595+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94879752293984] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94879752298864] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x7f793c014440 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94879752296192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee7fe0 con 0x7f793c014440 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f7948c0f800 20 add_watcher() i=0 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f7948c0f800 20 add_watcher() i=1 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f7948c0f800 20 add_watcher() i=2 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f7948c0f800 20 add_watcher() i=3 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f7948c0f800 20 add_watcher() i=4 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f7948c0f800 20 add_watcher() i=5 2024-09-07T03:32:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.596+0000 7f7948c0f800 20 add_watcher() i=6 2024-09-07T03:32:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.597+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94879752296192] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x7f793c014440 2024-09-07T03:32:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.597+0000 7f7948c0f800 20 add_watcher() i=7 2024-09-07T03:32:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.597+0000 7f7948c0f800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.597+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9eeb170 con 0x564ae9ed6a20 2024-09-07T03:32:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.597+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f792c03c040 con 0x564ae9ed6a20 2024-09-07T03:32:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.597+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94879752301216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9eeb170 con 0x564ae9ed6a20 2024-09-07T03:32:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.598+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94879752301216] v34'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x564ae9ed6a20 2024-09-07T03:32:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.598+0000 7f77fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.598+0000 7f7948c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.598+0000 7f7948c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.598+0000 7f7948c0f800 5 note: GC not initialized 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.599+0000 7f77f97e2640 20 reqs_thread_entry: start 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.599+0000 7f7948c0f800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.599+0000 7f7948c0f800 20 Filter name: none 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.599+0000 7f776affd640 20 reqs_thread_entry: start 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.599+0000 7f7948c0f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.599+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ae9f20d20 con 0x564ae9ed6a20 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.599+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f792c03c040 con 0x564ae9ed6a20 2024-09-07T03:32:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.599+0000 7f7948c0f800 20 rados_obj.operate() r=0 bl.length=556 2024-09-07T03:32:34.606 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:34.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.600+0000 7f77fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.600+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94879752301216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9f1f7f0 con 0x564ae9ed6a20 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.601+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94879752301216] v34'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x564ae9ed6a20 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.601+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94879752274832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9eeaaa0 con 0x564ae9edaef0 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.602+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94879752274832] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.602+0000 7f7948c0f800 20 remove_watcher() i=0 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.602+0000 7f7948c0f800 2 removed watcher, disabling cache 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.602+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94879752280768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee4390 con 0x564ae9ed6a20 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.603+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94879752280768] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x564ae9ed6a20 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.603+0000 7f7948c0f800 20 remove_watcher() i=1 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.603+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94879752285024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee4390 con 0x564ae9edaef0 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.604+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94879752285024] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.604+0000 7f7948c0f800 20 remove_watcher() i=2 2024-09-07T03:32:34.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.604+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94879752288160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee6b60 con 0x7f793c014440 2024-09-07T03:32:34.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.606+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94879752288160] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x7f793c014440 2024-09-07T03:32:34.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.606+0000 7f7948c0f800 20 remove_watcher() i=3 2024-09-07T03:32:34.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.606+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94879752289216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee4390 con 0x564ae9edaef0 2024-09-07T03:32:34.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.607+0000 7f7944b23640 1 -- 172.21.15.120:0/1474240410 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94879752289216] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f793c027070 con 0x564ae9edaef0 2024-09-07T03:32:34.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.607+0000 7f7948c0f800 20 remove_watcher() i=4 2024-09-07T03:32:34.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.607+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94879752293984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee6b60 con 0x564ae9edffc0 2024-09-07T03:32:34.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.608+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94879752293984] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.608+0000 7f7948c0f800 20 remove_watcher() i=5 2024-09-07T03:32:34.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.608+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94879752298864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee8e60 con 0x564ae9edffc0 2024-09-07T03:32:34.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.609+0000 7f7944322640 1 -- 172.21.15.120:0/1474240410 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94879752298864] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79340a0030 con 0x564ae9edffc0 2024-09-07T03:32:34.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.609+0000 7f7948c0f800 20 remove_watcher() i=6 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.609+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94879752296192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ae9ee6b60 con 0x7f793c014440 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94879752296192] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f792c03c040 con 0x7f793c014440 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 20 remove_watcher() i=7 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9edaef0 msgr2=0x564ae9edd2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9edaef0 0x564ae9edd2e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9ed6a20 msgr2=0x564ae9ed8ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9ed6a20 0x564ae9ed8ee0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f793c014440 msgr2=0x7f793c03bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f793c014440 0x7f793c03bab0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x564ae9edffc0 msgr2=0x564ae9ee23d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x564ae9edffc0 0x564ae9ee23d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f780c03c730 msgr2=0x7f780c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f780c03c730 0x7f780c03ebf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79340965b0 tx=0x7f7934094000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 msgr2=0x564ae9ecaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f793bfff640 1 -- 172.21.15.120:0/1474240410 reap_dead start 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ecaf10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f793c053d10 tx=0x7f793c053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 shutdown_connections 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1474240410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9ec3950 0x564ae9ecaf10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 >> 172.21.15.120:0/1474240410 conn(0x564ae9ebfd50 msgr2=0x564ae9ebdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 shutdown_connections 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.610+0000 7f7948c0f800 1 -- 172.21.15.120:0/1474240410 wait complete. 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/3594235704 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f781c03c780 msgr2=0x7f781c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/3594235704 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f781c03c780 0x7f781c03ec40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x564ae9e9d800 tx=0x7f793408a040 comp rx=0 tx=0).stop 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/3594235704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9eb6eb0 msgr2=0x564ae9eb72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/3594235704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9eb6eb0 0x564ae9eb72d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f793c016d20 tx=0x7f793c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/3594235704 shutdown_connections 2024-09-07T03:32:34.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/3594235704 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f781c03c780 0x7f781c03ec40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/3594235704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9eb6eb0 0x564ae9eb72d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/3594235704 >> 172.21.15.120:0/3594235704 conn(0x564ae9eab260 msgr2=0x564ae9eab640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/3594235704 shutdown_connections 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/3594235704 wait complete. 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9ea45b0 msgr2=0x564ae9ea69a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9ea45b0 0x564ae9ea69a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9da1de0 msgr2=0x564ae9ea3650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9da1de0 0x564ae9ea3650 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f782c03c730 msgr2=0x7f782c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f782c03c730 0x7f782c03ebf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f792c001e30 tx=0x7f792c001390 comp rx=0 tx=0).stop 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 msgr2=0x564ae9e9c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e9c000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7934067040 tx=0x7f7934002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 shutdown_connections 2024-09-07T03:32:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x564ae9ea45b0 0x564ae9ea69a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x564ae9da1de0 0x564ae9ea3650 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f782c03c730 0x7f782c03ebf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 --2- 172.21.15.120:0/1837743951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564ae9da14a0 0x564ae9e9c000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 >> 172.21.15.120:0/1837743951 conn(0x564ae9d9d1f0 msgr2=0x564ae9e8e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 shutdown_connections 2024-09-07T03:32:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.611+0000 7f7948c0f800 1 -- 172.21.15.120:0/1837743951 wait complete. 2024-09-07T03:32:34.621 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:34.622 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-07T03:32:34.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-07T03:32:34.622 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-07T03:32:34.670 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:34.670 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:34.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa55d28800 1 Processor -- start 2024-09-07T03:32:34.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa55d28800 1 -- start start 2024-09-07T03:32:34.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa55d28800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f58d2be4c0 0x55f58d2be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa55d28800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f58d169e40 con 0x55f58d2bee00 2024-09-07T03:32:34.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa55d28800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55f58d134680 con 0x55f58d2be4c0 2024-09-07T03:32:34.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa51a6f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55f58d2be4c0 0x55f58d2be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa5126e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55f58d2bee00 0x55f58d2bf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48354/0 (socket says 172.21.15.120:48354) 2024-09-07T03:32:34.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa5126e640 1 -- 172.21.15.120:0/3183344567 learned_addr learned my addr 172.21.15.120:0/3183344567 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:34.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa51a6f640 1 -- 172.21.15.120:0/3183344567 >> v1:172.21.15.104:6789/0 conn(0x55f58d2bee00 legacy=0x55f58d2bf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa51a6f640 1 -- 172.21.15.120:0/3183344567 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58d1506b0 con 0x55f58d2be4c0 2024-09-07T03:32:34.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.670+0000 7faa50a6d640 1 -- 172.21.15.120:0/3183344567 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 864389309 0 0) 0x55f58d169e40 con 0x55f58d2bee00 2024-09-07T03:32:34.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.672+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3183344567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d2be8c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faa4400a470 tx=0x7faa44045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09f40bfcc2e5dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.672+0000 7faa50a6d640 1 -- 172.21.15.120:0/3183344567 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa44053570 con 0x55f58d2be4c0 2024-09-07T03:32:34.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.672+0000 7faa50a6d640 1 -- 172.21.15.120:0/3183344567 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa44058070 con 0x55f58d2be4c0 2024-09-07T03:32:34.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.672+0000 7faa50a6d640 1 -- 172.21.15.120:0/3183344567 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa44053880 con 0x55f58d2be4c0 2024-09-07T03:32:34.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.673+0000 7faa55d28800 1 -- 172.21.15.120:0/3183344567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 msgr2=0x55f58d2be8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.673+0000 7faa55d28800 1 --2- 172.21.15.120:0/3183344567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d2be8c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faa4400a470 tx=0x7faa44045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:34.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.673+0000 7faa55d28800 1 -- 172.21.15.120:0/3183344567 shutdown_connections 2024-09-07T03:32:34.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.673+0000 7faa55d28800 1 --2- 172.21.15.120:0/3183344567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d2be8c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.673+0000 7faa55d28800 1 -- 172.21.15.120:0/3183344567 >> 172.21.15.120:0/3183344567 conn(0x55f58d2ba210 msgr2=0x55f58d2bc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.673+0000 7faa55d28800 1 -- 172.21.15.120:0/3183344567 shutdown_connections 2024-09-07T03:32:34.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.673+0000 7faa55d28800 1 -- 172.21.15.120:0/3183344567 wait complete. 2024-09-07T03:32:34.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.687+0000 7faa55d28800 1 Processor -- start 2024-09-07T03:32:34.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.687+0000 7faa55d28800 1 -- start start 2024-09-07T03:32:34.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.687+0000 7faa55d28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.687+0000 7faa55d28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f58d158dd0 con 0x55f58d2be4c0 2024-09-07T03:32:34.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.687+0000 7faa51a6f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.687+0000 7faa51a6f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41762/0 (socket says 172.21.15.120:41762) 2024-09-07T03:32:34.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.687+0000 7faa51a6f640 1 -- 172.21.15.120:0/2396931890 learned_addr learned my addr 172.21.15.120:0/2396931890 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.688+0000 7faa51a6f640 1 -- 172.21.15.120:0/2396931890 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58d171e10 con 0x55f58d2be4c0 2024-09-07T03:32:34.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.688+0000 7faa51a6f640 1 --2- 172.21.15.120:0/2396931890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b16e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faa4400a470 tx=0x7faa44051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7de5e18b0716c25 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.688+0000 7fa93fe07640 1 -- 172.21.15.120:0/2396931890 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa44053570 con 0x55f58d2be4c0 2024-09-07T03:32:34.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.688+0000 7fa93fe07640 1 -- 172.21.15.120:0/2396931890 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa44063030 con 0x55f58d2be4c0 2024-09-07T03:32:34.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.688+0000 7fa93fe07640 1 -- 172.21.15.120:0/2396931890 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa44053840 con 0x55f58d2be4c0 2024-09-07T03:32:34.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 -- 172.21.15.120:0/2396931890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 msgr2=0x55f58d3b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 --2- 172.21.15.120:0/2396931890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b16e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faa4400a470 tx=0x7faa44051000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 -- 172.21.15.120:0/2396931890 shutdown_connections 2024-09-07T03:32:34.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 --2- 172.21.15.120:0/2396931890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b16e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 -- 172.21.15.120:0/2396931890 >> 172.21.15.120:0/2396931890 conn(0x55f58d2ba210 msgr2=0x55f58d3ad060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 -- 172.21.15.120:0/2396931890 shutdown_connections 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 -- 172.21.15.120:0/2396931890 wait complete. 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 Processor -- start 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 -- start start 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa55d28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f58d2bfd80 con 0x55f58d2be4c0 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.689+0000 7faa51a6f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.690+0000 7faa51a6f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41778/0 (socket says 172.21.15.120:41778) 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.690+0000 7faa51a6f640 1 -- 172.21.15.120:0/3626928327 learned_addr learned my addr 172.21.15.120:0/3626928327 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.690+0000 7faa51a6f640 1 -- 172.21.15.120:0/3626928327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58d3b9450 con 0x55f58d2be4c0 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.690+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b8ef0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faa4400a470 tx=0x7faa44002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.690+0000 7fa93e604640 1 -- 172.21.15.120:0/3626928327 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa44078070 con 0x55f58d2be4c0 2024-09-07T03:32:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.690+0000 7fa93e604640 1 -- 172.21.15.120:0/3626928327 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa44068420 con 0x55f58d2be4c0 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.690+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f58d3b96e0 con 0x55f58d2be4c0 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.690+0000 7fa93e604640 1 -- 172.21.15.120:0/3626928327 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa44068700 con 0x55f58d2be4c0 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.690+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58d3ba2f0 con 0x55f58d2be4c0 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.691+0000 7fa93e604640 1 -- 172.21.15.120:0/3626928327 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faa4407b070 con 0x55f58d2be4c0 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.691+0000 7fa93e604640 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa93803c780 0x7fa93803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.691+0000 7fa93e604640 1 -- 172.21.15.120:0/3626928327 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7faa440979e0 con 0x55f58d2be4c0 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.691+0000 7faa5126e640 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa93803c780 0x7fa93803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.691+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d2bee00 0x55f58d3c0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.691+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3c0a80 con 0x55f58d2bee00 2024-09-07T03:32:34.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.692+0000 7faa52270640 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d2bee00 0x55f58d3c0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.692+0000 7faa5126e640 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa93803c780 0x7fa93803ec40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa3c000c00 tx=0x7faa3c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.692+0000 7faa52270640 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d2bee00 0x55f58d3c0540 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.692+0000 7faa52270640 1 -- 172.21.15.120:0/3626928327 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa4c00a4d0 con 0x55f58d2bee00 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.692+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3c1330 0x55f58d3c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.692+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3c3f10 con 0x55f58d3c1330 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.692+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3c1330 0x55f58d3c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.693+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3c1330 0x55f58d3c37a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.693+0000 7faa51a6f640 1 -- 172.21.15.120:0/3626928327 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa4407a030 con 0x55f58d3c1330 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.693+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3c57c0 con 0x55f58d3c1330 2024-09-07T03:32:34.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.693+0000 7faa51a6f640 1 -- 172.21.15.120:0/3626928327 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faa4407a030 con 0x55f58d3c1330 2024-09-07T03:32:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.693+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3c4840 con 0x55f58d3c1330 2024-09-07T03:32:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.694+0000 7faa51a6f640 1 -- 172.21.15.120:0/3626928327 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa4407a030 con 0x55f58d3c1330 2024-09-07T03:32:34.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.694+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3c4ca0 con 0x55f58d2bee00 2024-09-07T03:32:34.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.694+0000 7faa52270640 1 -- 172.21.15.120:0/3626928327 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faa4c00a4d0 con 0x55f58d2bee00 2024-09-07T03:32:34.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.694+0000 7faa55d28800 1 Processor -- start 2024-09-07T03:32:34.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.694+0000 7faa55d28800 1 -- start start 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.694+0000 7faa55d28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3d3ca0 0x55f58d3d40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.694+0000 7faa55d28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f58d1b6a00 con 0x55f58d3d3ca0 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.694+0000 7faa52270640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3d3ca0 0x55f58d3d40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.694+0000 7faa52270640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3d3ca0 0x55f58d3d40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41790/0 (socket says 172.21.15.120:41790) 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.695+0000 7faa52270640 1 -- 172.21.15.120:0/3596012642 learned_addr learned my addr 172.21.15.120:0/3596012642 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.695+0000 7faa52270640 1 -- 172.21.15.120:0/3596012642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58d3d4700 con 0x55f58d3d3ca0 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.695+0000 7faa52270640 1 --2- 172.21.15.120:0/3596012642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3d3ca0 0x55f58d3d40c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faa4c016d20 tx=0x7faa4c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.695+0000 7fa9377fe640 1 -- 172.21.15.120:0/3596012642 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa4c017660 con 0x55f58d3d3ca0 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.695+0000 7fa9377fe640 1 -- 172.21.15.120:0/3596012642 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4c01b030 con 0x55f58d3d3ca0 2024-09-07T03:32:34.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.695+0000 7faa55d28800 1 -- 172.21.15.120:0/3596012642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f58d3d4f30 con 0x55f58d3d3ca0 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.695+0000 7fa9377fe640 1 -- 172.21.15.120:0/3596012642 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa4c017950 con 0x55f58d3d3ca0 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.695+0000 7faa55d28800 1 -- 172.21.15.120:0/3596012642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58d3d54d0 con 0x55f58d3d3ca0 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.696+0000 7fa9377fe640 1 -- 172.21.15.120:0/3596012642 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faa4c017af0 con 0x55f58d3d3ca0 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.696+0000 7fa9377fe640 1 --2- 172.21.15.120:0/3596012642 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa92c03c780 0x7fa92c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.696+0000 7fa9377fe640 1 -- 172.21.15.120:0/3596012642 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7faa4c00e040 con 0x55f58d3d3ca0 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.696+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3596012642 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa92c03c780 0x7fa92c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.696+0000 7faa55d28800 1 Processor -- start 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.696+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3596012642 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa92c03c780 0x7fa92c03ec40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55f58d3ba6f0 tx=0x7faa4408a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.696+0000 7faa55d28800 1 -- start start 2024-09-07T03:32:34.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7faa55d28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7faa55d28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f58d3b1ed0 con 0x55f58d3e0720 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7faa52270640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7faa52270640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41804/0 (socket says 172.21.15.120:41804) 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7faa52270640 1 -- 172.21.15.120:0/3573765260 learned_addr learned my addr 172.21.15.120:0/3573765260 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7faa52270640 1 -- 172.21.15.120:0/3573765260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58d3e1110 con 0x55f58d3e0720 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7faa52270640 1 --2- 172.21.15.120:0/3573765260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e0b20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faa4c017f20 tx=0x7faa4c028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1514ff7456cacc74 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7fa9357fa640 1 -- 172.21.15.120:0/3573765260 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa4c0149b0 con 0x55f58d3e0720 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7fa9357fa640 1 -- 172.21.15.120:0/3573765260 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4c028350 con 0x55f58d3e0720 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.697+0000 7fa9357fa640 1 -- 172.21.15.120:0/3573765260 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa4c014b50 con 0x55f58d3e0720 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 -- 172.21.15.120:0/3573765260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 msgr2=0x55f58d3e0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 --2- 172.21.15.120:0/3573765260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e0b20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faa4c017f20 tx=0x7faa4c028e80 comp rx=0 tx=0).stop 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 -- 172.21.15.120:0/3573765260 shutdown_connections 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 --2- 172.21.15.120:0/3573765260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e0b20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 -- 172.21.15.120:0/3573765260 >> 172.21.15.120:0/3573765260 conn(0x55f58d3dcb20 msgr2=0x55f58d3dad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 -- 172.21.15.120:0/3573765260 shutdown_connections 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 -- 172.21.15.120:0/3573765260 wait complete. 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 Processor -- start 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 -- start start 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa55d28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55f58d3e1730 con 0x55f58d3e0720 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa52270640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa52270640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41808/0 (socket says 172.21.15.120:41808) 2024-09-07T03:32:34.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.698+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 learned_addr learned my addr 172.21.15.120:0/3670683929 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.699+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58d3e82f0 con 0x55f58d3e0720 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.699+0000 7faa52270640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e7d90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa4c017f20 tx=0x7faa4c053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.699+0000 7fa9237fe640 1 -- 172.21.15.120:0/3670683929 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa4c04c070 con 0x55f58d3e0720 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.699+0000 7fa9237fe640 1 -- 172.21.15.120:0/3670683929 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4c0129b0 con 0x55f58d3e0720 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.699+0000 7fa9237fe640 1 -- 172.21.15.120:0/3670683929 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa4c012c90 con 0x55f58d3e0720 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.699+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f58d3e8580 con 0x55f58d3e0720 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.699+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58d3e8f00 con 0x55f58d3e0720 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.700+0000 7fa9237fe640 1 -- 172.21.15.120:0/3670683929 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faa4c0135c0 con 0x55f58d3e0720 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.700+0000 7fa9237fe640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa91c03c780 0x7fa91c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.700+0000 7fa9237fe640 1 -- 172.21.15.120:0/3670683929 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7faa4c03bb40 con 0x55f58d3e0720 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.700+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa91c03c780 0x7fa91c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.700+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa91c03c780 0x7fa91c03ec40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa44053790 tx=0x7faa44090000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.700+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.700+0000 7faa55d28800 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d3f3880 0x55f58d3f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.700+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3f6490 con 0x55f58d3f3880 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa5126e640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d3f3880 0x55f58d3f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa5126e640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d3f3880 0x55f58d3f5d40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa55d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa55d28800 20 realm 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3f2bd0 con 0x55f58d3f3880 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa55d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa55d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.701+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3f6f80 con 0x55f58d3f3880 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa55d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa55d28800 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3f7d60 0x55f58d3fa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3fa820 con 0x55f58d3f7d60 2024-09-07T03:32:34.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa52270640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3f7d60 0x55f58d3fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa52270640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3f7d60 0x55f58d3fa150 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa55d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.702+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3fb070 con 0x55f58d3f7d60 2024-09-07T03:32:34.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa55d28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:34.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa55d28800 20 searching for the correct realm 2024-09-07T03:32:34.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa55d28800 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55f58d3fcde0 0x55f58d3ff250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3fcde0 2024-09-07T03:32:34.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55f58d3fcde0 0x55f58d3ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa51a6f640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55f58d3fcde0 0x55f58d3ff250 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f7d60 2024-09-07T03:32:34.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.703+0000 7faa52270640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faa4c014440 0x7faa4c025060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.704+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x7faa4c014440 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.704+0000 7faa5126e640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faa4c014440 0x7faa4c025060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.704+0000 7faa5126e640 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faa4c014440 0x7faa4c025060 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.704+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x7faa4c014440 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.704+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.704+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.704+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.704+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.704+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3fcde0 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.705+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.705+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.705+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.705+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f7d60 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.705+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.705+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f7d60 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.705+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.706+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.706+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.706+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x7faa4c014440 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.706+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x7faa4c014440 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.706+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.706+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.706+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x7faa4c014440 2024-09-07T03:32:34.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.706+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faa3c00f5f0 con 0x7faa4c014440 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.706+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f7d60 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.707+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.707+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3fcde0 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.707+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.707+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.707+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.707+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f7d60 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.707+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.707+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3fcde0 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3fcde0 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.708+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x7faa4c014440 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.709+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x7faa4c014440 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.709+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f3880 2024-09-07T03:32:34.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.709+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x55f58d3f3880 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.709+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x7faa4c014440 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.709+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x7faa4c014440 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.709+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3fcde0 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.709+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.709+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x7faa4c014440 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.710+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c00f5f0 con 0x7faa4c014440 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.710+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f7d60 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.710+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.710+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f7d60 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.710+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.710+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3fcde0 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.710+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.710+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f7d60 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3ff920 con 0x55f58d3f7d60 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3fb9c0 con 0x55f58d3f3880 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.711+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3fb5d0 con 0x55f58d3f7d60 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d3fc2f0 con 0x55f58d3f3880 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 zone default found 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 4 Realm: () 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 zonegroup default 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d400250 con 0x7faa4c014440 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x7faa4c014440 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d402490 con 0x55f58d3fcde0 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.712+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d402830 con 0x55f58d3fcde0 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.713+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.713+0000 7faa55d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.713+0000 7faa55d28800 20 started sync module instance, tier type = 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.713+0000 7faa55d28800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.713+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d4018d0 con 0x55f58d3f7d60 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.714+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.714+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94513125137600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d4020e0 con 0x55f58d3f7d60 2024-09-07T03:32:34.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.714+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d403530 con 0x55f58d3f3880 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.715+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94513125137600] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.715+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.715+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94513125141936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d403dd0 con 0x55f58d3f3880 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.715+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d404790 con 0x55f58d3f7d60 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.716+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94513125141936] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.717+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.717+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94513125147840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d403dd0 con 0x55f58d3f7d60 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.717+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d405200 con 0x7faa4c014440 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.718+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94513125147840] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.718+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x7faa4c014440 2024-09-07T03:32:34.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.718+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94513125149936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d403dd0 con 0x7faa4c014440 2024-09-07T03:32:34.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.718+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d405c10 con 0x55f58d3f7d60 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.719+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94513125149936] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x7faa4c014440 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.721+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.721+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94513125153088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d403dd0 con 0x55f58d3f7d60 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.721+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d406620 con 0x55f58d3fcde0 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.722+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94513125153088] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.722+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.722+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94513125155664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d403dd0 con 0x55f58d3fcde0 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.722+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d407070 con 0x55f58d3fcde0 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.723+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.723+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94513125157760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d407040 con 0x55f58d3fcde0 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.723+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d408050 con 0x7faa4c014440 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.723+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94513125155664] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x7faa4c014440 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94513125161728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d408010 con 0x7faa4c014440 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa55d28800 20 add_watcher() i=0 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa55d28800 20 add_watcher() i=1 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa55d28800 20 add_watcher() i=2 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa55d28800 20 add_watcher() i=3 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa55d28800 20 add_watcher() i=4 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa55d28800 20 add_watcher() i=5 2024-09-07T03:32:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94513125157760] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.724+0000 7faa55d28800 20 add_watcher() i=6 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.725+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94513125161728] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x7faa4c014440 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.725+0000 7faa55d28800 20 add_watcher() i=7 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.725+0000 7faa55d28800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.725+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d407460 con 0x55f58d3f3880 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.725+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.725+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94513125144864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d407460 con 0x55f58d3f3880 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.726+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94513125144864] v34'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.726+0000 7fa903fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.726+0000 7faa55d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.726+0000 7faa55d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.726+0000 7faa55d28800 5 note: GC not initialized 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7fa902ffd640 20 reqs_thread_entry: start 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 20 Filter name: none 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7fa900ff9640 20 reqs_thread_entry: start 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43e0a0 con 0x55f58d3f3880 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 20 rados_obj.operate() r=0 bl.length=556 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.727+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43ebf0 con 0x7faa4c014440 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.728+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x7faa4c014440 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.728+0000 7faa55d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.728+0000 7faa55d28800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.728+0000 7faa55d28800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.728+0000 7faa55d28800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.728+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d4448f0 con 0x55f58d3f3880 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7faa55d28800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7faa55d28800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7faa55d28800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94513125409552 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d4414e0 con 0x55f58d3f7d60 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94513125153088 notify 146028888074 ret 0) ==== 891+0+0 (crc 0 0 0) 0x55f58d3e8f00 con 0x55f58d3f7d60 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7fa9357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94513125153088 notifier 4386 bl.length()=849 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(65 notify.4 [notify cookie 94513125409552 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7fa9357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7fa9357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7fa9357fa640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa914003ea0 con 0x55f58d3f7d60 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.729+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.730+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94513125409552 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f58d3e8580 con 0x55f58d3f7d60 2024-09-07T03:32:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.730+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d444310 con 0x7faa4c014440 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x7faa4c014440 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7faa55d28800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7faa55d28800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7faa55d28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94513125409552 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43ef90 con 0x55f58d3f7d60 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== watch-notify(notify (1) cookie 94513125137600 notify 146028888075 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55f58d3e8580 con 0x55f58d3f7d60 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7fa9357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888075 cookie 94513125137600 notifier 4386 bl.length()=166 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7fa9357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7fa9357fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7fa9357fa640 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa914003ea0 con 0x55f58d3f7d60 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(68 notify.0 [notify cookie 94513125409552 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.731+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== watch-notify(notify_complete (2) cookie 94513125409552 notify 146028888075 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f58d3e82f0 con 0x55f58d3f7d60 2024-09-07T03:32:34.753 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-07T03:32:34.729049Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:34.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.732+0000 7fa903fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.732+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94513125144864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43bf00 con 0x55f58d3f3880 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.733+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94513125144864] v34'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.733+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94513125137600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43bf00 con 0x55f58d3f7d60 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.734+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94513125137600] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.734+0000 7faa55d28800 20 remove_watcher() i=0 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.734+0000 7faa55d28800 2 removed watcher, disabling cache 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.734+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94513125141936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43bf00 con 0x55f58d3f3880 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.735+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94513125141936] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x55f58d3f3880 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.735+0000 7faa55d28800 20 remove_watcher() i=1 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.735+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94513125147840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43bf00 con 0x55f58d3f7d60 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.736+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94513125147840] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.736+0000 7faa55d28800 20 remove_watcher() i=2 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.736+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94513125149936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43bf00 con 0x7faa4c014440 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.737+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94513125149936] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x7faa4c014440 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.737+0000 7faa55d28800 20 remove_watcher() i=3 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.737+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94513125153088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43bf00 con 0x55f58d3f7d60 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.738+0000 7faa52270640 1 -- 172.21.15.120:0/3670683929 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94513125153088] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4c027070 con 0x55f58d3f7d60 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.738+0000 7faa55d28800 20 remove_watcher() i=4 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.738+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94513125155664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43bf00 con 0x55f58d3fcde0 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.739+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94513125155664] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.739+0000 7faa55d28800 20 remove_watcher() i=5 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.739+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94513125157760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43bf00 con 0x55f58d3fcde0 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.740+0000 7faa51a6f640 1 -- 172.21.15.120:0/3670683929 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94513125157760] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa440a2070 con 0x55f58d3fcde0 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.740+0000 7faa55d28800 20 remove_watcher() i=6 2024-09-07T03:32:34.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.740+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94513125161728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f58d43bf00 con 0x7faa4c014440 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94513125161728] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c03c040 con 0x7faa4c014440 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 20 remove_watcher() i=7 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3f7d60 msgr2=0x55f58d3fa150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3f7d60 0x55f58d3fa150 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d3f3880 msgr2=0x55f58d3f5d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d3f3880 0x55f58d3f5d40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faa4c014440 msgr2=0x7faa4c025060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7faa4c014440 0x7faa4c025060 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55f58d3fcde0 msgr2=0x55f58d3ff250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55f58d3fcde0 0x55f58d3ff250 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa91c03c780 msgr2=0x7fa91c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa91c03c780 0x7fa91c03ec40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa44053790 tx=0x7faa44090000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 msgr2=0x55f58d3e7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 --2- 172.21.15.120:0/3670683929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3e0720 0x55f58d3e7d90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa4c017f20 tx=0x7faa4c053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 reap_dead start 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa5126e640 1 -- 172.21.15.120:0/3670683929 reap_dead start 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 shutdown_connections 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.741+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 >> 172.21.15.120:0/3670683929 conn(0x55f58d3dcb20 msgr2=0x55f58d3dad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 shutdown_connections 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3670683929 wait complete. 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3596012642 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa92c03c780 msgr2=0x7fa92c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3596012642 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa92c03c780 0x7fa92c03ec40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55f58d3ba6f0 tx=0x7faa4408a040 comp rx=0 tx=0).stop 2024-09-07T03:32:34.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3596012642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3d3ca0 msgr2=0x55f58d3d40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3596012642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3d3ca0 0x55f58d3d40c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faa4c016d20 tx=0x7faa4c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3596012642 shutdown_connections 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3596012642 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa92c03c780 0x7fa92c03ec40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3596012642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d3d3ca0 0x55f58d3d40c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3596012642 >> 172.21.15.120:0/3596012642 conn(0x55f58d3c8050 msgr2=0x55f58d3c8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3596012642 shutdown_connections 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3596012642 wait complete. 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3c1330 msgr2=0x55f58d3c37a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3c1330 0x55f58d3c37a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d2bee00 msgr2=0x55f58d3c0540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d2bee00 0x55f58d3c0540 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa93803c780 msgr2=0x7fa93803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa93803c780 0x7fa93803ec40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa3c000c00 tx=0x7faa3c0013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 msgr2=0x55f58d3b8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b8ef0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faa4400a470 tx=0x7faa44002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 shutdown_connections 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55f58d3c1330 0x55f58d3c37a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55f58d2bee00 0x55f58d3c0540 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa93803c780 0x7fa93803ec40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.742+0000 7faa55d28800 1 --2- 172.21.15.120:0/3626928327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55f58d2be4c0 0x55f58d3b8ef0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.743+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 >> 172.21.15.120:0/3626928327 conn(0x55f58d2ba210 msgr2=0x55f58d3ab850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.743+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 shutdown_connections 2024-09-07T03:32:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.743+0000 7faa55d28800 1 -- 172.21.15.120:0/3626928327 wait complete. 2024-09-07T03:32:34.765 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-07T03:32:34.729049Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:34.765 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-07T03:32:34.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-07T03:32:34.765 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-07T03:32:34.810 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:34.810 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:34.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.809+0000 7f4678d35800 1 Processor -- start 2024-09-07T03:32:34.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.809+0000 7f4678d35800 1 -- start start 2024-09-07T03:32:34.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.809+0000 7f4678d35800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e55818c500 0x55e55818c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.809+0000 7f4678d35800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e558035e40 con 0x55e558191320 2024-09-07T03:32:34.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.809+0000 7f4678d35800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e558000680 con 0x55e55818c500 2024-09-07T03:32:34.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.810+0000 7f4674a7d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e55818c500 0x55e55818c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.810+0000 7f466ffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55e558191320 0x55e558193710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48366/0 (socket says 172.21.15.120:48366) 2024-09-07T03:32:34.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.810+0000 7f466ffff640 1 -- 172.21.15.120:0/4268250702 learned_addr learned my addr 172.21.15.120:0/4268250702 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:34.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.810+0000 7f4674a7d640 1 -- 172.21.15.120:0/4268250702 >> v1:172.21.15.104:6789/0 conn(0x55e558191320 legacy=0x55e558193710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.810+0000 7f4674a7d640 1 -- 172.21.15.120:0/4268250702 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e55801c6b0 con 0x55e55818c500 2024-09-07T03:32:34.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.810+0000 7f466f7fe640 1 -- 172.21.15.120:0/4268250702 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2533840935 0 0) 0x55e558035e40 con 0x55e558191320 2024-09-07T03:32:34.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.812+0000 7f4674a7d640 1 --2- 172.21.15.120:0/4268250702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e55818c900 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f466800a470 tx=0x7f4668045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f13b8b7733aa341 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.812+0000 7f466f7fe640 1 -- 172.21.15.120:0/4268250702 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668053570 con 0x55e55818c500 2024-09-07T03:32:34.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.812+0000 7f466f7fe640 1 -- 172.21.15.120:0/4268250702 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4668058070 con 0x55e55818c500 2024-09-07T03:32:34.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.812+0000 7f466f7fe640 1 -- 172.21.15.120:0/4268250702 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668053880 con 0x55e55818c500 2024-09-07T03:32:34.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.812+0000 7f4678d35800 1 -- 172.21.15.120:0/4268250702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 msgr2=0x55e55818c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.812+0000 7f4678d35800 1 --2- 172.21.15.120:0/4268250702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e55818c900 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f466800a470 tx=0x7f4668045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:34.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.812+0000 7f4678d35800 1 -- 172.21.15.120:0/4268250702 shutdown_connections 2024-09-07T03:32:34.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.812+0000 7f4678d35800 1 --2- 172.21.15.120:0/4268250702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e55818c900 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.813+0000 7f4678d35800 1 -- 172.21.15.120:0/4268250702 >> 172.21.15.120:0/4268250702 conn(0x55e558185920 msgr2=0x55e558187da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.813+0000 7f4678d35800 1 -- 172.21.15.120:0/4268250702 shutdown_connections 2024-09-07T03:32:34.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.813+0000 7f4678d35800 1 -- 172.21.15.120:0/4268250702 wait complete. 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.826+0000 7f4678d35800 1 Processor -- start 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.826+0000 7f4678d35800 1 -- start start 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4678d35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e55827d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4678d35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e558024dd0 con 0x55e55818c500 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4674a7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e55827d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4674a7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e55827d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41822/0 (socket says 172.21.15.120:41822) 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4674a7d640 1 -- 172.21.15.120:0/1202176209 learned_addr learned my addr 172.21.15.120:0/1202176209 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4674a7d640 1 -- 172.21.15.120:0/1202176209 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e55803de10 con 0x55e55818c500 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4674a7d640 1 --2- 172.21.15.120:0/1202176209 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e55827d660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f466800a470 tx=0x7f4668051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abae0d19b1069329 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4562e05640 1 -- 172.21.15.120:0/1202176209 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668053570 con 0x55e55818c500 2024-09-07T03:32:34.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4562e05640 1 -- 172.21.15.120:0/1202176209 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4668063030 con 0x55e55818c500 2024-09-07T03:32:34.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.827+0000 7f4562e05640 1 -- 172.21.15.120:0/1202176209 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668053840 con 0x55e55818c500 2024-09-07T03:32:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.828+0000 7f4678d35800 1 -- 172.21.15.120:0/1202176209 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 msgr2=0x55e55827d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.828+0000 7f4678d35800 1 --2- 172.21.15.120:0/1202176209 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e55827d660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f466800a470 tx=0x7f4668051000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.828+0000 7f4678d35800 1 -- 172.21.15.120:0/1202176209 shutdown_connections 2024-09-07T03:32:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.828+0000 7f4678d35800 1 --2- 172.21.15.120:0/1202176209 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e55827d660 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.828+0000 7f4678d35800 1 -- 172.21.15.120:0/1202176209 >> 172.21.15.120:0/1202176209 conn(0x55e558185920 msgr2=0x55e558278fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.828+0000 7f4678d35800 1 -- 172.21.15.120:0/1202176209 shutdown_connections 2024-09-07T03:32:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.828+0000 7f4678d35800 1 -- 172.21.15.120:0/1202176209 wait complete. 2024-09-07T03:32:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.828+0000 7f4678d35800 1 Processor -- start 2024-09-07T03:32:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.828+0000 7f4678d35800 1 -- start start 2024-09-07T03:32:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.829+0000 7f4678d35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e558284e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.829+0000 7f4678d35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e558195250 con 0x55e55818c500 2024-09-07T03:32:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.829+0000 7f4674a7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e558284e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.829+0000 7f4674a7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e558284e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41834/0 (socket says 172.21.15.120:41834) 2024-09-07T03:32:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.829+0000 7f4674a7d640 1 -- 172.21.15.120:0/329129478 learned_addr learned my addr 172.21.15.120:0/329129478 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.829+0000 7f4674a7d640 1 -- 172.21.15.120:0/329129478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5582853f0 con 0x55e55818c500 2024-09-07T03:32:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.829+0000 7f4674a7d640 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e558284e90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f466800a470 tx=0x7f4668002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.829+0000 7f4561602640 1 -- 172.21.15.120:0/329129478 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668078070 con 0x55e55818c500 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.829+0000 7f4561602640 1 -- 172.21.15.120:0/329129478 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4668068420 con 0x55e55818c500 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.830+0000 7f4561602640 1 -- 172.21.15.120:0/329129478 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668068700 con 0x55e55818c500 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.830+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e558285680 con 0x55e55818c500 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.830+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e558286290 con 0x55e55818c500 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.830+0000 7f4561602640 1 -- 172.21.15.120:0/329129478 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f466807b070 con 0x55e55818c500 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f4561602640 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f455c03c730 0x7f455c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f4561602640 1 -- 172.21.15.120:0/329129478 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f46680979e0 con 0x55e55818c500 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f466ffff640 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f455c03c730 0x7f455c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e558191320 0x55e55828c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e55828ca20 con 0x55e558191320 2024-09-07T03:32:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f467527e640 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e558191320 0x55e55828c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f466ffff640 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f455c03c730 0x7f455c03ebf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4660000c00 tx=0x7f46600013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f467527e640 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e558191320 0x55e55828c4e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f467527e640 1 -- 172.21.15.120:0/329129478 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f467000a4d0 con 0x55e558191320 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e55828d2d0 0x55e55828f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.831+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e55828feb0 con 0x55e55828d2d0 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.832+0000 7f4674a7d640 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e55828d2d0 0x55e55828f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.832+0000 7f4674a7d640 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e55828d2d0 0x55e55828f740 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.832+0000 7f4674a7d640 1 -- 172.21.15.120:0/329129478 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f466807a030 con 0x55e55828d2d0 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.832+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e558291760 con 0x55e55828d2d0 2024-09-07T03:32:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.832+0000 7f4674a7d640 1 -- 172.21.15.120:0/329129478 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f466807a030 con 0x55e55828d2d0 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.833+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582907e0 con 0x55e55828d2d0 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.833+0000 7f4674a7d640 1 -- 172.21.15.120:0/329129478 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f466807a030 con 0x55e55828d2d0 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.833+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e558290c40 con 0x55e558191320 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.833+0000 7f467527e640 1 -- 172.21.15.120:0/329129478 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f467000a4d0 con 0x55e558191320 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.833+0000 7f4678d35800 1 Processor -- start 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.833+0000 7f4678d35800 1 -- start start 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f4678d35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55829fc40 0x55e5582a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f4678d35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e558082a00 con 0x55e55829fc40 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f467527e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55829fc40 0x55e5582a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f467527e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55829fc40 0x55e5582a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41838/0 (socket says 172.21.15.120:41838) 2024-09-07T03:32:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f467527e640 1 -- 172.21.15.120:0/1529051047 learned_addr learned my addr 172.21.15.120:0/1529051047 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f467527e640 1 -- 172.21.15.120:0/1529051047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5582a06a0 con 0x55e55829fc40 2024-09-07T03:32:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f467527e640 1 --2- 172.21.15.120:0/1529051047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55829fc40 0x55e5582a0060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4670016d20 tx=0x7f467000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f455affd640 1 -- 172.21.15.120:0/1529051047 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670017660 con 0x55e55829fc40 2024-09-07T03:32:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f455affd640 1 -- 172.21.15.120:0/1529051047 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467001b030 con 0x55e55829fc40 2024-09-07T03:32:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f4678d35800 1 -- 172.21.15.120:0/1529051047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5582a0ed0 con 0x55e55829fc40 2024-09-07T03:32:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f455affd640 1 -- 172.21.15.120:0/1529051047 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670017950 con 0x55e55829fc40 2024-09-07T03:32:34.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.834+0000 7f4678d35800 1 -- 172.21.15.120:0/1529051047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5582a1470 con 0x55e55829fc40 2024-09-07T03:32:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.835+0000 7f455affd640 1 -- 172.21.15.120:0/1529051047 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4670017b40 con 0x55e55829fc40 2024-09-07T03:32:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.835+0000 7f455affd640 1 --2- 172.21.15.120:0/1529051047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f454c03c730 0x7f454c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.835+0000 7f455affd640 1 -- 172.21.15.120:0/1529051047 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f467000e040 con 0x55e55829fc40 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.835+0000 7f4674a7d640 1 --2- 172.21.15.120:0/1529051047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f454c03c730 0x7f454c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f4678d35800 1 Processor -- start 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f4678d35800 1 -- start start 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f4674a7d640 1 --2- 172.21.15.120:0/1529051047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f454c03c730 0x7f454c03ebf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55e558286690 tx=0x7f4668052670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f4678d35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582acac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f4678d35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e55827de50 con 0x55e5582ac6c0 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f467527e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f467527e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582acac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41854/0 (socket says 172.21.15.120:41854) 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f467527e640 1 -- 172.21.15.120:0/3242436719 learned_addr learned my addr 172.21.15.120:0/3242436719 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f467527e640 1 -- 172.21.15.120:0/3242436719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5582ad0b0 con 0x55e5582ac6c0 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f467527e640 1 --2- 172.21.15.120:0/3242436719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582acac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4670013450 tx=0x7f4670053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d904d1ca32ce3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f4558ff9640 1 -- 172.21.15.120:0/3242436719 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670014a00 con 0x55e5582ac6c0 2024-09-07T03:32:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f4558ff9640 1 -- 172.21.15.120:0/3242436719 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4670051070 con 0x55e5582ac6c0 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.836+0000 7f4558ff9640 1 -- 172.21.15.120:0/3242436719 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670028350 con 0x55e5582ac6c0 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 -- 172.21.15.120:0/3242436719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 msgr2=0x55e5582acac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 --2- 172.21.15.120:0/3242436719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582acac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4670013450 tx=0x7f4670053f40 comp rx=0 tx=0).stop 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 -- 172.21.15.120:0/3242436719 shutdown_connections 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 --2- 172.21.15.120:0/3242436719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582acac0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 -- 172.21.15.120:0/3242436719 >> 172.21.15.120:0/3242436719 conn(0x55e5582a8ac0 msgr2=0x55e5582a6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 -- 172.21.15.120:0/3242436719 shutdown_connections 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 -- 172.21.15.120:0/3242436719 wait complete. 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 Processor -- start 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 -- start start 2024-09-07T03:32:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.837+0000 7f4678d35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e5582ad6d0 con 0x55e5582ac6c0 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f467527e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f467527e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41858/0 (socket says 172.21.15.120:41858) 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 learned_addr learned my addr 172.21.15.120:0/1433050770 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5582b42c0 con 0x55e5582ac6c0 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f467527e640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582b3d60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4670053f80 tx=0x7f4670053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f45527fc640 1 -- 172.21.15.120:0/1433050770 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670005030 con 0x55e5582ac6c0 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f45527fc640 1 -- 172.21.15.120:0/1433050770 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46700051d0 con 0x55e5582ac6c0 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f45527fc640 1 -- 172.21.15.120:0/1433050770 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46700054f0 con 0x55e5582ac6c0 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5582b4550 con 0x55e5582ac6c0 2024-09-07T03:32:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.838+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5582b4ed0 con 0x55e5582ac6c0 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.839+0000 7f45527fc640 1 -- 172.21.15.120:0/1433050770 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4670055280 con 0x55e5582ac6c0 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.839+0000 7f45527fc640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f453c03c730 0x7f453c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.839+0000 7f45527fc640 1 -- 172.21.15.120:0/1433050770 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f4670035c50 con 0x55e5582ac6c0 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.839+0000 7f4674a7d640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f453c03c730 0x7f453c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.839+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.839+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e5582bf7a0 0x55e5582c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.839+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582c23b0 con 0x55e5582bf7a0 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.839+0000 7f466ffff640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e5582bf7a0 0x55e5582c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4674a7d640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f453c03c730 0x7f453c03ebf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4668068ba0 tx=0x7f4668092000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f466ffff640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e5582bf7a0 0x55e5582c1c60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 20 realm 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582beaf0 con 0x55e5582bf7a0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582c2e90 con 0x55e5582bf7a0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e5582c3c70 0x55e5582c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.840+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582c66f0 con 0x55e5582c3c70 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f467527e640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e5582c3c70 0x55e5582c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f467527e640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e5582c3c70 0x55e5582c6060 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f4678d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582c6f90 con 0x55e5582c3c70 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f4678d35800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f4678d35800 20 searching for the correct realm 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.841+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e5582c8d00 0x55e5582cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.842+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c8d00 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.842+0000 7f4674a7d640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e5582c8d00 0x55e5582cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.842+0000 7f4674a7d640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e5582c8d00 0x55e5582cb110 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.842+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.842+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c3c70 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.843+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.843+0000 7f467527e640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f467004e7c0 0x7f4670002c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.843+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x7f467004e7c0 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.843+0000 7f466ffff640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f467004e7c0 0x7f4670002c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.843+0000 7f466ffff640 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f467004e7c0 0x7f4670002c80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.843+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x7f467004e7c0 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.843+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.843+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.843+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.844+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.844+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c8d00 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.844+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.844+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.844+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.844+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c3c70 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c3c70 2024-09-07T03:32:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x7f467004e7c0 2024-09-07T03:32:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x7f467004e7c0 2024-09-07T03:32:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.845+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x7f467004e7c0 2024-09-07T03:32:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.846+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f466000f5f0 con 0x7f467004e7c0 2024-09-07T03:32:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.846+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c3c70 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.846+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.846+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c8d00 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.846+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.846+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.846+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.846+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c3c70 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.847+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.847+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c8d00 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.847+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.847+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.847+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.847+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.847+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.847+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c8d00 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x7f467004e7c0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x7f467004e7c0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582bf7a0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x55e5582bf7a0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x7f467004e7c0 2024-09-07T03:32:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x7f467004e7c0 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.848+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c8d00 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.849+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.849+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x7f467004e7c0 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.849+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466000f5f0 con 0x7f467004e7c0 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.849+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c3c70 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.849+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.849+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c3c70 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.849+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.849+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c8d00 2024-09-07T03:32:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c3c70 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cb7e0 con 0x55e5582c3c70 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582c7910 con 0x55e5582bf7a0 2024-09-07T03:32:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f466003c040 con 0x55e5582bf7a0 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.850+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582c7d60 con 0x55e5582c3c70 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582c81c0 con 0x55e5582bf7a0 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f466003c040 con 0x55e5582bf7a0 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 20 zone default found 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 4 Realm: () 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:34.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 20 zonegroup default 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582c74b0 con 0x7f467004e7c0 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f466003c040 con 0x7f467004e7c0 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.851+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cdf40 con 0x55e5582c8d00 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.852+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.852+0000 7f4678d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.852+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.852+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582ce3b0 con 0x55e5582c8d00 2024-09-07T03:32:34.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.852+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.852+0000 7f4678d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.852+0000 7f4678d35800 20 started sync module instance, tier type = 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.852+0000 7f4678d35800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.852+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582ccd40 con 0x55e5582c3c70 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.853+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.853+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94443515203888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cecc0 con 0x55e5582c3c70 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.853+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cf510 con 0x55e5582bf7a0 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.854+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94443515203888] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.855+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466003c040 con 0x55e5582bf7a0 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.855+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94443515209744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cf8b0 con 0x55e5582bf7a0 2024-09-07T03:32:34.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.855+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d0100 con 0x55e5582c3c70 2024-09-07T03:32:34.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.856+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94443515209744] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466003c040 con 0x55e5582bf7a0 2024-09-07T03:32:34.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.856+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.856+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94443515214000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d04f0 con 0x55e5582c3c70 2024-09-07T03:32:34.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.856+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d0d40 con 0x7f467004e7c0 2024-09-07T03:32:34.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.857+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94443515214000] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.857+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466003c040 con 0x7f467004e7c0 2024-09-07T03:32:34.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.857+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94443515217136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d0dc0 con 0x7f467004e7c0 2024-09-07T03:32:34.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.857+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d1610 con 0x55e5582c3c70 2024-09-07T03:32:34.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.858+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94443515217136] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466003c040 con 0x7f467004e7c0 2024-09-07T03:32:34.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.861+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.861+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94443515218704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d1420 con 0x55e5582c3c70 2024-09-07T03:32:34.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.861+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d2020 con 0x55e5582c8d00 2024-09-07T03:32:34.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.862+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94443515218704] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.862+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.862+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94443515219760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d2020 con 0x55e5582c8d00 2024-09-07T03:32:34.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.862+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d2a20 con 0x55e5582c8d00 2024-09-07T03:32:34.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.865+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94443515219760] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.865+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.865+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94443515225392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d2020 con 0x55e5582c8d00 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.865+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d3470 con 0x7f467004e7c0 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466003c040 con 0x7f467004e7c0 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94443515228032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d3420 con 0x7f467004e7c0 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f4678d35800 20 add_watcher() i=0 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f4678d35800 20 add_watcher() i=1 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f4678d35800 20 add_watcher() i=2 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f4678d35800 20 add_watcher() i=3 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f4678d35800 20 add_watcher() i=4 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f4678d35800 20 add_watcher() i=5 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94443515225392] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.866+0000 7f4678d35800 20 add_watcher() i=6 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.867+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94443515228032] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466003c040 con 0x7f467004e7c0 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.867+0000 7f4678d35800 20 add_watcher() i=7 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.867+0000 7f4678d35800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.867+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d1b70 con 0x55e5582bf7a0 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.867+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f466003c040 con 0x55e5582bf7a0 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.867+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94443515230224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d1b70 con 0x55e5582bf7a0 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94443515230224] v34'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f466003c040 con 0x55e5582bf7a0 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f452b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f4678d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f4678d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f4678d35800 5 note: GC not initialized 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f452a7dc640 20 reqs_thread_entry: start 2024-09-07T03:32:34.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f4678d35800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f4678d35800 20 Filter name: none 2024-09-07T03:32:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f449bfff640 20 reqs_thread_entry: start 2024-09-07T03:32:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f4678d35800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.869+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e558309560 con 0x55e5582bf7a0 2024-09-07T03:32:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.870+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f466003c040 con 0x55e5582bf7a0 2024-09-07T03:32:34.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.870+0000 7f4678d35800 20 rados_obj.operate() r=0 bl.length=673 2024-09-07T03:32:34.887 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-07T03:32:34.729049Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.871+0000 7f452b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.871+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94443515230224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e558309970 con 0x55e5582bf7a0 2024-09-07T03:32:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.872+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94443515230224] v34'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f466003c040 con 0x55e5582bf7a0 2024-09-07T03:32:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.872+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94443515203888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d37f0 con 0x55e5582c3c70 2024-09-07T03:32:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.873+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94443515203888] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.873+0000 7f4678d35800 20 remove_watcher() i=0 2024-09-07T03:32:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.873+0000 7f4678d35800 2 removed watcher, disabling cache 2024-09-07T03:32:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.873+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94443515209744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cd130 con 0x55e5582bf7a0 2024-09-07T03:32:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.875+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94443515209744] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466003c040 con 0x55e5582bf7a0 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.875+0000 7f4678d35800 20 remove_watcher() i=1 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.875+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94443515214000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cd130 con 0x55e5582c3c70 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.876+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94443515214000] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.876+0000 7f4678d35800 20 remove_watcher() i=2 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.876+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94443515217136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cf8b0 con 0x7f467004e7c0 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.879+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94443515217136] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466003c040 con 0x7f467004e7c0 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.879+0000 7f4678d35800 20 remove_watcher() i=3 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.879+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94443515218704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cf8b0 con 0x55e5582c3c70 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.882+0000 7f467527e640 1 -- 172.21.15.120:0/1433050770 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94443515218704] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4670027070 con 0x55e5582c3c70 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.882+0000 7f4678d35800 20 remove_watcher() i=4 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.882+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94443515219760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d0b10 con 0x55e5582c8d00 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.883+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94443515219760] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.883+0000 7f4678d35800 20 remove_watcher() i=5 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.883+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94443515225392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582cf8b0 con 0x55e5582c8d00 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.885+0000 7f4674a7d640 1 -- 172.21.15.120:0/1433050770 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94443515225392] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4668090070 con 0x55e5582c8d00 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.885+0000 7f4678d35800 20 remove_watcher() i=6 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.885+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94443515228032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e5582d2530 con 0x7f467004e7c0 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94443515228032] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466003c040 con 0x7f467004e7c0 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 20 remove_watcher() i=7 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e5582c3c70 msgr2=0x55e5582c6060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e5582c3c70 0x55e5582c6060 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e5582bf7a0 msgr2=0x55e5582c1c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e5582bf7a0 0x55e5582c1c60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f467004e7c0 msgr2=0x7f4670002c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f467004e7c0 0x7f4670002c80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e5582c8d00 msgr2=0x55e5582cb110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e5582c8d00 0x55e5582cb110 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f453c03c730 msgr2=0x7f453c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f453c03c730 0x7f453c03ebf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4668068ba0 tx=0x7f4668092000 comp rx=0 tx=0).stop 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f466ffff640 1 -- 172.21.15.120:0/1433050770 reap_dead start 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 msgr2=0x55e5582b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582b3d60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4670053f80 tx=0x7f4670053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 shutdown_connections 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 --2- 172.21.15.120:0/1433050770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e5582ac6c0 0x55e5582b3d60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 >> 172.21.15.120:0/1433050770 conn(0x55e5582a8ac0 msgr2=0x55e5582a6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 shutdown_connections 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1433050770 wait complete. 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1529051047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f454c03c730 msgr2=0x7f454c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 --2- 172.21.15.120:0/1529051047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f454c03c730 0x7f454c03ebf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55e558286690 tx=0x7f4668052670 comp rx=0 tx=0).stop 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 -- 172.21.15.120:0/1529051047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55829fc40 msgr2=0x55e5582a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.886+0000 7f4678d35800 1 --2- 172.21.15.120:0/1529051047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55829fc40 0x55e5582a0060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4670016d20 tx=0x7f467000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/1529051047 shutdown_connections 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/1529051047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f454c03c730 0x7f454c03ebf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/1529051047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55829fc40 0x55e5582a0060 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/1529051047 >> 172.21.15.120:0/1529051047 conn(0x55e558293ff0 msgr2=0x55e5582943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/1529051047 shutdown_connections 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/1529051047 wait complete. 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e55828d2d0 msgr2=0x55e55828f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e55828d2d0 0x55e55828f740 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e558191320 msgr2=0x55e55828c4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e558191320 0x55e55828c4e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f455c03c730 msgr2=0x7f455c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f455c03c730 0x7f455c03ebf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4660000c00 tx=0x7f46600013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 msgr2=0x55e558284e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e558284e90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f466800a470 tx=0x7f4668002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 shutdown_connections 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e55828d2d0 0x55e55828f740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e558191320 0x55e55828c4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f455c03c730 0x7f455c03ebf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 --2- 172.21.15.120:0/329129478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e55818c500 0x55e558284e90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 >> 172.21.15.120:0/329129478 conn(0x55e558185920 msgr2=0x55e5582777d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 shutdown_connections 2024-09-07T03:32:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.887+0000 7f4678d35800 1 -- 172.21.15.120:0/329129478 wait complete. 2024-09-07T03:32:34.899 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-07T03:32:34.729049Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:34.900 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-07T03:32:34.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-07T03:32:34.900 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-07T03:32:34.946 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:34.946 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f846c80e800 1 Processor -- start 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f846c80e800 1 -- start start 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f846c80e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bb059f2240 0x55bb059f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f846c80e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb05897e40 con 0x55bb059ee730 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f846c80e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55bb05862680 con 0x55bb059f2240 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f84677df640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bb059f2240 0x55bb059f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f84677df640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bb059f2240 0x55bb059f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41872/0 (socket says 172.21.15.120:41872) 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f84677df640 1 -- 172.21.15.120:0/1636165190 learned_addr learned my addr 172.21.15.120:0/1636165190 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f8467fe0640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55bb059ee730 0x55bb059f0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48380/0 (socket says 172.21.15.120:48380) 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f84677df640 1 -- 172.21.15.120:0/1636165190 >> v1:172.21.15.104:6789/0 conn(0x55bb059ee730 legacy=0x55bb059f0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f8466fde640 1 -- 172.21.15.120:0/1636165190 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075989385 0 0) 0x55bb05897e40 con 0x55bb059ee730 2024-09-07T03:32:34.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.946+0000 7f84677df640 1 -- 172.21.15.120:0/1636165190 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb0587e6b0 con 0x55bb059f2240 2024-09-07T03:32:34.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.948+0000 7f84677df640 1 --2- 172.21.15.120:0/1636165190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059f2240 0x55bb059f46d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f845c00a520 tx=0x7f845c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fc03b0aec0133a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.948+0000 7f8466fde640 1 -- 172.21.15.120:0/1636165190 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845c055070 con 0x55bb059f2240 2024-09-07T03:32:34.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.948+0000 7f8466fde640 1 -- 172.21.15.120:0/1636165190 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845c0515b0 con 0x55bb059f2240 2024-09-07T03:32:34.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.948+0000 7f8466fde640 1 -- 172.21.15.120:0/1636165190 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845c0518d0 con 0x55bb059f2240 2024-09-07T03:32:34.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.949+0000 7f846c80e800 1 -- 172.21.15.120:0/1636165190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059f2240 msgr2=0x55bb059f46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.949+0000 7f846c80e800 1 --2- 172.21.15.120:0/1636165190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059f2240 0x55bb059f46d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f845c00a520 tx=0x7f845c045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.949+0000 7f846c80e800 1 -- 172.21.15.120:0/1636165190 shutdown_connections 2024-09-07T03:32:34.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.949+0000 7f846c80e800 1 --2- 172.21.15.120:0/1636165190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059f2240 0x55bb059f46d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.949+0000 7f846c80e800 1 -- 172.21.15.120:0/1636165190 >> 172.21.15.120:0/1636165190 conn(0x55bb059e81d0 msgr2=0x55bb059ea630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.949+0000 7f846c80e800 1 -- 172.21.15.120:0/1636165190 shutdown_connections 2024-09-07T03:32:34.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.949+0000 7f846c80e800 1 -- 172.21.15.120:0/1636165190 wait complete. 2024-09-07T03:32:34.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.963+0000 7f846c80e800 1 Processor -- start 2024-09-07T03:32:34.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.963+0000 7f846c80e800 1 -- start start 2024-09-07T03:32:34.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.963+0000 7f846c80e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb059edee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.963+0000 7f846c80e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb05886dd0 con 0x55bb059ee730 2024-09-07T03:32:34.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.963+0000 7f8467fe0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb059edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.963+0000 7f8467fe0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb059edee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41874/0 (socket says 172.21.15.120:41874) 2024-09-07T03:32:34.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.963+0000 7f8467fe0640 1 -- 172.21.15.120:0/2191755795 learned_addr learned my addr 172.21.15.120:0/2191755795 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.963+0000 7f8467fe0640 1 -- 172.21.15.120:0/2191755795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb0589fe10 con 0x55bb059ee730 2024-09-07T03:32:34.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.963+0000 7f8467fe0640 1 --2- 172.21.15.120:0/2191755795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb059edee0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8458001ea0 tx=0x7f845800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4660d85fe6bc0e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f8355e0b640 1 -- 172.21.15.120:0/2191755795 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458008070 con 0x55bb059ee730 2024-09-07T03:32:34.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f8355e0b640 1 -- 172.21.15.120:0/2191755795 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845800d500 con 0x55bb059ee730 2024-09-07T03:32:34.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f8355e0b640 1 -- 172.21.15.120:0/2191755795 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845800d880 con 0x55bb059ee730 2024-09-07T03:32:34.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f846c80e800 1 -- 172.21.15.120:0/2191755795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 msgr2=0x55bb059edee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f846c80e800 1 --2- 172.21.15.120:0/2191755795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb059edee0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8458001ea0 tx=0x7f845800b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f846c80e800 1 -- 172.21.15.120:0/2191755795 shutdown_connections 2024-09-07T03:32:34.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f846c80e800 1 --2- 172.21.15.120:0/2191755795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb059edee0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f846c80e800 1 -- 172.21.15.120:0/2191755795 >> 172.21.15.120:0/2191755795 conn(0x55bb059e81d0 msgr2=0x55bb05ad8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f846c80e800 1 -- 172.21.15.120:0/2191755795 shutdown_connections 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.964+0000 7f846c80e800 1 -- 172.21.15.120:0/2191755795 wait complete. 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.965+0000 7f846c80e800 1 Processor -- start 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.965+0000 7f846c80e800 1 -- start start 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.965+0000 7f846c80e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb05ae7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.965+0000 7f846c80e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb059f5050 con 0x55bb059ee730 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.965+0000 7f8467fe0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb05ae7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.965+0000 7f8467fe0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb05ae7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41888/0 (socket says 172.21.15.120:41888) 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.965+0000 7f8467fe0640 1 -- 172.21.15.120:0/2978538846 learned_addr learned my addr 172.21.15.120:0/2978538846 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.965+0000 7f8467fe0640 1 -- 172.21.15.120:0/2978538846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb05ae7560 con 0x55bb059ee730 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.965+0000 7f8467fe0640 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb05ae7000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8458000f60 tx=0x7f8458000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.966+0000 7f834ffff640 1 -- 172.21.15.120:0/2978538846 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845800f8d0 con 0x55bb059ee730 2024-09-07T03:32:34.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.966+0000 7f834ffff640 1 -- 172.21.15.120:0/2978538846 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845800fa70 con 0x55bb059ee730 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.966+0000 7f834ffff640 1 -- 172.21.15.120:0/2978538846 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845800fd50 con 0x55bb059ee730 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.966+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb05ae77f0 con 0x55bb059ee730 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.966+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb05ae81f0 con 0x55bb059ee730 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.966+0000 7f834ffff640 1 -- 172.21.15.120:0/2978538846 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8458017040 con 0x55bb059ee730 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.967+0000 7f834ffff640 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f835003c730 0x7f835003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.967+0000 7f834ffff640 1 -- 172.21.15.120:0/2978538846 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8458015020 con 0x55bb059ee730 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.967+0000 7f84677df640 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f835003c730 0x7f835003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.967+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb059f2240 0x55bb05aee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.967+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05aeeb90 con 0x55bb059f2240 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.967+0000 7f84687e1640 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb059f2240 0x55bb05aee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.967+0000 7f84677df640 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f835003c730 0x7f835003ebf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f845c057000 tx=0x7f845c052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.967+0000 7f84687e1640 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb059f2240 0x55bb05aee650 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.967+0000 7f84687e1640 1 -- 172.21.15.120:0/2978538846 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f846000a4d0 con 0x55bb059f2240 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.968+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05aef440 0x55bb05af1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.968+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05af1fe0 con 0x55bb05aef440 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.968+0000 7f8467fe0640 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05aef440 0x55bb05af1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.968+0000 7f8467fe0640 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05aef440 0x55bb05af1870 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.968+0000 7f8467fe0640 1 -- 172.21.15.120:0/2978538846 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f845802d070 con 0x55bb05aef440 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.968+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05af3890 con 0x55bb05aef440 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.969+0000 7f8467fe0640 1 -- 172.21.15.120:0/2978538846 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f845802d070 con 0x55bb05aef440 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.969+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05af2a00 con 0x55bb05aef440 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.969+0000 7f8467fe0640 1 -- 172.21.15.120:0/2978538846 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f845802d070 con 0x55bb05aef440 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.969+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05af2e20 con 0x55bb059f2240 2024-09-07T03:32:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.969+0000 7f84687e1640 1 -- 172.21.15.120:0/2978538846 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f846000a4d0 con 0x55bb059f2240 2024-09-07T03:32:34.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.969+0000 7f846c80e800 1 Processor -- start 2024-09-07T03:32:34.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f846c80e800 1 -- start start 2024-09-07T03:32:34.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f846c80e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b01d70 0x55bb05b02190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f846c80e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb058e4a00 con 0x55bb05b01d70 2024-09-07T03:32:34.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f84687e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b01d70 0x55bb05b02190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f84687e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b01d70 0x55bb05b02190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41892/0 (socket says 172.21.15.120:41892) 2024-09-07T03:32:34.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f84687e1640 1 -- 172.21.15.120:0/3964682667 learned_addr learned my addr 172.21.15.120:0/3964682667 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f84687e1640 1 -- 172.21.15.120:0/3964682667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb05b027d0 con 0x55bb05b01d70 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f84687e1640 1 --2- 172.21.15.120:0/3964682667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b01d70 0x55bb05b02190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8460016d20 tx=0x7f846000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f834d7fa640 1 -- 172.21.15.120:0/3964682667 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8460017660 con 0x55bb05b01d70 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.970+0000 7f834d7fa640 1 -- 172.21.15.120:0/3964682667 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846001b030 con 0x55bb05b01d70 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.971+0000 7f846c80e800 1 -- 172.21.15.120:0/3964682667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb05b03000 con 0x55bb05b01d70 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.971+0000 7f834d7fa640 1 -- 172.21.15.120:0/3964682667 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8460017950 con 0x55bb05b01d70 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.971+0000 7f846c80e800 1 -- 172.21.15.120:0/3964682667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb05b035a0 con 0x55bb05b01d70 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.971+0000 7f834d7fa640 1 -- 172.21.15.120:0/3964682667 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8460017af0 con 0x55bb05b01d70 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.971+0000 7f834d7fa640 1 --2- 172.21.15.120:0/3964682667 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f834003c780 0x7f834003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f834d7fa640 1 -- 172.21.15.120:0/3964682667 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f846000e040 con 0x55bb05b01d70 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f8467fe0640 1 --2- 172.21.15.120:0/3964682667 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f834003c780 0x7f834003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f846c80e800 1 Processor -- start 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f846c80e800 1 -- start start 2024-09-07T03:32:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f8467fe0640 1 --2- 172.21.15.120:0/3964682667 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f834003c780 0x7f834003ec40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55bb05af2520 tx=0x7f845801b440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f846c80e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b0ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f846c80e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb059ec780 con 0x55bb05b0e810 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f84687e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b0ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f84687e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b0ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41896/0 (socket says 172.21.15.120:41896) 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f84687e1640 1 -- 172.21.15.120:0/2098472366 learned_addr learned my addr 172.21.15.120:0/2098472366 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.972+0000 7f84687e1640 1 -- 172.21.15.120:0/2098472366 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb05b0f200 con 0x55bb05b0e810 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f84687e1640 1 --2- 172.21.15.120:0/2098472366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b0ec10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8460017f20 tx=0x7f8460028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e605cd39f5b5bed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f8346ffd640 1 -- 172.21.15.120:0/2098472366 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84600149b0 con 0x55bb05b0e810 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f8346ffd640 1 -- 172.21.15.120:0/2098472366 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8460028350 con 0x55bb05b0e810 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f8346ffd640 1 -- 172.21.15.120:0/2098472366 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8460014b50 con 0x55bb05b0e810 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f846c80e800 1 -- 172.21.15.120:0/2098472366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 msgr2=0x55bb05b0ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f846c80e800 1 --2- 172.21.15.120:0/2098472366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b0ec10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8460017f20 tx=0x7f8460028e80 comp rx=0 tx=0).stop 2024-09-07T03:32:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f846c80e800 1 -- 172.21.15.120:0/2098472366 shutdown_connections 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f846c80e800 1 --2- 172.21.15.120:0/2098472366 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b0ec10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f846c80e800 1 -- 172.21.15.120:0/2098472366 >> 172.21.15.120:0/2098472366 conn(0x55bb05b0ac10 msgr2=0x55bb05b08e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f846c80e800 1 -- 172.21.15.120:0/2098472366 shutdown_connections 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.973+0000 7f846c80e800 1 -- 172.21.15.120:0/2098472366 wait complete. 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f846c80e800 1 Processor -- start 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f846c80e800 1 -- start start 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f846c80e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b15e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f846c80e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bb05b0f820 con 0x55bb05b0e810 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f84687e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b15e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f84687e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b15e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41910/0 (socket says 172.21.15.120:41910) 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 learned_addr learned my addr 172.21.15.120:0/464236413 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb05b163c0 con 0x55bb05b0e810 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f84687e1640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b15e60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8460017f20 tx=0x7f8460053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f83457fa640 1 -- 172.21.15.120:0/464236413 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f846004c070 con 0x55bb05b0e810 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.974+0000 7f83457fa640 1 -- 172.21.15.120:0/464236413 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84600129b0 con 0x55bb05b0e810 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.975+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb05b16650 con 0x55bb05b0e810 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.975+0000 7f83457fa640 1 -- 172.21.15.120:0/464236413 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8460012c90 con 0x55bb05b0e810 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.975+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb05b16fd0 con 0x55bb05b0e810 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.975+0000 7f83457fa640 1 -- 172.21.15.120:0/464236413 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f84600135c0 con 0x55bb05b0e810 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.976+0000 7f83457fa640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f833003c780 0x7f833003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.976+0000 7f83457fa640 1 -- 172.21.15.120:0/464236413 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f846003bb40 con 0x55bb05b0e810 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.976+0000 7f8467fe0640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f833003c780 0x7f833003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.976+0000 7f8467fe0640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f833003c780 0x7f833003ec40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8458052a40 tx=0x7f8458042000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.976+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.976+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb05b21950 0x55bb05b23e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.976+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b24560 con 0x55bb05b21950 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.976+0000 7f84677df640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb05b21950 0x55bb05b23e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f84677df640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb05b21950 0x55bb05b23e10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 20 realm 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b24990 con 0x55bb05b21950 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b25260 con 0x55bb05b21950 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05b25c80 0x55bb05b280b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b28820 con 0x55bb05b25c80 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.977+0000 7f84687e1640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05b25c80 0x55bb05b280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f84687e1640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05b25c80 0x55bb05b280b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f846c80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b29070 con 0x55bb05b25c80 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f846c80e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f846c80e800 20 searching for the correct realm 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bb05b2ade0 0x55bb05b2d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b2ade0 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.978+0000 7f8467fe0640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bb05b2ade0 0x55bb05b2d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.979+0000 7f8467fe0640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bb05b2ade0 0x55bb05b2d210 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.979+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.979+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b25c80 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.979+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.979+0000 7f84687e1640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8460014440 0x7f8460025060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.979+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x7f8460014440 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.979+0000 7f84677df640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8460014440 0x7f8460025060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.980+0000 7f84677df640 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8460014440 0x7f8460025060 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.980+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.980+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.980+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.980+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.980+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.980+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b2ade0 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b25c80 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b25c80 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.981+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x7f8460014440 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.982+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.982+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.982+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.982+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x7f8460014440 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.982+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.982+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b25c80 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.982+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.982+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b2ade0 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.983+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.983+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.983+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.983+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b25c80 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.983+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.983+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b2ade0 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.983+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.983+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.984+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.984+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.984+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.984+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.984+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.984+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b2ade0 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.984+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.984+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x7f8460014440 2024-09-07T03:32:35.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b21950 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x7f8460014440 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b2ade0 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x7f8460014440 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.985+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b25c80 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.986+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.986+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b25c80 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.986+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.986+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b2ade0 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.986+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.986+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b25c80 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.986+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.986+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2d8e0 con 0x55bb05b25c80 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b299c0 con 0x55bb05b21950 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b29600 con 0x55bb05b25c80 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b29e00 con 0x55bb05b21950 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 zone default found 2024-09-07T03:32:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 4 Realm: () 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 zonegroup default 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.987+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2e210 con 0x7f8460014440 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b30450 con 0x55bb05b2ade0 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b307f0 con 0x55bb05b2ade0 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 20 started sync module instance, tier type = 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.988+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2f890 con 0x55bb05b25c80 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.989+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.989+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94261742861744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b2f890 con 0x55bb05b25c80 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.990+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b311b0 con 0x55bb05b21950 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.990+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94261742861744] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.991+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.991+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94261742865664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b31550 con 0x55bb05b21950 2024-09-07T03:32:35.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.991+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b32020 con 0x55bb05b25c80 2024-09-07T03:32:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.992+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94261742865664] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.992+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.992+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94261742869264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b31fe0 con 0x55bb05b25c80 2024-09-07T03:32:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.992+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b32a90 con 0x7f8460014440 2024-09-07T03:32:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:34.995+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94261742869264] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.000+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.000+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94261742859232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b32a90 con 0x7f8460014440 2024-09-07T03:32:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.000+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b33510 con 0x55bb05b25c80 2024-09-07T03:32:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.001+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94261742859232] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.003+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.003+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94261742874656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b32a90 con 0x55bb05b25c80 2024-09-07T03:32:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.003+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b33f20 con 0x55bb05b2ade0 2024-09-07T03:32:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.006+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.006+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94261742877296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b347c0 con 0x55bb05b2ade0 2024-09-07T03:32:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.006+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b35210 con 0x55bb05b2ade0 2024-09-07T03:32:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.009+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94261742877296] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.009+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94261742874656] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.009+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.009+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94261742872032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b34310 con 0x55bb05b2ade0 2024-09-07T03:32:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.009+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b35ae0 con 0x7f8460014440 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94261742872032] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94261742884400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b35a90 con 0x7f8460014440 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f846c80e800 20 add_watcher() i=0 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f846c80e800 20 add_watcher() i=1 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f846c80e800 20 add_watcher() i=2 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f846c80e800 20 add_watcher() i=3 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f846c80e800 20 add_watcher() i=4 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f846c80e800 20 add_watcher() i=5 2024-09-07T03:32:35.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.012+0000 7f846c80e800 20 add_watcher() i=6 2024-09-07T03:32:35.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.013+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94261742884400] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.013+0000 7f846c80e800 20 add_watcher() i=7 2024-09-07T03:32:35.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.013+0000 7f846c80e800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:35.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.013+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b35a90 con 0x55bb05b21950 2024-09-07T03:32:35.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.014+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.014+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94261742886528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b36880 con 0x55bb05b21950 2024-09-07T03:32:35.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.015+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94261742886528] v34'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.015+0000 7f831dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.015+0000 7f846c80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.015+0000 7f846c80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.015+0000 7f846c80e800 5 note: GC not initialized 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.015+0000 7f831cfe1640 20 reqs_thread_entry: start 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.015+0000 7f846c80e800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.015+0000 7f846c80e800 20 Filter name: none 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f82967fc640 20 reqs_thread_entry: start 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f846c80e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f846c80e800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b6c010 con 0x55bb05b21950 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f846c80e800 20 rados_obj.operate() r=0 bl.length=673 2024-09-07T03:32:35.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f846c80e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:35.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f846c80e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:35.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f846c80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:35.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.016+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b72a70 con 0x55bb05b21950 2024-09-07T03:32:35.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.017+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.017+0000 7f846c80e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:35.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.017+0000 7f846c80e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:35.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.017+0000 7f846c80e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:35.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.017+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94261743133872 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b6e170 con 0x55bb05b25c80 2024-09-07T03:32:35.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.018+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94261742874656 notify 146028888076 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55bb05b16fd0 con 0x55bb05b25c80 2024-09-07T03:32:35.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.018+0000 7f8346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94261742874656 notifier 4400 bl.length()=758 2024-09-07T03:32:35.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.018+0000 7f8346ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:35.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.018+0000 7f8346ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:35.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.018+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94261743133872 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.018+0000 7f8346ffd640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f832c003ea0 con 0x55bb05b25c80 2024-09-07T03:32:35.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.018+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.018+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94261743133872 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f846006b020 con 0x55bb05b25c80 2024-09-07T03:32:35.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.018+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b724b0 con 0x55bb05b21950 2024-09-07T03:32:35.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.020+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(66 foo:foo1 [delete] v34'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.020+0000 7f846c80e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-07T03:32:35.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.020+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94261743133872 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b6dcc0 con 0x55bb05b25c80 2024-09-07T03:32:35.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.020+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== watch-notify(notify (1) cookie 94261742861744 notify 146028888077 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f846006b020 con 0x55bb05b25c80 2024-09-07T03:32:35.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.020+0000 7f8346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 94261742861744 notifier 4400 bl.length()=159 2024-09-07T03:32:35.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.020+0000 7f8346ffd640 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f832c003ea0 con 0x55bb05b25c80 2024-09-07T03:32:35.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.020+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(67 notify.0 [notify cookie 94261743133872 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.021+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.021+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== watch-notify(notify_complete (2) cookie 94261743133872 notify 146028888077 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bb05b16650 con 0x55bb05b25c80 2024-09-07T03:32:35.023 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-07T03:32:34.729049Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:35.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.021+0000 7f831dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.021+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94261742886528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b69e90 con 0x55bb05b21950 2024-09-07T03:32:35.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.022+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94261742886528] v34'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.022+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94261742861744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b69e90 con 0x55bb05b25c80 2024-09-07T03:32:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.023+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94261742861744] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.023+0000 7f846c80e800 20 remove_watcher() i=0 2024-09-07T03:32:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.023+0000 7f846c80e800 2 removed watcher, disabling cache 2024-09-07T03:32:35.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.023+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94261742865664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b69e90 con 0x55bb05b21950 2024-09-07T03:32:35.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.025+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94261742865664] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x55bb05b21950 2024-09-07T03:32:35.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.025+0000 7f846c80e800 20 remove_watcher() i=1 2024-09-07T03:32:35.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.025+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94261742869264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b69e90 con 0x55bb05b25c80 2024-09-07T03:32:35.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.028+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94261742869264] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.028+0000 7f846c80e800 20 remove_watcher() i=2 2024-09-07T03:32:35.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.028+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94261742859232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b69e90 con 0x7f8460014440 2024-09-07T03:32:35.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.031+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94261742859232] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.031+0000 7f846c80e800 20 remove_watcher() i=3 2024-09-07T03:32:35.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.031+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94261742874656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b69e90 con 0x55bb05b25c80 2024-09-07T03:32:35.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.036+0000 7f84687e1640 1 -- 172.21.15.120:0/464236413 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94261742874656] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8460027070 con 0x55bb05b25c80 2024-09-07T03:32:35.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.036+0000 7f846c80e800 20 remove_watcher() i=4 2024-09-07T03:32:35.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.036+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94261742877296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b69e90 con 0x55bb05b2ade0 2024-09-07T03:32:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.037+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94261742877296] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.037+0000 7f846c80e800 20 remove_watcher() i=5 2024-09-07T03:32:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.037+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94261742872032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b69e90 con 0x55bb05b2ade0 2024-09-07T03:32:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.038+0000 7f8467fe0640 1 -- 172.21.15.120:0/464236413 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94261742872032] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845802d070 con 0x55bb05b2ade0 2024-09-07T03:32:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.038+0000 7f846c80e800 20 remove_watcher() i=6 2024-09-07T03:32:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.038+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94261742884400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb05b69e90 con 0x7f8460014440 2024-09-07T03:32:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94261742884400] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f845c057030 con 0x7f8460014440 2024-09-07T03:32:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 20 remove_watcher() i=7 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05b25c80 msgr2=0x55bb05b280b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05b25c80 0x55bb05b280b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb05b21950 msgr2=0x55bb05b23e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb05b21950 0x55bb05b23e10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8460014440 msgr2=0x7f8460025060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8460014440 0x7f8460025060 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bb05b2ade0 msgr2=0x55bb05b2d210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bb05b2ade0 0x55bb05b2d210 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f833003c780 msgr2=0x7f833003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f833003c780 0x7f833003ec40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8458052a40 tx=0x7f8458042000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 msgr2=0x55bb05b15e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f84677df640 1 -- 172.21.15.120:0/464236413 reap_dead start 2024-09-07T03:32:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b15e60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8460017f20 tx=0x7f8460053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 shutdown_connections 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 --2- 172.21.15.120:0/464236413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b0e810 0x55bb05b15e60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 >> 172.21.15.120:0/464236413 conn(0x55bb05b0ac10 msgr2=0x55bb05b08e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 shutdown_connections 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/464236413 wait complete. 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/3964682667 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f834003c780 msgr2=0x7f834003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 --2- 172.21.15.120:0/3964682667 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f834003c780 0x7f834003ec40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55bb05af2520 tx=0x7f845801b440 comp rx=0 tx=0).stop 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 -- 172.21.15.120:0/3964682667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b01d70 msgr2=0x55bb05b02190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.039+0000 7f846c80e800 1 --2- 172.21.15.120:0/3964682667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b01d70 0x55bb05b02190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8460016d20 tx=0x7f846000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/3964682667 shutdown_connections 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/3964682667 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f834003c780 0x7f834003ec40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/3964682667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb05b01d70 0x55bb05b02190 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/3964682667 >> 172.21.15.120:0/3964682667 conn(0x55bb05af6120 msgr2=0x55bb05af6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/3964682667 shutdown_connections 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/3964682667 wait complete. 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05aef440 msgr2=0x55bb05af1870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05aef440 0x55bb05af1870 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb059f2240 msgr2=0x55bb05aee650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb059f2240 0x55bb05aee650 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f835003c730 msgr2=0x7f835003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f835003c730 0x7f835003ebf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f845c057000 tx=0x7f845c052000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 msgr2=0x55bb05ae7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb05ae7000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8458000f60 tx=0x7f8458000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 shutdown_connections 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bb05aef440 0x55bb05af1870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bb059f2240 0x55bb05aee650 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f835003c730 0x7f835003ebf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 --2- 172.21.15.120:0/2978538846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bb059ee730 0x55bb05ae7000 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 >> 172.21.15.120:0/2978538846 conn(0x55bb059e81d0 msgr2=0x55bb05ad8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 shutdown_connections 2024-09-07T03:32:35.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.040+0000 7f846c80e800 1 -- 172.21.15.120:0/2978538846 wait complete. 2024-09-07T03:32:35.050 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-07T03:32:34.729049Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:35.050 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-07T03:32:35.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-07T03:32:35.050 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-07T03:32:35.094 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:35.095 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:35.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.094+0000 7ffb69546800 1 Processor -- start 2024-09-07T03:32:35.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.094+0000 7ffb69546800 1 -- start start 2024-09-07T03:32:35.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.094+0000 7ffb69546800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563fe4d47df0 0x563fe4d48af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.094+0000 7ffb69546800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563fe4bf2e40 con 0x563fe4d49030 2024-09-07T03:32:35.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.094+0000 7ffb69546800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x563fe4bbd680 con 0x563fe4d47df0 2024-09-07T03:32:35.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.095+0000 7ffb67037640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563fe4d47df0 0x563fe4d48af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.095+0000 7ffb5ffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x563fe4d49030 0x563fe4d4dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48384/0 (socket says 172.21.15.120:48384) 2024-09-07T03:32:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.095+0000 7ffb5ffff640 1 -- 172.21.15.120:0/4097857403 learned_addr learned my addr 172.21.15.120:0/4097857403 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.095+0000 7ffb66836640 1 -- 172.21.15.120:0/4097857403 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273816373 0 0) 0x563fe4bf2e40 con 0x563fe4d49030 2024-09-07T03:32:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.095+0000 7ffb66836640 1 -- 172.21.15.120:0/4097857403 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb54001e10 con 0x563fe4d49030 2024-09-07T03:32:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.095+0000 7ffb67037640 1 -- 172.21.15.120:0/4097857403 >> v1:172.21.15.104:6789/0 conn(0x563fe4d49030 legacy=0x563fe4d4dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.095+0000 7ffb67037640 1 -- 172.21.15.120:0/4097857403 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe4bd96b0 con 0x563fe4d47df0 2024-09-07T03:32:35.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb67037640 1 --2- 172.21.15.120:0/4097857403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4d48af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800a470 tx=0x7ffb58045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15408f9e2e59b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb66836640 1 -- 172.21.15.120:0/4097857403 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb58059070 con 0x563fe4d47df0 2024-09-07T03:32:35.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb66836640 1 -- 172.21.15.120:0/4097857403 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb58054570 con 0x563fe4d47df0 2024-09-07T03:32:35.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb66836640 1 -- 172.21.15.120:0/4097857403 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb58054850 con 0x563fe4d47df0 2024-09-07T03:32:35.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb69546800 1 -- 172.21.15.120:0/4097857403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 msgr2=0x563fe4d48af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb69546800 1 --2- 172.21.15.120:0/4097857403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4d48af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800a470 tx=0x7ffb58045920 comp rx=0 tx=0).stop 2024-09-07T03:32:35.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb69546800 1 -- 172.21.15.120:0/4097857403 shutdown_connections 2024-09-07T03:32:35.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb69546800 1 --2- 172.21.15.120:0/4097857403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4d48af0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb69546800 1 -- 172.21.15.120:0/4097857403 >> 172.21.15.120:0/4097857403 conn(0x563fe4d431c0 msgr2=0x563fe4d45620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb69546800 1 -- 172.21.15.120:0/4097857403 shutdown_connections 2024-09-07T03:32:35.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.097+0000 7ffb69546800 1 -- 172.21.15.120:0/4097857403 wait complete. 2024-09-07T03:32:35.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.111+0000 7ffb69546800 1 Processor -- start 2024-09-07T03:32:35.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.111+0000 7ffb69546800 1 -- start start 2024-09-07T03:32:35.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.111+0000 7ffb69546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4cbbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.111+0000 7ffb69546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563fe4be1dd0 con 0x563fe4d47df0 2024-09-07T03:32:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.112+0000 7ffb67037640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4cbbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.112+0000 7ffb67037640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4cbbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41924/0 (socket says 172.21.15.120:41924) 2024-09-07T03:32:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.112+0000 7ffb67037640 1 -- 172.21.15.120:0/2243855399 learned_addr learned my addr 172.21.15.120:0/2243855399 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.112+0000 7ffb67037640 1 -- 172.21.15.120:0/2243855399 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe4bfae10 con 0x563fe4d47df0 2024-09-07T03:32:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.112+0000 7ffb67037640 1 --2- 172.21.15.120:0/2243855399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4cbbd50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffb58025b20 tx=0x7ffb5804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d398c477d6b59c39 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.112+0000 7ffa5560a640 1 -- 172.21.15.120:0/2243855399 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb58059070 con 0x563fe4d47df0 2024-09-07T03:32:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.112+0000 7ffa5560a640 1 -- 172.21.15.120:0/2243855399 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb58065070 con 0x563fe4d47df0 2024-09-07T03:32:35.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.112+0000 7ffa5560a640 1 -- 172.21.15.120:0/2243855399 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb58054ac0 con 0x563fe4d47df0 2024-09-07T03:32:35.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 -- 172.21.15.120:0/2243855399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 msgr2=0x563fe4cbbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 --2- 172.21.15.120:0/2243855399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4cbbd50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffb58025b20 tx=0x7ffb5804e000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 -- 172.21.15.120:0/2243855399 shutdown_connections 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 --2- 172.21.15.120:0/2243855399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4cbbd50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 -- 172.21.15.120:0/2243855399 >> 172.21.15.120:0/2243855399 conn(0x563fe4d431c0 msgr2=0x563fe4e32d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 -- 172.21.15.120:0/2243855399 shutdown_connections 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 -- 172.21.15.120:0/2243855399 wait complete. 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 Processor -- start 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 -- start start 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4e3fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.113+0000 7ffb69546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563fe4d49720 con 0x563fe4d47df0 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffb67037640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4e3fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffb67037640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4e3fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41928/0 (socket says 172.21.15.120:41928) 2024-09-07T03:32:35.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffb67037640 1 -- 172.21.15.120:0/401209875 learned_addr learned my addr 172.21.15.120:0/401209875 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffb67037640 1 -- 172.21.15.120:0/401209875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe4e401c0 con 0x563fe4d47df0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffb67037640 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4e3fc60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffb58025b20 tx=0x7ffb58002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffa53e07640 1 -- 172.21.15.120:0/401209875 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb58054d60 con 0x563fe4d47df0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffa53e07640 1 -- 172.21.15.120:0/401209875 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5805a040 con 0x563fe4d47df0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fe4e40450 con 0x563fe4d47df0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffa53e07640 1 -- 172.21.15.120:0/401209875 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb580605f0 con 0x563fe4d47df0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.114+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe4e40e50 con 0x563fe4d47df0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.115+0000 7ffa53e07640 1 -- 172.21.15.120:0/401209875 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ffb58060790 con 0x563fe4d47df0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.115+0000 7ffa53e07640 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4c03c730 0x7ffa4c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.115+0000 7ffa53e07640 1 -- 172.21.15.120:0/401209875 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7ffb58097100 con 0x563fe4d47df0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.115+0000 7ffb5ffff640 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4c03c730 0x7ffa4c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.115+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4d49030 0x563fe4e472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.115+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e41a30 con 0x563fe4d49030 2024-09-07T03:32:35.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.115+0000 7ffb67838640 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4d49030 0x563fe4e472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.116+0000 7ffb5ffff640 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4c03c730 0x7ffa4c03ebf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb50001db0 tx=0x7ffb50001310 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.116+0000 7ffb67838640 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4d49030 0x563fe4e472b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.116+0000 7ffb67838640 1 -- 172.21.15.120:0/401209875 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb6000a4d0 con 0x563fe4d49030 2024-09-07T03:32:35.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.116+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e48220 0x563fe4e4a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.116+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e4ac50 con 0x563fe4e48220 2024-09-07T03:32:35.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.116+0000 7ffb67037640 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e48220 0x563fe4e4a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.116+0000 7ffb67037640 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e48220 0x563fe4e4a610 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.117+0000 7ffb67037640 1 -- 172.21.15.120:0/401209875 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e48220 2024-09-07T03:32:35.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.117+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e4c500 con 0x563fe4e48220 2024-09-07T03:32:35.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.117+0000 7ffb67037640 1 -- 172.21.15.120:0/401209875 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e48220 2024-09-07T03:32:35.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.117+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e4b670 con 0x563fe4e48220 2024-09-07T03:32:35.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.117+0000 7ffb67037640 1 -- 172.21.15.120:0/401209875 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e48220 2024-09-07T03:32:35.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.117+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e4bad0 con 0x563fe4d49030 2024-09-07T03:32:35.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.118+0000 7ffb67838640 1 -- 172.21.15.120:0/401209875 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb6000a4d0 con 0x563fe4d49030 2024-09-07T03:32:35.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.118+0000 7ffb69546800 1 Processor -- start 2024-09-07T03:32:35.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.118+0000 7ffb69546800 1 -- start start 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.118+0000 7ffb69546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e38830 0x563fe4e370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.118+0000 7ffb69546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563fe4c3fa00 con 0x563fe4e38830 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.118+0000 7ffb67838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e38830 0x563fe4e370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.118+0000 7ffb67838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e38830 0x563fe4e370a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41936/0 (socket says 172.21.15.120:41936) 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.118+0000 7ffb67838640 1 -- 172.21.15.120:0/191507010 learned_addr learned my addr 172.21.15.120:0/191507010 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.119+0000 7ffb67838640 1 -- 172.21.15.120:0/191507010 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe4e38d50 con 0x563fe4e38830 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.119+0000 7ffb67838640 1 --2- 172.21.15.120:0/191507010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e38830 0x563fe4e370a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffb600169b0 tx=0x7ffb60016e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.119+0000 7ffa51602640 1 -- 172.21.15.120:0/191507010 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6000de50 con 0x563fe4e38830 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.119+0000 7ffa51602640 1 -- 172.21.15.120:0/191507010 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6001b030 con 0x563fe4e38830 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.119+0000 7ffa51602640 1 -- 172.21.15.120:0/191507010 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb600175a0 con 0x563fe4e38830 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.119+0000 7ffb69546800 1 -- 172.21.15.120:0/191507010 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fe4e375e0 con 0x563fe4e38830 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.119+0000 7ffb69546800 1 -- 172.21.15.120:0/191507010 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe4e37b80 con 0x563fe4e38830 2024-09-07T03:32:35.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.120+0000 7ffa51602640 1 -- 172.21.15.120:0/191507010 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ffb60017740 con 0x563fe4e38830 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.120+0000 7ffa51602640 1 --2- 172.21.15.120:0/191507010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4003c840 0x7ffa4003ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.120+0000 7ffa51602640 1 -- 172.21.15.120:0/191507010 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7ffb6000e040 con 0x563fe4e38830 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.120+0000 7ffb67037640 1 --2- 172.21.15.120:0/191507010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4003c840 0x7ffa4003ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.120+0000 7ffb69546800 1 Processor -- start 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.120+0000 7ffb69546800 1 -- start start 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.120+0000 7ffb67037640 1 --2- 172.21.15.120:0/191507010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4003c840 0x7ffa4003ed00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x563fe4e479e0 tx=0x7ffb58094040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.120+0000 7ffb69546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e69b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.120+0000 7ffb69546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563fe4e3b0c0 con 0x563fe4e69700 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffb67838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e69b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffb67838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e69b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41938/0 (socket says 172.21.15.120:41938) 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffb67838640 1 -- 172.21.15.120:0/1722979934 learned_addr learned my addr 172.21.15.120:0/1722979934 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffb67838640 1 -- 172.21.15.120:0/1722979934 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe4e6a0f0 con 0x563fe4e69700 2024-09-07T03:32:35.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffb67838640 1 --2- 172.21.15.120:0/1722979934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e69b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb60017fd0 tx=0x7ffb600145b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cad076d74f99ed server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffa4affd640 1 -- 172.21.15.120:0/1722979934 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb60051020 con 0x563fe4e69700 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffa4affd640 1 -- 172.21.15.120:0/1722979934 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6001fc50 con 0x563fe4e69700 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffa4affd640 1 -- 172.21.15.120:0/1722979934 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb60017a30 con 0x563fe4e69700 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffb69546800 1 -- 172.21.15.120:0/1722979934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 msgr2=0x563fe4e69b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.121+0000 7ffb69546800 1 --2- 172.21.15.120:0/1722979934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e69b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb60017fd0 tx=0x7ffb600145b0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb69546800 1 -- 172.21.15.120:0/1722979934 shutdown_connections 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb69546800 1 --2- 172.21.15.120:0/1722979934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e69b00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb69546800 1 -- 172.21.15.120:0/1722979934 >> 172.21.15.120:0/1722979934 conn(0x563fe4e65b00 msgr2=0x563fe4e63d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb69546800 1 -- 172.21.15.120:0/1722979934 shutdown_connections 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb69546800 1 -- 172.21.15.120:0/1722979934 wait complete. 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb69546800 1 Processor -- start 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb69546800 1 -- start start 2024-09-07T03:32:35.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb69546800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e70d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb69546800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563fe4e6a710 con 0x563fe4e69700 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb67838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e70d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb67838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e70d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41942/0 (socket says 172.21.15.120:41942) 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 learned_addr learned my addr 172.21.15.120:0/3552875207 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.122+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe4e712a0 con 0x563fe4e69700 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.123+0000 7ffb67838640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e70d40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb60017fd0 tx=0x7ffb60053980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.123+0000 7ffa497fa640 1 -- 172.21.15.120:0/3552875207 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb60052260 con 0x563fe4e69700 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.123+0000 7ffa497fa640 1 -- 172.21.15.120:0/3552875207 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6002f070 con 0x563fe4e69700 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.123+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fe4e71530 con 0x563fe4e69700 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.123+0000 7ffa497fa640 1 -- 172.21.15.120:0/3552875207 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb60052570 con 0x563fe4e69700 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.123+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe4e71eb0 con 0x563fe4e69700 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.123+0000 7ffa497fa640 1 -- 172.21.15.120:0/3552875207 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ffb60005050 con 0x563fe4e69700 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.124+0000 7ffa497fa640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa3003c780 0x7ffa3003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.124+0000 7ffa497fa640 1 -- 172.21.15.120:0/3552875207 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7ffb60053e00 con 0x563fe4e69700 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.124+0000 7ffb67037640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa3003c780 0x7ffa3003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.124+0000 7ffb67037640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa3003c780 0x7ffa3003ec40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb5804e040 tx=0x7ffb5807cbe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.124+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.124+0000 7ffb69546800 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4e7c840 0x563fe4e7ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.124+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e7f450 con 0x563fe4e7c840 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.124+0000 7ffb5ffff640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4e7c840 0x563fe4e7ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb5ffff640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4e7c840 0x563fe4e7ed00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb50009050 con 0x563fe4e7c840 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 20 realm 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e7bb90 con 0x563fe4e7c840 2024-09-07T03:32:35.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb50009050 con 0x563fe4e7c840 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e7ff40 con 0x563fe4e7c840 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb50009050 con 0x563fe4e7c840 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e80d20 0x563fe4e83110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e837e0 con 0x563fe4e80d20 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.125+0000 7ffb67838640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e80d20 0x563fe4e83110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb67838640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e80d20 0x563fe4e83110 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb69546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e84030 con 0x563fe4e80d20 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb69546800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb69546800 20 searching for the correct realm 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb69546800 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563fe4e85da0 0x563fe4e881d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e85da0 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.126+0000 7ffb67037640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563fe4e85da0 0x563fe4e881d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.127+0000 7ffb67037640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563fe4e85da0 0x563fe4e881d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.127+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.127+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e80d20 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.127+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.127+0000 7ffb67838640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffb60034b70 0x7ffb60011710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.127+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x7ffb60034b70 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.127+0000 7ffb5ffff640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffb60034b70 0x7ffb60011710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.128+0000 7ffb5ffff640 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffb60034b70 0x7ffb60011710 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.128+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50009050 con 0x7ffb60034b70 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.128+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.128+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50009050 con 0x563fe4e7c840 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.128+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.128+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.128+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e85da0 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.128+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.128+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.129+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.129+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e80d20 2024-09-07T03:32:35.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.129+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.129+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e80d20 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.129+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.129+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.129+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.129+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x7ffb60034b70 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.130+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.130+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.130+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.130+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x7ffb60034b70 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.130+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.130+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e80d20 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.130+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.130+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e85da0 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.131+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.131+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.131+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.131+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e80d20 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.131+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.131+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e85da0 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.131+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.131+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e85da0 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x7ffb60034b70 2024-09-07T03:32:35.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.132+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e7c840 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.133+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.133+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x7ffb60034b70 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.133+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.133+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e85da0 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.133+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.133+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x7ffb60034b70 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.133+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.133+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e80d20 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.134+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.134+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e80d20 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.134+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.134+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e85da0 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.134+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.134+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e80d20 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.134+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.134+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e888a0 con 0x563fe4e80d20 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e84980 con 0x563fe4e7c840 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e84590 con 0x563fe4e80d20 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e852f0 con 0x563fe4e7c840 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 zone default found 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 4 Realm: () 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:35.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 zonegroup default 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.135+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e891d0 con 0x7ffb60034b70 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8b410 con 0x563fe4e85da0 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8b7b0 con 0x563fe4e85da0 2024-09-07T03:32:35.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 20 started sync module instance, tier type = 2024-09-07T03:32:35.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:35.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.136+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8a850 con 0x563fe4e80d20 2024-09-07T03:32:35.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.137+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.137+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94832423382080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8b060 con 0x563fe4e80d20 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.137+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8c4f0 con 0x563fe4e7c840 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.138+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94832423382080] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.139+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.139+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94832423385936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8c910 con 0x563fe4e7c840 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.139+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8d360 con 0x563fe4e80d20 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.140+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94832423385936] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.140+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.140+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94832423390800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8d750 con 0x563fe4e80d20 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.140+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8e190 con 0x7ffb60034b70 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.141+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94832423390800] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.142+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.142+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94832423394400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8e150 con 0x7ffb60034b70 2024-09-07T03:32:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.142+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8ec00 con 0x563fe4e80d20 2024-09-07T03:32:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.143+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94832423394400] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.144+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.144+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94832423397104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8e150 con 0x563fe4e80d20 2024-09-07T03:32:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.144+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8f610 con 0x563fe4e85da0 2024-09-07T03:32:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.145+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.145+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94832423399776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8fe60 con 0x563fe4e85da0 2024-09-07T03:32:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.145+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e90920 con 0x563fe4e85da0 2024-09-07T03:32:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.146+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94832423397104] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.146+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94832423399776] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.146+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.146+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94832423401904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e8bf70 con 0x563fe4e85da0 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.146+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e91200 con 0x7ffb60034b70 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94832423401904] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94832423404528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e911c0 con 0x7ffb60034b70 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb69546800 20 add_watcher() i=0 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb69546800 20 add_watcher() i=1 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb69546800 20 add_watcher() i=2 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb69546800 20 add_watcher() i=3 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb69546800 20 add_watcher() i=4 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb69546800 20 add_watcher() i=5 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.147+0000 7ffb69546800 20 add_watcher() i=6 2024-09-07T03:32:35.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.148+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94832423404528] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.148+0000 7ffb69546800 20 add_watcher() i=7 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.148+0000 7ffb69546800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.148+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e94650 con 0x563fe4e7c840 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.149+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.149+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94832423407328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4e91ba0 con 0x563fe4e7c840 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94832423407328] v34'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffa1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffb69546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffb69546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffb69546800 5 note: GC not initialized 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffa1cfe1640 20 reqs_thread_entry: start 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffb69546800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:35.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffb69546800 20 Filter name: none 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ff9967fc640 20 reqs_thread_entry: start 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffb69546800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffb69546800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.150+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec7720 con 0x563fe4e7c840 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.151+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.151+0000 7ffb69546800 20 rados_obj.operate() r=0 bl.length=582 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.151+0000 7ffb69546800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.151+0000 7ffb69546800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.151+0000 7ffb69546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.151+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ecdbd0 con 0x563fe4e7c840 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffb69546800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffb69546800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffb69546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94832423654864 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec9520 con 0x563fe4e80d20 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94832423397104 notify 146028888078 ret 0) ==== 774+0+0 (crc 0 0 0) 0x563fe4e71eb0 con 0x563fe4e80d20 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffa4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94832423397104 notifier 4407 bl.length()=732 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffa4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffa4affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94832423654864 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.152+0000 7ffa4affd640 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ffa2c003ea0 con 0x563fe4e80d20 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.153+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.153+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94832423654864 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563fe4e71530 con 0x563fe4e80d20 2024-09-07T03:32:35.165 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-07T03:32:34.729049Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.154+0000 7ffa1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.154+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94832423407328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec55c0 con 0x563fe4e7c840 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.155+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94832423407328] v34'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.155+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94832423382080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec55c0 con 0x563fe4e80d20 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.156+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94832423382080] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.156+0000 7ffb69546800 20 remove_watcher() i=0 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.156+0000 7ffb69546800 2 removed watcher, disabling cache 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.156+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94832423385936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec55c0 con 0x563fe4e7c840 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.157+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94832423385936] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x563fe4e7c840 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.157+0000 7ffb69546800 20 remove_watcher() i=1 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.157+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94832423390800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec55c0 con 0x563fe4e80d20 2024-09-07T03:32:35.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.158+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94832423390800] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.158+0000 7ffb69546800 20 remove_watcher() i=2 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.158+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94832423394400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec55c0 con 0x7ffb60034b70 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.159+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94832423394400] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.159+0000 7ffb69546800 20 remove_watcher() i=3 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.159+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94832423397104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec55c0 con 0x563fe4e80d20 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.160+0000 7ffb67838640 1 -- 172.21.15.120:0/3552875207 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94832423397104] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb60027070 con 0x563fe4e80d20 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.160+0000 7ffb69546800 20 remove_watcher() i=4 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.160+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94832423399776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec55c0 con 0x563fe4e85da0 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.161+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94832423399776] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.161+0000 7ffb69546800 20 remove_watcher() i=5 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.161+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94832423401904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec55c0 con 0x563fe4e85da0 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.162+0000 7ffb67037640 1 -- 172.21.15.120:0/3552875207 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94832423401904] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5807c910 con 0x563fe4e85da0 2024-09-07T03:32:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.162+0000 7ffb69546800 20 remove_watcher() i=6 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.162+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94832423404528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563fe4ec55c0 con 0x7ffb60034b70 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94832423404528] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb50028040 con 0x7ffb60034b70 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 20 remove_watcher() i=7 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e80d20 msgr2=0x563fe4e83110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e80d20 0x563fe4e83110 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4e7c840 msgr2=0x563fe4e7ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4e7c840 0x563fe4e7ed00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffb60034b70 msgr2=0x7ffb60011710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffb60034b70 0x7ffb60011710 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563fe4e85da0 msgr2=0x563fe4e881d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563fe4e85da0 0x563fe4e881d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa3003c780 msgr2=0x7ffa3003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa3003c780 0x7ffa3003ec40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb5804e040 tx=0x7ffb5807cbe0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 msgr2=0x563fe4e70d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 --2- 172.21.15.120:0/3552875207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e69700 0x563fe4e70d40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb60017fd0 tx=0x7ffb60053980 comp rx=0 tx=0).stop 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 reap_dead start 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb5ffff640 1 -- 172.21.15.120:0/3552875207 reap_dead start 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 shutdown_connections 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 >> 172.21.15.120:0/3552875207 conn(0x563fe4e65b00 msgr2=0x563fe4e63d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 shutdown_connections 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/3552875207 wait complete. 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/191507010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4003c840 msgr2=0x7ffa4003ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 --2- 172.21.15.120:0/191507010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4003c840 0x7ffa4003ed00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x563fe4e479e0 tx=0x7ffb58094040 comp rx=0 tx=0).stop 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 -- 172.21.15.120:0/191507010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e38830 msgr2=0x563fe4e370a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.163+0000 7ffb69546800 1 --2- 172.21.15.120:0/191507010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e38830 0x563fe4e370a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffb600169b0 tx=0x7ffb60016e70 comp rx=0 tx=0).stop 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/191507010 shutdown_connections 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/191507010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4003c840 0x7ffa4003ed00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/191507010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4e38830 0x563fe4e370a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/191507010 >> 172.21.15.120:0/191507010 conn(0x563fe4e4eda0 msgr2=0x563fe4e4f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/191507010 shutdown_connections 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/191507010 wait complete. 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e48220 msgr2=0x563fe4e4a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e48220 0x563fe4e4a610 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4d49030 msgr2=0x563fe4e472b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4d49030 0x563fe4e472b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4c03c730 msgr2=0x7ffa4c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4c03c730 0x7ffa4c03ebf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb50001db0 tx=0x7ffb50001310 comp rx=0 tx=0).stop 2024-09-07T03:32:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 msgr2=0x563fe4e3fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4e3fc60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffb58025b20 tx=0x7ffb58002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 shutdown_connections 2024-09-07T03:32:35.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563fe4e48220 0x563fe4e4a610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563fe4d49030 0x563fe4e472b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ffa4c03c730 0x7ffa4c03ebf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 --2- 172.21.15.120:0/401209875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563fe4d47df0 0x563fe4e3fc60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 >> 172.21.15.120:0/401209875 conn(0x563fe4d431c0 msgr2=0x563fe4e31510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 shutdown_connections 2024-09-07T03:32:35.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.164+0000 7ffb69546800 1 -- 172.21.15.120:0/401209875 wait complete. 2024-09-07T03:32:35.176 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-07T03:32:34.729049Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:35.176 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-07T03:32:35.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-07T03:32:35.176 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-07T03:32:35.264 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:35.264 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:35.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.263+0000 7f92cef22800 1 Processor -- start 2024-09-07T03:32:35.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.263+0000 7f92cef22800 1 -- start start 2024-09-07T03:32:35.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.264+0000 7f92cef22800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b0fe028210 0x55b0fe02a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.264+0000 7f92cef22800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b0fdecde40 con 0x55b0fe0246a0 2024-09-07T03:32:35.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.264+0000 7f92cef22800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b0fde98680 con 0x55b0fe028210 2024-09-07T03:32:35.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.264+0000 7f92ca301640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b0fe028210 0x55b0fe02a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.264+0000 7f92cab02640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b0fe0246a0 0x55b0fe026a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48394/0 (socket says 172.21.15.120:48394) 2024-09-07T03:32:35.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.264+0000 7f92ca301640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b0fe028210 0x55b0fe02a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41952/0 (socket says 172.21.15.120:41952) 2024-09-07T03:32:35.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.264+0000 7f92cab02640 1 -- 172.21.15.120:0/4119437533 learned_addr learned my addr 172.21.15.120:0/4119437533 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:35.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.264+0000 7f92ca301640 1 -- 172.21.15.120:0/4119437533 >> v1:172.21.15.104:6789/0 conn(0x55b0fe0246a0 legacy=0x55b0fe026a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.264+0000 7f92ca301640 1 -- 172.21.15.120:0/4119437533 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0fdeb46b0 con 0x55b0fe028210 2024-09-07T03:32:35.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.266+0000 7f92ca301640 1 --2- 172.21.15.120:0/4119437533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe028210 0x55b0fe02a6d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f92c000a470 tx=0x7f92c0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d009a3069138d943 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.266+0000 7f92c9b00640 1 -- 172.21.15.120:0/4119437533 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c0053570 con 0x55b0fe028210 2024-09-07T03:32:35.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.266+0000 7f92c9b00640 1 -- 172.21.15.120:0/4119437533 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c0058070 con 0x55b0fe028210 2024-09-07T03:32:35.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.266+0000 7f92c9b00640 1 -- 172.21.15.120:0/4119437533 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c0053880 con 0x55b0fe028210 2024-09-07T03:32:35.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.267+0000 7f92cef22800 1 -- 172.21.15.120:0/4119437533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe028210 msgr2=0x55b0fe02a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.267+0000 7f92cef22800 1 --2- 172.21.15.120:0/4119437533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe028210 0x55b0fe02a6d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f92c000a470 tx=0x7f92c0045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:35.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.267+0000 7f92cef22800 1 -- 172.21.15.120:0/4119437533 shutdown_connections 2024-09-07T03:32:35.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.267+0000 7f92cef22800 1 --2- 172.21.15.120:0/4119437533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe028210 0x55b0fe02a6d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.267+0000 7f92cef22800 1 -- 172.21.15.120:0/4119437533 >> 172.21.15.120:0/4119437533 conn(0x55b0fe01e1e0 msgr2=0x55b0fe020640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.267+0000 7f92cef22800 1 -- 172.21.15.120:0/4119437533 shutdown_connections 2024-09-07T03:32:35.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.267+0000 7f92cef22800 1 -- 172.21.15.120:0/4119437533 wait complete. 2024-09-07T03:32:35.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.281+0000 7f92cef22800 1 Processor -- start 2024-09-07T03:32:35.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.281+0000 7f92cef22800 1 -- start start 2024-09-07T03:32:35.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.281+0000 7f92cef22800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe113690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.281+0000 7f92cef22800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b0fdebcdd0 con 0x55b0fe0246a0 2024-09-07T03:32:35.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.281+0000 7f92cab02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.281+0000 7f92cab02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41964/0 (socket says 172.21.15.120:41964) 2024-09-07T03:32:35.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.281+0000 7f92cab02640 1 -- 172.21.15.120:0/3047367388 learned_addr learned my addr 172.21.15.120:0/3047367388 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.282+0000 7f92cab02640 1 -- 172.21.15.120:0/3047367388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0fded5e10 con 0x55b0fe0246a0 2024-09-07T03:32:35.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.282+0000 7f92cab02640 1 --2- 172.21.15.120:0/3047367388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe113690 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f92bc001e40 tx=0x7f92bc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3b1c8df4b4a042 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.282+0000 7f91b8e09640 1 -- 172.21.15.120:0/3047367388 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92bc012020 con 0x55b0fe0246a0 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.282+0000 7f91b8e09640 1 -- 172.21.15.120:0/3047367388 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92bc00e5a0 con 0x55b0fe0246a0 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.282+0000 7f91b8e09640 1 -- 172.21.15.120:0/3047367388 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92bc00e8a0 con 0x55b0fe0246a0 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 -- 172.21.15.120:0/3047367388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 msgr2=0x55b0fe113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 --2- 172.21.15.120:0/3047367388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe113690 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f92bc001e40 tx=0x7f92bc001e70 comp rx=0 tx=0).stop 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 -- 172.21.15.120:0/3047367388 shutdown_connections 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 --2- 172.21.15.120:0/3047367388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe113690 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 -- 172.21.15.120:0/3047367388 >> 172.21.15.120:0/3047367388 conn(0x55b0fe01e1e0 msgr2=0x55b0fe10f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 -- 172.21.15.120:0/3047367388 shutdown_connections 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 -- 172.21.15.120:0/3047367388 wait complete. 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 Processor -- start 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 -- start start 2024-09-07T03:32:35.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe11afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cef22800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b0fe02b050 con 0x55b0fe0246a0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cab02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe11afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cab02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe11afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41976/0 (socket says 172.21.15.120:41976) 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.283+0000 7f92cab02640 1 -- 172.21.15.120:0/1599270352 learned_addr learned my addr 172.21.15.120:0/1599270352 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.284+0000 7f92cab02640 1 -- 172.21.15.120:0/1599270352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0fe11b520 con 0x55b0fe0246a0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.284+0000 7f92cab02640 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe11afc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0012b0 tx=0x7f92bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.284+0000 7f91b7606640 1 -- 172.21.15.120:0/1599270352 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92bc012030 con 0x55b0fe0246a0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.284+0000 7f91b7606640 1 -- 172.21.15.120:0/1599270352 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92bc01a750 con 0x55b0fe0246a0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.284+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0fe11b7b0 con 0x55b0fe0246a0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.284+0000 7f91b7606640 1 -- 172.21.15.120:0/1599270352 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92bc01aa70 con 0x55b0fe0246a0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.284+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0fe11c1b0 con 0x55b0fe0246a0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.285+0000 7f91b7606640 1 -- 172.21.15.120:0/1599270352 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f92bc015020 con 0x55b0fe0246a0 2024-09-07T03:32:35.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.285+0000 7f91b7606640 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91b003c780 0x7f91b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.285+0000 7f91b7606640 1 -- 172.21.15.120:0/1599270352 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f92bc020030 con 0x55b0fe0246a0 2024-09-07T03:32:35.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.285+0000 7f92ca301640 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91b003c780 0x7f91b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.285+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe028210 0x55b0fe122610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.285+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe11cd70 con 0x55b0fe028210 2024-09-07T03:32:35.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.285+0000 7f92cb303640 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe028210 0x55b0fe122610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.285+0000 7f92ca301640 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91b003c780 0x7f91b003ec40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f92c0057000 tx=0x7f92c0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.286+0000 7f92cb303640 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe028210 0x55b0fe122610 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.286+0000 7f92cb303640 1 -- 172.21.15.120:0/1599270352 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92c400a4d0 con 0x55b0fe028210 2024-09-07T03:32:35.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.286+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe123580 0x55b0fe125970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.286+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe125fb0 con 0x55b0fe123580 2024-09-07T03:32:35.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.286+0000 7f92cab02640 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe123580 0x55b0fe125970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.286+0000 7f92cab02640 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe123580 0x55b0fe125970 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.287+0000 7f92cab02640 1 -- 172.21.15.120:0/1599270352 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe123580 2024-09-07T03:32:35.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.287+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe127860 con 0x55b0fe123580 2024-09-07T03:32:35.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.287+0000 7f92cab02640 1 -- 172.21.15.120:0/1599270352 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe123580 2024-09-07T03:32:35.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.287+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1269a0 con 0x55b0fe123580 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.287+0000 7f92cab02640 1 -- 172.21.15.120:0/1599270352 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe123580 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.287+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe126dc0 con 0x55b0fe028210 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.288+0000 7f92cb303640 1 -- 172.21.15.120:0/1599270352 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f92c400a4d0 con 0x55b0fe028210 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.288+0000 7f92cef22800 1 Processor -- start 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.288+0000 7f92cef22800 1 -- start start 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.288+0000 7f92cef22800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe135d40 0x55b0fe136160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.288+0000 7f92cef22800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b0fdf1aa00 con 0x55b0fe135d40 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.288+0000 7f92cb303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe135d40 0x55b0fe136160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.288+0000 7f92cb303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe135d40 0x55b0fe136160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41984/0 (socket says 172.21.15.120:41984) 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.288+0000 7f92cb303640 1 -- 172.21.15.120:0/2814678798 learned_addr learned my addr 172.21.15.120:0/2814678798 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.289+0000 7f92cb303640 1 -- 172.21.15.120:0/2814678798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0fe1367a0 con 0x55b0fe135d40 2024-09-07T03:32:35.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.289+0000 7f92cb303640 1 --2- 172.21.15.120:0/2814678798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe135d40 0x55b0fe136160 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f92c4016d20 tx=0x7f92c400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.289+0000 7f91b4e01640 1 -- 172.21.15.120:0/2814678798 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4017660 con 0x55b0fe135d40 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.289+0000 7f91b4e01640 1 -- 172.21.15.120:0/2814678798 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c401b030 con 0x55b0fe135d40 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.289+0000 7f91b4e01640 1 -- 172.21.15.120:0/2814678798 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4017950 con 0x55b0fe135d40 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.289+0000 7f92cef22800 1 -- 172.21.15.120:0/2814678798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0fe136fd0 con 0x55b0fe135d40 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.289+0000 7f92cef22800 1 -- 172.21.15.120:0/2814678798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0fe137570 con 0x55b0fe135d40 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.290+0000 7f91b4e01640 1 -- 172.21.15.120:0/2814678798 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f92c4017b40 con 0x55b0fe135d40 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.290+0000 7f91b4e01640 1 --2- 172.21.15.120:0/2814678798 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91a403c730 0x7f91a403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.290+0000 7f91b4e01640 1 -- 172.21.15.120:0/2814678798 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f92c400e040 con 0x55b0fe135d40 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.290+0000 7f92cab02640 1 --2- 172.21.15.120:0/2814678798 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91a403c730 0x7f91a403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.290+0000 7f92cef22800 1 Processor -- start 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.290+0000 7f92cab02640 1 --2- 172.21.15.120:0/2814678798 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91a403c730 0x7f91a403ebf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55b0fe1264c0 tx=0x7f92bc047040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.290+0000 7f92cef22800 1 -- start start 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.290+0000 7f92cef22800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe142be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.290+0000 7f92cef22800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b0fe113ee0 con 0x55b0fe1427e0 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.291+0000 7f92cb303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.291+0000 7f92cb303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe142be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41988/0 (socket says 172.21.15.120:41988) 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.291+0000 7f92cb303640 1 -- 172.21.15.120:0/987508199 learned_addr learned my addr 172.21.15.120:0/987508199 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.291+0000 7f92cb303640 1 -- 172.21.15.120:0/987508199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0fe1431d0 con 0x55b0fe1427e0 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.291+0000 7f92cb303640 1 --2- 172.21.15.120:0/987508199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe142be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f92c4013450 tx=0x7f92c4053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3303df46ba609727 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.291+0000 7f91ae7fc640 1 -- 172.21.15.120:0/987508199 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4014a00 con 0x55b0fe1427e0 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.291+0000 7f91ae7fc640 1 -- 172.21.15.120:0/987508199 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c4051070 con 0x55b0fe1427e0 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.291+0000 7f91ae7fc640 1 -- 172.21.15.120:0/987508199 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4028350 con 0x55b0fe1427e0 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 -- 172.21.15.120:0/987508199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 msgr2=0x55b0fe142be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 --2- 172.21.15.120:0/987508199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe142be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f92c4013450 tx=0x7f92c4053f40 comp rx=0 tx=0).stop 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 -- 172.21.15.120:0/987508199 shutdown_connections 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 --2- 172.21.15.120:0/987508199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe142be0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 -- 172.21.15.120:0/987508199 >> 172.21.15.120:0/987508199 conn(0x55b0fe13ebe0 msgr2=0x55b0fe13ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 -- 172.21.15.120:0/987508199 shutdown_connections 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 -- 172.21.15.120:0/987508199 wait complete. 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 Processor -- start 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 -- start start 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cef22800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b0fe1437f0 con 0x55b0fe1427e0 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cb303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cb303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe149e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:41992/0 (socket says 172.21.15.120:41992) 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 learned_addr learned my addr 172.21.15.120:0/2833773838 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.292+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0fe14a3e0 con 0x55b0fe1427e0 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.293+0000 7f92cb303640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe149e80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f92c4053f80 tx=0x7f92c4053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.293+0000 7f91acff9640 1 -- 172.21.15.120:0/2833773838 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4005030 con 0x55b0fe1427e0 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.293+0000 7f91acff9640 1 -- 172.21.15.120:0/2833773838 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c40051d0 con 0x55b0fe1427e0 2024-09-07T03:32:35.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.293+0000 7f91acff9640 1 -- 172.21.15.120:0/2833773838 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c40054f0 con 0x55b0fe1427e0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.293+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0fe14a670 con 0x55b0fe1427e0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.293+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0fe14aff0 con 0x55b0fe1427e0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.293+0000 7f91acff9640 1 -- 172.21.15.120:0/2833773838 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f92c4055280 con 0x55b0fe1427e0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.294+0000 7f91acff9640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f919403c780 0x7f919403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.294+0000 7f91acff9640 1 -- 172.21.15.120:0/2833773838 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f92c4035c50 con 0x55b0fe1427e0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.294+0000 7f92cab02640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f919403c780 0x7f919403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.294+0000 7f92cab02640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f919403c780 0x7f919403ec40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f92bc018f90 tx=0x7f92bc036000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.294+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.294+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe155910 0x55b0fe157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.294+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe158520 con 0x55b0fe155910 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.294+0000 7f92ca301640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe155910 0x55b0fe157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92ca301640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe155910 0x55b0fe157dd0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 20 realm 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe158950 con 0x55b0fe155910 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe159220 con 0x55b0fe155910 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe159c40 0x55b0fe15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.295+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe15c7e0 con 0x55b0fe159c40 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cb303640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe159c40 0x55b0fe15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cb303640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe159c40 0x55b0fe15c070 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cef22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe15d030 con 0x55b0fe159c40 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cef22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cef22800 20 searching for the correct realm 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b0fe15eda0 0x55b0fe1611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe15eda0 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.296+0000 7f92cab02640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b0fe15eda0 0x55b0fe1611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.297+0000 7f92cab02640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b0fe15eda0 0x55b0fe1611f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.297+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.297+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe159c40 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.297+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.297+0000 7f92cb303640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f92c404e7c0 0x7f92c4052170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.297+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x7f92c404e7c0 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.297+0000 7f92ca301640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f92c404e7c0 0x7f92c4052170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.298+0000 7f92ca301640 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f92c404e7c0 0x7f92c4052170 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.298+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.298+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.298+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.298+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.298+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.298+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe15eda0 2024-09-07T03:32:35.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.299+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.299+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.299+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.299+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe159c40 2024-09-07T03:32:35.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.299+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.299+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe159c40 2024-09-07T03:32:35.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.299+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.299+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x7f92c404e7c0 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x7f92c404e7c0 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe159c40 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.300+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe15eda0 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.301+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.301+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.301+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.301+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe159c40 2024-09-07T03:32:35.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.301+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.301+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe15eda0 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.301+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.302+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.302+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.302+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.302+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.302+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.302+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.302+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe15eda0 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.302+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.302+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x7f92c404e7c0 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe155910 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x7f92c404e7c0 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe15eda0 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x7f92c404e7c0 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.303+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe159c40 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.304+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.304+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe159c40 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.304+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.304+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe15eda0 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.304+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.304+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe159c40 2024-09-07T03:32:35.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1618c0 con 0x55b0fe159c40 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe15d980 con 0x55b0fe155910 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe15d5c0 con 0x55b0fe159c40 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.305+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe15ddc0 con 0x55b0fe155910 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 zone default found 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 4 Realm: () 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:35.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 zonegroup default 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1621f0 con 0x7f92c404e7c0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe164430 con 0x55b0fe15eda0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1647d0 con 0x55b0fe15eda0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 started sync module instance, tier type = 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.306+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe163870 con 0x55b0fe159c40 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.308+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.308+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94218665475520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe163870 con 0x55b0fe159c40 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.308+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1651d0 con 0x55b0fe155910 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.309+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94218665475520] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.309+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.309+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94218665472960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1637e0 con 0x55b0fe155910 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.309+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe166090 con 0x55b0fe159c40 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.310+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94218665472960] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.310+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.310+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94218665481664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe166090 con 0x55b0fe159c40 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.310+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe166a90 con 0x7f92c404e7c0 2024-09-07T03:32:35.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.311+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94218665481664] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.311+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.311+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94218665485728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe166090 con 0x7f92c404e7c0 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.312+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1674a0 con 0x55b0fe159c40 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.312+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94218665485728] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.313+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.313+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94218665483232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1674a0 con 0x55b0fe159c40 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.313+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe167ea0 con 0x55b0fe15eda0 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.314+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.314+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94218665483232] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.314+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94218665488368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe167410 con 0x55b0fe15eda0 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.314+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe168d60 con 0x55b0fe15eda0 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.315+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.315+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94218665495184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe169520 con 0x55b0fe15eda0 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.315+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe16a040 con 0x7f92c404e7c0 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.315+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94218665488368] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94218665499408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe16a000 con 0x7f92c404e7c0 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92cef22800 20 add_watcher() i=0 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92cef22800 20 add_watcher() i=1 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92cef22800 20 add_watcher() i=2 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92cef22800 20 add_watcher() i=3 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92cef22800 20 add_watcher() i=4 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92cef22800 20 add_watcher() i=5 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94218665495184] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.316+0000 7f92cef22800 20 add_watcher() i=6 2024-09-07T03:32:35.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.317+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94218665499408] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.317+0000 7f92cef22800 20 add_watcher() i=7 2024-09-07T03:32:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.317+0000 7f92cef22800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.317+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe168f70 con 0x55b0fe155910 2024-09-07T03:32:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.317+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.317+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94218665493136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe168f70 con 0x55b0fe155910 2024-09-07T03:32:35.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94218665493136] v34'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f91817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f92cef22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:35.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f92cef22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f92cef22800 5 note: GC not initialized 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f90fbfff640 20 reqs_thread_entry: start 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f92cef22800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f92cef22800 20 Filter name: none 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f90f9ffb640 20 reqs_thread_entry: start 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f92cef22800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f92cef22800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.319+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1a0090 con 0x55b0fe155910 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.320+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.320+0000 7f92cef22800 20 rados_obj.operate() r=0 bl.length=556 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.320+0000 7f92cef22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.320+0000 7f92cef22800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:35.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.320+0000 7f92cef22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.320+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1a6660 con 0x55b0fe155910 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f92cef22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f92cef22800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f92cef22800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94218665746592 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1a1d20 con 0x55b0fe159c40 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94218665483232 notify 146028888079 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b0fe14aff0 con 0x55b0fe159c40 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f91ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94218665483232 notifier 4414 bl.length()=567 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f91ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f91ae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f91ae7fc640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9190003ea0 con 0x55b0fe159c40 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.321+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94218665746592 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.322+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.322+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94218665746592 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b0fe14a670 con 0x55b0fe159c40 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.322+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1a60a0 con 0x7f92c404e7c0 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.323+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(66 foo:foo2 [delete] v34'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.323+0000 7f92cef22800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.323+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94218665746592 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe1a1870 con 0x55b0fe159c40 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.323+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== watch-notify(notify (1) cookie 94218665475520 notify 146028888080 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55b0fe14a670 con 0x55b0fe159c40 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.323+0000 7f91adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 94218665475520 notifier 4414 bl.length()=159 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.323+0000 7f91adffb640 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f91000032c0 con 0x55b0fe159c40 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.323+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(67 notify.0 [notify cookie 94218665746592 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.323+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.323+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== watch-notify(notify_complete (2) cookie 94218665746592 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b0fe14a3e0 con 0x55b0fe159c40 2024-09-07T03:32:35.336 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:35.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.324+0000 7f91817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.324+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94218665493136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe19def0 con 0x55b0fe155910 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.325+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94218665493136] v34'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.325+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94218665475520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe19def0 con 0x55b0fe159c40 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.326+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94218665475520] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.326+0000 7f92cef22800 20 remove_watcher() i=0 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.326+0000 7f92cef22800 2 removed watcher, disabling cache 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.326+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94218665472960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe19def0 con 0x55b0fe155910 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.327+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94218665472960] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x55b0fe155910 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.327+0000 7f92cef22800 20 remove_watcher() i=1 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.327+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94218665481664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe19def0 con 0x55b0fe159c40 2024-09-07T03:32:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.328+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94218665481664] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.328+0000 7f92cef22800 20 remove_watcher() i=2 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.328+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94218665485728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe19def0 con 0x7f92c404e7c0 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.329+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94218665485728] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.329+0000 7f92cef22800 20 remove_watcher() i=3 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.329+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94218665483232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe19def0 con 0x55b0fe159c40 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.330+0000 7f92cb303640 1 -- 172.21.15.120:0/2833773838 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94218665483232] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c4027070 con 0x55b0fe159c40 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.330+0000 7f92cef22800 20 remove_watcher() i=4 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.330+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94218665488368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe19def0 con 0x55b0fe15eda0 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.331+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94218665488368] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.331+0000 7f92cef22800 20 remove_watcher() i=5 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.331+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94218665495184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe19def0 con 0x55b0fe15eda0 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.332+0000 7f92cab02640 1 -- 172.21.15.120:0/2833773838 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94218665495184] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc018ce0 con 0x55b0fe15eda0 2024-09-07T03:32:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.332+0000 7f92cef22800 20 remove_watcher() i=6 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.332+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94218665499408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0fe19def0 con 0x7f92c404e7c0 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94218665499408] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c0051070 con 0x7f92c404e7c0 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 20 remove_watcher() i=7 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe159c40 msgr2=0x55b0fe15c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe159c40 0x55b0fe15c070 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe155910 msgr2=0x55b0fe157dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe155910 0x55b0fe157dd0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f92c404e7c0 msgr2=0x7f92c4052170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f92c404e7c0 0x7f92c4052170 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b0fe15eda0 msgr2=0x55b0fe1611f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b0fe15eda0 0x55b0fe1611f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f919403c780 msgr2=0x7f919403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f919403c780 0x7f919403ec40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f92bc018f90 tx=0x7f92bc036000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 msgr2=0x55b0fe149e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92ca301640 1 -- 172.21.15.120:0/2833773838 reap_dead start 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe149e80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f92c4053f80 tx=0x7f92c4053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 shutdown_connections 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 --2- 172.21.15.120:0/2833773838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe1427e0 0x55b0fe149e80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.333+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 >> 172.21.15.120:0/2833773838 conn(0x55b0fe13ebe0 msgr2=0x55b0fe13cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 shutdown_connections 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/2833773838 wait complete. 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/2814678798 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91a403c730 msgr2=0x7f91a403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/2814678798 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91a403c730 0x7f91a403ebf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55b0fe1264c0 tx=0x7f92bc047040 comp rx=0 tx=0).stop 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/2814678798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe135d40 msgr2=0x55b0fe136160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/2814678798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe135d40 0x55b0fe136160 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f92c4016d20 tx=0x7f92c400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/2814678798 shutdown_connections 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/2814678798 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91a403c730 0x7f91a403ebf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/2814678798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe135d40 0x55b0fe136160 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/2814678798 >> 172.21.15.120:0/2814678798 conn(0x55b0fe12a0f0 msgr2=0x55b0fe12a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/2814678798 shutdown_connections 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/2814678798 wait complete. 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe123580 msgr2=0x55b0fe125970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe123580 0x55b0fe125970 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe028210 msgr2=0x55b0fe122610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe028210 0x55b0fe122610 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91b003c780 msgr2=0x7f91b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91b003c780 0x7f91b003ec40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f92c0057000 tx=0x7f92c0052000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 msgr2=0x55b0fe11afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe11afc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0012b0 tx=0x7f92bc000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 shutdown_connections 2024-09-07T03:32:35.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b0fe123580 0x55b0fe125970 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b0fe028210 0x55b0fe122610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f91b003c780 0x7f91b003ec40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 --2- 172.21.15.120:0/1599270352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0fe0246a0 0x55b0fe11afc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 >> 172.21.15.120:0/1599270352 conn(0x55b0fe01e1e0 msgr2=0x55b0fe114970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 shutdown_connections 2024-09-07T03:32:35.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.334+0000 7f92cef22800 1 -- 172.21.15.120:0/1599270352 wait complete. 2024-09-07T03:32:35.347 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:35.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-07T03:32:35.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-07T03:32:35.347 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-07T03:32:35.391 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:35.391 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:35.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.391+0000 7f8ff3414800 1 Processor -- start 2024-09-07T03:32:35.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.391+0000 7f8ff3414800 1 -- start start 2024-09-07T03:32:35.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.391+0000 7f8ff3414800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5612de8a54a0 0x5612de8a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.391+0000 7f8ff3414800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612de750e40 con 0x5612de8a5de0 2024-09-07T03:32:35.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.391+0000 7f8ff3414800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5612de71b680 con 0x5612de8a54a0 2024-09-07T03:32:35.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.391+0000 7f8feebe0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5612de8a54a0 0x5612de8a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.391+0000 7f8fee3df640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5612de8a5de0 0x5612de8a6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48402/0 (socket says 172.21.15.120:48402) 2024-09-07T03:32:35.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.391+0000 7f8fee3df640 1 -- 172.21.15.120:0/2714953531 learned_addr learned my addr 172.21.15.120:0/2714953531 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:35.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.392+0000 7f8feebe0640 1 -- 172.21.15.120:0/2714953531 >> v1:172.21.15.104:6789/0 conn(0x5612de8a5de0 legacy=0x5612de8a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.392+0000 7f8feebe0640 1 -- 172.21.15.120:0/2714953531 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612de7376b0 con 0x5612de8a54a0 2024-09-07T03:32:35.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.392+0000 7f8fedbde640 1 -- 172.21.15.120:0/2714953531 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1342913951 0 0) 0x5612de750e40 con 0x5612de8a5de0 2024-09-07T03:32:35.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.393+0000 7f8feebe0640 1 --2- 172.21.15.120:0/2714953531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de8a58a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000a470 tx=0x7f8fe0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e813f69f4d3491 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.393+0000 7f8fedbde640 1 -- 172.21.15.120:0/2714953531 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe0053570 con 0x5612de8a54a0 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.393+0000 7f8fedbde640 1 -- 172.21.15.120:0/2714953531 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe0058070 con 0x5612de8a54a0 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.393+0000 7f8fedbde640 1 -- 172.21.15.120:0/2714953531 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe0053880 con 0x5612de8a54a0 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.394+0000 7f8ff3414800 1 -- 172.21.15.120:0/2714953531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 msgr2=0x5612de8a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.394+0000 7f8ff3414800 1 --2- 172.21.15.120:0/2714953531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de8a58a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000a470 tx=0x7f8fe0045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.394+0000 7f8ff3414800 1 -- 172.21.15.120:0/2714953531 shutdown_connections 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.394+0000 7f8ff3414800 1 --2- 172.21.15.120:0/2714953531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de8a58a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.394+0000 7f8ff3414800 1 -- 172.21.15.120:0/2714953531 >> 172.21.15.120:0/2714953531 conn(0x5612de8a11f0 msgr2=0x5612de8a3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.394+0000 7f8ff3414800 1 -- 172.21.15.120:0/2714953531 shutdown_connections 2024-09-07T03:32:35.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.394+0000 7f8ff3414800 1 -- 172.21.15.120:0/2714953531 wait complete. 2024-09-07T03:32:35.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.408+0000 7f8ff3414800 1 Processor -- start 2024-09-07T03:32:35.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.408+0000 7f8ff3414800 1 -- start start 2024-09-07T03:32:35.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.408+0000 7f8ff3414800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de998630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.408+0000 7f8ff3414800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5612de73fdd0 con 0x5612de8a54a0 2024-09-07T03:32:35.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.408+0000 7f8feebe0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de998630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.408+0000 7f8feebe0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de998630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42014/0 (socket says 172.21.15.120:42014) 2024-09-07T03:32:35.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.408+0000 7f8feebe0640 1 -- 172.21.15.120:0/577634805 learned_addr learned my addr 172.21.15.120:0/577634805 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.408+0000 7f8feebe0640 1 -- 172.21.15.120:0/577634805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612de758e10 con 0x5612de8a54a0 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8feebe0640 1 --2- 172.21.15.120:0/577634805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de998630 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000a470 tx=0x7f8fe0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c453b2099476661 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8edce09640 1 -- 172.21.15.120:0/577634805 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe0053570 con 0x5612de8a54a0 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8edce09640 1 -- 172.21.15.120:0/577634805 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe0063030 con 0x5612de8a54a0 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8edce09640 1 -- 172.21.15.120:0/577634805 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe0053840 con 0x5612de8a54a0 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8ff3414800 1 -- 172.21.15.120:0/577634805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 msgr2=0x5612de998630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8ff3414800 1 --2- 172.21.15.120:0/577634805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de998630 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000a470 tx=0x7f8fe0051000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8ff3414800 1 -- 172.21.15.120:0/577634805 shutdown_connections 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8ff3414800 1 --2- 172.21.15.120:0/577634805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de998630 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8ff3414800 1 -- 172.21.15.120:0/577634805 >> 172.21.15.120:0/577634805 conn(0x5612de8a11f0 msgr2=0x5612de993fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.409+0000 7f8ff3414800 1 -- 172.21.15.120:0/577634805 shutdown_connections 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.410+0000 7f8ff3414800 1 -- 172.21.15.120:0/577634805 wait complete. 2024-09-07T03:32:35.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.410+0000 7f8ff3414800 1 Processor -- start 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.410+0000 7f8ff3414800 1 -- start start 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.410+0000 7f8ff3414800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de99fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.410+0000 7f8ff3414800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5612de8a6d60 con 0x5612de8a54a0 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.410+0000 7f8feebe0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de99fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.410+0000 7f8feebe0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de99fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42026/0 (socket says 172.21.15.120:42026) 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.410+0000 7f8feebe0640 1 -- 172.21.15.120:0/879304912 learned_addr learned my addr 172.21.15.120:0/879304912 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.410+0000 7f8feebe0640 1 -- 172.21.15.120:0/879304912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612de9a03a0 con 0x5612de8a54a0 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.411+0000 7f8feebe0640 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de99fe40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000a470 tx=0x7f8fe0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.411+0000 7f8edb606640 1 -- 172.21.15.120:0/879304912 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe0078070 con 0x5612de8a54a0 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.411+0000 7f8edb606640 1 -- 172.21.15.120:0/879304912 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe0068420 con 0x5612de8a54a0 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.411+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612de9a0630 con 0x5612de8a54a0 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.411+0000 7f8edb606640 1 -- 172.21.15.120:0/879304912 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe0068700 con 0x5612de8a54a0 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.411+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612de9a1240 con 0x5612de8a54a0 2024-09-07T03:32:35.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.411+0000 7f8edb606640 1 -- 172.21.15.120:0/879304912 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8fe007b070 con 0x5612de8a54a0 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.412+0000 7f8edb606640 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ed403c730 0x7f8ed403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.412+0000 7f8edb606640 1 -- 172.21.15.120:0/879304912 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8fe0097920 con 0x5612de8a54a0 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.412+0000 7f8fee3df640 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ed403c730 0x7f8ed403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.412+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de8a5de0 0x5612de9a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.412+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9a79d0 con 0x5612de8a5de0 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.412+0000 7f8fef3e1640 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de8a5de0 0x5612de9a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.412+0000 7f8fee3df640 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ed403c730 0x7f8ed403ebf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4000c00 tx=0x7f8fe40013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.412+0000 7f8fef3e1640 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de8a5de0 0x5612de9a7490 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.413+0000 7f8fef3e1640 1 -- 172.21.15.120:0/879304912 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe800a4d0 con 0x5612de8a5de0 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.413+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9a8280 0x5612de9aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.413+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9aae60 con 0x5612de9a8280 2024-09-07T03:32:35.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.413+0000 7f8feebe0640 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9a8280 0x5612de9aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.413+0000 7f8feebe0640 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9a8280 0x5612de9aa6f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.414+0000 7f8feebe0640 1 -- 172.21.15.120:0/879304912 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fe007a030 con 0x5612de9a8280 2024-09-07T03:32:35.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.414+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ac710 con 0x5612de9a8280 2024-09-07T03:32:35.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.414+0000 7f8feebe0640 1 -- 172.21.15.120:0/879304912 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fe007a030 con 0x5612de9a8280 2024-09-07T03:32:35.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.414+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ab790 con 0x5612de9a8280 2024-09-07T03:32:35.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.414+0000 7f8feebe0640 1 -- 172.21.15.120:0/879304912 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fe007a030 con 0x5612de9a8280 2024-09-07T03:32:35.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.414+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9abbf0 con 0x5612de8a5de0 2024-09-07T03:32:35.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.414+0000 7f8fef3e1640 1 -- 172.21.15.120:0/879304912 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8fe800a4d0 con 0x5612de8a5de0 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.415+0000 7f8ff3414800 1 Processor -- start 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.415+0000 7f8ff3414800 1 -- start start 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.415+0000 7f8ff3414800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9babf0 0x5612de9bb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.415+0000 7f8ff3414800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5612de79da00 con 0x5612de9babf0 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.415+0000 7f8fef3e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9babf0 0x5612de9bb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.415+0000 7f8fef3e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9babf0 0x5612de9bb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42034/0 (socket says 172.21.15.120:42034) 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.415+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3401249075 learned_addr learned my addr 172.21.15.120:0/3401249075 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.415+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3401249075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612de9bb650 con 0x5612de9babf0 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.415+0000 7f8fef3e1640 1 --2- 172.21.15.120:0/3401249075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9babf0 0x5612de9bb010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8016d20 tx=0x7f8fe800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.416+0000 7f8ed8e01640 1 -- 172.21.15.120:0/3401249075 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe8017660 con 0x5612de9babf0 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.416+0000 7f8ed8e01640 1 -- 172.21.15.120:0/3401249075 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe801b030 con 0x5612de9babf0 2024-09-07T03:32:35.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.416+0000 7f8ff3414800 1 -- 172.21.15.120:0/3401249075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612de9bbe80 con 0x5612de9babf0 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.416+0000 7f8ed8e01640 1 -- 172.21.15.120:0/3401249075 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe8017950 con 0x5612de9babf0 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.416+0000 7f8ff3414800 1 -- 172.21.15.120:0/3401249075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612de9bc420 con 0x5612de9babf0 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.416+0000 7f8ed8e01640 1 -- 172.21.15.120:0/3401249075 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8fe8017af0 con 0x5612de9babf0 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8ed8e01640 1 --2- 172.21.15.120:0/3401249075 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ec803c780 0x7f8ec803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8ed8e01640 1 -- 172.21.15.120:0/3401249075 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8fe800e040 con 0x5612de9babf0 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8feebe0640 1 --2- 172.21.15.120:0/3401249075 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ec803c780 0x7f8ec803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8ff3414800 1 Processor -- start 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8ff3414800 1 -- start start 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8feebe0640 1 --2- 172.21.15.120:0/3401249075 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ec803c780 0x7f8ec803ec40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5612de9a1640 tx=0x7f8fe0052670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8ff3414800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8ff3414800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5612de998e20 con 0x5612de9c7670 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8fef3e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8fef3e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42038/0 (socket says 172.21.15.120:42038) 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3966088554 learned_addr learned my addr 172.21.15.120:0/3966088554 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.417+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3966088554 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612de9c8060 con 0x5612de9c7670 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8fef3e1640 1 --2- 172.21.15.120:0/3966088554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9c7a70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8017f20 tx=0x7f8fe8028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d14c7814a341bb server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ed27fc640 1 -- 172.21.15.120:0/3966088554 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe80149b0 con 0x5612de9c7670 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ed27fc640 1 -- 172.21.15.120:0/3966088554 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe8028350 con 0x5612de9c7670 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ed27fc640 1 -- 172.21.15.120:0/3966088554 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe8014b50 con 0x5612de9c7670 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ff3414800 1 -- 172.21.15.120:0/3966088554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 msgr2=0x5612de9c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3966088554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9c7a70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8017f20 tx=0x7f8fe8028e80 comp rx=0 tx=0).stop 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ff3414800 1 -- 172.21.15.120:0/3966088554 shutdown_connections 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3966088554 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9c7a70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ff3414800 1 -- 172.21.15.120:0/3966088554 >> 172.21.15.120:0/3966088554 conn(0x5612de9c3a70 msgr2=0x5612de9c1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ff3414800 1 -- 172.21.15.120:0/3966088554 shutdown_connections 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ff3414800 1 -- 172.21.15.120:0/3966088554 wait complete. 2024-09-07T03:32:35.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.418+0000 7f8ff3414800 1 Processor -- start 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8ff3414800 1 -- start start 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8ff3414800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8ff3414800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5612de9c8680 con 0x5612de9c7670 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8fef3e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8fef3e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42040/0 (socket says 172.21.15.120:42040) 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 learned_addr learned my addr 172.21.15.120:0/3600862251 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612de9cf240 con 0x5612de9c7670 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8fef3e1640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9cece0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8017f20 tx=0x7f8fe8053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8ed0ff9640 1 -- 172.21.15.120:0/3600862251 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe804c070 con 0x5612de9c7670 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8ed0ff9640 1 -- 172.21.15.120:0/3600862251 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe80129b0 con 0x5612de9c7670 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8ed0ff9640 1 -- 172.21.15.120:0/3600862251 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe8012c90 con 0x5612de9c7670 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612de9cf4d0 con 0x5612de9c7670 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.419+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612de9cfe50 con 0x5612de9c7670 2024-09-07T03:32:35.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.420+0000 7f8ed0ff9640 1 -- 172.21.15.120:0/3600862251 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8fe80135c0 con 0x5612de9c7670 2024-09-07T03:32:35.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.420+0000 7f8ed0ff9640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8eb803c780 0x7f8eb803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.420+0000 7f8ed0ff9640 1 -- 172.21.15.120:0/3600862251 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8fe803bb40 con 0x5612de9c7670 2024-09-07T03:32:35.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.420+0000 7f8feebe0640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8eb803c780 0x7f8eb803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de9da7a0 0x5612de9dcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9dd3b0 con 0x5612de9da7a0 2024-09-07T03:32:35.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8fee3df640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de9da7a0 0x5612de9dcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8feebe0640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8eb803c780 0x7f8eb803ec40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0097c90 tx=0x7f8fe0092000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8fee3df640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de9da7a0 0x5612de9dcc60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8ff3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8ff3414800 20 realm 2024-09-07T03:32:35.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9d9af0 con 0x5612de9da7a0 2024-09-07T03:32:35.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.421+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9dde90 con 0x5612de9da7a0 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9dec70 0x5612de9e1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e16f0 con 0x5612de9dec70 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8fef3e1640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9dec70 0x5612de9e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8fef3e1640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9dec70 0x5612de9e1060 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.422+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e1f90 con 0x5612de9dec70 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8ff3414800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8ff3414800 20 searching for the correct realm 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612de9e3d00 0x5612de9e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9e3d00 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8feebe0640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612de9e3d00 0x5612de9e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8feebe0640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612de9e3d00 0x5612de9e6110 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.423+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9dec70 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.424+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.424+0000 7f8fef3e1640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8fe8014440 0x7f8fe8025060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.424+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x7f8fe8014440 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.424+0000 7f8fee3df640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8fe8014440 0x7f8fe8025060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.424+0000 7f8fee3df640 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8fe8014440 0x7f8fe8025060 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.424+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x7f8fe8014440 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.424+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.424+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.424+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.425+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.425+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9e3d00 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.425+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.425+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.425+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.425+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9dec70 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.425+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.425+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9dec70 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.426+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.426+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.426+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.426+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x7f8fe8014440 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.426+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x7f8fe8014440 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.426+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.426+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.426+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x7f8fe8014440 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.426+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fe400f5f0 con 0x7f8fe8014440 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.427+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9dec70 2024-09-07T03:32:35.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.427+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.427+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9e3d00 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.427+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.427+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.427+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.427+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9dec70 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.427+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.427+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9e3d00 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.428+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.428+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.428+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.428+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.428+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.428+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.428+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.428+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9e3d00 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x7f8fe8014440 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x7f8fe8014440 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9da7a0 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x5612de9da7a0 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x7f8fe8014440 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x7f8fe8014440 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9e3d00 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.429+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x7f8fe8014440 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.430+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe400f5f0 con 0x7f8fe8014440 2024-09-07T03:32:35.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.430+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9dec70 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.430+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.430+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9dec70 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.430+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.430+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9e3d00 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.430+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.430+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9dec70 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e67e0 con 0x5612de9dec70 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:35.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e28e0 con 0x5612de9da7a0 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e2d00 con 0x5612de9dec70 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.431+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e3160 con 0x5612de9da7a0 2024-09-07T03:32:35.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 20 zone default found 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 4 Realm: () 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 20 zonegroup default 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e6c60 con 0x7f8fe8014440 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x7f8fe8014440 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e8f20 con 0x5612de9e3d00 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.432+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e9310 con 0x5612de9e3d00 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.433+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.433+0000 7f8ff3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.433+0000 7f8ff3414800 20 started sync module instance, tier type = 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.433+0000 7f8ff3414800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.433+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e83b0 con 0x5612de9dec70 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.434+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.434+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94639044331696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e83b0 con 0x5612de9dec70 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.434+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e9e90 con 0x5612de9da7a0 2024-09-07T03:32:35.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.435+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94639044331696] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.435+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.435+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94639044329216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9e8320 con 0x5612de9da7a0 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.435+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ead50 con 0x5612de9dec70 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.436+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94639044329216] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.436+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.436+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94639044338304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ead50 con 0x5612de9dec70 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.436+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9eb750 con 0x7f8fe8014440 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.437+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x7f8fe8014440 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.437+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94639044342368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9eb6c0 con 0x7f8fe8014440 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.437+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ec740 con 0x5612de9dec70 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.438+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94639044338304] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.438+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94639044342368] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x7f8fe8014440 2024-09-07T03:32:35.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.439+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.439+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94639044344640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ec700 con 0x5612de9dec70 2024-09-07T03:32:35.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.439+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ecfe0 con 0x5612de9e3d00 2024-09-07T03:32:35.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.440+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.440+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94639044348720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ed400 con 0x5612de9e3d00 2024-09-07T03:32:35.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.440+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9edc50 con 0x5612de9e3d00 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.440+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94639044344640] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.441+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94639044348720] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.441+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.441+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94639044349776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ed820 con 0x5612de9e3d00 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.441+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9ee0b0 con 0x7f8fe8014440 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94639044349776] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x7f8fe8014440 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94639044350832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9edc40 con 0x7f8fe8014440 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8ff3414800 20 add_watcher() i=0 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8ff3414800 20 add_watcher() i=1 2024-09-07T03:32:35.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8ff3414800 20 add_watcher() i=2 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8ff3414800 20 add_watcher() i=3 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8ff3414800 20 add_watcher() i=4 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8ff3414800 20 add_watcher() i=5 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.442+0000 7f8ff3414800 20 add_watcher() i=6 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.444+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94639044350832] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x7f8fe8014440 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.444+0000 7f8ff3414800 20 add_watcher() i=7 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.444+0000 7f8ff3414800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.444+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612de9f1590 con 0x5612de9da7a0 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.445+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.445+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94639044352352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612de9eea80 con 0x5612de9da7a0 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.446+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94639044352352] v34'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.446+0000 7f8ea57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.446+0000 7f8ff3414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.446+0000 7f8ff3414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.446+0000 7f8ff3414800 5 note: GC not initialized 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.446+0000 7f8e1ffff640 20 reqs_thread_entry: start 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.447+0000 7f8ff3414800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.447+0000 7f8ff3414800 20 Filter name: none 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.447+0000 7f8e1dffb640 20 reqs_thread_entry: start 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.447+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.447+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612dea24170 con 0x5612de9da7a0 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.447+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.447+0000 7f8ff3414800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.447+0000 7f8ff3414800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.447+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612dea24a00 con 0x5612de9da7a0 2024-09-07T03:32:35.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.448+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.448+0000 7f8ff3414800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.448+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612dea25a10 con 0x7f8fe8014440 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.448+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x7f8fe8014440 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.449+0000 7f8ea57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.449+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94639044352352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612dea220b0 con 0x5612de9da7a0 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.450+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94639044352352] v34'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.450+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94639044331696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612dea220b0 con 0x5612de9dec70 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.451+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94639044331696] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.451+0000 7f8ff3414800 20 remove_watcher() i=0 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.451+0000 7f8ff3414800 2 removed watcher, disabling cache 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.451+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94639044329216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612dea220b0 con 0x5612de9da7a0 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.452+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94639044329216] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x5612de9da7a0 2024-09-07T03:32:35.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.452+0000 7f8ff3414800 20 remove_watcher() i=1 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.452+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94639044338304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612dea220b0 con 0x5612de9dec70 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.454+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94639044338304] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.454+0000 7f8ff3414800 20 remove_watcher() i=2 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.454+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94639044342368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612dea220b0 con 0x7f8fe8014440 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.455+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94639044342368] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x7f8fe8014440 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.455+0000 7f8ff3414800 20 remove_watcher() i=3 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.455+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94639044344640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612dea220b0 con 0x5612de9dec70 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.456+0000 7f8fef3e1640 1 -- 172.21.15.120:0/3600862251 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94639044344640] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe8027070 con 0x5612de9dec70 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.456+0000 7f8ff3414800 20 remove_watcher() i=4 2024-09-07T03:32:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.456+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94639044348720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612dea220b0 con 0x5612de9e3d00 2024-09-07T03:32:35.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.457+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94639044348720] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.457+0000 7f8ff3414800 20 remove_watcher() i=5 2024-09-07T03:32:35.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.457+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94639044349776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612dea220b0 con 0x5612de9e3d00 2024-09-07T03:32:35.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.458+0000 7f8feebe0640 1 -- 172.21.15.120:0/3600862251 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94639044349776] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe0090070 con 0x5612de9e3d00 2024-09-07T03:32:35.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.458+0000 7f8ff3414800 20 remove_watcher() i=6 2024-09-07T03:32:35.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.458+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94639044350832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612dea220b0 con 0x7f8fe8014440 2024-09-07T03:32:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94639044350832] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe403c040 con 0x7f8fe8014440 2024-09-07T03:32:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 20 remove_watcher() i=7 2024-09-07T03:32:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9dec70 msgr2=0x5612de9e1060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9dec70 0x5612de9e1060 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de9da7a0 msgr2=0x5612de9dcc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de9da7a0 0x5612de9dcc60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8fe8014440 msgr2=0x7f8fe8025060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8fe8014440 0x7f8fe8025060 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612de9e3d00 msgr2=0x5612de9e6110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5612de9e3d00 0x5612de9e6110 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.463+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8eb803c780 msgr2=0x7f8eb803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8eb803c780 0x7f8eb803ec40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0097c90 tx=0x7f8fe0092000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 msgr2=0x5612de9cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3600862251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9c7670 0x5612de9cece0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8017f20 tx=0x7f8fe8053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 reap_dead start 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8fee3df640 1 -- 172.21.15.120:0/3600862251 reap_dead start 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 shutdown_connections 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 >> 172.21.15.120:0/3600862251 conn(0x5612de9c3a70 msgr2=0x5612de9c1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 shutdown_connections 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3600862251 wait complete. 2024-09-07T03:32:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3401249075 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ec803c780 msgr2=0x7f8ec803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3401249075 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ec803c780 0x7f8ec803ec40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5612de9a1640 tx=0x7f8fe0052670 comp rx=0 tx=0).stop 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3401249075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9babf0 msgr2=0x5612de9bb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3401249075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9babf0 0x5612de9bb010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8016d20 tx=0x7f8fe800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3401249075 shutdown_connections 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3401249075 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ec803c780 0x7f8ec803ec40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/3401249075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de9babf0 0x5612de9bb010 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3401249075 >> 172.21.15.120:0/3401249075 conn(0x5612de9aefa0 msgr2=0x5612de9af380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3401249075 shutdown_connections 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/3401249075 wait complete. 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9a8280 msgr2=0x5612de9aa6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9a8280 0x5612de9aa6f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de8a5de0 msgr2=0x5612de9a7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de8a5de0 0x5612de9a7490 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ed403c730 msgr2=0x7f8ed403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ed403c730 0x7f8ed403ebf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4000c00 tx=0x7f8fe40013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 msgr2=0x5612de99fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de99fe40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000a470 tx=0x7f8fe0002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 shutdown_connections 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5612de9a8280 0x5612de9aa6f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5612de8a5de0 0x5612de9a7490 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ed403c730 0x7f8ed403ebf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.464+0000 7f8ff3414800 1 --2- 172.21.15.120:0/879304912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5612de8a54a0 0x5612de99fe40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.465+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 >> 172.21.15.120:0/879304912 conn(0x5612de8a11f0 msgr2=0x5612de9927a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.465+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 shutdown_connections 2024-09-07T03:32:35.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.465+0000 7f8ff3414800 1 -- 172.21.15.120:0/879304912 wait complete. 2024-09-07T03:32:35.476 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-07T03:32:35.476 DEBUG:tasks.util.rgw: json result: [] 2024-09-07T03:32:35.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-07T03:32:35.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-07T03:32:35.477 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-07T03:32:35.561 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:35.561 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:35.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.560+0000 7fcbe8413800 1 Processor -- start 2024-09-07T03:32:35.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.560+0000 7fcbe8413800 1 -- start start 2024-09-07T03:32:35.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.560+0000 7fcbe8413800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c27ad07230 0x55c27ad096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.560+0000 7fcbe8413800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c27abace40 con 0x55c27ad03720 2024-09-07T03:32:35.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.560+0000 7fcbe8413800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55c27ab77680 con 0x55c27ad07230 2024-09-07T03:32:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.561+0000 7fcbdb347640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55c27ad07230 0x55c27ad096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.561+0000 7fcbe3b48640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55c27ad03720 0x55c27ad05b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48418/0 (socket says 172.21.15.120:48418) 2024-09-07T03:32:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.561+0000 7fcbe3b48640 1 -- 172.21.15.120:0/2557156696 learned_addr learned my addr 172.21.15.120:0/2557156696 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.561+0000 7fcbdb347640 1 -- 172.21.15.120:0/2557156696 >> v1:172.21.15.104:6789/0 conn(0x55c27ad03720 legacy=0x55c27ad05b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.561+0000 7fcbe3347640 1 -- 172.21.15.120:0/2557156696 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216422097 0 0) 0x55c27abace40 con 0x55c27ad03720 2024-09-07T03:32:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.561+0000 7fcbdb347640 1 -- 172.21.15.120:0/2557156696 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c27ab936b0 con 0x55c27ad07230 2024-09-07T03:32:35.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.563+0000 7fcbdb347640 1 --2- 172.21.15.120:0/2557156696 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad07230 0x55c27ad096c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00a470 tx=0x7fcbcc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d792b4ebe3007dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.563+0000 7fcbe3347640 1 -- 172.21.15.120:0/2557156696 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbcc053570 con 0x55c27ad07230 2024-09-07T03:32:35.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.563+0000 7fcbe3347640 1 -- 172.21.15.120:0/2557156696 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbcc058070 con 0x55c27ad07230 2024-09-07T03:32:35.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.563+0000 7fcbe3347640 1 -- 172.21.15.120:0/2557156696 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbcc053880 con 0x55c27ad07230 2024-09-07T03:32:35.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.563+0000 7fcbe8413800 1 -- 172.21.15.120:0/2557156696 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad07230 msgr2=0x55c27ad096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.563+0000 7fcbe8413800 1 --2- 172.21.15.120:0/2557156696 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad07230 0x55c27ad096c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00a470 tx=0x7fcbcc045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.563+0000 7fcbe8413800 1 -- 172.21.15.120:0/2557156696 shutdown_connections 2024-09-07T03:32:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.563+0000 7fcbe8413800 1 --2- 172.21.15.120:0/2557156696 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad07230 0x55c27ad096c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.563+0000 7fcbe8413800 1 -- 172.21.15.120:0/2557156696 >> 172.21.15.120:0/2557156696 conn(0x55c27acfd1c0 msgr2=0x55c27acff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.564+0000 7fcbe8413800 1 -- 172.21.15.120:0/2557156696 shutdown_connections 2024-09-07T03:32:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.564+0000 7fcbe8413800 1 -- 172.21.15.120:0/2557156696 wait complete. 2024-09-07T03:32:35.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.577+0000 7fcbe8413800 1 Processor -- start 2024-09-07T03:32:35.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.577+0000 7fcbe8413800 1 -- start start 2024-09-07T03:32:35.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.577+0000 7fcbe8413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27ad02eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.577+0000 7fcbe8413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c27ab9bdd0 con 0x55c27ad03720 2024-09-07T03:32:35.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.578+0000 7fcbe3b48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27ad02eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.578+0000 7fcbe3b48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27ad02eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42062/0 (socket says 172.21.15.120:42062) 2024-09-07T03:32:35.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.578+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1922060959 learned_addr learned my addr 172.21.15.120:0/1922060959 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.578+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1922060959 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c27abb4e10 con 0x55c27ad03720 2024-09-07T03:32:35.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.578+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/1922060959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27ad02eb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4001ea0 tx=0x7fcbd400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e46692c082df623 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.578+0000 7fcad1e0b640 1 -- 172.21.15.120:0/1922060959 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd4008070 con 0x55c27ad03720 2024-09-07T03:32:35.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.578+0000 7fcad1e0b640 1 -- 172.21.15.120:0/1922060959 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd400d500 con 0x55c27ad03720 2024-09-07T03:32:35.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.578+0000 7fcad1e0b640 1 -- 172.21.15.120:0/1922060959 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd400d880 con 0x55c27ad03720 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 -- 172.21.15.120:0/1922060959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 msgr2=0x55c27ad02eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1922060959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27ad02eb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4001ea0 tx=0x7fcbd400b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 -- 172.21.15.120:0/1922060959 shutdown_connections 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1922060959 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27ad02eb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 -- 172.21.15.120:0/1922060959 >> 172.21.15.120:0/1922060959 conn(0x55c27acfd1c0 msgr2=0x55c27adede00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 -- 172.21.15.120:0/1922060959 shutdown_connections 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 -- 172.21.15.120:0/1922060959 wait complete. 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 Processor -- start 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 -- start start 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27adfc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe8413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c27ad0a040 con 0x55c27ad03720 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.579+0000 7fcbe3b48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27adfc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.580+0000 7fcbe3b48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27adfc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42064/0 (socket says 172.21.15.120:42064) 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.580+0000 7fcbe3b48640 1 -- 172.21.15.120:0/3577520795 learned_addr learned my addr 172.21.15.120:0/3577520795 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.580+0000 7fcbe3b48640 1 -- 172.21.15.120:0/3577520795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c27adfc570 con 0x55c27ad03720 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.580+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27adfc010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4000f60 tx=0x7fcbd4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.580+0000 7fcacbfff640 1 -- 172.21.15.120:0/3577520795 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd400f8d0 con 0x55c27ad03720 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.580+0000 7fcacbfff640 1 -- 172.21.15.120:0/3577520795 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd400fa70 con 0x55c27ad03720 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.580+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c27adfc800 con 0x55c27ad03720 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.580+0000 7fcacbfff640 1 -- 172.21.15.120:0/3577520795 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd400fd50 con 0x55c27ad03720 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.580+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c27adfd200 con 0x55c27ad03720 2024-09-07T03:32:35.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.581+0000 7fcacbfff640 1 -- 172.21.15.120:0/3577520795 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcbd4017040 con 0x55c27ad03720 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.581+0000 7fcacbfff640 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcacc03c730 0x7fcacc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.581+0000 7fcacbfff640 1 -- 172.21.15.120:0/3577520795 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fcbd4015020 con 0x55c27ad03720 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.581+0000 7fcbdb347640 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcacc03c730 0x7fcacc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.581+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ad07230 0x55c27ae03660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.581+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae03ba0 con 0x55c27ad07230 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.581+0000 7fcbe4349640 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ad07230 0x55c27ae03660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.582+0000 7fcbdb347640 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcacc03c730 0x7fcacc03ebf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc057000 tx=0x7fcbcc052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.582+0000 7fcbe4349640 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ad07230 0x55c27ae03660 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.582+0000 7fcbe4349640 1 -- 172.21.15.120:0/3577520795 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbdc00a4d0 con 0x55c27ad07230 2024-09-07T03:32:35.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.582+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae04450 0x55c27ae068e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.582+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae07050 con 0x55c27ae04450 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.582+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae04450 0x55c27ae068e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.583+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae04450 0x55c27ae068e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.583+0000 7fcbe3b48640 1 -- 172.21.15.120:0/3577520795 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae04450 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.583+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae08900 con 0x55c27ae04450 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.583+0000 7fcbe3b48640 1 -- 172.21.15.120:0/3577520795 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae04450 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.583+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae07a70 con 0x55c27ae04450 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.583+0000 7fcbe3b48640 1 -- 172.21.15.120:0/3577520795 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae04450 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.583+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae07e90 con 0x55c27ad07230 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.584+0000 7fcbe4349640 1 -- 172.21.15.120:0/3577520795 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcbdc00a4d0 con 0x55c27ad07230 2024-09-07T03:32:35.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.584+0000 7fcbe8413800 1 Processor -- start 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.584+0000 7fcbe8413800 1 -- start start 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.584+0000 7fcbe8413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae16de0 0x55c27ae17200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.584+0000 7fcbe8413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c27abf9a00 con 0x55c27ae16de0 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.584+0000 7fcbe4349640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae16de0 0x55c27ae17200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.584+0000 7fcbe4349640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae16de0 0x55c27ae17200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42080/0 (socket says 172.21.15.120:42080) 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.584+0000 7fcbe4349640 1 -- 172.21.15.120:0/1500211575 learned_addr learned my addr 172.21.15.120:0/1500211575 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.585+0000 7fcbe4349640 1 -- 172.21.15.120:0/1500211575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c27ae17840 con 0x55c27ae16de0 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.585+0000 7fcbe4349640 1 --2- 172.21.15.120:0/1500211575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae16de0 0x55c27ae17200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc016d20 tx=0x7fcbdc00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.585+0000 7fcac97fa640 1 -- 172.21.15.120:0/1500211575 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc017660 con 0x55c27ae16de0 2024-09-07T03:32:35.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.585+0000 7fcac97fa640 1 -- 172.21.15.120:0/1500211575 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc01b030 con 0x55c27ae16de0 2024-09-07T03:32:35.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.585+0000 7fcbe8413800 1 -- 172.21.15.120:0/1500211575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c27ae18070 con 0x55c27ae16de0 2024-09-07T03:32:35.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.585+0000 7fcac97fa640 1 -- 172.21.15.120:0/1500211575 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc017950 con 0x55c27ae16de0 2024-09-07T03:32:35.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.585+0000 7fcbe8413800 1 -- 172.21.15.120:0/1500211575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c27ae18610 con 0x55c27ae16de0 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.586+0000 7fcac97fa640 1 -- 172.21.15.120:0/1500211575 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcbdc017af0 con 0x55c27ae16de0 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.586+0000 7fcac97fa640 1 --2- 172.21.15.120:0/1500211575 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcabc03c780 0x7fcabc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.586+0000 7fcac97fa640 1 -- 172.21.15.120:0/1500211575 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fcbdc00e040 con 0x55c27ae16de0 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.586+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/1500211575 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcabc03c780 0x7fcabc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.586+0000 7fcbe8413800 1 Processor -- start 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.586+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/1500211575 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcabc03c780 0x7fcabc03ec40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55c27ae07590 tx=0x7fcbd401b440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.586+0000 7fcbe8413800 1 -- start start 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcbe8413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae23c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcbe8413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c27ad01750 con 0x55c27ae23860 2024-09-07T03:32:35.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcbe4349640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae23c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcbe4349640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae23c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42092/0 (socket says 172.21.15.120:42092) 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcbe4349640 1 -- 172.21.15.120:0/3625264547 learned_addr learned my addr 172.21.15.120:0/3625264547 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcbe4349640 1 -- 172.21.15.120:0/3625264547 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c27ae24250 con 0x55c27ae23860 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcbe4349640 1 --2- 172.21.15.120:0/3625264547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae23c60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc017f20 tx=0x7fcbdc028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349a089a06ee03c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcac2ffd640 1 -- 172.21.15.120:0/3625264547 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc0149b0 con 0x55c27ae23860 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcac2ffd640 1 -- 172.21.15.120:0/3625264547 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc028350 con 0x55c27ae23860 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.587+0000 7fcac2ffd640 1 -- 172.21.15.120:0/3625264547 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc014b50 con 0x55c27ae23860 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 -- 172.21.15.120:0/3625264547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 msgr2=0x55c27ae23c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3625264547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae23c60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc017f20 tx=0x7fcbdc028e80 comp rx=0 tx=0).stop 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 -- 172.21.15.120:0/3625264547 shutdown_connections 2024-09-07T03:32:35.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3625264547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae23c60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 -- 172.21.15.120:0/3625264547 >> 172.21.15.120:0/3625264547 conn(0x55c27ae1fc60 msgr2=0x55c27ae1dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 -- 172.21.15.120:0/3625264547 shutdown_connections 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 -- 172.21.15.120:0/3625264547 wait complete. 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 Processor -- start 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 -- start start 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae2aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe8413800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c27ae24870 con 0x55c27ae23860 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe4349640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae2aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe4349640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae2aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42104/0 (socket says 172.21.15.120:42104) 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.588+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 learned_addr learned my addr 172.21.15.120:0/1742361321 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.589+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c27ae2b430 con 0x55c27ae23860 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.589+0000 7fcbe4349640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae2aed0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc017f20 tx=0x7fcbdc053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.589+0000 7fcac17fa640 1 -- 172.21.15.120:0/1742361321 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc04c070 con 0x55c27ae23860 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.589+0000 7fcac17fa640 1 -- 172.21.15.120:0/1742361321 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0129b0 con 0x55c27ae23860 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.589+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c27ae2b6c0 con 0x55c27ae23860 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.589+0000 7fcac17fa640 1 -- 172.21.15.120:0/1742361321 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc012c90 con 0x55c27ae23860 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.589+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c27ae2c040 con 0x55c27ae23860 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcac17fa640 1 -- 172.21.15.120:0/1742361321 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcbdc0135c0 con 0x55c27ae23860 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcac17fa640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcaac03c730 0x7fcaac03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcac17fa640 1 -- 172.21.15.120:0/1742361321 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fcbdc03bb40 con 0x55c27ae23860 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcaac03c730 0x7fcaac03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ae369b0 0x55c27ae38e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae39590 con 0x55c27ae369b0 2024-09-07T03:32:35.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcbdb347640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ae369b0 0x55c27ae38e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcaac03c730 0x7fcaac03ebf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400eab0 tx=0x7fcbd4042000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.590+0000 7fcbdb347640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ae369b0 0x55c27ae38e40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 20 realm 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae399c0 con 0x55c27ae369b0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae3a290 con 0x55c27ae369b0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae3acb0 0x55c27ae3d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae3d810 con 0x55c27ae3acb0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.591+0000 7fcbe4349640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae3acb0 0x55c27ae3d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe4349640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae3acb0 0x55c27ae3d0a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe8413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae3e0b0 con 0x55c27ae3acb0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe8413800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:35.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe8413800 20 searching for the correct realm 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c27ae3fe20 0x55c27ae42230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3fe20 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.592+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c27ae3fe20 0x55c27ae42230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.593+0000 7fcbe3b48640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c27ae3fe20 0x55c27ae42230 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.593+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.593+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3acb0 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.593+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.593+0000 7fcbe4349640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcbdc014440 0x7fcbdc04e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.593+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x7fcbdc014440 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.593+0000 7fcbdb347640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcbdc014440 0x7fcbdc04e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.594+0000 7fcbdb347640 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcbdc014440 0x7fcbdc04e480 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.594+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.594+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.594+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.594+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.594+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.594+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3fe20 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.595+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.595+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.595+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.595+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3acb0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.595+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.595+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3acb0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.595+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.595+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.596+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.596+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x7fcbdc014440 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.596+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.596+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.596+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.596+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x7fcbdc014440 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.596+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.596+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3acb0 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.597+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.597+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3fe20 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.597+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.597+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.597+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.597+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3acb0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.597+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.597+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3fe20 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.598+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.598+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.598+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.598+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.598+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.598+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.598+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.598+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3fe20 2024-09-07T03:32:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.598+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.599+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x7fcbdc014440 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.599+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.599+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae369b0 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.599+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.599+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x7fcbdc014440 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.599+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.599+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3fe20 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.599+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.599+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x7fcbdc014440 2024-09-07T03:32:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.600+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.600+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3acb0 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.600+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.600+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3acb0 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.600+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.600+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3fe20 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.600+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.600+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3acb0 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42900 con 0x55c27ae3acb0 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:35.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae3ea00 con 0x55c27ae369b0 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae3edf0 con 0x55c27ae3acb0 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.601+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae3f250 con 0x55c27ae369b0 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 20 zone default found 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 4 Realm: () 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 20 zonegroup default 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae42dd0 con 0x7fcbdc014440 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae45090 con 0x55c27ae3fe20 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae45460 con 0x55c27ae3fe20 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.602+0000 7fcbe8413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.603+0000 7fcbe8413800 20 started sync module instance, tier type = 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.603+0000 7fcbe8413800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.603+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae44520 con 0x55c27ae3acb0 2024-09-07T03:32:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.604+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.604+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293773797920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae44520 con 0x55c27ae3acb0 2024-09-07T03:32:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.604+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae45fa0 con 0x55c27ae369b0 2024-09-07T03:32:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.605+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.605+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94293773797920] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.605+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94293773802128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae46830 con 0x55c27ae369b0 2024-09-07T03:32:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.605+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae44090 con 0x55c27ae3acb0 2024-09-07T03:32:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.608+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94293773802128] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.608+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.608+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94293773804352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae46760 con 0x55c27ae3acb0 2024-09-07T03:32:35.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.608+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae478c0 con 0x7fcbdc014440 2024-09-07T03:32:35.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.609+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.609+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94293773808656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae47830 con 0x7fcbdc014440 2024-09-07T03:32:35.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.609+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae48890 con 0x55c27ae3acb0 2024-09-07T03:32:35.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.609+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94293773804352] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.610+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.610+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94293773812608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae48850 con 0x55c27ae3acb0 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.610+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae492a0 con 0x55c27ae3fe20 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.610+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94293773808656] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.612+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94293773812608] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.612+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.612+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94293773807088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae47cb0 con 0x55c27ae3fe20 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.612+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae49b40 con 0x55c27ae3fe20 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.614+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.614+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94293773817488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae4a000 con 0x55c27ae3fe20 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.614+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae4aaf0 con 0x7fcbdc014440 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.614+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94293773807088] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94293773817488] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94293773821376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae4aab0 con 0x7fcbdc014440 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbe8413800 20 add_watcher() i=0 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbe8413800 20 add_watcher() i=1 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbe8413800 20 add_watcher() i=2 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbe8413800 20 add_watcher() i=3 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbe8413800 20 add_watcher() i=4 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbe8413800 20 add_watcher() i=5 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.615+0000 7fcbe8413800 20 add_watcher() i=6 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.616+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94293773821376] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.616+0000 7fcbe8413800 20 add_watcher() i=7 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.616+0000 7fcbe8413800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:35.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.616+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae48df0 con 0x55c27ae369b0 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.616+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.616+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94293773818544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae4b330 con 0x55c27ae369b0 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94293773818544] v34'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fca99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fcbe8413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fcbe8413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fcbe8413800 5 note: GC not initialized 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fca98fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fcbe8413800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fcbe8413800 20 Filter name: none 2024-09-07T03:32:35.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fca127fc640 20 reqs_thread_entry: start 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.618+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae80610 con 0x55c27ae369b0 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.619+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.619+0000 7fcbe8413800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.619+0000 7fcbe8413800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.619+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae80ed0 con 0x55c27ae369b0 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.619+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.619+0000 7fcbe8413800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.619+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae81ee0 con 0x7fcbdc014440 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.619+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.620+0000 7fca99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.620+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94293773818544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae7e550 con 0x55c27ae369b0 2024-09-07T03:32:35.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.621+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94293773818544] v34'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.621+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94293773797920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae7e550 con 0x55c27ae3acb0 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.622+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94293773797920] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.622+0000 7fcbe8413800 20 remove_watcher() i=0 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.622+0000 7fcbe8413800 2 removed watcher, disabling cache 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.622+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94293773802128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae7e550 con 0x55c27ae369b0 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.623+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94293773802128] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x55c27ae369b0 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.623+0000 7fcbe8413800 20 remove_watcher() i=1 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.623+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94293773804352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae7e550 con 0x55c27ae3acb0 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.624+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94293773804352] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.624+0000 7fcbe8413800 20 remove_watcher() i=2 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.624+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94293773808656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae7e550 con 0x7fcbdc014440 2024-09-07T03:32:35.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.627+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94293773808656] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.627+0000 7fcbe8413800 20 remove_watcher() i=3 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.627+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94293773812608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae7e550 con 0x55c27ae3acb0 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.628+0000 7fcbe4349640 1 -- 172.21.15.120:0/1742361321 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94293773812608] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc027070 con 0x55c27ae3acb0 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.628+0000 7fcbe8413800 20 remove_watcher() i=4 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.628+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94293773807088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae7e550 con 0x55c27ae3fe20 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.629+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94293773807088] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.629+0000 7fcbe8413800 20 remove_watcher() i=5 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.629+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94293773817488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae7e550 con 0x55c27ae3fe20 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.630+0000 7fcbe3b48640 1 -- 172.21.15.120:0/1742361321 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94293773817488] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbd402d070 con 0x55c27ae3fe20 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.630+0000 7fcbe8413800 20 remove_watcher() i=6 2024-09-07T03:32:35.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.630+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94293773821376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c27ae7e550 con 0x7fcbdc014440 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.630+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94293773821376] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbcc051070 con 0x7fcbdc014440 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.630+0000 7fcbe8413800 20 remove_watcher() i=7 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae3acb0 msgr2=0x55c27ae3d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae3acb0 0x55c27ae3d0a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ae369b0 msgr2=0x55c27ae38e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ae369b0 0x55c27ae38e40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcbdc014440 msgr2=0x7fcbdc04e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fcbdc014440 0x7fcbdc04e480 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c27ae3fe20 msgr2=0x55c27ae42230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55c27ae3fe20 0x55c27ae42230 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcaac03c730 msgr2=0x7fcaac03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcaac03c730 0x7fcaac03ebf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400eab0 tx=0x7fcbd4042000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbdb347640 1 -- 172.21.15.120:0/1742361321 reap_dead start 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 msgr2=0x55c27ae2aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae2aed0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc017f20 tx=0x7fcbdc053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 shutdown_connections 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1742361321 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae23860 0x55c27ae2aed0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 >> 172.21.15.120:0/1742361321 conn(0x55c27ae1fc60 msgr2=0x55c27ae1de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 shutdown_connections 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1742361321 wait complete. 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1500211575 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcabc03c780 msgr2=0x7fcabc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1500211575 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcabc03c780 0x7fcabc03ec40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55c27ae07590 tx=0x7fcbd401b440 comp rx=0 tx=0).stop 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1500211575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae16de0 msgr2=0x55c27ae17200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1500211575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae16de0 0x55c27ae17200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc016d20 tx=0x7fcbdc00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1500211575 shutdown_connections 2024-09-07T03:32:35.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1500211575 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcabc03c780 0x7fcabc03ec40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 --2- 172.21.15.120:0/1500211575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ae16de0 0x55c27ae17200 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1500211575 >> 172.21.15.120:0/1500211575 conn(0x55c27ae0b190 msgr2=0x55c27ae0b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1500211575 shutdown_connections 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.631+0000 7fcbe8413800 1 -- 172.21.15.120:0/1500211575 wait complete. 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae04450 msgr2=0x55c27ae068e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae04450 0x55c27ae068e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ad07230 msgr2=0x55c27ae03660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ad07230 0x55c27ae03660 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcacc03c730 msgr2=0x7fcacc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcacc03c730 0x7fcacc03ebf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc057000 tx=0x7fcbcc052000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 msgr2=0x55c27adfc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27adfc010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4000f60 tx=0x7fcbd4000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 shutdown_connections 2024-09-07T03:32:35.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55c27ae04450 0x55c27ae068e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55c27ad07230 0x55c27ae03660 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcacc03c730 0x7fcacc03ebf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 --2- 172.21.15.120:0/3577520795 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c27ad03720 0x55c27adfc010 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 >> 172.21.15.120:0/3577520795 conn(0x55c27acfd1c0 msgr2=0x55c27aded950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 shutdown_connections 2024-09-07T03:32:35.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.632+0000 7fcbe8413800 1 -- 172.21.15.120:0/3577520795 wait complete. 2024-09-07T03:32:35.645 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-07T03:32:35.645 DEBUG:tasks.util.rgw: json result: [] 2024-09-07T03:32:35.753 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:35.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-07T03:32:35.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-07T03:32:35.754 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-07T03:32:35.798 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:35.871 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:35.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.798+0000 7f0be0340800 1 Processor -- start 2024-09-07T03:32:35.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.798+0000 7f0be0340800 1 -- start start 2024-09-07T03:32:35.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.798+0000 7f0be0340800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55649c4da200 0x55649c4dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.798+0000 7f0be0340800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55649c383e40 con 0x55649c4d8df0 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.798+0000 7f0be0340800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55649c34e680 con 0x55649c4da200 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.798+0000 7f0bdb8ec640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55649c4da200 0x55649c4dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.798+0000 7f0bdc0ed640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55649c4d8df0 0x55649c4d9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48424/0 (socket says 172.21.15.120:48424) 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.798+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/4241552114 learned_addr learned my addr 172.21.15.120:0/4241552114 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.799+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/4241552114 >> v1:172.21.15.104:6789/0 conn(0x55649c4d8df0 legacy=0x55649c4d9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.799+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/4241552114 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649c36a6b0 con 0x55649c4da200 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0bdb8ec640 1 --2- 172.21.15.120:0/4241552114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4da200 0x55649c4dfda0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000a470 tx=0x7f0bd0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c01df910df337e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0bdb0eb640 1 -- 172.21.15.120:0/4241552114 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd0053570 con 0x55649c4da200 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0bdb0eb640 1 -- 172.21.15.120:0/4241552114 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd0058070 con 0x55649c4da200 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0bdb0eb640 1 -- 172.21.15.120:0/4241552114 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd0053880 con 0x55649c4da200 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0be0340800 1 -- 172.21.15.120:0/4241552114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4da200 msgr2=0x55649c4dfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0be0340800 1 --2- 172.21.15.120:0/4241552114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4da200 0x55649c4dfda0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000a470 tx=0x7f0bd0045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0be0340800 1 -- 172.21.15.120:0/4241552114 shutdown_connections 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0be0340800 1 --2- 172.21.15.120:0/4241552114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4da200 0x55649c4dfda0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0be0340800 1 -- 172.21.15.120:0/4241552114 >> 172.21.15.120:0/4241552114 conn(0x55649c4d41c0 msgr2=0x55649c4d6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0be0340800 1 -- 172.21.15.120:0/4241552114 shutdown_connections 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.801+0000 7f0be0340800 1 -- 172.21.15.120:0/4241552114 wait complete. 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.815+0000 7f0be0340800 1 Processor -- start 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.815+0000 7f0be0340800 1 -- start start 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.815+0000 7f0be0340800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c44cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.815+0000 7f0be0340800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55649c372dd0 con 0x55649c4d8df0 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.815+0000 7f0bdc0ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c44cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.816+0000 7f0bdc0ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c44cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42116/0 (socket says 172.21.15.120:42116) 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.816+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3042462602 learned_addr learned my addr 172.21.15.120:0/3042462602 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.816+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3042462602 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649c38be10 con 0x55649c4d8df0 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.816+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/3042462602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c44cdf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc001e40 tx=0x7f0bcc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5841192f52b5f75b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.816+0000 7f0aca60c640 1 -- 172.21.15.120:0/3042462602 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc012020 con 0x55649c4d8df0 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.816+0000 7f0aca60c640 1 -- 172.21.15.120:0/3042462602 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bcc00e5a0 con 0x55649c4d8df0 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.816+0000 7f0aca60c640 1 -- 172.21.15.120:0/3042462602 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc00e8a0 con 0x55649c4d8df0 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 -- 172.21.15.120:0/3042462602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 msgr2=0x55649c44cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 --2- 172.21.15.120:0/3042462602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c44cdf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc001e40 tx=0x7f0bcc001e70 comp rx=0 tx=0).stop 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 -- 172.21.15.120:0/3042462602 shutdown_connections 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 --2- 172.21.15.120:0/3042462602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c44cdf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 -- 172.21.15.120:0/3042462602 >> 172.21.15.120:0/3042462602 conn(0x55649c4d41c0 msgr2=0x55649c5c3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 -- 172.21.15.120:0/3042462602 shutdown_connections 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 -- 172.21.15.120:0/3042462602 wait complete. 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 Processor -- start 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 -- start start 2024-09-07T03:32:35.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c5d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0be0340800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55649c4da8f0 con 0x55649c4d8df0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.817+0000 7f0bdc0ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c5d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.818+0000 7f0bdc0ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c5d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42124/0 (socket says 172.21.15.120:42124) 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.818+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/2398561456 learned_addr learned my addr 172.21.15.120:0/2398561456 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.818+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/2398561456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649c5d1530 con 0x55649c4d8df0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.818+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c5d0fd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c010 tx=0x7f0bcc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.818+0000 7f0ac8e09640 1 -- 172.21.15.120:0/2398561456 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc012030 con 0x55649c4d8df0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.818+0000 7f0ac8e09640 1 -- 172.21.15.120:0/2398561456 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bcc0014a0 con 0x55649c4d8df0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.818+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55649c5d17c0 con 0x55649c4d8df0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.818+0000 7f0ac8e09640 1 -- 172.21.15.120:0/2398561456 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bcc01a7a0 con 0x55649c4d8df0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.818+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649c5d21c0 con 0x55649c4d8df0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.819+0000 7f0ac8e09640 1 -- 172.21.15.120:0/2398561456 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0bcc015020 con 0x55649c4d8df0 2024-09-07T03:32:35.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.819+0000 7f0ac8e09640 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ac403c730 0x7f0ac403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.819+0000 7f0ac8e09640 1 -- 172.21.15.120:0/2398561456 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f0bcc020030 con 0x55649c4d8df0 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.819+0000 7f0bdb8ec640 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ac403c730 0x7f0ac403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.820+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c4da200 0x55649c5d8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.820+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c5d8b60 con 0x55649c4da200 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.820+0000 7f0bdc8ee640 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c4da200 0x55649c5d8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.820+0000 7f0bdb8ec640 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ac403c730 0x7f0ac403ebf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0057000 tx=0x7f0bd0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.820+0000 7f0bdc8ee640 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c4da200 0x55649c5d8620 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.820+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/2398561456 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bd400a4d0 con 0x55649c4da200 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.820+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c5d9410 0x55649c5db8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.820+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c5dc020 con 0x55649c5d9410 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.820+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c5d9410 0x55649c5db8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.821+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c5d9410 0x55649c5db8b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.821+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/2398561456 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bcc01ab20 con 0x55649c5d9410 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.821+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c5dd8d0 con 0x55649c5d9410 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.821+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/2398561456 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0bcc01ab20 con 0x55649c5d9410 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.821+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c5dca40 con 0x55649c5d9410 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.821+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/2398561456 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bcc01ab20 con 0x55649c5d9410 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.822+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c5dce60 con 0x55649c4da200 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.822+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/2398561456 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0bd400a4d0 con 0x55649c4da200 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.822+0000 7f0be0340800 1 Processor -- start 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.822+0000 7f0be0340800 1 -- start start 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.822+0000 7f0be0340800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5ebd90 0x55649c5ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.822+0000 7f0be0340800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55649c3d0a00 con 0x55649c5ebd90 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.822+0000 7f0bdc8ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5ebd90 0x55649c5ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.823+0000 7f0bdc8ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5ebd90 0x55649c5ec1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42134/0 (socket says 172.21.15.120:42134) 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.823+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3122032072 learned_addr learned my addr 172.21.15.120:0/3122032072 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.823+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3122032072 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649c5ec7f0 con 0x55649c5ebd90 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.823+0000 7f0bdc8ee640 1 --2- 172.21.15.120:0/3122032072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5ebd90 0x55649c5ec1b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4016d20 tx=0x7f0bd400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.823+0000 7f0ac1ffb640 1 -- 172.21.15.120:0/3122032072 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd4017660 con 0x55649c5ebd90 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.823+0000 7f0ac1ffb640 1 -- 172.21.15.120:0/3122032072 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd401b030 con 0x55649c5ebd90 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.823+0000 7f0be0340800 1 -- 172.21.15.120:0/3122032072 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55649c5ed020 con 0x55649c5ebd90 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.823+0000 7f0ac1ffb640 1 -- 172.21.15.120:0/3122032072 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd4017950 con 0x55649c5ebd90 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.823+0000 7f0be0340800 1 -- 172.21.15.120:0/3122032072 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649c5ed5c0 con 0x55649c5ebd90 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.824+0000 7f0ac1ffb640 1 -- 172.21.15.120:0/3122032072 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0bd4017af0 con 0x55649c5ebd90 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.824+0000 7f0ac1ffb640 1 --2- 172.21.15.120:0/3122032072 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ab403c780 0x7f0ab403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.824+0000 7f0ac1ffb640 1 -- 172.21.15.120:0/3122032072 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f0bd400e040 con 0x55649c5ebd90 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.824+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/3122032072 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ab403c780 0x7f0ab403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.824+0000 7f0be0340800 1 Processor -- start 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.824+0000 7f0be0340800 1 -- start start 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.824+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/3122032072 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ab403c780 0x7f0ab403ec40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55649c5d26e0 tx=0x7f0bcc00def0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0be0340800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0be0340800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55649c5cc370 con 0x55649c5f8890 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0bdc8ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0bdc8ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5f8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42142/0 (socket says 172.21.15.120:42142) 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/2910116584 learned_addr learned my addr 172.21.15.120:0/2910116584 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/2910116584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649c5f9280 con 0x55649c5f8890 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0bdc8ee640 1 --2- 172.21.15.120:0/2910116584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5f8c90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4053e00 tx=0x7f0bd4017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b738b6e1fbfd4c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0abb7fe640 1 -- 172.21.15.120:0/2910116584 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd4014d40 con 0x55649c5f8890 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0abb7fe640 1 -- 172.21.15.120:0/2910116584 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd4051070 con 0x55649c5f8890 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.825+0000 7f0abb7fe640 1 -- 172.21.15.120:0/2910116584 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd40149b0 con 0x55649c5f8890 2024-09-07T03:32:35.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 -- 172.21.15.120:0/2910116584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 msgr2=0x55649c5f8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 --2- 172.21.15.120:0/2910116584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5f8c90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4053e00 tx=0x7f0bd4017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 -- 172.21.15.120:0/2910116584 shutdown_connections 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 --2- 172.21.15.120:0/2910116584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5f8c90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 -- 172.21.15.120:0/2910116584 >> 172.21.15.120:0/2910116584 conn(0x55649c5f4c90 msgr2=0x55649c5f2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 -- 172.21.15.120:0/2910116584 shutdown_connections 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 -- 172.21.15.120:0/2910116584 wait complete. 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 Processor -- start 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 -- start start 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0be0340800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55649c5f98a0 con 0x55649c5f8890 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0bdc8ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0bdc8ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42154/0 (socket says 172.21.15.120:42154) 2024-09-07T03:32:35.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.826+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 learned_addr learned my addr 172.21.15.120:0/3794111697 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.827+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649c600460 con 0x55649c5f8890 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.827+0000 7f0bdc8ee640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5fff00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4012500 tx=0x7f0bd4053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.827+0000 7f0ab9ffb640 1 -- 172.21.15.120:0/3794111697 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd4028820 con 0x55649c5f8890 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.827+0000 7f0ab9ffb640 1 -- 172.21.15.120:0/3794111697 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd402e070 con 0x55649c5f8890 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.827+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55649c6006f0 con 0x55649c5f8890 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.827+0000 7f0ab9ffb640 1 -- 172.21.15.120:0/3794111697 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bd40127a0 con 0x55649c5f8890 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.827+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649c601070 con 0x55649c5f8890 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.828+0000 7f0ab9ffb640 1 -- 172.21.15.120:0/3794111697 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0bd4039060 con 0x55649c5f8890 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.828+0000 7f0ab9ffb640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0aac03c780 0x7f0aac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.828+0000 7f0ab9ffb640 1 -- 172.21.15.120:0/3794111697 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f0bd4033c90 con 0x55649c5f8890 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.828+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0aac03c780 0x7f0aac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.828+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.828+0000 7f0be0340800 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c60b850 0x55649c60dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.828+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c60e460 con 0x55649c60b850 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.828+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0aac03c780 0x7f0aac03ec40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc01a6a0 tx=0x7f0bcc049000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.828+0000 7f0bdb8ec640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c60b850 0x55649c60dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0bdb8ec640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c60b850 0x55649c60dd10 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 20 realm 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c60e890 con 0x55649c60b850 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c60f160 con 0x55649c60b850 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c60fb80 0x55649c611f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.829+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c6126e0 con 0x55649c60fb80 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0bdc8ee640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c60fb80 0x55649c611f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0bdc8ee640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c60fb80 0x55649c611f70 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0be0340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c612f80 con 0x55649c60fb80 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0be0340800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0be0340800 20 searching for the correct realm 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0be0340800 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55649c614cf0 0x55649c617120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c614cf0 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.830+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55649c614cf0 0x55649c617120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.831+0000 7f0bdc0ed640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55649c614cf0 0x55649c617120 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.831+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.831+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60fb80 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.831+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.831+0000 7f0bdc8ee640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0bd403b070 0x7f0bd4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.831+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x7f0bd403b070 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.832+0000 7f0bdb8ec640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0bd403b070 0x7f0bd4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.832+0000 7f0bdb8ec640 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0bd403b070 0x7f0bd4055b00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:35.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.832+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.832+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.832+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.832+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.832+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.832+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c614cf0 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.833+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.833+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.833+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.833+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60fb80 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.833+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.833+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60fb80 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x7f0bd403b070 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x7f0bd403b070 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.834+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60fb80 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.835+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.835+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c614cf0 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.835+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.835+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.835+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.835+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60fb80 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.835+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.835+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c614cf0 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c614cf0 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.836+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x7f0bd403b070 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.837+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.837+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60b850 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.837+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.837+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x7f0bd403b070 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.837+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.837+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c614cf0 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.837+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.837+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x7f0bd403b070 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.837+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.838+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60fb80 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.838+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.838+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60fb80 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.838+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.838+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c614cf0 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.838+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.838+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60fb80 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55649c6177f0 con 0x55649c60fb80 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c613900 con 0x55649c60b850 2024-09-07T03:32:35.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c613cf0 con 0x55649c60fb80 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.839+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c614150 con 0x55649c60b850 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 zone default found 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 4 Realm: () 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:35.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 zonegroup default 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c617cc0 con 0x7f0bd403b070 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c619f80 con 0x55649c614cf0 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c61a350 con 0x55649c614cf0 2024-09-07T03:32:35.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 started sync module instance, tier type = 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.840+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c619410 con 0x55649c60fb80 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.842+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.842+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93890608732160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61ac60 con 0x55649c60fb80 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.842+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61ac60 con 0x55649c60b850 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.842+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93890608732160] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.843+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.843+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93890608736176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61b570 con 0x55649c60b850 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.843+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61c070 con 0x55649c60fb80 2024-09-07T03:32:35.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.844+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93890608736176] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.844+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.844+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93890608741216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61c030 con 0x55649c60fb80 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.844+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61cb50 con 0x7f0bd403b070 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.845+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.845+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93890608744032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61cff0 con 0x7f0bd403b070 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.845+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61db10 con 0x55649c60fb80 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.846+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93890608741216] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.847+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93890608744032] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.848+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.848+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93890608745088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61dad0 con 0x55649c60fb80 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.848+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61dad0 con 0x55649c614cf0 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.849+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93890608745088] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.849+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.849+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93890608748000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61e3b0 con 0x55649c614cf0 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.849+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61ed70 con 0x55649c614cf0 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.850+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93890608748000] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.851+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.851+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93890608752832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61ece0 con 0x55649c614cf0 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.851+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61fc30 con 0x7f0bd403b070 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93890608752832] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93890608755040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c61fc30 con 0x7f0bd403b070 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0be0340800 20 add_watcher() i=0 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0be0340800 20 add_watcher() i=1 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0be0340800 20 add_watcher() i=2 2024-09-07T03:32:35.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0be0340800 20 add_watcher() i=3 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0be0340800 20 add_watcher() i=4 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0be0340800 20 add_watcher() i=5 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.852+0000 7f0be0340800 20 add_watcher() i=6 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.853+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93890608755040] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.853+0000 7f0be0340800 20 add_watcher() i=7 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.853+0000 7f0be0340800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.853+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c6230b0 con 0x55649c60b850 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.853+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.853+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93890608757072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c6205d0 con 0x55649c60b850 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.854+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93890608757072] v34'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0a927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0be0340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0be0340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:35.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0be0340800 5 note: GC not initialized 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0a917e2640 20 reqs_thread_entry: start 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0be0340800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0be0340800 20 Filter name: none 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0a02ffd640 20 reqs_thread_entry: start 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c655c90 con 0x55649c60b850 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.855+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.856+0000 7f0be0340800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.856+0000 7f0be0340800 20 rados->read ofs=0 len=0 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.856+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c656550 con 0x55649c60b850 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.856+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.856+0000 7f0be0340800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.856+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55649c657560 con 0x7f0bd403b070 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.856+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.857+0000 7f0a927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.857+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93890608757072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c653bb0 con 0x55649c60b850 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.858+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93890608757072] v34'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.858+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93890608732160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c653bb0 con 0x55649c60fb80 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.860+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93890608732160] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.860+0000 7f0be0340800 20 remove_watcher() i=0 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.860+0000 7f0be0340800 2 removed watcher, disabling cache 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.860+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93890608736176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c653bb0 con 0x55649c60b850 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.861+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93890608736176] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x55649c60b850 2024-09-07T03:32:35.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.861+0000 7f0be0340800 20 remove_watcher() i=1 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.861+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93890608741216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c653bb0 con 0x55649c60fb80 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.862+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93890608741216] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.862+0000 7f0be0340800 20 remove_watcher() i=2 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.862+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93890608744032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c653bb0 con 0x7f0bd403b070 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.863+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93890608744032] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.863+0000 7f0be0340800 20 remove_watcher() i=3 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.863+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93890608745088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c653bb0 con 0x55649c60fb80 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.864+0000 7f0bdc8ee640 1 -- 172.21.15.120:0/3794111697 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93890608745088] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd4027070 con 0x55649c60fb80 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.864+0000 7f0be0340800 20 remove_watcher() i=4 2024-09-07T03:32:35.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.864+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93890608748000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c653bb0 con 0x55649c614cf0 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.865+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93890608748000] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.865+0000 7f0be0340800 20 remove_watcher() i=5 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.865+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93890608752832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c653bb0 con 0x55649c614cf0 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.866+0000 7f0bdc0ed640 1 -- 172.21.15.120:0/3794111697 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93890608752832] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bcc034040 con 0x55649c614cf0 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.866+0000 7f0be0340800 20 remove_watcher() i=6 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.866+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93890608755040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55649c653bb0 con 0x7f0bd403b070 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93890608755040] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bd0051070 con 0x7f0bd403b070 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 20 remove_watcher() i=7 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c60fb80 msgr2=0x55649c611f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c60fb80 0x55649c611f70 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c60b850 msgr2=0x55649c60dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c60b850 0x55649c60dd10 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0bd403b070 msgr2=0x7f0bd4055b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0bd403b070 0x7f0bd4055b00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55649c614cf0 msgr2=0x55649c617120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55649c614cf0 0x55649c617120 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0aac03c780 msgr2=0x7f0aac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0aac03c780 0x7f0aac03ec40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc01a6a0 tx=0x7f0bcc049000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 msgr2=0x55649c5fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 --2- 172.21.15.120:0/3794111697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5f8890 0x55649c5fff00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4012500 tx=0x7f0bd4053d60 comp rx=0 tx=0).stop 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 reap_dead start 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0bdb8ec640 1 -- 172.21.15.120:0/3794111697 reap_dead start 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 shutdown_connections 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.867+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 >> 172.21.15.120:0/3794111697 conn(0x55649c5f4c90 msgr2=0x55649c5f2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 shutdown_connections 2024-09-07T03:32:35.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/3794111697 wait complete. 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/3122032072 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ab403c780 msgr2=0x7f0ab403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/3122032072 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ab403c780 0x7f0ab403ec40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55649c5d26e0 tx=0x7f0bcc00def0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/3122032072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5ebd90 msgr2=0x55649c5ec1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/3122032072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5ebd90 0x55649c5ec1b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4016d20 tx=0x7f0bd400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/3122032072 shutdown_connections 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/3122032072 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ab403c780 0x7f0ab403ec40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/3122032072 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c5ebd90 0x55649c5ec1b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/3122032072 >> 172.21.15.120:0/3122032072 conn(0x55649c5e0140 msgr2=0x55649c5e0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/3122032072 shutdown_connections 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/3122032072 wait complete. 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c5d9410 msgr2=0x55649c5db8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c5d9410 0x55649c5db8b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c4da200 msgr2=0x55649c5d8620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c4da200 0x55649c5d8620 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ac403c730 msgr2=0x7f0ac403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ac403c730 0x7f0ac403ebf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0057000 tx=0x7f0bd0052000 comp rx=0 tx=0).stop 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 msgr2=0x55649c5d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c5d0fd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c010 tx=0x7f0bcc000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 shutdown_connections 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55649c5d9410 0x55649c5db8b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55649c4da200 0x55649c5d8620 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ac403c730 0x7f0ac403ebf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 --2- 172.21.15.120:0/2398561456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55649c4d8df0 0x55649c5d0fd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.868+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 >> 172.21.15.120:0/2398561456 conn(0x55649c4d41c0 msgr2=0x55649c5c26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.869+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 shutdown_connections 2024-09-07T03:32:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:35.869+0000 7f0be0340800 1 -- 172.21.15.120:0/2398561456 wait complete. 2024-09-07T03:32:35.935 INFO:teuthology.orchestra.run.smithi120.stdout:["myfoo"] 2024-09-07T03:32:35.936 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-07T03:32:36.003 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:36.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-07T03:32:36.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-07T03:32:36.004 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-07T03:32:36.046 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:36.046 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:36.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092e440800 1 Processor -- start 2024-09-07T03:32:36.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092e440800 1 -- start start 2024-09-07T03:32:36.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092e440800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d80fc5c200 0x55d80fc61da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092e440800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d80fb05e40 con 0x55d80fc5adf0 2024-09-07T03:32:36.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092e440800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d80fad0680 con 0x55d80fc5c200 2024-09-07T03:32:36.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092b729640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d80fc5c200 0x55d80fc61da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092bf2a640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55d80fc5adf0 0x55d80fc5baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48434/0 (socket says 172.21.15.120:48434) 2024-09-07T03:32:36.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092bf2a640 1 -- 172.21.15.120:0/15943226 learned_addr learned my addr 172.21.15.120:0/15943226 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:36.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092b729640 1 -- 172.21.15.120:0/15943226 >> v1:172.21.15.104:6789/0 conn(0x55d80fc5adf0 legacy=0x55d80fc5baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.046+0000 7f092b729640 1 -- 172.21.15.120:0/15943226 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80faec6b0 con 0x55d80fc5c200 2024-09-07T03:32:36.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.048+0000 7f092b729640 1 --2- 172.21.15.120:0/15943226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5c200 0x55d80fc61da0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f092000a470 tx=0x7f0920045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca3cb21b84ee2c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.048+0000 7f092af28640 1 -- 172.21.15.120:0/15943226 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0920053570 con 0x55d80fc5c200 2024-09-07T03:32:36.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.048+0000 7f092af28640 1 -- 172.21.15.120:0/15943226 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0920058070 con 0x55d80fc5c200 2024-09-07T03:32:36.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.048+0000 7f092af28640 1 -- 172.21.15.120:0/15943226 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0920053880 con 0x55d80fc5c200 2024-09-07T03:32:36.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.049+0000 7f092e440800 1 -- 172.21.15.120:0/15943226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5c200 msgr2=0x55d80fc61da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.049+0000 7f092e440800 1 --2- 172.21.15.120:0/15943226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5c200 0x55d80fc61da0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f092000a470 tx=0x7f0920045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:36.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.049+0000 7f092e440800 1 -- 172.21.15.120:0/15943226 shutdown_connections 2024-09-07T03:32:36.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.049+0000 7f092e440800 1 --2- 172.21.15.120:0/15943226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5c200 0x55d80fc61da0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.049+0000 7f092e440800 1 -- 172.21.15.120:0/15943226 >> 172.21.15.120:0/15943226 conn(0x55d80fc561e0 msgr2=0x55d80fc58620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.049+0000 7f092e440800 1 -- 172.21.15.120:0/15943226 shutdown_connections 2024-09-07T03:32:36.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.049+0000 7f092e440800 1 -- 172.21.15.120:0/15943226 wait complete. 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.062+0000 7f092e440800 1 Processor -- start 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.063+0000 7f092e440800 1 -- start start 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.063+0000 7f092e440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fd4a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.063+0000 7f092e440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d80faf4dd0 con 0x55d80fc5adf0 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.063+0000 7f092bf2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fd4a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.063+0000 7f092bf2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fd4a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42172/0 (socket says 172.21.15.120:42172) 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.063+0000 7f092bf2a640 1 -- 172.21.15.120:0/1423680543 learned_addr learned my addr 172.21.15.120:0/1423680543 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.063+0000 7f092bf2a640 1 -- 172.21.15.120:0/1423680543 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80fb0de10 con 0x55d80fc5adf0 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.063+0000 7f092bf2a640 1 --2- 172.21.15.120:0/1423680543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fd4a510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f091c001e40 tx=0x7f091c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d25774338dd7a91 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f0819e0b640 1 -- 172.21.15.120:0/1423680543 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f091c012020 con 0x55d80fc5adf0 2024-09-07T03:32:36.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f0819e0b640 1 -- 172.21.15.120:0/1423680543 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c00e5a0 con 0x55d80fc5adf0 2024-09-07T03:32:36.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f0819e0b640 1 -- 172.21.15.120:0/1423680543 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f091c00e8a0 con 0x55d80fc5adf0 2024-09-07T03:32:36.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f092e440800 1 -- 172.21.15.120:0/1423680543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 msgr2=0x55d80fd4a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f092e440800 1 --2- 172.21.15.120:0/1423680543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fd4a510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f091c001e40 tx=0x7f091c001e70 comp rx=0 tx=0).stop 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f092e440800 1 -- 172.21.15.120:0/1423680543 shutdown_connections 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f092e440800 1 --2- 172.21.15.120:0/1423680543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fd4a510 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f092e440800 1 -- 172.21.15.120:0/1423680543 >> 172.21.15.120:0/1423680543 conn(0x55d80fc561e0 msgr2=0x55d80fd45e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f092e440800 1 -- 172.21.15.120:0/1423680543 shutdown_connections 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.064+0000 7f092e440800 1 -- 172.21.15.120:0/1423680543 wait complete. 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.065+0000 7f092e440800 1 Processor -- start 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.065+0000 7f092e440800 1 -- start start 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.065+0000 7f092e440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fbcf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.065+0000 7f092e440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d80fc5c8f0 con 0x55d80fc5adf0 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.065+0000 7f092bf2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fbcf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.065+0000 7f092bf2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fbcf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42180/0 (socket says 172.21.15.120:42180) 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.065+0000 7f092bf2a640 1 -- 172.21.15.120:0/3378948844 learned_addr learned my addr 172.21.15.120:0/3378948844 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.065+0000 7f092bf2a640 1 -- 172.21.15.120:0/3378948844 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80fbcfad0 con 0x55d80fc5adf0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.066+0000 7f092bf2a640 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fbcf570 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c010 tx=0x7f091c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.066+0000 7f0813fff640 1 -- 172.21.15.120:0/3378948844 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f091c012030 con 0x55d80fc5adf0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.066+0000 7f0813fff640 1 -- 172.21.15.120:0/3378948844 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c0014a0 con 0x55d80fc5adf0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.066+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d80fd55c00 con 0x55d80fc5adf0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.066+0000 7f0813fff640 1 -- 172.21.15.120:0/3378948844 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f091c01a7a0 con 0x55d80fc5adf0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.066+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80fd561c0 con 0x55d80fc5adf0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.067+0000 7f0813fff640 1 -- 172.21.15.120:0/3378948844 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f091c015020 con 0x55d80fc5adf0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.067+0000 7f0813fff640 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f081403c730 0x7f081403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.067+0000 7f0813fff640 1 -- 172.21.15.120:0/3378948844 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f091c020030 con 0x55d80fc5adf0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.067+0000 7f092b729640 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f081403c730 0x7f081403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.067+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fc5c200 0x55d80fd5a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.067+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd5a7c0 con 0x55d80fc5c200 2024-09-07T03:32:36.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.067+0000 7f092c72b640 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fc5c200 0x55d80fd5a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.067+0000 7f092b729640 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f081403c730 0x7f081403ebf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0920057000 tx=0x7f0920052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.067+0000 7f092c72b640 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fc5c200 0x55d80fd5a150 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.068+0000 7f092c72b640 1 -- 172.21.15.120:0/3378948844 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f092400a4d0 con 0x55d80fc5c200 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.068+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd5b5b0 0x55d80fd5d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.068+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd5dfe0 con 0x55d80fd5b5b0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.068+0000 7f092bf2a640 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd5b5b0 0x55d80fd5d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.068+0000 7f092bf2a640 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd5b5b0 0x55d80fd5d9a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.069+0000 7f092bf2a640 1 -- 172.21.15.120:0/3378948844 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f091c01ab20 con 0x55d80fd5b5b0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.069+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd5f890 con 0x55d80fd5b5b0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.069+0000 7f092bf2a640 1 -- 172.21.15.120:0/3378948844 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f091c01ab20 con 0x55d80fd5b5b0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.069+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd5ea00 con 0x55d80fd5b5b0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.069+0000 7f092bf2a640 1 -- 172.21.15.120:0/3378948844 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f091c01ab20 con 0x55d80fd5b5b0 2024-09-07T03:32:36.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.069+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd5ee20 con 0x55d80fc5c200 2024-09-07T03:32:36.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.069+0000 7f092c72b640 1 -- 172.21.15.120:0/3378948844 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f092400a4d0 con 0x55d80fc5c200 2024-09-07T03:32:36.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.070+0000 7f092e440800 1 Processor -- start 2024-09-07T03:32:36.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.070+0000 7f092e440800 1 -- start start 2024-09-07T03:32:36.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.070+0000 7f092e440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd6dd50 0x55d80fd6e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.070+0000 7f092e440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d80fb52a00 con 0x55d80fd6dd50 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.070+0000 7f092c72b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd6dd50 0x55d80fd6e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.070+0000 7f092c72b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd6dd50 0x55d80fd6e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42196/0 (socket says 172.21.15.120:42196) 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.070+0000 7f092c72b640 1 -- 172.21.15.120:0/944773464 learned_addr learned my addr 172.21.15.120:0/944773464 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.070+0000 7f092c72b640 1 -- 172.21.15.120:0/944773464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80fd6e7b0 con 0x55d80fd6dd50 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.071+0000 7f092c72b640 1 --2- 172.21.15.120:0/944773464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd6dd50 0x55d80fd6e170 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0924016d20 tx=0x7f092400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.071+0000 7f08117fa640 1 -- 172.21.15.120:0/944773464 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0924017660 con 0x55d80fd6dd50 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.071+0000 7f08117fa640 1 -- 172.21.15.120:0/944773464 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092401b030 con 0x55d80fd6dd50 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.071+0000 7f092e440800 1 -- 172.21.15.120:0/944773464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d80fd6efe0 con 0x55d80fd6dd50 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.071+0000 7f08117fa640 1 -- 172.21.15.120:0/944773464 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0924017950 con 0x55d80fd6dd50 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.071+0000 7f092e440800 1 -- 172.21.15.120:0/944773464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80fd6f580 con 0x55d80fd6dd50 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f08117fa640 1 -- 172.21.15.120:0/944773464 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0924017af0 con 0x55d80fd6dd50 2024-09-07T03:32:36.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f08117fa640 1 --2- 172.21.15.120:0/944773464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f080403c780 0x7f080403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f08117fa640 1 -- 172.21.15.120:0/944773464 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f092400e040 con 0x55d80fd6dd50 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f092bf2a640 1 --2- 172.21.15.120:0/944773464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f080403c780 0x7f080403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f092e440800 1 Processor -- start 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f092e440800 1 -- start start 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f092bf2a640 1 --2- 172.21.15.120:0/944773464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f080403c780 0x7f080403ec40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55d80fd5ad70 tx=0x7f091c00def0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f092e440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd53040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f092e440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d80fd4ad60 con 0x55d80fd52c40 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.072+0000 7f092c72b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd53040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092c72b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd53040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42208/0 (socket says 172.21.15.120:42208) 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092c72b640 1 -- 172.21.15.120:0/4159384183 learned_addr learned my addr 172.21.15.120:0/4159384183 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092c72b640 1 -- 172.21.15.120:0/4159384183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80fd53580 con 0x55d80fd52c40 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092c72b640 1 --2- 172.21.15.120:0/4159384183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd53040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0924017f20 tx=0x7f0924028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1de50b18dbe3ed server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f080affd640 1 -- 172.21.15.120:0/4159384183 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09240149b0 con 0x55d80fd52c40 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f080affd640 1 -- 172.21.15.120:0/4159384183 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0924028350 con 0x55d80fd52c40 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f080affd640 1 -- 172.21.15.120:0/4159384183 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0924014b50 con 0x55d80fd52c40 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092e440800 1 -- 172.21.15.120:0/4159384183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 msgr2=0x55d80fd53040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092e440800 1 --2- 172.21.15.120:0/4159384183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd53040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0924017f20 tx=0x7f0924028e80 comp rx=0 tx=0).stop 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092e440800 1 -- 172.21.15.120:0/4159384183 shutdown_connections 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092e440800 1 --2- 172.21.15.120:0/4159384183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd53040 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092e440800 1 -- 172.21.15.120:0/4159384183 >> 172.21.15.120:0/4159384183 conn(0x55d80fd76bf0 msgr2=0x55d80fd74e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092e440800 1 -- 172.21.15.120:0/4159384183 shutdown_connections 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.073+0000 7f092e440800 1 -- 172.21.15.120:0/4159384183 wait complete. 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.074+0000 7f092e440800 1 Processor -- start 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.074+0000 7f092e440800 1 -- start start 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.074+0000 7f092e440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd840b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.074+0000 7f092e440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d80fd51b00 con 0x55d80fd52c40 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.074+0000 7f092c72b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd840b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.074+0000 7f092c72b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd840b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42222/0 (socket says 172.21.15.120:42222) 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.074+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 learned_addr learned my addr 172.21.15.120:0/1372145185 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.074+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80fd84610 con 0x55d80fd52c40 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.074+0000 7f092c72b640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd840b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0924017f20 tx=0x7f0924053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.075+0000 7f08097fa640 1 -- 172.21.15.120:0/1372145185 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f092404c070 con 0x55d80fd52c40 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.075+0000 7f08097fa640 1 -- 172.21.15.120:0/1372145185 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09240129b0 con 0x55d80fd52c40 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.075+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d80fd848a0 con 0x55d80fd52c40 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.075+0000 7f08097fa640 1 -- 172.21.15.120:0/1372145185 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0924012c90 con 0x55d80fd52c40 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.075+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80fd85220 con 0x55d80fd52c40 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.075+0000 7f08097fa640 1 -- 172.21.15.120:0/1372145185 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f09240135c0 con 0x55d80fd52c40 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.076+0000 7f08097fa640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f07f403c780 0x7f07f403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.076+0000 7f08097fa640 1 -- 172.21.15.120:0/1372145185 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f092403bb40 con 0x55d80fd52c40 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.076+0000 7f092bf2a640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f07f403c780 0x7f07f403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.076+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.076+0000 7f092bf2a640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f07f403c780 0x7f07f403ec40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f091c01a6a0 tx=0x7f091c049000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.076+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fd8faf0 0x55d80fd91fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.076+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd92700 con 0x55d80fd8faf0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.076+0000 7f092b729640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fd8faf0 0x55d80fd91fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.076+0000 7f092b729640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fd8faf0 0x55d80fd91fb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 20 realm 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd92b30 con 0x55d80fd8faf0 2024-09-07T03:32:36.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd93400 con 0x55d80fd8faf0 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd93e20 0x55d80fd96210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd96980 con 0x55d80fd93e20 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.077+0000 7f092c72b640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd93e20 0x55d80fd96210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092c72b640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd93e20 0x55d80fd96210 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092e440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd97220 con 0x55d80fd93e20 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092e440800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092e440800 20 searching for the correct realm 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d80fd98f90 0x55d80fd9b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd98f90 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.078+0000 7f092bf2a640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d80fd98f90 0x55d80fd9b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.079+0000 7f092bf2a640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d80fd98f90 0x55d80fd9b3c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.079+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.079+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd93e20 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.079+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.079+0000 7f092c72b640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0924014440 0x7f09240138b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.079+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x7f0924014440 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.079+0000 7f092b729640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0924014440 0x7f09240138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.079+0000 7f092b729640 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0924014440 0x7f09240138b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.080+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.080+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.080+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.080+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.080+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.080+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd98f90 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.080+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.080+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.081+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.081+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd93e20 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.081+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.081+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd93e20 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.081+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.081+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.081+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.081+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x7f0924014440 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.082+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.082+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.082+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.082+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x7f0924014440 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.082+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.082+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd93e20 2024-09-07T03:32:36.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.082+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.082+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd98f90 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.083+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.083+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.083+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.083+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd93e20 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.083+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.083+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd98f90 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.083+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.083+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.084+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.084+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.084+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.084+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.084+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.084+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd98f90 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.084+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.084+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x7f0924014440 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.084+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.085+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd8faf0 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.085+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.085+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x7f0924014440 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.085+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.085+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd98f90 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.085+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.085+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x7f0924014440 2024-09-07T03:32:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.085+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.085+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd93e20 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.086+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.086+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd93e20 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.086+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.086+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd98f90 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.086+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.086+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd93e20 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.086+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.086+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ba90 con 0x55d80fd93e20 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd97b70 con 0x55d80fd8faf0 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd97f60 con 0x55d80fd93e20 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd983c0 con 0x55d80fd8faf0 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.087+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 zone default found 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 4 Realm: () 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 zonegroup default 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9bf60 con 0x7f0924014440 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9e240 con 0x55d80fd98f90 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9e610 con 0x55d80fd98f90 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 started sync module instance, tier type = 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.088+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9d6d0 con 0x55d80fd93e20 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.089+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.089+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94386467232448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9ef00 con 0x55d80fd93e20 2024-09-07T03:32:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.089+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.091+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94386467232448] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.091+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.091+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94386467236704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9faf0 con 0x55d80fd8faf0 2024-09-07T03:32:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.091+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda04b0 con 0x55d80fd93e20 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.092+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94386467236704] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.092+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.092+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94386467237760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda04b0 con 0x55d80fd93e20 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.092+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda0e70 con 0x7f0924014440 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.093+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.093+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94386467244480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda0de0 con 0x7f0924014440 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.093+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x55d80fd93e20 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.094+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94386467237760] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.094+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94386467244480] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.094+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.094+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94386467246688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x55d80fd93e20 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.095+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda26c0 con 0x55d80fd98f90 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.096+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.096+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94386467250704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x55d80fd98f90 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.096+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda3620 con 0x55d80fd98f90 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.096+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94386467246688] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.097+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.097+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94386467241984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda3a40 con 0x55d80fd98f90 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.097+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda4440 con 0x7f0924014440 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.097+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94386467250704] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94386467241984] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94386467254576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda3f50 con 0x7f0924014440 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092e440800 20 add_watcher() i=0 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092e440800 20 add_watcher() i=1 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092e440800 20 add_watcher() i=2 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092e440800 20 add_watcher() i=3 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092e440800 20 add_watcher() i=4 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092e440800 20 add_watcher() i=5 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.098+0000 7f092e440800 20 add_watcher() i=6 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.099+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94386467254576] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.099+0000 7f092e440800 20 add_watcher() i=7 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.099+0000 7f092e440800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.099+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda4400 con 0x55d80fd8faf0 2024-09-07T03:32:36.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.099+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.099+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94386467252832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda48b0 con 0x55d80fd8faf0 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.100+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94386467252832] v34'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.100+0000 7f07e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.100+0000 7f092e440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.100+0000 7f092e440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.100+0000 7f092e440800 5 note: GC not initialized 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.100+0000 7f07e0fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.101+0000 7f092e440800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.101+0000 7f092e440800 20 Filter name: none 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.101+0000 7f075a7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.101+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fdd9be0 con 0x55d80fd98f90 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.101+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(62 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.101+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x55d80fd93e20 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.101+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(63 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.101+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9d6d0 con 0x55d80fd8faf0 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.102+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 [pgnls start_epoch 34 out=49b] v34'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.102+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.102+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 [pgnls start_epoch 34 out=49b] v34'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.102+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x7f0924014440 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.102+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(66 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.102+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd93e20 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.103+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.103+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.103+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.103+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd98f90 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.103+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(69 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.103+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x7f0924014440 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.103+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 [pgnls start_epoch 34 out=49b] v34'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.103+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd93e20 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.104+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(71 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.104+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.104+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(72 [pgnls start_epoch 34 out=127b] v34'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.104+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd98f90 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.104+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.104+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.104+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(74 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.104+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd98f90 2024-09-07T03:32:36.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.105+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(75 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.105+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x7f0924014440 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.105+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(76 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.105+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd98f90 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.105+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(77 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.105+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.105+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(78 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.105+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd93e20 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.106+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(79 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.106+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x7f0924014440 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.106+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(80 [pgnls start_epoch 34 out=70b] v34'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.106+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd93e20 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.106+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(81 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.106+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.106+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(82 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.106+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd98f90 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.107+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(83 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.107+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x7f0924014440 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.107+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(84 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.107+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.107+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(85 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.107+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.107+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(86 [pgnls start_epoch 34 out=49b] v34'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.107+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd98f90 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.108+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 [pgnls start_epoch 34 out=49b] v34'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.108+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd98f90 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.108+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.108+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x7f0924014440 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.108+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(89 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.108+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd8faf0 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.108+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(90 [pgnls start_epoch 34 out=49b] v34'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.108+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd93e20 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.109+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(91 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.109+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x55d80fd98f90 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.109+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(92 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.109+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9f750 con 0x7f0924014440 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.109+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(93 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.109+0000 7f092e440800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:36.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.109+0000 7f092e440800 20 RGWRados::pool_iterate: got myfoo 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.110+0000 7f07e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.110+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94386467252832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x55d80fd8faf0 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.111+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94386467252832] v34'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.111+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94386467232448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fd9d6d0 con 0x55d80fd93e20 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.112+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94386467232448] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.112+0000 7f092e440800 20 remove_watcher() i=0 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.112+0000 7f092e440800 2 removed watcher, disabling cache 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.112+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94386467236704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x55d80fd8faf0 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.113+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94386467236704] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920051070 con 0x55d80fd8faf0 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.113+0000 7f092e440800 20 remove_watcher() i=1 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.113+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94386467237760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x55d80fd93e20 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.117+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94386467237760] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.117+0000 7f092e440800 20 remove_watcher() i=2 2024-09-07T03:32:36.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.117+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94386467244480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x7f0924014440 2024-09-07T03:32:36.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.118+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94386467244480] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.118+0000 7f092e440800 20 remove_watcher() i=3 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.118+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94386467246688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x55d80fd93e20 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.121+0000 7f092c72b640 1 -- 172.21.15.120:0/1372145185 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94386467246688] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0924027070 con 0x55d80fd93e20 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.121+0000 7f092e440800 20 remove_watcher() i=4 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.121+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94386467250704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fda1e20 con 0x55d80fd98f90 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.122+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94386467250704] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.122+0000 7f092e440800 20 remove_watcher() i=5 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.122+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94386467241984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fdd7e00 con 0x55d80fd98f90 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.124+0000 7f092bf2a640 1 -- 172.21.15.120:0/1372145185 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94386467241984] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f091c034040 con 0x55d80fd98f90 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.124+0000 7f092e440800 20 remove_watcher() i=6 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.124+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94386467254576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d80fdd7e00 con 0x7f0924014440 2024-09-07T03:32:36.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94386467254576] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0920051070 con 0x7f0924014440 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 20 remove_watcher() i=7 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd93e20 msgr2=0x55d80fd96210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd93e20 0x55d80fd96210 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fd8faf0 msgr2=0x55d80fd91fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fd8faf0 0x55d80fd91fb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0924014440 msgr2=0x7f09240138b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0924014440 0x7f09240138b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d80fd98f90 msgr2=0x55d80fd9b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d80fd98f90 0x55d80fd9b3c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f07f403c780 msgr2=0x7f07f403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f07f403c780 0x7f07f403ec40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f091c01a6a0 tx=0x7f091c049000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 msgr2=0x55d80fd840b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092b729640 1 -- 172.21.15.120:0/1372145185 reap_dead start 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd840b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0924017f20 tx=0x7f0924053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 shutdown_connections 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 --2- 172.21.15.120:0/1372145185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd52c40 0x55d80fd840b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.125+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 >> 172.21.15.120:0/1372145185 conn(0x55d80fd76bf0 msgr2=0x55d80fd74e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 shutdown_connections 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/1372145185 wait complete. 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/944773464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f080403c780 msgr2=0x7f080403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/944773464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f080403c780 0x7f080403ec40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55d80fd5ad70 tx=0x7f091c00def0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/944773464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd6dd50 msgr2=0x55d80fd6e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/944773464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd6dd50 0x55d80fd6e170 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0924016d20 tx=0x7f092400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/944773464 shutdown_connections 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/944773464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f080403c780 0x7f080403ec40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/944773464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fd6dd50 0x55d80fd6e170 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/944773464 >> 172.21.15.120:0/944773464 conn(0x55d80fd62100 msgr2=0x55d80fd624e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/944773464 shutdown_connections 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/944773464 wait complete. 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd5b5b0 msgr2=0x55d80fd5d9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd5b5b0 0x55d80fd5d9a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fc5c200 msgr2=0x55d80fd5a150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fc5c200 0x55d80fd5a150 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f081403c730 msgr2=0x7f081403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f081403c730 0x7f081403ebf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0920057000 tx=0x7f0920052000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 msgr2=0x55d80fbcf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fbcf570 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c010 tx=0x7f091c000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 shutdown_connections 2024-09-07T03:32:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d80fd5b5b0 0x55d80fd5d9a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d80fc5c200 0x55d80fd5a150 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f081403c730 0x7f081403ebf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 --2- 172.21.15.120:0/3378948844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d80fc5adf0 0x55d80fbcf570 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 >> 172.21.15.120:0/3378948844 conn(0x55d80fc561e0 msgr2=0x55d80fd4b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 shutdown_connections 2024-09-07T03:32:36.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.126+0000 7f092e440800 1 -- 172.21.15.120:0/3378948844 wait complete. 2024-09-07T03:32:36.138 INFO:teuthology.orchestra.run.smithi120.stdout:["myfoo"] 2024-09-07T03:32:36.138 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-07T03:32:36.155 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:36.167 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:36.180 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:36.229 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-07T03:32:36.259 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:36.289 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:36.316 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:36.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-07T03:32:36.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-07T03:32:36.317 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-07T03:32:36.361 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:36.361 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb4d3a800 1 Processor -- start 2024-09-07T03:32:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb4d3a800 1 -- start start 2024-09-07T03:32:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb4d3a800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560b5d9e0de0 0x560b5d9e1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb4d3a800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b5d88be40 con 0x560b5d9e2020 2024-09-07T03:32:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb4d3a800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560b5d856680 con 0x560b5d9e0de0 2024-09-07T03:32:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb0a81640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560b5d9e0de0 0x560b5d9e1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb0280640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x560b5d9e2020 0x560b5d9e6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48442/0 (socket says 172.21.15.120:48442) 2024-09-07T03:32:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb0a81640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560b5d9e0de0 0x560b5d9e1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42226/0 (socket says 172.21.15.120:42226) 2024-09-07T03:32:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb0280640 1 -- 172.21.15.120:0/4278812677 learned_addr learned my addr 172.21.15.120:0/4278812677 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4278812677 >> v1:172.21.15.104:6789/0 conn(0x560b5d9e2020 legacy=0x560b5d9e6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.361+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4278812677 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5d8726b0 con 0x560b5d9e0de0 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.363+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/4278812677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5d9e1ae0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0005fd0 tx=0x7f1ca0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4850fd9e59327a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.363+0000 7f1cafa7f640 1 -- 172.21.15.120:0/4278812677 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca0058530 con 0x560b5d9e0de0 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.363+0000 7f1cafa7f640 1 -- 172.21.15.120:0/4278812677 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca00586d0 con 0x560b5d9e0de0 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.363+0000 7f1cafa7f640 1 -- 172.21.15.120:0/4278812677 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca00589d0 con 0x560b5d9e0de0 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.364+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4278812677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 msgr2=0x560b5d9e1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.364+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4278812677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5d9e1ae0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0005fd0 tx=0x7f1ca0045c30 comp rx=0 tx=0).stop 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.364+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4278812677 shutdown_connections 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.364+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4278812677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5d9e1ae0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.364+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4278812677 >> 172.21.15.120:0/4278812677 conn(0x560b5d9dc1b0 msgr2=0x560b5d9de610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.364+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4278812677 shutdown_connections 2024-09-07T03:32:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.364+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4278812677 wait complete. 2024-09-07T03:32:36.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.377+0000 7f1cb4d3a800 1 Processor -- start 2024-09-07T03:32:36.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.378+0000 7f1cb4d3a800 1 -- start start 2024-09-07T03:32:36.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.378+0000 7f1cb4d3a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.378+0000 7f1cb4d3a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b5d87add0 con 0x560b5d9e0de0 2024-09-07T03:32:36.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.378+0000 7f1cb0a81640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.378+0000 7f1cb0a81640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42238/0 (socket says 172.21.15.120:42238) 2024-09-07T03:32:36.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.378+0000 7f1cb0a81640 1 -- 172.21.15.120:0/177592200 learned_addr learned my addr 172.21.15.120:0/177592200 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.378+0000 7f1cb0a81640 1 -- 172.21.15.120:0/177592200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5d893e10 con 0x560b5d9e0de0 2024-09-07T03:32:36.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.379+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/177592200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad0510 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0025a60 tx=0x7f1ca0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8d5fb956dbf6ea server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.379+0000 7f1b9ee0d640 1 -- 172.21.15.120:0/177592200 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca0058a30 con 0x560b5d9e0de0 2024-09-07T03:32:36.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.379+0000 7f1b9ee0d640 1 -- 172.21.15.120:0/177592200 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca0068070 con 0x560b5d9e0de0 2024-09-07T03:32:36.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.379+0000 7f1b9ee0d640 1 -- 172.21.15.120:0/177592200 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca0058d00 con 0x560b5d9e0de0 2024-09-07T03:32:36.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.379+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/177592200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 msgr2=0x560b5dad0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.379+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/177592200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad0510 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0025a60 tx=0x7f1ca0051000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/177592200 shutdown_connections 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/177592200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad0510 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/177592200 >> 172.21.15.120:0/177592200 conn(0x560b5d9dc1b0 msgr2=0x560b5dacbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/177592200 shutdown_connections 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/177592200 wait complete. 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb4d3a800 1 Processor -- start 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb4d3a800 1 -- start start 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb4d3a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb4d3a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b5d9e2710 con 0x560b5d9e0de0 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb0a81640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb0a81640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42252/0 (socket says 172.21.15.120:42252) 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.380+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4127142031 learned_addr learned my addr 172.21.15.120:0/4127142031 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.381+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4127142031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5dad9330 con 0x560b5d9e0de0 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.381+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad8dd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0025a60 tx=0x7f1ca0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.381+0000 7f1b9d60a640 1 -- 172.21.15.120:0/4127142031 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca0063650 con 0x560b5d9e0de0 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.381+0000 7f1b9d60a640 1 -- 172.21.15.120:0/4127142031 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca00637f0 con 0x560b5d9e0de0 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.381+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b5dad95c0 con 0x560b5d9e0de0 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.381+0000 7f1b9d60a640 1 -- 172.21.15.120:0/4127142031 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca0063b10 con 0x560b5d9e0de0 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.381+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b5dad9fc0 con 0x560b5d9e0de0 2024-09-07T03:32:36.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.382+0000 7f1b9d60a640 1 -- 172.21.15.120:0/4127142031 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1ca0075020 con 0x560b5d9e0de0 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.382+0000 7f1b9d60a640 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b9803c730 0x7f1b9803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.382+0000 7f1b9d60a640 1 -- 172.21.15.120:0/4127142031 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1ca0098080 con 0x560b5d9e0de0 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.382+0000 7f1cb0280640 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b9803c730 0x7f1b9803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.382+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5d9e2020 0x560b5dae0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.382+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5dadabb0 con 0x560b5d9e2020 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.382+0000 7f1cb1282640 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5d9e2020 0x560b5dae0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.382+0000 7f1cb0280640 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b9803c730 0x7f1b9803ebf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c98004170 tx=0x7f1c98001330 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.383+0000 7f1cb1282640 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5d9e2020 0x560b5dae0420 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.383+0000 7f1cb1282640 1 -- 172.21.15.120:0/4127142031 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5d9e2020 2024-09-07T03:32:36.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.383+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5dae13b0 0x560b5dae37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.383+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5dae3e00 con 0x560b5dae13b0 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.383+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5dae13b0 0x560b5dae37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.384+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5dae13b0 0x560b5dae37a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.384+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4127142031 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5dae13b0 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.384+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5dae56b0 con 0x560b5dae13b0 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.384+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4127142031 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5dae13b0 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.384+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5dae47f0 con 0x560b5dae13b0 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.384+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4127142031 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5dae13b0 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.384+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5dae4c50 con 0x560b5d9e2020 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.385+0000 7f1cb1282640 1 -- 172.21.15.120:0/4127142031 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5d9e2020 2024-09-07T03:32:36.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.385+0000 7f1cb4d3a800 1 Processor -- start 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.385+0000 7f1cb4d3a800 1 -- start start 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.385+0000 7f1cb4d3a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5daf3ba0 0x560b5daf3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.385+0000 7f1cb4d3a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b5d8d8a00 con 0x560b5daf3ba0 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.385+0000 7f1cb1282640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5daf3ba0 0x560b5daf3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.386+0000 7f1cb1282640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5daf3ba0 0x560b5daf3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42264/0 (socket says 172.21.15.120:42264) 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.386+0000 7f1cb1282640 1 -- 172.21.15.120:0/1169920917 learned_addr learned my addr 172.21.15.120:0/1169920917 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.386+0000 7f1cb1282640 1 -- 172.21.15.120:0/1169920917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5daf4600 con 0x560b5daf3ba0 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.386+0000 7f1cb1282640 1 --2- 172.21.15.120:0/1169920917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5daf3ba0 0x560b5daf3fc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800aa90 tx=0x7f1ca800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.386+0000 7f1b967fc640 1 -- 172.21.15.120:0/1169920917 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca8007d70 con 0x560b5daf3ba0 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.386+0000 7f1b967fc640 1 -- 172.21.15.120:0/1169920917 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca8018430 con 0x560b5daf3ba0 2024-09-07T03:32:36.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.386+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1169920917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b5daf4e30 con 0x560b5daf3ba0 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.386+0000 7f1b967fc640 1 -- 172.21.15.120:0/1169920917 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca8018750 con 0x560b5daf3ba0 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.386+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1169920917 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b5daf53d0 con 0x560b5daf3ba0 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.387+0000 7f1b967fc640 1 -- 172.21.15.120:0/1169920917 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1ca8020020 con 0x560b5daf3ba0 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.387+0000 7f1b967fc640 1 --2- 172.21.15.120:0/1169920917 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b8803c780 0x7f1b8803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.387+0000 7f1b967fc640 1 -- 172.21.15.120:0/1169920917 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1ca801e020 con 0x560b5daf3ba0 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.387+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/1169920917 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b8803c780 0x7f1b8803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.387+0000 7f1cb4d3a800 1 Processor -- start 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.387+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/1169920917 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b8803c780 0x7f1b8803ec40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x560b5dae0b70 tx=0x7f1ca0088040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1cb4d3a800 1 -- start start 2024-09-07T03:32:36.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1cb4d3a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db00a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1cb4d3a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b5dad0ca0 con 0x560b5db00660 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1cb1282640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db00a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1cb1282640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db00a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42266/0 (socket says 172.21.15.120:42266) 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1cb1282640 1 -- 172.21.15.120:0/1405457441 learned_addr learned my addr 172.21.15.120:0/1405457441 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1cb1282640 1 -- 172.21.15.120:0/1405457441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5db01050 con 0x560b5db00660 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1cb1282640 1 --2- 172.21.15.120:0/1405457441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db00a60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80531c0 tx=0x7f1ca80206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c529909b4451cb server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1b87fff640 1 -- 172.21.15.120:0/1405457441 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca8020b70 con 0x560b5db00660 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1b87fff640 1 -- 172.21.15.120:0/1405457441 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca8022410 con 0x560b5db00660 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.388+0000 7f1b87fff640 1 -- 172.21.15.120:0/1405457441 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca804c590 con 0x560b5db00660 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1405457441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 msgr2=0x560b5db00a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/1405457441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db00a60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80531c0 tx=0x7f1ca80206e0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1405457441 shutdown_connections 2024-09-07T03:32:36.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/1405457441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db00a60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1405457441 >> 172.21.15.120:0/1405457441 conn(0x560b5dafca80 msgr2=0x560b5dafacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1405457441 shutdown_connections 2024-09-07T03:32:36.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1405457441 wait complete. 2024-09-07T03:32:36.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 Processor -- start 2024-09-07T03:32:36.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 -- start start 2024-09-07T03:32:36.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db07cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb4d3a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560b5db01670 con 0x560b5db00660 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.389+0000 7f1cb1282640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db07cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.390+0000 7f1cb1282640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db07cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42278/0 (socket says 172.21.15.120:42278) 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.390+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 learned_addr learned my addr 172.21.15.120:0/4208504012 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.390+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5db08210 con 0x560b5db00660 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.390+0000 7f1cb1282640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db07cb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8020d60 tx=0x7f1ca8053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.390+0000 7f1b867fc640 1 -- 172.21.15.120:0/4208504012 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca8017e60 con 0x560b5db00660 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.390+0000 7f1b867fc640 1 -- 172.21.15.120:0/4208504012 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca8031020 con 0x560b5db00660 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.390+0000 7f1b867fc640 1 -- 172.21.15.120:0/4208504012 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ca8020b70 con 0x560b5db00660 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.390+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b5db084a0 con 0x560b5db00660 2024-09-07T03:32:36.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.390+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b5db09030 con 0x560b5db00660 2024-09-07T03:32:36.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.391+0000 7f1b867fc640 1 -- 172.21.15.120:0/4208504012 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1ca8016040 con 0x560b5db00660 2024-09-07T03:32:36.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.391+0000 7f1b867fc640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7c03c750 0x7f1b7c03ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.391+0000 7f1b867fc640 1 -- 172.21.15.120:0/4208504012 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1ca8032030 con 0x560b5db00660 2024-09-07T03:32:36.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.391+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7c03c750 0x7f1b7c03ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.391+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.391+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5db137b0 0x560b5db15c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.391+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db163c0 con 0x560b5db137b0 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.391+0000 7f1cb0280640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5db137b0 0x560b5db15c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.391+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7c03c750 0x7f1b7c03ec10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0059f70 tx=0x7f1ca0090000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb0280640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5db137b0 0x560b5db15c70 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c98009050 con 0x560b5db137b0 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 20 realm 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db12b00 con 0x560b5db137b0 2024-09-07T03:32:36.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c98009050 con 0x560b5db137b0 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db16ea0 con 0x560b5db137b0 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c98009050 con 0x560b5db137b0 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5db17c80 0x560b5db1a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.392+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1a700 con 0x560b5db17c80 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb1282640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5db17c80 0x560b5db1a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb1282640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5db17c80 0x560b5db1a070 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb4d3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1afa0 con 0x560b5db17c80 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb4d3a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb4d3a800 20 searching for the correct realm 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560b5db1cd10 0x560b5db1f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db1cd10 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.393+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560b5db1cd10 0x560b5db1f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.394+0000 7f1cb0a81640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560b5db1cd10 0x560b5db1f140 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.394+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.394+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db17c80 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.394+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.394+0000 7f1cb1282640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1ca804cbe0 0x7f1ca801f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.394+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x7f1ca804cbe0 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.394+0000 7f1cb0280640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1ca804cbe0 0x7f1ca801f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.395+0000 7f1cb0280640 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1ca804cbe0 0x7f1ca801f2c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.395+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98009050 con 0x7f1ca804cbe0 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.395+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.395+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98009050 con 0x560b5db137b0 2024-09-07T03:32:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.395+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.395+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.395+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db1cd10 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.396+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.396+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.396+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.396+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db17c80 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.396+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.396+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db17c80 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x7f1ca804cbe0 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x7f1ca804cbe0 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.397+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db17c80 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.398+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.398+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db1cd10 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.398+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.398+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.398+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.398+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db17c80 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.399+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.399+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db1cd10 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.399+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.399+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.399+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.399+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.399+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.399+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.400+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.400+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db1cd10 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.400+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.400+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x7f1ca804cbe0 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.400+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.400+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db137b0 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.400+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.400+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x7f1ca804cbe0 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.401+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.401+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db1cd10 2024-09-07T03:32:36.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.401+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.401+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x7f1ca804cbe0 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.401+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.401+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1f810 con 0x560b5db17c80 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.401+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.401+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ca8068040 con 0x560b5db17c80 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.401+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ca8068040 con 0x560b5db1cd10 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ca8068040 con 0x560b5db17c80 2024-09-07T03:32:36.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ca8068040 con 0x560b5db17c80 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1b7f0 con 0x560b5db137b0 2024-09-07T03:32:36.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.402+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1bbe0 con 0x560b5db17c80 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1bbe0 con 0x560b5db137b0 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 20 zone default found 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 4 Realm: () 2024-09-07T03:32:36.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 20 zonegroup default 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db1b440 con 0x7f1ca804cbe0 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db21800 con 0x560b5db1cd10 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.403+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.404+0000 7f1cb4d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.404+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.404+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db21cc0 con 0x560b5db1cd10 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.404+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.404+0000 7f1cb4d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.404+0000 7f1cb4d3a800 20 started sync module instance, tier type = 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.404+0000 7f1cb4d3a800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.404+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db20b70 con 0x560b5db17c80 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.405+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.405+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94606816579728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db20b70 con 0x560b5db17c80 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.405+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db22800 con 0x560b5db137b0 2024-09-07T03:32:36.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.406+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.406+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94606816579728] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.406+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94606816584432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db23090 con 0x560b5db137b0 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.406+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db23680 con 0x560b5db17c80 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.407+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94606816584432] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.409+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.409+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94606816577216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db23680 con 0x560b5db17c80 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.409+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db240b0 con 0x7f1ca804cbe0 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.411+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.411+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94606816590816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db245a0 con 0x7f1ca804cbe0 2024-09-07T03:32:36.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.411+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db250b0 con 0x560b5db17c80 2024-09-07T03:32:36.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.414+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94606816590816] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.414+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(52 notify.4 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.414+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(49 notify.2 [watch watch cookie 94606816577216] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.414+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94606816594784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db25070 con 0x560b5db17c80 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.415+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db25950 con 0x560b5db1cd10 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.415+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.415+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94606816597152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db25d70 con 0x560b5db1cd10 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.415+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db265c0 con 0x560b5db1cd10 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.416+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.416+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94606816599888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db26a20 con 0x560b5db1cd10 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.417+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db27520 con 0x7f1ca804cbe0 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.417+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94606816594784] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.417+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94606816597152] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.417+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94606816599888] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.418+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.418+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94606816598208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db274e0 con 0x7f1ca804cbe0 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.418+0000 7f1cb4d3a800 20 add_watcher() i=0 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.418+0000 7f1cb4d3a800 20 add_watcher() i=1 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.418+0000 7f1cb4d3a800 20 add_watcher() i=2 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.418+0000 7f1cb4d3a800 20 add_watcher() i=3 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.418+0000 7f1cb4d3a800 20 add_watcher() i=4 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.418+0000 7f1cb4d3a800 20 add_watcher() i=5 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.418+0000 7f1cb4d3a800 20 add_watcher() i=6 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.419+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94606816598208] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.419+0000 7f1cb4d3a800 20 add_watcher() i=7 2024-09-07T03:32:36.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.419+0000 7f1cb4d3a800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.419+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db22ba0 con 0x560b5db137b0 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.419+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.419+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94606816604176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db22ba0 con 0x560b5db137b0 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.420+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94606816604176] v34'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1b66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1cb4d3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1cb4d3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1cb4d3a800 5 note: GC not initialized 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1b65fe3640 20 reqs_thread_entry: start 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1cb4d3a800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1cb4d3a800 20 Filter name: none 2024-09-07T03:32:36.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1ad77fe640 20 reqs_thread_entry: start 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.421+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5d110 con 0x7f1ca804cbe0 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb4d3a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5d9a0 con 0x560b5db137b0 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb4d3a800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb4d3a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-07T03:32:36.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5c400 con 0x7f1ca804cbe0 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb4d3a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.422+0000 7f1cb4d3a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5efb0 con 0x560b5db137b0 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 4.1c 4:39102d40:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5e920 con 0x7f1ca804cbe0 2024-09-07T03:32:36.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 4.31 4:8df6caeb:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db63870 con 0x560b5db17c80 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:68 4.19 4:985013a3:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db66120 con 0x560b5db1cd10 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 4.25 4:a77a67e6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db68ae0 con 0x560b5db17c80 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 4.5 4:a27908f1:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db68ae0 con 0x560b5db17c80 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 4.20 4:066752fa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db6d8c0 con 0x560b5db17c80 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 4.5 4:a0612de6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db702b0 con 0x560b5db17c80 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 4.23 4:c790c41e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db72cc0 con 0x560b5db1cd10 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:74 4.16 4:6b625f27:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db756f0 con 0x560b5db1cd10 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 4.38 4:1d9d37b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db78140 con 0x560b5db17c80 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:76 4.30 4:0fa4adf5:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560b5db7aa30 con 0x560b5db17c80 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(66 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(68 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(74 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(67 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(69 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.423+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(70 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.424+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(71 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.424+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(75 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.424+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(76 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.424+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(72 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.424+0000 7f1b66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.425+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94606816604176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5c150 con 0x560b5db137b0 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.425+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94606816604176] v34'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.426+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94606816579728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5aab0 con 0x560b5db17c80 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.426+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94606816579728] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.426+0000 7f1cb4d3a800 20 remove_watcher() i=0 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.426+0000 7f1cb4d3a800 2 removed watcher, disabling cache 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.427+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94606816584432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5aab0 con 0x560b5db137b0 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.427+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94606816584432] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x560b5db137b0 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.427+0000 7f1cb4d3a800 20 remove_watcher() i=1 2024-09-07T03:32:36.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.427+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94606816577216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5aab0 con 0x560b5db17c80 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.431+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94606816577216] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.431+0000 7f1cb4d3a800 20 remove_watcher() i=2 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.431+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94606816590816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5aab0 con 0x7f1ca804cbe0 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.432+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94606816590816] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.432+0000 7f1cb4d3a800 20 remove_watcher() i=3 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.432+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94606816594784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5aab0 con 0x560b5db17c80 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.434+0000 7f1cb1282640 1 -- 172.21.15.120:0/4208504012 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94606816594784] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca80083e0 con 0x560b5db17c80 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.434+0000 7f1cb4d3a800 20 remove_watcher() i=4 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.434+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94606816597152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5aab0 con 0x560b5db1cd10 2024-09-07T03:32:36.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.435+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94606816597152] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.435+0000 7f1cb4d3a800 20 remove_watcher() i=5 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.435+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94606816599888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5aab0 con 0x560b5db1cd10 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.436+0000 7f1cb0a81640 1 -- 172.21.15.120:0/4208504012 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94606816599888] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ca0077c10 con 0x560b5db1cd10 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.436+0000 7f1cb4d3a800 20 remove_watcher() i=6 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.436+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94606816598208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560b5db5aab0 con 0x7f1ca804cbe0 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94606816598208] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c98028040 con 0x7f1ca804cbe0 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 20 remove_watcher() i=7 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5db17c80 msgr2=0x560b5db1a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5db17c80 0x560b5db1a070 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5db137b0 msgr2=0x560b5db15c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5db137b0 0x560b5db15c70 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1ca804cbe0 msgr2=0x7f1ca801f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1ca804cbe0 0x7f1ca801f2c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560b5db1cd10 msgr2=0x560b5db1f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560b5db1cd10 0x560b5db1f140 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7c03c750 msgr2=0x7f1b7c03ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b7c03c750 0x7f1b7c03ec10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0059f70 tx=0x7f1ca0090000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 msgr2=0x560b5db07cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb0280640 1 -- 172.21.15.120:0/4208504012 reap_dead start 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db07cb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8020d60 tx=0x7f1ca8053150 comp rx=0 tx=0).stop 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 shutdown_connections 2024-09-07T03:32:36.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4208504012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5db00660 0x560b5db07cb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 >> 172.21.15.120:0/4208504012 conn(0x560b5dafca80 msgr2=0x560b5dafac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 shutdown_connections 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.437+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4208504012 wait complete. 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1169920917 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b8803c780 msgr2=0x7f1b8803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/1169920917 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b8803c780 0x7f1b8803ec40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x560b5dae0b70 tx=0x7f1ca0088040 comp rx=0 tx=0).stop 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1169920917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5daf3ba0 msgr2=0x560b5daf3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/1169920917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5daf3ba0 0x560b5daf3fc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800aa90 tx=0x7f1ca800af50 comp rx=0 tx=0).stop 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1169920917 shutdown_connections 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/1169920917 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b8803c780 0x7f1b8803ec40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/1169920917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5daf3ba0 0x560b5daf3fc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1169920917 >> 172.21.15.120:0/1169920917 conn(0x560b5dae7f50 msgr2=0x560b5dae8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1169920917 shutdown_connections 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/1169920917 wait complete. 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5dae13b0 msgr2=0x560b5dae37a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5dae13b0 0x560b5dae37a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5d9e2020 msgr2=0x560b5dae0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5d9e2020 0x560b5dae0420 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b9803c730 msgr2=0x7f1b9803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b9803c730 0x7f1b9803ebf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c98004170 tx=0x7f1c98001330 comp rx=0 tx=0).stop 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 msgr2=0x560b5dad8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad8dd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0025a60 tx=0x7f1ca0003330 comp rx=0 tx=0).stop 2024-09-07T03:32:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 shutdown_connections 2024-09-07T03:32:36.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560b5dae13b0 0x560b5dae37a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560b5d9e2020 0x560b5dae0420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1b9803c730 0x7f1b9803ebf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 --2- 172.21.15.120:0/4127142031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560b5d9e0de0 0x560b5dad8dd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 >> 172.21.15.120:0/4127142031 conn(0x560b5d9dc1b0 msgr2=0x560b5dad16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 shutdown_connections 2024-09-07T03:32:36.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.438+0000 7f1cb4d3a800 1 -- 172.21.15.120:0/4127142031 wait complete. 2024-09-07T03:32:36.457 INFO:teuthology.orchestra.run.smithi120.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1445b2f9-7226-49a1-ba30-52d0fcf4c719","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","marker":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-07T03:32:35.748599Z","creation_time":"2024-09-07T03:32:35.744783Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-07T03:32:36.457 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1445b2f9-7226-49a1-ba30-52d0fcf4c719', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-07T03:32:35.748599Z', 'creation_time': '2024-09-07T03:32:35.744783Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-07T03:32:36.458 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-07T03:32:36.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-07T03:32:36.458 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-07T03:32:36.502 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:36.502 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:36.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.501+0000 7fbcbb946800 1 Processor -- start 2024-09-07T03:32:36.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.501+0000 7fbcbb946800 1 -- start start 2024-09-07T03:32:36.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.501+0000 7fbcbb946800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56481c4bc1f0 0x56481c4be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.501+0000 7fbcbb946800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56481c361e40 con 0x56481c4b86e0 2024-09-07T03:32:36.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.501+0000 7fbcbb946800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56481c32c680 con 0x56481c4bc1f0 2024-09-07T03:32:36.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.502+0000 7fbcb8c36640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56481c4bc1f0 0x56481c4be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.502+0000 7fbcb9437640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56481c4b86e0 0x56481c4baad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48454/0 (socket says 172.21.15.120:48454) 2024-09-07T03:32:36.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.502+0000 7fbcb9437640 1 -- 172.21.15.120:0/362480680 learned_addr learned my addr 172.21.15.120:0/362480680 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:36.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.502+0000 7fbcb8c36640 1 -- 172.21.15.120:0/362480680 >> v1:172.21.15.104:6789/0 conn(0x56481c4b86e0 legacy=0x56481c4baad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.502+0000 7fbcb8c36640 1 -- 172.21.15.120:0/362480680 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481c3486b0 con 0x56481c4bc1f0 2024-09-07T03:32:36.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcb8c36640 1 --2- 172.21.15.120:0/362480680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4bc1f0 0x56481c4be6b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbca400a470 tx=0x7fbca4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48dba475f4a73d71 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcb3fff640 1 -- 172.21.15.120:0/362480680 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca4053570 con 0x56481c4bc1f0 2024-09-07T03:32:36.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcb3fff640 1 -- 172.21.15.120:0/362480680 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca4058070 con 0x56481c4bc1f0 2024-09-07T03:32:36.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcb3fff640 1 -- 172.21.15.120:0/362480680 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca4053880 con 0x56481c4bc1f0 2024-09-07T03:32:36.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcbb946800 1 -- 172.21.15.120:0/362480680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4bc1f0 msgr2=0x56481c4be6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcbb946800 1 --2- 172.21.15.120:0/362480680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4bc1f0 0x56481c4be6b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbca400a470 tx=0x7fbca4045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:36.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcbb946800 1 -- 172.21.15.120:0/362480680 shutdown_connections 2024-09-07T03:32:36.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcbb946800 1 --2- 172.21.15.120:0/362480680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4bc1f0 0x56481c4be6b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcbb946800 1 -- 172.21.15.120:0/362480680 >> 172.21.15.120:0/362480680 conn(0x56481c4b21c0 msgr2=0x56481c4b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcbb946800 1 -- 172.21.15.120:0/362480680 shutdown_connections 2024-09-07T03:32:36.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.504+0000 7fbcbb946800 1 -- 172.21.15.120:0/362480680 wait complete. 2024-09-07T03:32:36.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.518+0000 7fbcbb946800 1 Processor -- start 2024-09-07T03:32:36.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.518+0000 7fbcbb946800 1 -- start start 2024-09-07T03:32:36.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.518+0000 7fbcbb946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5a7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.518+0000 7fbcbb946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56481c350dd0 con 0x56481c4b86e0 2024-09-07T03:32:36.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.519+0000 7fbcb9437640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5a7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.519+0000 7fbcb9437640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5a7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42294/0 (socket says 172.21.15.120:42294) 2024-09-07T03:32:36.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.519+0000 7fbcb9437640 1 -- 172.21.15.120:0/4222204770 learned_addr learned my addr 172.21.15.120:0/4222204770 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.519+0000 7fbcb9437640 1 -- 172.21.15.120:0/4222204770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481c369e10 con 0x56481c4b86e0 2024-09-07T03:32:36.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.519+0000 7fbcb9437640 1 --2- 172.21.15.120:0/4222204770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5a7680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbcac001e40 tx=0x7fbcac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec6764713e84c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.519+0000 7fbba7606640 1 -- 172.21.15.120:0/4222204770 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcac012020 con 0x56481c4b86e0 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.519+0000 7fbba7606640 1 -- 172.21.15.120:0/4222204770 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcac00e5a0 con 0x56481c4b86e0 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.519+0000 7fbba7606640 1 -- 172.21.15.120:0/4222204770 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcac00e8a0 con 0x56481c4b86e0 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.520+0000 7fbcbb946800 1 -- 172.21.15.120:0/4222204770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 msgr2=0x56481c5a7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.520+0000 7fbcbb946800 1 --2- 172.21.15.120:0/4222204770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5a7680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbcac001e40 tx=0x7fbcac001e70 comp rx=0 tx=0).stop 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.520+0000 7fbcbb946800 1 -- 172.21.15.120:0/4222204770 shutdown_connections 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.520+0000 7fbcbb946800 1 --2- 172.21.15.120:0/4222204770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5a7680 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.520+0000 7fbcbb946800 1 -- 172.21.15.120:0/4222204770 >> 172.21.15.120:0/4222204770 conn(0x56481c4b21c0 msgr2=0x56481c5a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.520+0000 7fbcbb946800 1 -- 172.21.15.120:0/4222204770 shutdown_connections 2024-09-07T03:32:36.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.520+0000 7fbcbb946800 1 -- 172.21.15.120:0/4222204770 wait complete. 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.520+0000 7fbcbb946800 1 Processor -- start 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.521+0000 7fbcbb946800 1 -- start start 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.521+0000 7fbcbb946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.521+0000 7fbcbb946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56481c4bf030 con 0x56481c4b86e0 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.521+0000 7fbcb9437640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.521+0000 7fbcb9437640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42306/0 (socket says 172.21.15.120:42306) 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.521+0000 7fbcb9437640 1 -- 172.21.15.120:0/495872896 learned_addr learned my addr 172.21.15.120:0/495872896 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.521+0000 7fbcb9437640 1 -- 172.21.15.120:0/495872896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481c5af560 con 0x56481c4b86e0 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.521+0000 7fbcb9437640 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5af000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c010 tx=0x7fbcac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.522+0000 7fbba5e03640 1 -- 172.21.15.120:0/495872896 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcac012030 con 0x56481c4b86e0 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.522+0000 7fbba5e03640 1 -- 172.21.15.120:0/495872896 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcac0014a0 con 0x56481c4b86e0 2024-09-07T03:32:36.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.522+0000 7fbba5e03640 1 -- 172.21.15.120:0/495872896 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcac01a7a0 con 0x56481c4b86e0 2024-09-07T03:32:36.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.522+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56481c5af7f0 con 0x56481c4b86e0 2024-09-07T03:32:36.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.522+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56481c5b01f0 con 0x56481c4b86e0 2024-09-07T03:32:36.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.523+0000 7fbba5e03640 1 -- 172.21.15.120:0/495872896 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbcac015020 con 0x56481c4b86e0 2024-09-07T03:32:36.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.523+0000 7fbba5e03640 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbba003c730 0x7fbba003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.523+0000 7fbba5e03640 1 -- 172.21.15.120:0/495872896 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fbcac020030 con 0x56481c4b86e0 2024-09-07T03:32:36.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.523+0000 7fbcb8c36640 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbba003c730 0x7fbba003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.523+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c4bc1f0 0x56481c5b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.523+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5b6b90 con 0x56481c4bc1f0 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.523+0000 7fbcb9c38640 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c4bc1f0 0x56481c5b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.523+0000 7fbcb8c36640 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbba003c730 0x7fbba003ebf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbca4057000 tx=0x7fbca4052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.523+0000 7fbcb9c38640 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c4bc1f0 0x56481c5b6650 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.524+0000 7fbcb9c38640 1 -- 172.21.15.120:0/495872896 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcb400a4d0 con 0x56481c4bc1f0 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.524+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5b7440 0x56481c5b98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.524+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5ba050 con 0x56481c5b7440 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.524+0000 7fbcb9437640 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5b7440 0x56481c5b98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.524+0000 7fbcb9437640 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5b7440 0x56481c5b98e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.524+0000 7fbcb9437640 1 -- 172.21.15.120:0/495872896 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcac01ab20 con 0x56481c5b7440 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.524+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5bb900 con 0x56481c5b7440 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.525+0000 7fbcb9437640 1 -- 172.21.15.120:0/495872896 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbcac01ab20 con 0x56481c5b7440 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.525+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5baa70 con 0x56481c5b7440 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.525+0000 7fbcb9437640 1 -- 172.21.15.120:0/495872896 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcac01ab20 con 0x56481c5b7440 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.525+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5bae90 con 0x56481c4bc1f0 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.526+0000 7fbcb9c38640 1 -- 172.21.15.120:0/495872896 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbcb400a4d0 con 0x56481c4bc1f0 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.526+0000 7fbcbb946800 1 Processor -- start 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.526+0000 7fbcbb946800 1 -- start start 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.526+0000 7fbcbb946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b7e80 0x56481c4b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.526+0000 7fbcbb946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56481c3aea00 con 0x56481c4b7e80 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.526+0000 7fbcb9c38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b7e80 0x56481c4b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.526+0000 7fbcb9c38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b7e80 0x56481c4b66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42318/0 (socket says 172.21.15.120:42318) 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.526+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1656546759 learned_addr learned my addr 172.21.15.120:0/1656546759 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.527+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1656546759 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481c4b83a0 con 0x56481c4b7e80 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.527+0000 7fbcb9c38640 1 --2- 172.21.15.120:0/1656546759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b7e80 0x56481c4b66f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4016d20 tx=0x7fbcb400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.527+0000 7fbb9effd640 1 -- 172.21.15.120:0/1656546759 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4017660 con 0x56481c4b7e80 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.527+0000 7fbb9effd640 1 -- 172.21.15.120:0/1656546759 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb401b030 con 0x56481c4b7e80 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.527+0000 7fbcbb946800 1 -- 172.21.15.120:0/1656546759 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56481c4b6c30 con 0x56481c4b7e80 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.527+0000 7fbb9effd640 1 -- 172.21.15.120:0/1656546759 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4017950 con 0x56481c4b7e80 2024-09-07T03:32:36.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.527+0000 7fbcbb946800 1 -- 172.21.15.120:0/1656546759 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56481c4b7180 con 0x56481c4b7e80 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.528+0000 7fbb9effd640 1 -- 172.21.15.120:0/1656546759 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbcb4017af0 con 0x56481c4b7e80 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.528+0000 7fbb9effd640 1 --2- 172.21.15.120:0/1656546759 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb9403c780 0x7fbb9403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.528+0000 7fbb9effd640 1 -- 172.21.15.120:0/1656546759 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fbcb400e040 con 0x56481c4b7e80 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.528+0000 7fbcb9437640 1 --2- 172.21.15.120:0/1656546759 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb9403c780 0x7fbb9403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.528+0000 7fbcbb946800 1 Processor -- start 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.528+0000 7fbcb9437640 1 --2- 172.21.15.120:0/1656546759 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb9403c780 0x7fbb9403ec40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x56481c5b0710 tx=0x7fbcac00def0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.528+0000 7fbcbb946800 1 -- start start 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbcbb946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5d8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbcbb946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56481c5a7ed0 con 0x56481c5d8a60 2024-09-07T03:32:36.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbcb9c38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5d8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbcb9c38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5d8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42332/0 (socket says 172.21.15.120:42332) 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbcb9c38640 1 -- 172.21.15.120:0/3790062033 learned_addr learned my addr 172.21.15.120:0/3790062033 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbcb9c38640 1 -- 172.21.15.120:0/3790062033 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481c5d9450 con 0x56481c5d8a60 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbcb9c38640 1 --2- 172.21.15.120:0/3790062033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5d8e60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4017f20 tx=0x7fbcb4028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40f59bfc760abec server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbb9cff9640 1 -- 172.21.15.120:0/3790062033 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb40149b0 con 0x56481c5d8a60 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbb9cff9640 1 -- 172.21.15.120:0/3790062033 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb4028350 con 0x56481c5d8a60 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.529+0000 7fbb9cff9640 1 -- 172.21.15.120:0/3790062033 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4014b50 con 0x56481c5d8a60 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 -- 172.21.15.120:0/3790062033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 msgr2=0x56481c5d8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 --2- 172.21.15.120:0/3790062033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5d8e60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4017f20 tx=0x7fbcb4028e80 comp rx=0 tx=0).stop 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 -- 172.21.15.120:0/3790062033 shutdown_connections 2024-09-07T03:32:36.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 --2- 172.21.15.120:0/3790062033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5d8e60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 -- 172.21.15.120:0/3790062033 >> 172.21.15.120:0/3790062033 conn(0x56481c5d4e60 msgr2=0x56481c5d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 -- 172.21.15.120:0/3790062033 shutdown_connections 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 -- 172.21.15.120:0/3790062033 wait complete. 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 Processor -- start 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 -- start start 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.530+0000 7fbcbb946800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.531+0000 7fbcbb946800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56481c5d9a70 con 0x56481c5d8a60 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.531+0000 7fbcb9c38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.531+0000 7fbcb9c38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5e00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42348/0 (socket says 172.21.15.120:42348) 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.531+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 learned_addr learned my addr 172.21.15.120:0/1061807187 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.531+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481c5e0640 con 0x56481c5d8a60 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.531+0000 7fbcb9c38640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5e00e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4017f20 tx=0x7fbcb4053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.531+0000 7fbb8affd640 1 -- 172.21.15.120:0/1061807187 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb404c070 con 0x56481c5d8a60 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.531+0000 7fbb8affd640 1 -- 172.21.15.120:0/1061807187 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb40129b0 con 0x56481c5d8a60 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.531+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56481c5e08d0 con 0x56481c5d8a60 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.532+0000 7fbb8affd640 1 -- 172.21.15.120:0/1061807187 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4012c90 con 0x56481c5d8a60 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.532+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56481c5e1250 con 0x56481c5d8a60 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.532+0000 7fbb8affd640 1 -- 172.21.15.120:0/1061807187 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbcb40135c0 con 0x56481c5d8a60 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.533+0000 7fbb8affd640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb8403c780 0x7fbb8403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.533+0000 7fbb8affd640 1 -- 172.21.15.120:0/1061807187 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fbcb403bb40 con 0x56481c5d8a60 2024-09-07T03:32:36.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.533+0000 7fbcb9437640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb8403c780 0x7fbb8403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.533+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.533+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c5ebb90 0x56481c5ee050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.533+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5ee7a0 con 0x56481c5ebb90 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.533+0000 7fbcb8c36640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c5ebb90 0x56481c5ee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.533+0000 7fbcb9437640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb8403c780 0x7fbb8403ec40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbcac01a6a0 tx=0x7fbcac049000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.533+0000 7fbcb8c36640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c5ebb90 0x56481c5ee050 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 20 realm 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5eebd0 con 0x56481c5ebb90 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5ef4a0 con 0x56481c5ebb90 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5efec0 0x56481c5f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f2a20 con 0x56481c5efec0 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.534+0000 7fbcb9c38640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5efec0 0x56481c5f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcb9c38640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5efec0 0x56481c5f22b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcbb946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f32c0 con 0x56481c5efec0 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcbb946800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcbb946800 20 searching for the correct realm 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56481c5f5030 0x56481c5f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5f5030 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcb9437640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56481c5f5030 0x56481c5f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.535+0000 7fbcb9437640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56481c5f5030 0x56481c5f7480 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.536+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.536+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5efec0 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.536+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.536+0000 7fbcb9c38640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbcb4014440 0x7fbcb40138b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.536+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x7fbcb4014440 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.536+0000 7fbcb8c36640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbcb4014440 0x7fbcb40138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.536+0000 7fbcb8c36640 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbcb4014440 0x7fbcb40138b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.537+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.537+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.537+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.537+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.537+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.537+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5f5030 2024-09-07T03:32:36.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.537+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.537+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.538+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.538+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5efec0 2024-09-07T03:32:36.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.538+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.538+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5efec0 2024-09-07T03:32:36.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.538+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.538+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.539+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.539+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x7fbcb4014440 2024-09-07T03:32:36.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.539+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.539+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.539+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.539+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x7fbcb4014440 2024-09-07T03:32:36.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.539+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.539+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5efec0 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.540+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.540+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5f5030 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.540+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.540+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.540+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.540+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5efec0 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.540+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.541+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5f5030 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.541+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.541+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.541+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.541+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.541+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.541+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.541+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.541+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5f5030 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.542+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.542+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x7fbcb4014440 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.542+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.542+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5ebb90 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.542+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.542+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x7fbcb4014440 2024-09-07T03:32:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.542+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.542+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5f5030 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.543+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.543+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x7fbcb4014440 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.543+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.543+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5efec0 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.543+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.543+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5efec0 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.543+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.543+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5f5030 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5efec0 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f7b50 con 0x56481c5efec0 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcbb946800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcbb946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcbb946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcbb946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcbb946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcbb946800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f3c40 con 0x56481c5ebb90 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.544+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f4030 con 0x56481c5efec0 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f4490 con 0x56481c5ebb90 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 zone default found 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 4 Realm: () 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 zonegroup default 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f8020 con 0x7fbcb4014440 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.545+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fa2e0 con 0x56481c5f5030 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.546+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.546+0000 7fbcbb946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.546+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.546+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fa6b0 con 0x56481c5f5030 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.546+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.546+0000 7fbcbb946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.546+0000 7fbcbb946800 20 started sync module instance, tier type = 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.546+0000 7fbcbb946800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:36.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.546+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f9770 con 0x56481c5efec0 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.547+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.547+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94867713661792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5f93d0 con 0x56481c5efec0 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.547+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fb5e0 con 0x56481c5ebb90 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.548+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.548+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94867713661792] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.548+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94867713665808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fb980 con 0x56481c5ebb90 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.548+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fc3e0 con 0x56481c5efec0 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.549+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94867713665808] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.551+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.551+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94867713667376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fc3a0 con 0x56481c5efec0 2024-09-07T03:32:36.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.551+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fce60 con 0x7fbcb4014440 2024-09-07T03:32:36.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.552+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.552+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94867713673584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fd2e0 con 0x7fbcb4014440 2024-09-07T03:32:36.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.552+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fdde0 con 0x56481c5efec0 2024-09-07T03:32:36.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.556+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94867713667376] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.564+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94867713673584] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.564+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.564+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94867713674640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fdda0 con 0x56481c5efec0 2024-09-07T03:32:36.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.564+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fe6b0 con 0x56481c5f5030 2024-09-07T03:32:36.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.565+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.565+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94867713679872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5fdda0 con 0x56481c5f5030 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.565+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5ff5c0 con 0x56481c5f5030 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.565+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94867713674640] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.566+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94867713679872] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.569+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.569+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94867713677520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c5ff0d0 con 0x56481c5f5030 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.569+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c600000 con 0x7fbcb4014440 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94867713677520] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94867713682000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c600000 con 0x7fbcb4014440 2024-09-07T03:32:36.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcbb946800 20 add_watcher() i=0 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcbb946800 20 add_watcher() i=1 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcbb946800 20 add_watcher() i=2 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcbb946800 20 add_watcher() i=3 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcbb946800 20 add_watcher() i=4 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcbb946800 20 add_watcher() i=5 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.570+0000 7fbcbb946800 20 add_watcher() i=6 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.571+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94867713682000] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.571+0000 7fbcbb946800 20 add_watcher() i=7 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.571+0000 7fbcbb946800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:36.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.571+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c603340 con 0x56481c5ebb90 2024-09-07T03:32:36.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.571+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.571+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94867713686720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c600590 con 0x56481c5ebb90 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94867713686720] v34'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbb6ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbcbb946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbcbb946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbcbb946800 5 note: GC not initialized 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbb6efe5640 20 reqs_thread_entry: start 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbcbb946800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbcbb946800 20 Filter name: none 2024-09-07T03:32:36.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbb6cfe1640 20 reqs_thread_entry: start 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.573+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c635f60 con 0x56481c5ebb90 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.574+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.574+0000 7fbcbb946800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.574+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.574+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c636820 con 0x56481c5ebb90 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.574+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.574+0000 7fbcbb946800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.574+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c637830 con 0x7fbcb4014440 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.574+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c635140 con 0x7fbcb4014440 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c637830 con 0x56481c5ebb90 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(66 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 4.1c 4:39102d40:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c6372d0 con 0x7fbcb4014440 2024-09-07T03:32:36.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 4.31 4:8df6caeb:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c63c180 con 0x56481c5efec0 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 4.19 4:985013a3:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c637310 con 0x56481c5f5030 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 4.25 4:a77a67e6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c640fb0 con 0x56481c5efec0 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 4.5 4:a27908f1:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c640fb0 con 0x56481c5efec0 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.575+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 4.20 4:066752fa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c6461e0 con 0x56481c5efec0 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 4.5 4:a0612de6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c648bf0 con 0x56481c5efec0 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:74 4.23 4:c790c41e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c64b940 con 0x56481c5f5030 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 4.16 4:6b625f27:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c64e1b0 con 0x56481c5f5030 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:76 4.38 4:1d9d37b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c650aa0 con 0x56481c5efec0 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 4.30 4:0fa4adf5:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56481c653410 con 0x56481c5efec0 2024-09-07T03:32:36.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(67 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(68 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(70 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(74 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(71 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(75 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(72 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(76 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(77 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.576+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(73 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.577+0000 7fbb6ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.577+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94867713686720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c633ea0 con 0x56481c5ebb90 2024-09-07T03:32:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.578+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94867713686720] v34'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.578+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94867713661792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c633ea0 con 0x56481c5efec0 2024-09-07T03:32:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.579+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94867713661792] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.579+0000 7fbcbb946800 20 remove_watcher() i=0 2024-09-07T03:32:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.579+0000 7fbcbb946800 2 removed watcher, disabling cache 2024-09-07T03:32:36.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.579+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94867713665808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c633ea0 con 0x56481c5ebb90 2024-09-07T03:32:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.582+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94867713665808] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x56481c5ebb90 2024-09-07T03:32:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.582+0000 7fbcbb946800 20 remove_watcher() i=1 2024-09-07T03:32:36.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.582+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94867713667376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c633ea0 con 0x56481c5efec0 2024-09-07T03:32:36.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.586+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94867713667376] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.586+0000 7fbcbb946800 20 remove_watcher() i=2 2024-09-07T03:32:36.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.586+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94867713673584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c633ea0 con 0x7fbcb4014440 2024-09-07T03:32:36.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.594+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94867713673584] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.594+0000 7fbcbb946800 20 remove_watcher() i=3 2024-09-07T03:32:36.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.594+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94867713674640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c633ea0 con 0x56481c5efec0 2024-09-07T03:32:36.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.595+0000 7fbcb9c38640 1 -- 172.21.15.120:0/1061807187 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94867713674640] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb4027070 con 0x56481c5efec0 2024-09-07T03:32:36.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.595+0000 7fbcbb946800 20 remove_watcher() i=4 2024-09-07T03:32:36.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.595+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94867713679872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c633ea0 con 0x56481c5f5030 2024-09-07T03:32:36.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.596+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94867713679872] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.596+0000 7fbcbb946800 20 remove_watcher() i=5 2024-09-07T03:32:36.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.596+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94867713677520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c633ea0 con 0x56481c5f5030 2024-09-07T03:32:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.599+0000 7fbcb9437640 1 -- 172.21.15.120:0/1061807187 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94867713677520] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcac034040 con 0x56481c5f5030 2024-09-07T03:32:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.599+0000 7fbcbb946800 20 remove_watcher() i=6 2024-09-07T03:32:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.599+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94867713682000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56481c633ea0 con 0x7fbcb4014440 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94867713682000] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbca4051070 con 0x7fbcb4014440 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 20 remove_watcher() i=7 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5efec0 msgr2=0x56481c5f22b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5efec0 0x56481c5f22b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c5ebb90 msgr2=0x56481c5ee050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c5ebb90 0x56481c5ee050 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbcb4014440 msgr2=0x7fbcb40138b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbcb4014440 0x7fbcb40138b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56481c5f5030 msgr2=0x56481c5f7480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56481c5f5030 0x56481c5f7480 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb8403c780 msgr2=0x7fbb8403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb8403c780 0x7fbb8403ec40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbcac01a6a0 tx=0x7fbcac049000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 msgr2=0x56481c5e00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcb8c36640 1 -- 172.21.15.120:0/1061807187 reap_dead start 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5e00e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4017f20 tx=0x7fbcb4053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 shutdown_connections 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1061807187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c5d8a60 0x56481c5e00e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 >> 172.21.15.120:0/1061807187 conn(0x56481c5d4e60 msgr2=0x56481c5d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 shutdown_connections 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1061807187 wait complete. 2024-09-07T03:32:36.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 -- 172.21.15.120:0/1656546759 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb9403c780 msgr2=0x7fbb9403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.600+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1656546759 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb9403c780 0x7fbb9403ec40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x56481c5b0710 tx=0x7fbcac00def0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/1656546759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b7e80 msgr2=0x56481c4b66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1656546759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b7e80 0x56481c4b66f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4016d20 tx=0x7fbcb400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/1656546759 shutdown_connections 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1656546759 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbb9403c780 0x7fbb9403ec40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/1656546759 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b7e80 0x56481c4b66f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/1656546759 >> 172.21.15.120:0/1656546759 conn(0x56481c5be170 msgr2=0x56481c5be550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/1656546759 shutdown_connections 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/1656546759 wait complete. 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5b7440 msgr2=0x56481c5b98e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5b7440 0x56481c5b98e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c4bc1f0 msgr2=0x56481c5b6650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c4bc1f0 0x56481c5b6650 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbba003c730 msgr2=0x7fbba003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbba003c730 0x7fbba003ebf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbca4057000 tx=0x7fbca4052000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 msgr2=0x56481c5af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5af000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c010 tx=0x7fbcac000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 shutdown_connections 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56481c5b7440 0x56481c5b98e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56481c4bc1f0 0x56481c5b6650 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbba003c730 0x7fbba003ebf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 --2- 172.21.15.120:0/495872896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56481c4b86e0 0x56481c5af000 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 >> 172.21.15.120:0/495872896 conn(0x56481c4b21c0 msgr2=0x56481c5a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 shutdown_connections 2024-09-07T03:32:36.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.601+0000 7fbcbb946800 1 -- 172.21.15.120:0/495872896 wait complete. 2024-09-07T03:32:36.611 INFO:teuthology.orchestra.run.smithi120.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1445b2f9-7226-49a1-ba30-52d0fcf4c719","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","marker":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-07T03:32:35.748599Z","creation_time":"2024-09-07T03:32:35.744783Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-07T03:32:36.611 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1445b2f9-7226-49a1-ba30-52d0fcf4c719', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-07T03:32:35.748599Z', 'creation_time': '2024-09-07T03:32:35.744783Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-07T03:32:36.618 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-07T03:32:36.618 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-07T03:32:36.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-07T03:32:36.619 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-07T03:32:36.695 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:36.695 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.695+0000 7f6f60c2f800 1 Processor -- start 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.695+0000 7f6f60c2f800 1 -- start start 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.695+0000 7f6f60c2f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558b90c03690 0x558b90c05a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.695+0000 7f6f60c2f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b90aace40 con 0x558b90c06020 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.695+0000 7f6f60c2f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x558b90a77680 con 0x558b90c03690 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.695+0000 7f6f5e719640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558b90c03690 0x558b90c05a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.695+0000 7f6f55f18640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x558b90c06020 0x558b90c084e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48462/0 (socket says 172.21.15.120:48462) 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.695+0000 7f6f55f18640 1 -- 172.21.15.120:0/3279815395 learned_addr learned my addr 172.21.15.120:0/3279815395 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.696+0000 7f6f5e719640 1 -- 172.21.15.120:0/3279815395 >> v1:172.21.15.104:6789/0 conn(0x558b90c06020 legacy=0x558b90c084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.696+0000 7f6f5e719640 1 -- 172.21.15.120:0/3279815395 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b90a936b0 con 0x558b90c03690 2024-09-07T03:32:36.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.697+0000 7f6f5e719640 1 --2- 172.21.15.120:0/3279815395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90c05a80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000a470 tx=0x7f6f50045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c851be67bc2bbb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f5df18640 1 -- 172.21.15.120:0/3279815395 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f50059070 con 0x558b90c03690 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f5df18640 1 -- 172.21.15.120:0/3279815395 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f50054570 con 0x558b90c03690 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f5df18640 1 -- 172.21.15.120:0/3279815395 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f50054870 con 0x558b90c03690 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f60c2f800 1 -- 172.21.15.120:0/3279815395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 msgr2=0x558b90c05a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/3279815395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90c05a80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000a470 tx=0x7f6f50045880 comp rx=0 tx=0).stop 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f60c2f800 1 -- 172.21.15.120:0/3279815395 shutdown_connections 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/3279815395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90c05a80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f60c2f800 1 -- 172.21.15.120:0/3279815395 >> 172.21.15.120:0/3279815395 conn(0x558b90bfd1f0 msgr2=0x558b90bff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f60c2f800 1 -- 172.21.15.120:0/3279815395 shutdown_connections 2024-09-07T03:32:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.698+0000 7f6f60c2f800 1 -- 172.21.15.120:0/3279815395 wait complete. 2024-09-07T03:32:36.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.712+0000 7f6f60c2f800 1 Processor -- start 2024-09-07T03:32:36.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.712+0000 7f6f60c2f800 1 -- start start 2024-09-07T03:32:36.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.712+0000 7f6f60c2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.712+0000 7f6f60c2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558b90a9bdd0 con 0x558b90c03690 2024-09-07T03:32:36.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.712+0000 7f6f5e719640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.713+0000 7f6f5e719640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42368/0 (socket says 172.21.15.120:42368) 2024-09-07T03:32:36.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.713+0000 7f6f5e719640 1 -- 172.21.15.120:0/2650773495 learned_addr learned my addr 172.21.15.120:0/2650773495 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.713+0000 7f6f5e719640 1 -- 172.21.15.120:0/2650773495 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b90ab4e10 con 0x558b90c03690 2024-09-07T03:32:36.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.713+0000 7f6f5e719640 1 --2- 172.21.15.120:0/2650773495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf2670 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000a470 tx=0x7f6f5004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1257f84c51b62e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.713+0000 7f6e4c608640 1 -- 172.21.15.120:0/2650773495 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f50064070 con 0x558b90c03690 2024-09-07T03:32:36.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.713+0000 7f6e4c608640 1 -- 172.21.15.120:0/2650773495 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f50054850 con 0x558b90c03690 2024-09-07T03:32:36.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.713+0000 7f6e4c608640 1 -- 172.21.15.120:0/2650773495 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f50059040 con 0x558b90c03690 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 -- 172.21.15.120:0/2650773495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 msgr2=0x558b90cf2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/2650773495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf2670 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000a470 tx=0x7f6f5004e000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 -- 172.21.15.120:0/2650773495 shutdown_connections 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/2650773495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf2670 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 -- 172.21.15.120:0/2650773495 >> 172.21.15.120:0/2650773495 conn(0x558b90bfd1f0 msgr2=0x558b90cedff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 -- 172.21.15.120:0/2650773495 shutdown_connections 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 -- 172.21.15.120:0/2650773495 wait complete. 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 Processor -- start 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 -- start start 2024-09-07T03:32:36.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.714+0000 7f6f60c2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558b90c0a040 con 0x558b90c03690 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6f5e719640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6f5e719640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42376/0 (socket says 172.21.15.120:42376) 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6f5e719640 1 -- 172.21.15.120:0/953205199 learned_addr learned my addr 172.21.15.120:0/953205199 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6f5e719640 1 -- 172.21.15.120:0/953205199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b90cfa3e0 con 0x558b90c03690 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6f5e719640 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf9e80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000a470 tx=0x7f6f50002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6e4ae05640 1 -- 172.21.15.120:0/953205199 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5006d070 con 0x558b90c03690 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6e4ae05640 1 -- 172.21.15.120:0/953205199 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f500695b0 con 0x558b90c03690 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b90cfa670 con 0x558b90c03690 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6e4ae05640 1 -- 172.21.15.120:0/953205199 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f50064050 con 0x558b90c03690 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.715+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b90cfb230 con 0x558b90c03690 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.716+0000 7f6e4ae05640 1 -- 172.21.15.120:0/953205199 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6f50069890 con 0x558b90c03690 2024-09-07T03:32:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.716+0000 7f6e4ae05640 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e4403c780 0x7f6e4403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.716+0000 7f6e4ae05640 1 -- 172.21.15.120:0/953205199 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f6f50096fe0 con 0x558b90c03690 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.716+0000 7f6f55f18640 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e4403c780 0x7f6e4403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.716+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90c06020 0x558b90d01480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.716+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d019c0 con 0x558b90c06020 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.717+0000 7f6f5ef1a640 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90c06020 0x558b90d01480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.717+0000 7f6f55f18640 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e4403c780 0x7f6e4403ec40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6f48001eb0 tx=0x7f6f480015b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.717+0000 7f6f5ef1a640 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90c06020 0x558b90d01480 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.717+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/953205199 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5800a4d0 con 0x558b90c06020 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.717+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d022c0 0x558b90d04750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.717+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d04ec0 con 0x558b90d022c0 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.717+0000 7f6f5e719640 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d022c0 0x558b90d04750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.718+0000 7f6f5e719640 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d022c0 0x558b90d04750 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.718+0000 7f6f5e719640 1 -- 172.21.15.120:0/953205199 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d022c0 2024-09-07T03:32:36.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.718+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d06770 con 0x558b90d022c0 2024-09-07T03:32:36.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.718+0000 7f6f5e719640 1 -- 172.21.15.120:0/953205199 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d022c0 2024-09-07T03:32:36.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.718+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d058b0 con 0x558b90d022c0 2024-09-07T03:32:36.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.718+0000 7f6f5e719640 1 -- 172.21.15.120:0/953205199 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d022c0 2024-09-07T03:32:36.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.718+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d05cd0 con 0x558b90c06020 2024-09-07T03:32:36.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.719+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/953205199 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6f5800a4d0 con 0x558b90c06020 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.719+0000 7f6f60c2f800 1 Processor -- start 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.719+0000 7f6f60c2f800 1 -- start start 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.719+0000 7f6f60c2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c02e50 0x558b90c016c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.719+0000 7f6f60c2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558b90af9a00 con 0x558b90c02e50 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.719+0000 7f6f5ef1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c02e50 0x558b90c016c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.719+0000 7f6f5ef1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c02e50 0x558b90c016c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42386/0 (socket says 172.21.15.120:42386) 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.719+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/1498315232 learned_addr learned my addr 172.21.15.120:0/1498315232 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.720+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/1498315232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b90c03370 con 0x558b90c02e50 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.720+0000 7f6f5ef1a640 1 --2- 172.21.15.120:0/1498315232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c02e50 0x558b90c016c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6f58016d20 tx=0x7f6f5800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.720+0000 7f6e43fff640 1 -- 172.21.15.120:0/1498315232 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58017660 con 0x558b90c02e50 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.720+0000 7f6e43fff640 1 -- 172.21.15.120:0/1498315232 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5801b030 con 0x558b90c02e50 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.720+0000 7f6f60c2f800 1 -- 172.21.15.120:0/1498315232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b90c01c00 con 0x558b90c02e50 2024-09-07T03:32:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.720+0000 7f6e43fff640 1 -- 172.21.15.120:0/1498315232 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58017950 con 0x558b90c02e50 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.720+0000 7f6f60c2f800 1 -- 172.21.15.120:0/1498315232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b90c021a0 con 0x558b90c02e50 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.721+0000 7f6e43fff640 1 -- 172.21.15.120:0/1498315232 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6f58017af0 con 0x558b90c02e50 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.721+0000 7f6e43fff640 1 --2- 172.21.15.120:0/1498315232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e3803c780 0x7f6e3803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.721+0000 7f6e43fff640 1 -- 172.21.15.120:0/1498315232 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f6f5800e040 con 0x558b90c02e50 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.721+0000 7f6f5e719640 1 --2- 172.21.15.120:0/1498315232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e3803c780 0x7f6e3803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.721+0000 7f6f60c2f800 1 Processor -- start 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.721+0000 7f6f5e719640 1 --2- 172.21.15.120:0/1498315232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e3803c780 0x7f6e3803ec40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x558b90d053d0 tx=0x7f6f5005ff20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.721+0000 7f6f60c2f800 1 -- start start 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6f60c2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d23d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6f60c2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558b90cf2e00 con 0x558b90d23930 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6f5ef1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d23d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6f5ef1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d23d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42390/0 (socket says 172.21.15.120:42390) 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/148246683 learned_addr learned my addr 172.21.15.120:0/148246683 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/148246683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b90d24320 con 0x558b90d23930 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6f5ef1a640 1 --2- 172.21.15.120:0/148246683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d23d30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6f58053e00 tx=0x7f6f58017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9aa5fb05a67eee server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6e41ffb640 1 -- 172.21.15.120:0/148246683 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58014e70 con 0x558b90d23930 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6e41ffb640 1 -- 172.21.15.120:0/148246683 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f58051070 con 0x558b90d23930 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.722+0000 7f6e41ffb640 1 -- 172.21.15.120:0/148246683 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58014b00 con 0x558b90d23930 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 -- 172.21.15.120:0/148246683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 msgr2=0x558b90d23d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/148246683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d23d30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6f58053e00 tx=0x7f6f58017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 -- 172.21.15.120:0/148246683 shutdown_connections 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/148246683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d23d30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 -- 172.21.15.120:0/148246683 >> 172.21.15.120:0/148246683 conn(0x558b90d1fd30 msgr2=0x558b90d1df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 -- 172.21.15.120:0/148246683 shutdown_connections 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 -- 172.21.15.120:0/148246683 wait complete. 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 Processor -- start 2024-09-07T03:32:36.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 -- start start 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d2af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.723+0000 7f6f60c2f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558b90d24940 con 0x558b90d23930 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6f5ef1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d2af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6f5ef1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d2af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42404/0 (socket says 172.21.15.120:42404) 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 learned_addr learned my addr 172.21.15.120:0/4020330040 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b90d2b4a0 con 0x558b90d23930 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6f5ef1a640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d2af40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6f58053d30 tx=0x7f6f58053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6e2ffff640 1 -- 172.21.15.120:0/4020330040 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f580557d0 con 0x558b90d23930 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6e2ffff640 1 -- 172.21.15.120:0/4020330040 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f58028350 con 0x558b90d23930 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b90d2b730 con 0x558b90d23930 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6e2ffff640 1 -- 172.21.15.120:0/4020330040 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58028630 con 0x558b90d23930 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.724+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b90d2c0b0 con 0x558b90d23930 2024-09-07T03:32:36.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.725+0000 7f6e2ffff640 1 -- 172.21.15.120:0/4020330040 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6f5804e040 con 0x558b90d23930 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.725+0000 7f6e2ffff640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e2803c780 0x7f6e2803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.725+0000 7f6e2ffff640 1 -- 172.21.15.120:0/4020330040 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f6f58052d20 con 0x558b90d23930 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.725+0000 7f6f5e719640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e2803c780 0x7f6e2803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.725+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.725+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90d36960 0x558b90d38e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.725+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d39570 con 0x558b90d36960 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.725+0000 7f6f55f18640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90d36960 0x558b90d38e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f5e719640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e2803c780 0x7f6e2803ec40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f5005eec0 tx=0x7f6f50084000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f55f18640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90d36960 0x558b90d38e20 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 20 realm 2024-09-07T03:32:36.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d35d00 con 0x558b90d36960 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d3a050 con 0x558b90d36960 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d3ae30 0x558b90d3d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.726+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d3d8f0 con 0x558b90d3ae30 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.727+0000 7f6f5ef1a640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d3ae30 0x558b90d3d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.727+0000 7f6f5ef1a640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d3ae30 0x558b90d3d220 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.727+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.727+0000 7f6f60c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.727+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.727+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d3e190 con 0x558b90d3ae30 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.727+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.727+0000 7f6f60c2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.728+0000 7f6f60c2f800 20 searching for the correct realm 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.728+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558b90d3ff00 0x558b90d42350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.728+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ff00 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.728+0000 7f6f5e719640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558b90d3ff00 0x558b90d42350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.728+0000 7f6f5e719640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558b90d3ff00 0x558b90d42350 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.728+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.728+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ae30 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.728+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.728+0000 7f6f5ef1a640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6f58014440 0x7f6f580209f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.729+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x7f6f58014440 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.729+0000 7f6f55f18640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6f58014440 0x7f6f580209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.729+0000 7f6f55f18640 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6f58014440 0x7f6f580209f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.729+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x7f6f58014440 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.729+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.729+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.729+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.729+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.730+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ff00 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.730+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.730+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.730+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.730+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ae30 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.730+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.730+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ae30 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x7f6f58014440 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x7f6f58014440 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x7f6f58014440 2024-09-07T03:32:36.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6f4800f830 con 0x7f6f58014440 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.731+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ae30 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.732+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.732+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ff00 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.732+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.732+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.732+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.732+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ae30 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.732+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.732+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ff00 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ff00 2024-09-07T03:32:36.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.733+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x7f6f58014440 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.734+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x7f6f58014440 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.734+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d36960 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.734+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x558b90d36960 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.734+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x7f6f58014440 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.734+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x7f6f58014440 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.734+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ff00 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.734+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.734+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x7f6f58014440 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.734+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4800f830 con 0x7f6f58014440 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.735+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ae30 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.735+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.735+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ae30 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.735+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.735+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ff00 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.735+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.735+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ae30 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b90d42a20 con 0x558b90d3ae30 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:36.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d3eae0 con 0x558b90d36960 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d3ef30 con 0x558b90d3ae30 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.736+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d3f390 con 0x558b90d36960 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 20 zone default found 2024-09-07T03:32:36.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 4 Realm: () 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 20 zonegroup default 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d3e660 con 0x7f6f58014440 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d45130 con 0x558b90d3ff00 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.737+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d455f0 con 0x558b90d3ff00 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.738+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.738+0000 7f6f60c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.738+0000 7f6f60c2f800 20 started sync module instance, tier type = 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.738+0000 7f6f60c2f800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.738+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d43f30 con 0x558b90d3ae30 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.739+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.739+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94057918644944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d446f0 con 0x558b90d3ae30 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.739+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d46520 con 0x558b90d36960 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.740+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94057918644944] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.740+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.740+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94057918652528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d46940 con 0x558b90d36960 2024-09-07T03:32:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.740+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d47390 con 0x558b90d3ae30 2024-09-07T03:32:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.742+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94057918652528] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.746+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.746+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94057918656128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d47350 con 0x558b90d3ae30 2024-09-07T03:32:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.746+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d47e40 con 0x7f6f58014440 2024-09-07T03:32:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.747+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94057918656128] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.749+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.749+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94057918658896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d47e40 con 0x7f6f58014440 2024-09-07T03:32:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.749+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d48850 con 0x558b90d3ae30 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.751+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94057918658896] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.753+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.753+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94057918650960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d48850 con 0x558b90d3ae30 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.753+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d49260 con 0x558b90d3ff00 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.755+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.755+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94057918664112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d49b00 con 0x558b90d3ff00 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.755+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d4a560 con 0x558b90d3ff00 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.755+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94057918650960] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.756+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94057918664112] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.756+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.756+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94057918661536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d49650 con 0x558b90d3ff00 2024-09-07T03:32:36.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.756+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d4ae30 con 0x7f6f58014440 2024-09-07T03:32:36.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.758+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94057918671232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d4b250 con 0x7f6f58014440 2024-09-07T03:32:36.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f60c2f800 20 add_watcher() i=0 2024-09-07T03:32:36.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f60c2f800 20 add_watcher() i=1 2024-09-07T03:32:36.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f60c2f800 20 add_watcher() i=2 2024-09-07T03:32:36.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f60c2f800 20 add_watcher() i=3 2024-09-07T03:32:36.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f60c2f800 20 add_watcher() i=4 2024-09-07T03:32:36.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f60c2f800 20 add_watcher() i=5 2024-09-07T03:32:36.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94057918661536] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f60c2f800 20 add_watcher() i=6 2024-09-07T03:32:36.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.759+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94057918671232] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.760+0000 7f6f60c2f800 20 add_watcher() i=7 2024-09-07T03:32:36.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.760+0000 7f6f60c2f800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:36.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.760+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d4df00 con 0x558b90d36960 2024-09-07T03:32:36.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.760+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.760+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94057918668912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d4b250 con 0x558b90d36960 2024-09-07T03:32:36.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.761+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94057918668912] v34'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.761+0000 7f6e14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.761+0000 7f6f60c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:36.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.761+0000 7f6f60c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:36.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.761+0000 7f6f60c2f800 5 note: GC not initialized 2024-09-07T03:32:36.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6d8f7fe640 20 reqs_thread_entry: start 2024-09-07T03:32:36.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6f60c2f800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6f60c2f800 20 Filter name: none 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6d8d7fa640 20 reqs_thread_entry: start 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d81090 con 0x7f6f58014440 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6f60c2f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.762+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d81920 con 0x558b90d36960 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d80380 con 0x7f6f58014440 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d82f60 con 0x558b90d36960 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 4.1c 4:39102d40:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d829b0 con 0x7f6f58014440 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.763+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 4.31 4:8df6caeb:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d87820 con 0x558b90d3ae30 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:68 4.19 4:985013a3:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d829b0 con 0x558b90d3ff00 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 4.25 4:a77a67e6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d8c5c0 con 0x558b90d3ae30 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 4.5 4:a27908f1:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d8efc0 con 0x558b90d3ae30 2024-09-07T03:32:36.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 4.20 4:066752fa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d91c30 con 0x558b90d3ae30 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 4.5 4:a0612de6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d944a0 con 0x558b90d3ae30 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 4.23 4:c790c41e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d96d50 con 0x558b90d3ff00 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:74 4.16 4:6b625f27:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d99780 con 0x558b90d3ff00 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 4.38 4:1d9d37b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d9c1f0 con 0x558b90d3ae30 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(66 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:76 4.30 4:0fa4adf5:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b90d9c1f0 con 0x558b90d3ae30 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(68 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(74 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(67 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(69 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(70 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(71 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(75 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(76 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.764+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(72 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.765+0000 7f6e14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.765+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94057918668912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d800d0 con 0x558b90d36960 2024-09-07T03:32:36.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.768+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94057918668912] v34'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.768+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94057918644944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d7ea30 con 0x558b90d3ae30 2024-09-07T03:32:36.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.769+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94057918644944] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.769+0000 7f6f60c2f800 20 remove_watcher() i=0 2024-09-07T03:32:36.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.769+0000 7f6f60c2f800 2 removed watcher, disabling cache 2024-09-07T03:32:36.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.769+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94057918652528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d7ea30 con 0x558b90d36960 2024-09-07T03:32:36.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.770+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94057918652528] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x558b90d36960 2024-09-07T03:32:36.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.770+0000 7f6f60c2f800 20 remove_watcher() i=1 2024-09-07T03:32:36.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.770+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94057918656128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d7ea30 con 0x558b90d3ae30 2024-09-07T03:32:36.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.772+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94057918656128] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.772+0000 7f6f60c2f800 20 remove_watcher() i=2 2024-09-07T03:32:36.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.772+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94057918658896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d7ea30 con 0x7f6f58014440 2024-09-07T03:32:36.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.773+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94057918658896] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.773+0000 7f6f60c2f800 20 remove_watcher() i=3 2024-09-07T03:32:36.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.773+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94057918650960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d7ea30 con 0x558b90d3ae30 2024-09-07T03:32:36.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.777+0000 7f6f5ef1a640 1 -- 172.21.15.120:0/4020330040 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94057918650960] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f58027070 con 0x558b90d3ae30 2024-09-07T03:32:36.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.777+0000 7f6f60c2f800 20 remove_watcher() i=4 2024-09-07T03:32:36.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.777+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94057918664112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d7ea30 con 0x558b90d3ff00 2024-09-07T03:32:36.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.778+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94057918664112] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.778+0000 7f6f60c2f800 20 remove_watcher() i=5 2024-09-07T03:32:36.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.778+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94057918661536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d7ea30 con 0x558b90d3ff00 2024-09-07T03:32:36.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.779+0000 7f6f5e719640 1 -- 172.21.15.120:0/4020330040 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94057918661536] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50078070 con 0x558b90d3ff00 2024-09-07T03:32:36.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.779+0000 7f6f60c2f800 20 remove_watcher() i=6 2024-09-07T03:32:36.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.779+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94057918671232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b90d7ea30 con 0x7f6f58014440 2024-09-07T03:32:36.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94057918671232] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4803c040 con 0x7f6f58014440 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 20 remove_watcher() i=7 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d3ae30 msgr2=0x558b90d3d220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d3ae30 0x558b90d3d220 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90d36960 msgr2=0x558b90d38e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90d36960 0x558b90d38e20 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6f58014440 msgr2=0x7f6f580209f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6f58014440 0x7f6f580209f0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558b90d3ff00 msgr2=0x558b90d42350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558b90d3ff00 0x558b90d42350 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e2803c780 msgr2=0x7f6e2803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e2803c780 0x7f6e2803ec40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f5005eec0 tx=0x7f6f50084000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 msgr2=0x558b90d2af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f55f18640 1 -- 172.21.15.120:0/4020330040 reap_dead start 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d2af40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6f58053d30 tx=0x7f6f58053d60 comp rx=0 tx=0).stop 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 shutdown_connections 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/4020330040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90d23930 0x558b90d2af40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 >> 172.21.15.120:0/4020330040 conn(0x558b90d1fd30 msgr2=0x558b90d1df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 shutdown_connections 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.780+0000 7f6f60c2f800 1 -- 172.21.15.120:0/4020330040 wait complete. 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/1498315232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e3803c780 msgr2=0x7f6e3803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/1498315232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e3803c780 0x7f6e3803ec40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x558b90d053d0 tx=0x7f6f5005ff20 comp rx=0 tx=0).stop 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/1498315232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c02e50 msgr2=0x558b90c016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/1498315232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c02e50 0x558b90c016c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6f58016d20 tx=0x7f6f5800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/1498315232 shutdown_connections 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/1498315232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e3803c780 0x7f6e3803ec40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/1498315232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c02e50 0x558b90c016c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/1498315232 >> 172.21.15.120:0/1498315232 conn(0x558b90d09020 msgr2=0x558b90d09400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/1498315232 shutdown_connections 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/1498315232 wait complete. 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d022c0 msgr2=0x558b90d04750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d022c0 0x558b90d04750 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90c06020 msgr2=0x558b90d01480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90c06020 0x558b90d01480 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e4403c780 msgr2=0x7f6e4403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e4403c780 0x7f6e4403ec40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6f48001eb0 tx=0x7f6f480015b0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 msgr2=0x558b90cf9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf9e80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000a470 tx=0x7f6f50002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 shutdown_connections 2024-09-07T03:32:36.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558b90d022c0 0x558b90d04750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558b90c06020 0x558b90d01480 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e4403c780 0x7f6e4403ec40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 --2- 172.21.15.120:0/953205199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558b90c03690 0x558b90cf9e80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 >> 172.21.15.120:0/953205199 conn(0x558b90bfd1f0 msgr2=0x558b90cec7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 shutdown_connections 2024-09-07T03:32:36.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.781+0000 7f6f60c2f800 1 -- 172.21.15.120:0/953205199 wait complete. 2024-09-07T03:32:36.790 INFO:teuthology.orchestra.run.smithi120.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1445b2f9-7226-49a1-ba30-52d0fcf4c719","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","marker":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-07T03:32:35.748599Z","creation_time":"2024-09-07T03:32:35.744783Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-07T03:32:36.791 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1445b2f9-7226-49a1-ba30-52d0fcf4c719', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-07T03:32:35.748599Z', 'creation_time': '2024-09-07T03:32:35.744783Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-07T03:32:36.791 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-07T03:32:36.791 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-07T03:32:36.791 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-07T03:32:36.836 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:36.837 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:36.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.836+0000 7fac3a128800 1 Processor -- start 2024-09-07T03:32:36.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.836+0000 7fac3a128800 1 -- start start 2024-09-07T03:32:36.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.836+0000 7fac3a128800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559e0299e610 0x559e029a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.836+0000 7fac3a128800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e02847e40 con 0x559e029a1030 2024-09-07T03:32:36.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.836+0000 7fac3a128800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x559e02812680 con 0x559e0299e610 2024-09-07T03:32:36.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.836+0000 7fac35e4b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559e0299e610 0x559e029a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.836+0000 7fac3564a640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x559e029a1030 0x559e029a34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48466/0 (socket says 172.21.15.120:48466) 2024-09-07T03:32:36.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.836+0000 7fac35e4b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559e0299e610 0x559e029a0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42410/0 (socket says 172.21.15.120:42410) 2024-09-07T03:32:36.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.836+0000 7fac3564a640 1 -- 172.21.15.120:0/3939759326 learned_addr learned my addr 172.21.15.120:0/3939759326 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:36.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.837+0000 7fac35e4b640 1 -- 172.21.15.120:0/3939759326 >> v1:172.21.15.104:6789/0 conn(0x559e029a1030 legacy=0x559e029a34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.837+0000 7fac35e4b640 1 -- 172.21.15.120:0/3939759326 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0282e6b0 con 0x559e0299e610 2024-09-07T03:32:36.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.838+0000 7fac35e4b640 1 --2- 172.21.15.120:0/3939759326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e029a0a00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fac2800a470 tx=0x7fac28045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc8d01a348b2d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac34e49640 1 -- 172.21.15.120:0/3939759326 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac28053570 con 0x559e0299e610 2024-09-07T03:32:36.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac34e49640 1 -- 172.21.15.120:0/3939759326 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac28058070 con 0x559e0299e610 2024-09-07T03:32:36.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac34e49640 1 -- 172.21.15.120:0/3939759326 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac28053880 con 0x559e0299e610 2024-09-07T03:32:36.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac3a128800 1 -- 172.21.15.120:0/3939759326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 msgr2=0x559e029a0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac3a128800 1 --2- 172.21.15.120:0/3939759326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e029a0a00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fac2800a470 tx=0x7fac28045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:36.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac3a128800 1 -- 172.21.15.120:0/3939759326 shutdown_connections 2024-09-07T03:32:36.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac3a128800 1 --2- 172.21.15.120:0/3939759326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e029a0a00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac3a128800 1 -- 172.21.15.120:0/3939759326 >> 172.21.15.120:0/3939759326 conn(0x559e029981d0 msgr2=0x559e0299a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac3a128800 1 -- 172.21.15.120:0/3939759326 shutdown_connections 2024-09-07T03:32:36.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.839+0000 7fac3a128800 1 -- 172.21.15.120:0/3939759326 wait complete. 2024-09-07T03:32:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.853+0000 7fac3a128800 1 Processor -- start 2024-09-07T03:32:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.853+0000 7fac3a128800 1 -- start start 2024-09-07T03:32:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.853+0000 7fac3a128800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a8d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.853+0000 7fac3a128800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e02836dd0 con 0x559e0299e610 2024-09-07T03:32:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.853+0000 7fac35e4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a8d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.854+0000 7fac35e4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a8d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42424/0 (socket says 172.21.15.120:42424) 2024-09-07T03:32:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.854+0000 7fac35e4b640 1 -- 172.21.15.120:0/3348006720 learned_addr learned my addr 172.21.15.120:0/3348006720 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.854+0000 7fac35e4b640 1 -- 172.21.15.120:0/3348006720 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0284fe10 con 0x559e0299e610 2024-09-07T03:32:36.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.854+0000 7fac35e4b640 1 --2- 172.21.15.120:0/3348006720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a8d6b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fac28025c20 tx=0x7fac28051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e79056e9cf56f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.854+0000 7fab23e07640 1 -- 172.21.15.120:0/3348006720 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac28053a20 con 0x559e0299e610 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.854+0000 7fab23e07640 1 -- 172.21.15.120:0/3348006720 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac28063070 con 0x559e0299e610 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.854+0000 7fab23e07640 1 -- 172.21.15.120:0/3348006720 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac28053cf0 con 0x559e0299e610 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 -- 172.21.15.120:0/3348006720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 msgr2=0x559e02a8d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 --2- 172.21.15.120:0/3348006720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a8d6b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fac28025c20 tx=0x7fac28051000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 -- 172.21.15.120:0/3348006720 shutdown_connections 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 --2- 172.21.15.120:0/3348006720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a8d6b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 -- 172.21.15.120:0/3348006720 >> 172.21.15.120:0/3348006720 conn(0x559e029981d0 msgr2=0x559e02a89030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 -- 172.21.15.120:0/3348006720 shutdown_connections 2024-09-07T03:32:36.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 -- 172.21.15.120:0/3348006720 wait complete. 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 Processor -- start 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 -- start start 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a94ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.855+0000 7fac3a128800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e029a5050 con 0x559e0299e610 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fac35e4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a94ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fac35e4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a94ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42436/0 (socket says 172.21.15.120:42436) 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fac35e4b640 1 -- 172.21.15.120:0/410895980 learned_addr learned my addr 172.21.15.120:0/410895980 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fac35e4b640 1 -- 172.21.15.120:0/410895980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e02a95430 con 0x559e0299e610 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fac35e4b640 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a94ed0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac28025c20 tx=0x7fac28002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fab22604640 1 -- 172.21.15.120:0/410895980 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac2806c030 con 0x559e0299e610 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fab22604640 1 -- 172.21.15.120:0/410895980 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac28068660 con 0x559e0299e610 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e02a956c0 con 0x559e0299e610 2024-09-07T03:32:36.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fab22604640 1 -- 172.21.15.120:0/410895980 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac28068940 con 0x559e0299e610 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.856+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e02a960c0 con 0x559e0299e610 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.857+0000 7fab22604640 1 -- 172.21.15.120:0/410895980 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fac28068ae0 con 0x559e0299e610 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.857+0000 7fab22604640 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1c03c780 0x7fab1c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.857+0000 7fab22604640 1 -- 172.21.15.120:0/410895980 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fac28098020 con 0x559e0299e610 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.857+0000 7fac3564a640 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1c03c780 0x7fab1c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.857+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e029a1030 0x559e02a9c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.857+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02a9ca60 con 0x559e029a1030 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.858+0000 7fac3664c640 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e029a1030 0x559e02a9c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.858+0000 7fac3564a640 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1c03c780 0x7fab1c03ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fac2c001d70 tx=0x7fac2c0012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.858+0000 7fac3664c640 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e029a1030 0x559e02a9c520 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.858+0000 7fac3664c640 1 -- 172.21.15.120:0/410895980 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac3000a4d0 con 0x559e029a1030 2024-09-07T03:32:36.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.858+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02a9d360 0x559e02a9f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.858+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02a9ff60 con 0x559e02a9d360 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.858+0000 7fac35e4b640 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02a9d360 0x559e02a9f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.859+0000 7fac35e4b640 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02a9d360 0x559e02a9f7f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.859+0000 7fac35e4b640 1 -- 172.21.15.120:0/410895980 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac28051070 con 0x559e02a9d360 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.859+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02aa1810 con 0x559e02a9d360 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.859+0000 7fac35e4b640 1 -- 172.21.15.120:0/410895980 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fac28051070 con 0x559e02a9d360 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.859+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02aa0950 con 0x559e02a9d360 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.860+0000 7fac35e4b640 1 -- 172.21.15.120:0/410895980 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac28051070 con 0x559e02a9d360 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.860+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02aa0db0 con 0x559e029a1030 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.860+0000 7fac3664c640 1 -- 172.21.15.120:0/410895980 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fac3000a4d0 con 0x559e029a1030 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.860+0000 7fac3a128800 1 Processor -- start 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.860+0000 7fac3a128800 1 -- start start 2024-09-07T03:32:36.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.860+0000 7fac3a128800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299ddd0 0x559e0299c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.860+0000 7fac3a128800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e02894a00 con 0x559e0299ddd0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fac3664c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299ddd0 0x559e0299c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fac3664c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299ddd0 0x559e0299c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42450/0 (socket says 172.21.15.120:42450) 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fac3664c640 1 -- 172.21.15.120:0/3389840131 learned_addr learned my addr 172.21.15.120:0/3389840131 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fac3664c640 1 -- 172.21.15.120:0/3389840131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0299e2f0 con 0x559e0299ddd0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fac3664c640 1 --2- 172.21.15.120:0/3389840131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299ddd0 0x559e0299c640 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fac30016d20 tx=0x7fac3000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fab1b7fe640 1 -- 172.21.15.120:0/3389840131 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30017660 con 0x559e0299ddd0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fab1b7fe640 1 -- 172.21.15.120:0/3389840131 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3001b030 con 0x559e0299ddd0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fab1b7fe640 1 -- 172.21.15.120:0/3389840131 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30017950 con 0x559e0299ddd0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fac3a128800 1 -- 172.21.15.120:0/3389840131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e0299cb80 con 0x559e0299ddd0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.861+0000 7fac3a128800 1 -- 172.21.15.120:0/3389840131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e0299d120 con 0x559e0299ddd0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.862+0000 7fab1b7fe640 1 -- 172.21.15.120:0/3389840131 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fac30017af0 con 0x559e0299ddd0 2024-09-07T03:32:36.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.862+0000 7fab1b7fe640 1 --2- 172.21.15.120:0/3389840131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1003c780 0x7fab1003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.862+0000 7fab1b7fe640 1 -- 172.21.15.120:0/3389840131 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fac3000e040 con 0x559e0299ddd0 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.862+0000 7fac35e4b640 1 --2- 172.21.15.120:0/3389840131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1003c780 0x7fab1003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.862+0000 7fac3a128800 1 Processor -- start 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fac3a128800 1 -- start start 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fac35e4b640 1 --2- 172.21.15.120:0/3389840131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1003c780 0x7fab1003ec40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x559e02a96630 tx=0x7fac28081040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fac3a128800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02abed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fac3a128800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e02a8dea0 con 0x559e02abe990 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fac3664c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02abed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fac3664c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02abed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42464/0 (socket says 172.21.15.120:42464) 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fac3664c640 1 -- 172.21.15.120:0/2902296994 learned_addr learned my addr 172.21.15.120:0/2902296994 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fac3664c640 1 -- 172.21.15.120:0/2902296994 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e02abf380 con 0x559e02abe990 2024-09-07T03:32:36.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fac3664c640 1 --2- 172.21.15.120:0/2902296994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02abed90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac30054030 tx=0x7fac30054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a5b1354b96617b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fab197fa640 1 -- 172.21.15.120:0/2902296994 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30014d40 con 0x559e02abe990 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fab197fa640 1 -- 172.21.15.120:0/2902296994 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac300149b0 con 0x559e02abe990 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.863+0000 7fab197fa640 1 -- 172.21.15.120:0/2902296994 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30028350 con 0x559e02abe990 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 -- 172.21.15.120:0/2902296994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 msgr2=0x559e02abed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 --2- 172.21.15.120:0/2902296994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02abed90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac30054030 tx=0x7fac30054060 comp rx=0 tx=0).stop 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 -- 172.21.15.120:0/2902296994 shutdown_connections 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 --2- 172.21.15.120:0/2902296994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02abed90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 -- 172.21.15.120:0/2902296994 >> 172.21.15.120:0/2902296994 conn(0x559e02abad90 msgr2=0x559e02ab8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 -- 172.21.15.120:0/2902296994 shutdown_connections 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 -- 172.21.15.120:0/2902296994 wait complete. 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 Processor -- start 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 -- start start 2024-09-07T03:32:36.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02ac5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.864+0000 7fac3a128800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559e02abf970 con 0x559e02abe990 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fac3664c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02ac5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fac3664c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02ac5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42472/0 (socket says 172.21.15.120:42472) 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 learned_addr learned my addr 172.21.15.120:0/2126503705 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e02ac6490 con 0x559e02abe990 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fac3664c640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02ac5f30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac30053d10 tx=0x7fac30053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fab077fe640 1 -- 172.21.15.120:0/2126503705 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30012570 con 0x559e02abe990 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fab077fe640 1 -- 172.21.15.120:0/2126503705 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac30005500 con 0x559e02abe990 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fab077fe640 1 -- 172.21.15.120:0/2126503705 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac30055570 con 0x559e02abe990 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e02ac6720 con 0x559e02abe990 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.865+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e02ac72b0 con 0x559e02abe990 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.866+0000 7fab077fe640 1 -- 172.21.15.120:0/2126503705 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fac300127a0 con 0x559e02abe990 2024-09-07T03:32:36.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.866+0000 7fab077fe640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab0003c730 0x7fab0003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.866+0000 7fab077fe640 1 -- 172.21.15.120:0/2126503705 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fac30048920 con 0x559e02abe990 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.866+0000 7fac35e4b640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab0003c730 0x7fab0003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e02ad1a40 0x559e02ad3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ad4650 con 0x559e02ad1a40 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3564a640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e02ad1a40 0x559e02ad3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac35e4b640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab0003c730 0x7fab0003ebf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac28053ca0 tx=0x7fac28083000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3564a640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e02ad1a40 0x559e02ad3f00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac2c009050 con 0x559e02ad1a40 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3a128800 20 realm 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.867+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ad0d90 con 0x559e02ad1a40 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac2c009050 con 0x559e02ad1a40 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3a128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ad5130 con 0x559e02ad1a40 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac2c009050 con 0x559e02ad1a40 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02ad5f10 0x559e02ad8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ad89d0 con 0x559e02ad5f10 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3664c640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02ad5f10 0x559e02ad8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3664c640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02ad5f10 0x559e02ad8300 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.868+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac3a128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ad9270 con 0x559e02ad5f10 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac3a128800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac3a128800 20 searching for the correct realm 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559e02adafe0 0x559e02add3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02adafe0 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac35e4b640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559e02adafe0 0x559e02add3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac35e4b640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559e02adafe0 0x559e02add3f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.869+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad5f10 2024-09-07T03:32:36.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.870+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.870+0000 7fac3664c640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fac30014440 0x7fac3003bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.870+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x7fac30014440 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.870+0000 7fac3564a640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fac30014440 0x7fac3003bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.870+0000 7fac3564a640 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fac30014440 0x7fac3003bab0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.870+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c009050 con 0x7fac30014440 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.870+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.871+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c009050 con 0x559e02ad1a40 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.871+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.871+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.871+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02adafe0 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.871+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.871+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.871+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.871+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad5f10 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad5f10 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x7fac30014440 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.872+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x7fac30014440 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.873+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.873+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad5f10 2024-09-07T03:32:36.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.873+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.873+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02adafe0 2024-09-07T03:32:36.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.873+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.873+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.873+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.874+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad5f10 2024-09-07T03:32:36.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.874+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.874+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02adafe0 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.874+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.874+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.874+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.874+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.874+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.874+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.875+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.875+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02adafe0 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.875+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.875+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x7fac30014440 2024-09-07T03:32:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.875+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.875+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad1a40 2024-09-07T03:32:36.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.875+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.875+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x7fac30014440 2024-09-07T03:32:36.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.876+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.876+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02adafe0 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.876+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.876+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x7fac30014440 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.876+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.876+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad5f10 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad5f10 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02adafe0 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad5f10 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e02addac0 con 0x559e02ad5f10 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3a128800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3a128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3a128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3a128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3a128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3a128800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.877+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ad9bc0 con 0x559e02ad1a40 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ada010 con 0x559e02ad5f10 2024-09-07T03:32:36.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ada470 con 0x559e02ad1a40 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 20 zone default found 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 4 Realm: () 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 20 zonegroup default 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.878+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ad9740 con 0x7fac30014440 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae01f0 con 0x559e02adafe0 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae06b0 con 0x559e02adafe0 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 20 started sync module instance, tier type = 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:36.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.879+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02adeff0 con 0x559e02ad5f10 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.880+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.880+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94137138146112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae0b10 con 0x559e02ad5f10 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.880+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae0b10 con 0x559e02ad1a40 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.882+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94137138146112] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.882+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.882+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94137138154256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae13e0 con 0x559e02ad1a40 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.882+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae1cb0 con 0x559e02ad5f10 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.883+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94137138154256] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.883+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.883+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94137138155312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae1800 con 0x559e02ad5f10 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.883+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae27b0 con 0x7fac30014440 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.884+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.884+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94137138160272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae27b0 con 0x7fac30014440 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.884+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94137138155312] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.884+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae3760 con 0x559e02ad5f10 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.886+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94137138160272] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.888+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.888+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94137138162592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae3760 con 0x559e02ad5f10 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.888+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae4000 con 0x559e02adafe0 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.890+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.890+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94137138166608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae3760 con 0x559e02adafe0 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.890+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae4b50 con 0x559e02adafe0 2024-09-07T03:32:36.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.890+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94137138162592] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.892+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94137138166608] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.892+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.892+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94137138167664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae4b10 con 0x559e02adafe0 2024-09-07T03:32:36.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.892+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae53f0 con 0x7fac30014440 2024-09-07T03:32:36.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94137138171712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae5810 con 0x7fac30014440 2024-09-07T03:32:36.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac3a128800 20 add_watcher() i=0 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac3a128800 20 add_watcher() i=1 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac3a128800 20 add_watcher() i=2 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac3a128800 20 add_watcher() i=3 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac3a128800 20 add_watcher() i=4 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac3a128800 20 add_watcher() i=5 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94137138167664] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.893+0000 7fac3a128800 20 add_watcher() i=6 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.894+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94137138171712] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.894+0000 7fac3a128800 20 add_watcher() i=7 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.894+0000 7fac3a128800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.894+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae8510 con 0x559e02ad1a40 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.895+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.895+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94137138169408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae5810 con 0x559e02ad1a40 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.896+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94137138169408] v34'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.896+0000 7faaebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.896+0000 7fac3a128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.896+0000 7fac3a128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.896+0000 7fac3a128800 5 note: GC not initialized 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.897+0000 7faaeafe5640 20 reqs_thread_entry: start 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.897+0000 7fac3a128800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.897+0000 7fac3a128800 20 Filter name: none 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.897+0000 7faae8fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.897+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.897+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b1b120 con 0x559e02ad1a40 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.897+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.897+0000 7fac3a128800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.897+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b1c540 con 0x7fac30014440 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b1c510 con 0x559e02ad1a40 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(64 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:65 4.1c 4:39102d40:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b1e050 con 0x7fac30014440 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 4.31 4:8df6caeb:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b20d20 con 0x559e02ad5f10 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 4.19 4:985013a3:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b237f0 con 0x559e02adafe0 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 4.25 4:a77a67e6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b26060 con 0x559e02ad5f10 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 4.5 4:a27908f1:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b288d0 con 0x559e02ad5f10 2024-09-07T03:32:36.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 4.20 4:066752fa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b288d0 con 0x559e02ad5f10 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 4.5 4:a0612de6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b2d8a0 con 0x559e02ad5f10 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 4.23 4:c790c41e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b30210 con 0x559e02adafe0 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 4.16 4:6b625f27:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b32b00 con 0x559e02adafe0 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 4.38 4:1d9d37b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b32b00 con 0x559e02ad5f10 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.898+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 4.30 4:0fa4adf5:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b37cf0 con 0x559e02ad5f10 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(65 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(66 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(69 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(67 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(74 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(75 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(72 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.899+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02b37c70 con 0x7fac30014440 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.900+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(76 foo.buckets [call] v34'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.900+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02b37c70 con 0x7fac30014440 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.901+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(77 foo.buckets [call] v34'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.901+0000 7fac3a128800 20 rados->read ofs=0 len=0 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.901+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b37c70 con 0x559e02ad1a40 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.901+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.901+0000 7fac3a128800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.901+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02b37c70 con 0x7fac30014440 2024-09-07T03:32:36.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.901+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.902+0000 7faaebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.902+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94137138169408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02b37c70 con 0x559e02ad1a40 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.903+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94137138169408] v34'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.903+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94137138146112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae4640 con 0x559e02ad5f10 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.904+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94137138146112] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.904+0000 7fac3a128800 20 remove_watcher() i=0 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.904+0000 7fac3a128800 2 removed watcher, disabling cache 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.904+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94137138154256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae4640 con 0x559e02ad1a40 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.905+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94137138154256] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x559e02ad1a40 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.905+0000 7fac3a128800 20 remove_watcher() i=1 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.905+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94137138155312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae0b10 con 0x559e02ad5f10 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.908+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94137138155312] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.908+0000 7fac3a128800 20 remove_watcher() i=2 2024-09-07T03:32:36.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.908+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94137138160272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae4640 con 0x7fac30014440 2024-09-07T03:32:36.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.909+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94137138160272] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.909+0000 7fac3a128800 20 remove_watcher() i=3 2024-09-07T03:32:36.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.909+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94137138162592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae2290 con 0x559e02ad5f10 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.910+0000 7fac3664c640 1 -- 172.21.15.120:0/2126503705 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94137138162592] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac30027070 con 0x559e02ad5f10 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.910+0000 7fac3a128800 20 remove_watcher() i=4 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.910+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94137138166608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae4640 con 0x559e02adafe0 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.911+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94137138166608] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.911+0000 7fac3a128800 20 remove_watcher() i=5 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.911+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94137138167664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae2290 con 0x559e02adafe0 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.912+0000 7fac35e4b640 1 -- 172.21.15.120:0/2126503705 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94137138167664] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac28051070 con 0x559e02adafe0 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.912+0000 7fac3a128800 20 remove_watcher() i=6 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.912+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94137138171712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e02ae4640 con 0x7fac30014440 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94137138171712] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c028040 con 0x7fac30014440 2024-09-07T03:32:36.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 20 remove_watcher() i=7 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02ad5f10 msgr2=0x559e02ad8300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02ad5f10 0x559e02ad8300 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e02ad1a40 msgr2=0x559e02ad3f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e02ad1a40 0x559e02ad3f00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fac30014440 msgr2=0x7fac3003bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fac30014440 0x7fac3003bab0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559e02adafe0 msgr2=0x559e02add3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559e02adafe0 0x559e02add3f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab0003c730 msgr2=0x7fab0003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab0003c730 0x7fab0003ebf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac28053ca0 tx=0x7fac28083000 comp rx=0 tx=0).stop 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 msgr2=0x559e02ac5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02ac5f30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac30053d10 tx=0x7fac30053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:36.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3564a640 1 -- 172.21.15.120:0/2126503705 reap_dead start 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 shutdown_connections 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/2126503705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e02abe990 0x559e02ac5f30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 >> 172.21.15.120:0/2126503705 conn(0x559e02abad90 msgr2=0x559e02ab8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 shutdown_connections 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/2126503705 wait complete. 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/3389840131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1003c780 msgr2=0x7fab1003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/3389840131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1003c780 0x7fab1003ec40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x559e02a96630 tx=0x7fac28081040 comp rx=0 tx=0).stop 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/3389840131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299ddd0 msgr2=0x559e0299c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/3389840131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299ddd0 0x559e0299c640 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fac30016d20 tx=0x7fac3000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/3389840131 shutdown_connections 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/3389840131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1003c780 0x7fab1003ec40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 --2- 172.21.15.120:0/3389840131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299ddd0 0x559e0299c640 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/3389840131 >> 172.21.15.120:0/3389840131 conn(0x559e02aa40c0 msgr2=0x559e02aa44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/3389840131 shutdown_connections 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.913+0000 7fac3a128800 1 -- 172.21.15.120:0/3389840131 wait complete. 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02a9d360 msgr2=0x559e02a9f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02a9d360 0x559e02a9f7f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e029a1030 msgr2=0x559e02a9c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e029a1030 0x559e02a9c520 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1c03c780 msgr2=0x7fab1c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1c03c780 0x7fab1c03ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fac2c001d70 tx=0x7fac2c0012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 msgr2=0x559e02a94ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a94ed0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac28025c20 tx=0x7fac28002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 shutdown_connections 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559e02a9d360 0x559e02a9f7f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559e029a1030 0x559e02a9c520 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fab1c03c780 0x7fab1c03ec40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 --2- 172.21.15.120:0/410895980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559e0299e610 0x559e02a94ed0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 >> 172.21.15.120:0/410895980 conn(0x559e029981d0 msgr2=0x559e02a87820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 shutdown_connections 2024-09-07T03:32:36.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.914+0000 7fac3a128800 1 -- 172.21.15.120:0/410895980 wait complete. 2024-09-07T03:32:36.926 INFO:teuthology.orchestra.run.smithi120.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-07T03:32:36.901280Z","last_stats_update":"2024-09-07T03:32:36.900282Z"} 2024-09-07T03:32:36.926 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-07T03:32:36.901280Z', 'last_stats_update': '2024-09-07T03:32:36.900282Z'} 2024-09-07T03:32:36.931 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:36.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-07T03:32:36.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-07T03:32:36.932 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-07T03:32:36.978 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:36.978 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:36.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b9893a800 1 Processor -- start 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b9893a800 1 -- start start 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b9893a800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562d7c9e2210 0x562d7c9e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b9893a800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d7c88be40 con 0x562d7c9e0e00 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b9893a800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x562d7c856680 con 0x562d7c9e2210 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b8be80640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562d7c9e2210 0x562d7c9e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b94681640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x562d7c9e0e00 0x562d7c9e1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48470/0 (socket says 172.21.15.120:48470) 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b8be80640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562d7c9e2210 0x562d7c9e7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42488/0 (socket says 172.21.15.120:42488) 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b94681640 1 -- 172.21.15.120:0/675830529 learned_addr learned my addr 172.21.15.120:0/675830529 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b8be80640 1 -- 172.21.15.120:0/675830529 >> v1:172.21.15.104:6789/0 conn(0x562d7c9e0e00 legacy=0x562d7c9e1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b8be80640 1 -- 172.21.15.120:0/675830529 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d7c8726b0 con 0x562d7c9e2210 2024-09-07T03:32:36.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.978+0000 7f3b93e80640 1 -- 172.21.15.120:0/675830529 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161943816 0 0) 0x562d7c88be40 con 0x562d7c9e0e00 2024-09-07T03:32:36.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.980+0000 7f3b8be80640 1 --2- 172.21.15.120:0/675830529 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e2210 0x562d7c9e7db0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00a470 tx=0x7f3b7c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de81bc5eb4eb990 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.980+0000 7f3b93e80640 1 -- 172.21.15.120:0/675830529 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b7c053570 con 0x562d7c9e2210 2024-09-07T03:32:36.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.980+0000 7f3b93e80640 1 -- 172.21.15.120:0/675830529 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c058070 con 0x562d7c9e2210 2024-09-07T03:32:36.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.980+0000 7f3b93e80640 1 -- 172.21.15.120:0/675830529 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b7c053880 con 0x562d7c9e2210 2024-09-07T03:32:36.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.981+0000 7f3b9893a800 1 -- 172.21.15.120:0/675830529 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e2210 msgr2=0x562d7c9e7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:36.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.981+0000 7f3b9893a800 1 --2- 172.21.15.120:0/675830529 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e2210 0x562d7c9e7db0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00a470 tx=0x7f3b7c045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:36.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.981+0000 7f3b9893a800 1 -- 172.21.15.120:0/675830529 shutdown_connections 2024-09-07T03:32:36.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.981+0000 7f3b9893a800 1 --2- 172.21.15.120:0/675830529 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e2210 0x562d7c9e7db0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:36.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.981+0000 7f3b9893a800 1 -- 172.21.15.120:0/675830529 >> 172.21.15.120:0/675830529 conn(0x562d7c9dc1d0 msgr2=0x562d7c9de630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:36.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.981+0000 7f3b9893a800 1 -- 172.21.15.120:0/675830529 shutdown_connections 2024-09-07T03:32:36.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.981+0000 7f3b9893a800 1 -- 172.21.15.120:0/675830529 wait complete. 2024-09-07T03:32:36.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.994+0000 7f3b9893a800 1 Processor -- start 2024-09-07T03:32:36.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.994+0000 7f3b9893a800 1 -- start start 2024-09-07T03:32:36.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.995+0000 7f3b9893a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7c954dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:36.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.995+0000 7f3b9893a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d7c87add0 con 0x562d7c9e0e00 2024-09-07T03:32:36.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.995+0000 7f3b94681640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7c954dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:36.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.995+0000 7f3b94681640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7c954dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42494/0 (socket says 172.21.15.120:42494) 2024-09-07T03:32:36.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.995+0000 7f3b94681640 1 -- 172.21.15.120:0/2272534909 learned_addr learned my addr 172.21.15.120:0/2272534909 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:36.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.995+0000 7f3b94681640 1 -- 172.21.15.120:0/2272534909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d7c893e10 con 0x562d7c9e0e00 2024-09-07T03:32:36.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.995+0000 7f3b94681640 1 --2- 172.21.15.120:0/2272534909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7c954dc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b84001ea0 tx=0x7f3b8400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff15ef0875ac49bf server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:36.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3a8260c640 1 -- 172.21.15.120:0/2272534909 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b84008070 con 0x562d7c9e0e00 2024-09-07T03:32:36.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3a8260c640 1 -- 172.21.15.120:0/2272534909 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8400d500 con 0x562d7c9e0e00 2024-09-07T03:32:36.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3a8260c640 1 -- 172.21.15.120:0/2272534909 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8400d880 con 0x562d7c9e0e00 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3b9893a800 1 -- 172.21.15.120:0/2272534909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 msgr2=0x562d7c954dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3b9893a800 1 --2- 172.21.15.120:0/2272534909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7c954dc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b84001ea0 tx=0x7f3b8400b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3b9893a800 1 -- 172.21.15.120:0/2272534909 shutdown_connections 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3b9893a800 1 --2- 172.21.15.120:0/2272534909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7c954dc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3b9893a800 1 -- 172.21.15.120:0/2272534909 >> 172.21.15.120:0/2272534909 conn(0x562d7c9dc1d0 msgr2=0x562d7cacbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3b9893a800 1 -- 172.21.15.120:0/2272534909 shutdown_connections 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.996+0000 7f3b9893a800 1 -- 172.21.15.120:0/2272534909 wait complete. 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3b9893a800 1 Processor -- start 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3b9893a800 1 -- start start 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3b9893a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7cad8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3b9893a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d7c9e2900 con 0x562d7c9e0e00 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3b94681640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7cad8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3b94681640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7cad8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42508/0 (socket says 172.21.15.120:42508) 2024-09-07T03:32:37.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3b94681640 1 -- 172.21.15.120:0/3298386722 learned_addr learned my addr 172.21.15.120:0/3298386722 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3b94681640 1 -- 172.21.15.120:0/3298386722 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d7cad9360 con 0x562d7c9e0e00 2024-09-07T03:32:37.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3b94681640 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7cad8e00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3b840012f0 tx=0x7f3b84000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3a80e09640 1 -- 172.21.15.120:0/3298386722 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8400f9d0 con 0x562d7c9e0e00 2024-09-07T03:32:37.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3a80e09640 1 -- 172.21.15.120:0/3298386722 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8400fb70 con 0x562d7c9e0e00 2024-09-07T03:32:37.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.997+0000 7f3a80e09640 1 -- 172.21.15.120:0/3298386722 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8400fe50 con 0x562d7c9e0e00 2024-09-07T03:32:37.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.998+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d7cad95f0 con 0x562d7c9e0e00 2024-09-07T03:32:37.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.998+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d7cad9ff0 con 0x562d7c9e0e00 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.998+0000 7f3a80e09640 1 -- 172.21.15.120:0/3298386722 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3b84017040 con 0x562d7c9e0e00 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3a80e09640 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a7c03c920 0x7f3a7c03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3a80e09640 1 -- 172.21.15.120:0/3298386722 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f3b84015020 con 0x562d7c9e0e00 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3b8be80640 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a7c03c920 0x7f3a7c03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7c9e2210 0x562d7cae0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cae0990 con 0x562d7c9e2210 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3b94e82640 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7c9e2210 0x562d7cae0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3b8be80640 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a7c03c920 0x7f3a7c03ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c057000 tx=0x7f3b7c052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3b94e82640 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7c9e2210 0x562d7cae0450 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3b94e82640 1 -- 172.21.15.120:0/3298386722 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b8c00a4d0 con 0x562d7c9e2210 2024-09-07T03:32:37.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cae1240 0x562d7cae3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:36.999+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cae3e70 con 0x562d7cae1240 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.000+0000 7f3b94681640 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cae1240 0x562d7cae3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.000+0000 7f3b94681640 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cae1240 0x562d7cae3700 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.000+0000 7f3b94681640 1 -- 172.21.15.120:0/3298386722 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cae1240 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.000+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cae5720 con 0x562d7cae1240 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.001+0000 7f3b94681640 1 -- 172.21.15.120:0/3298386722 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cae1240 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.001+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cae4890 con 0x562d7cae1240 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.001+0000 7f3b94681640 1 -- 172.21.15.120:0/3298386722 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cae1240 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.001+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cae4cb0 con 0x562d7c9e2210 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.001+0000 7f3b94e82640 1 -- 172.21.15.120:0/3298386722 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3b8c00a4d0 con 0x562d7c9e2210 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.001+0000 7f3b9893a800 1 Processor -- start 2024-09-07T03:32:37.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.002+0000 7f3b9893a800 1 -- start start 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.002+0000 7f3b9893a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7caf3bd0 0x562d7caf3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.002+0000 7f3b9893a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d7c8d8a00 con 0x562d7caf3bd0 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.002+0000 7f3b94e82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7caf3bd0 0x562d7caf3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.002+0000 7f3b94e82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7caf3bd0 0x562d7caf3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42512/0 (socket says 172.21.15.120:42512) 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.002+0000 7f3b94e82640 1 -- 172.21.15.120:0/1098206472 learned_addr learned my addr 172.21.15.120:0/1098206472 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.002+0000 7f3b94e82640 1 -- 172.21.15.120:0/1098206472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d7caf4630 con 0x562d7caf3bd0 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.002+0000 7f3b94e82640 1 --2- 172.21.15.120:0/1098206472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7caf3bd0 0x562d7caf3ff0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c016d20 tx=0x7f3b8c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.003+0000 7f3a79ffb640 1 -- 172.21.15.120:0/1098206472 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c017660 con 0x562d7caf3bd0 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.003+0000 7f3a79ffb640 1 -- 172.21.15.120:0/1098206472 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c01b030 con 0x562d7caf3bd0 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.003+0000 7f3b9893a800 1 -- 172.21.15.120:0/1098206472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d7caf4e60 con 0x562d7caf3bd0 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.003+0000 7f3a79ffb640 1 -- 172.21.15.120:0/1098206472 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c017950 con 0x562d7caf3bd0 2024-09-07T03:32:37.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.003+0000 7f3b9893a800 1 -- 172.21.15.120:0/1098206472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d7caf5400 con 0x562d7caf3bd0 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.003+0000 7f3a79ffb640 1 -- 172.21.15.120:0/1098206472 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3b8c017af0 con 0x562d7caf3bd0 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.003+0000 7f3a79ffb640 1 --2- 172.21.15.120:0/1098206472 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6c03c780 0x7f3a6c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3a79ffb640 1 -- 172.21.15.120:0/1098206472 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f3b8c00e040 con 0x562d7caf3bd0 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b94681640 1 --2- 172.21.15.120:0/1098206472 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6c03c780 0x7f3a6c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b9893a800 1 Processor -- start 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b9893a800 1 -- start start 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b94681640 1 --2- 172.21.15.120:0/1098206472 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6c03c780 0x7f3a6c03ec40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x562d7cae43b0 tx=0x7f3b84001460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b9893a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb00ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b9893a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d7cad4190 con 0x562d7cb006d0 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b94e82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb00ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b94e82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb00ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42522/0 (socket says 172.21.15.120:42522) 2024-09-07T03:32:37.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b94e82640 1 -- 172.21.15.120:0/2817032192 learned_addr learned my addr 172.21.15.120:0/2817032192 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.004+0000 7f3b94e82640 1 -- 172.21.15.120:0/2817032192 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d7cb010c0 con 0x562d7cb006d0 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3b94e82640 1 --2- 172.21.15.120:0/2817032192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb00ad0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c053e00 tx=0x7f3b8c017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ae66b5eaf99113 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3a737fe640 1 -- 172.21.15.120:0/2817032192 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c014d40 con 0x562d7cb006d0 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3a737fe640 1 -- 172.21.15.120:0/2817032192 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c051070 con 0x562d7cb006d0 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3a737fe640 1 -- 172.21.15.120:0/2817032192 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c0149b0 con 0x562d7cb006d0 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3b9893a800 1 -- 172.21.15.120:0/2817032192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 msgr2=0x562d7cb00ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3b9893a800 1 --2- 172.21.15.120:0/2817032192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb00ad0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c053e00 tx=0x7f3b8c017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3b9893a800 1 -- 172.21.15.120:0/2817032192 shutdown_connections 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3b9893a800 1 --2- 172.21.15.120:0/2817032192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb00ad0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3b9893a800 1 -- 172.21.15.120:0/2817032192 >> 172.21.15.120:0/2817032192 conn(0x562d7cafcad0 msgr2=0x562d7cafad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3b9893a800 1 -- 172.21.15.120:0/2817032192 shutdown_connections 2024-09-07T03:32:37.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3b9893a800 1 -- 172.21.15.120:0/2817032192 wait complete. 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.005+0000 7f3b9893a800 1 Processor -- start 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b9893a800 1 -- start start 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b9893a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb07d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b9893a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d7cb016e0 con 0x562d7cb006d0 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b94e82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb07d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b94e82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb07d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42528/0 (socket says 172.21.15.120:42528) 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 learned_addr learned my addr 172.21.15.120:0/3347347315 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d7cb082c0 con 0x562d7cb006d0 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b94e82640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb07d60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c012500 tx=0x7f3b8c053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3a71ffb640 1 -- 172.21.15.120:0/3347347315 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c012570 con 0x562d7cb006d0 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3a71ffb640 1 -- 172.21.15.120:0/3347347315 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c02e070 con 0x562d7cb006d0 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d7cb08550 con 0x562d7cb006d0 2024-09-07T03:32:37.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3a71ffb640 1 -- 172.21.15.120:0/3347347315 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c028820 con 0x562d7cb006d0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.006+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d7cb08ed0 con 0x562d7cb006d0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.007+0000 7f3a71ffb640 1 -- 172.21.15.120:0/3347347315 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3b8c039060 con 0x562d7cb006d0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.007+0000 7f3a71ffb640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6403c780 0x7f3a6403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.007+0000 7f3a71ffb640 1 -- 172.21.15.120:0/3347347315 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f3b8c033d10 con 0x562d7cb006d0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.007+0000 7f3b94681640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6403c780 0x7f3a6403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.008+0000 7f3b94681640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6403c780 0x7f3a6403ec40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400bbf0 tx=0x7f3b84043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.008+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.008+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7cb138b0 0x562d7cb15d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.008+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb164c0 con 0x562d7cb138b0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.008+0000 7f3b8be80640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7cb138b0 0x562d7cb15d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.008+0000 7f3b8be80640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7cb138b0 0x562d7cb15d70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 20 realm 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb168f0 con 0x562d7cb138b0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb171c0 con 0x562d7cb138b0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cb17be0 0x562d7cb1a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1a780 con 0x562d7cb17be0 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.009+0000 7f3b94e82640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cb17be0 0x562d7cb1a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b94e82640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cb17be0 0x562d7cb1a010 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b9893a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1afd0 con 0x562d7cb17be0 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b9893a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b9893a800 20 searching for the correct realm 2024-09-07T03:32:37.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d7cb1cd40 0x562d7cb1f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb1cd40 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.010+0000 7f3b94681640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d7cb1cd40 0x562d7cb1f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.011+0000 7f3b94681640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d7cb1cd40 0x562d7cb1f170 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.011+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.011+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb17be0 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.011+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.011+0000 7f3b94e82640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3b8c04e050 0x7f3b8c0127a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.011+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x7f3b8c04e050 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.011+0000 7f3b8be80640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3b8c04e050 0x7f3b8c0127a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.011+0000 7f3b8be80640 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3b8c04e050 0x7f3b8c0127a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.012+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.012+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.012+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.012+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.012+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.012+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb1cd40 2024-09-07T03:32:37.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.012+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.012+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.013+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.013+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb17be0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.013+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.013+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb17be0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.013+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.013+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.013+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.013+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x7f3b8c04e050 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.014+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.014+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.014+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.014+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x7f3b8c04e050 2024-09-07T03:32:37.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.014+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.014+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb17be0 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.014+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.014+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb1cd40 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.015+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.015+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.015+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.015+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb17be0 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.015+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.015+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb1cd40 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb1cd40 2024-09-07T03:32:37.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.016+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x7f3b8c04e050 2024-09-07T03:32:37.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.017+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.017+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb138b0 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.017+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.017+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x7f3b8c04e050 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.017+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.017+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb1cd40 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.017+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.017+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x7f3b8c04e050 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb17be0 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb17be0 2024-09-07T03:32:37.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb1cd40 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb17be0 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.018+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1f840 con 0x562d7cb17be0 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:37.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1b950 con 0x562d7cb138b0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1b530 con 0x562d7cb17be0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb1c2c0 con 0x562d7cb138b0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.019+0000 7f3b9893a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:37.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 zone default found 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 4 Realm: () 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 zonegroup default 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb20170 con 0x7f3b8c04e050 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb223b0 con 0x562d7cb1cd40 2024-09-07T03:32:37.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb22750 con 0x562d7cb1cd40 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 started sync module instance, tier type = 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.020+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb217f0 con 0x562d7cb17be0 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.022+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.022+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94753365564432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb22fa0 con 0x562d7cb17be0 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.022+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb237f0 con 0x562d7cb138b0 2024-09-07T03:32:37.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.023+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.023+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94753365569440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb24040 con 0x562d7cb138b0 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.023+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb24890 con 0x562d7cb17be0 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.023+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94753365564432] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.024+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.024+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94753365573696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb24910 con 0x562d7cb17be0 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.024+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb252d0 con 0x7f3b8c04e050 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.025+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94753365573696] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.026+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.026+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94753365575232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb252d0 con 0x7f3b8c04e050 2024-09-07T03:32:37.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.026+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb25cd0 con 0x562d7cb17be0 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.027+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94753365575232] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.027+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94753365569440] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.028+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.028+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94753365572496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb24e20 con 0x562d7cb17be0 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.028+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb26570 con 0x562d7cb1cd40 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.029+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.029+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94753365582016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb24e20 con 0x562d7cb1cd40 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.029+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb274a0 con 0x562d7cb1cd40 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.029+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94753365572496] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.030+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94753365582016] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.030+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.030+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94753365585808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb26910 con 0x562d7cb1cd40 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.030+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb27d40 con 0x7f3b8c04e050 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94753365585808] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94753365579744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb27d40 con 0x7f3b8c04e050 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b9893a800 20 add_watcher() i=0 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b9893a800 20 add_watcher() i=1 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b9893a800 20 add_watcher() i=2 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b9893a800 20 add_watcher() i=3 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b9893a800 20 add_watcher() i=4 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b9893a800 20 add_watcher() i=5 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.031+0000 7f3b9893a800 20 add_watcher() i=6 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.032+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94753365579744] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.032+0000 7f3b9893a800 20 add_watcher() i=7 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.032+0000 7f3b9893a800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.032+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb2b220 con 0x562d7cb138b0 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.032+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.032+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94753365588576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb287b0 con 0x562d7cb138b0 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.033+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94753365588576] v34'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3a4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b9893a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b9893a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b9893a800 5 note: GC not initialized 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3a497e2640 20 reqs_thread_entry: start 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b9893a800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b9893a800 20 Filter name: none 2024-09-07T03:32:37.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f39c2ffd640 20 reqs_thread_entry: start 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b9893a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5e2d0 con 0x562d7cb138b0 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.034+0000 7f3b9893a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb60260 con 0x7f3b8c04e050 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 : miss 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb61ad0 con 0x562d7cb138b0 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(64 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:37.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.035+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb651d0 con 0x7f3b8c04e050 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.036+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(65 foo.buckets [call] v34'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.036+0000 7f3b9893a800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.036+0000 7f3b9893a800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.036+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb641c0 con 0x7f3b8c04e050 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.036+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.036+0000 7f3b9893a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.036+0000 7f3b9893a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.036+0000 7f3b9893a800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.036+0000 7f3b9893a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.037+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb68ce0 con 0x7f3b8c04e050 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v34'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3b9893a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3b9893a800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3b9893a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94753365837568 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb65fe0 con 0x562d7cb1cd40 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== watch-notify(notify (1) cookie 94753365585808 notify 146028888071 ret 0) ==== 380+0+0 (crc 0 0 0) 0x562d7cad9ff0 con 0x562d7cb1cd40 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3a737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94753365585808 notifier 4477 bl.length()=338 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3a737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3a737fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(68 notify.6 [notify cookie 94753365837568 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3a737fe640 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3a58003ea0 con 0x562d7cb1cd40 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.038+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== watch-notify(notify_complete (2) cookie 94753365837568 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d7cad95f0 con 0x562d7cb1cd40 2024-09-07T03:32:37.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.039+0000 7f3a4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.039+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94753365588576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5c190 con 0x562d7cb138b0 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.040+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94753365588576] v34'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.040+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94753365564432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5c190 con 0x562d7cb17be0 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.042+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94753365564432] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.042+0000 7f3b9893a800 20 remove_watcher() i=0 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.042+0000 7f3b9893a800 2 removed watcher, disabling cache 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.042+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94753365569440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5c190 con 0x562d7cb138b0 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.043+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94753365569440] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x562d7cb138b0 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.043+0000 7f3b9893a800 20 remove_watcher() i=1 2024-09-07T03:32:37.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.043+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94753365573696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5c190 con 0x562d7cb17be0 2024-09-07T03:32:37.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.044+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94753365573696] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.044+0000 7f3b9893a800 20 remove_watcher() i=2 2024-09-07T03:32:37.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.044+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94753365575232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5c190 con 0x7f3b8c04e050 2024-09-07T03:32:37.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.045+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94753365575232] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.045+0000 7f3b9893a800 20 remove_watcher() i=3 2024-09-07T03:32:37.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.045+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94753365572496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5c190 con 0x562d7cb17be0 2024-09-07T03:32:37.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.046+0000 7f3b94e82640 1 -- 172.21.15.120:0/3347347315 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94753365572496] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c027070 con 0x562d7cb17be0 2024-09-07T03:32:37.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.046+0000 7f3b9893a800 20 remove_watcher() i=4 2024-09-07T03:32:37.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.046+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94753365582016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5c190 con 0x562d7cb1cd40 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.047+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94753365582016] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.047+0000 7f3b9893a800 20 remove_watcher() i=5 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.047+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94753365585808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5c190 con 0x562d7cb1cd40 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.048+0000 7f3b94681640 1 -- 172.21.15.120:0/3347347315 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94753365585808] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8402d070 con 0x562d7cb1cd40 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.048+0000 7f3b9893a800 20 remove_watcher() i=6 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.048+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94753365579744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d7cb5c190 con 0x7f3b8c04e050 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94753365579744] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b7c051070 con 0x7f3b8c04e050 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 20 remove_watcher() i=7 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cb17be0 msgr2=0x562d7cb1a010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cb17be0 0x562d7cb1a010 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7cb138b0 msgr2=0x562d7cb15d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7cb138b0 0x562d7cb15d70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3b8c04e050 msgr2=0x7f3b8c0127a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3b8c04e050 0x7f3b8c0127a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d7cb1cd40 msgr2=0x562d7cb1f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d7cb1cd40 0x562d7cb1f170 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6403c780 msgr2=0x7f3a6403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6403c780 0x7f3a6403ec40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400bbf0 tx=0x7f3b84043000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 msgr2=0x562d7cb07d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3347347315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7cb006d0 0x562d7cb07d60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c012500 tx=0x7f3b8c053d60 comp rx=0 tx=0).stop 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 reap_dead start 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b8be80640 1 -- 172.21.15.120:0/3347347315 reap_dead start 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 shutdown_connections 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 >> 172.21.15.120:0/3347347315 conn(0x562d7cafcad0 msgr2=0x562d7caface0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 shutdown_connections 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.049+0000 7f3b9893a800 1 -- 172.21.15.120:0/3347347315 wait complete. 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/1098206472 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6c03c780 msgr2=0x7f3a6c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/1098206472 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6c03c780 0x7f3a6c03ec40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x562d7cae43b0 tx=0x7f3b84001460 comp rx=0 tx=0).stop 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/1098206472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7caf3bd0 msgr2=0x562d7caf3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/1098206472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7caf3bd0 0x562d7caf3ff0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c016d20 tx=0x7f3b8c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/1098206472 shutdown_connections 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/1098206472 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a6c03c780 0x7f3a6c03ec40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/1098206472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7caf3bd0 0x562d7caf3ff0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/1098206472 >> 172.21.15.120:0/1098206472 conn(0x562d7cae7f80 msgr2=0x562d7cae8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/1098206472 shutdown_connections 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/1098206472 wait complete. 2024-09-07T03:32:37.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cae1240 msgr2=0x562d7cae3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cae1240 0x562d7cae3700 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7c9e2210 msgr2=0x562d7cae0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7c9e2210 0x562d7cae0450 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a7c03c920 msgr2=0x7f3a7c03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a7c03c920 0x7f3a7c03ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c057000 tx=0x7f3b7c052000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 msgr2=0x562d7cad8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7cad8e00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3b840012f0 tx=0x7f3b84000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 shutdown_connections 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d7cae1240 0x562d7cae3700 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d7c9e2210 0x562d7cae0450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3a7c03c920 0x7f3a7c03ede0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 --2- 172.21.15.120:0/3298386722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d7c9e0e00 0x562d7cad8e00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 >> 172.21.15.120:0/3298386722 conn(0x562d7c9dc1d0 msgr2=0x562d7caca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 shutdown_connections 2024-09-07T03:32:37.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.050+0000 7f3b9893a800 1 -- 172.21.15.120:0/3298386722 wait complete. 2024-09-07T03:32:37.068 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-07T03:32:37.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-07T03:32:37.068 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-07T03:32:37.121 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:37.121 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e9a814800 1 Processor -- start 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e9a814800 1 -- start start 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e9a814800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b20b9d84e0 0x55b20b9d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e9a814800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b20b883e40 con 0x55b20b9d8e20 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e9a814800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b20b84e680 con 0x55b20b9d84e0 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e95ecb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b20b9d84e0 0x55b20b9d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e956ca640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b20b9d8e20 0x55b20b9d92d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48482/0 (socket says 172.21.15.120:48482) 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e95ecb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b20b9d84e0 0x55b20b9d88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42532/0 (socket says 172.21.15.120:42532) 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e956ca640 1 -- 172.21.15.120:0/1059219556 learned_addr learned my addr 172.21.15.120:0/1059219556 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1059219556 >> v1:172.21.15.104:6789/0 conn(0x55b20b9d8e20 legacy=0x55b20b9d92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.121+0000 7f6e94ec9640 1 -- 172.21.15.120:0/1059219556 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3198447401 0 0) 0x55b20b883e40 con 0x55b20b9d8e20 2024-09-07T03:32:37.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.122+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1059219556 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b20b86a6b0 con 0x55b20b9d84e0 2024-09-07T03:32:37.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.123+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/1059219556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20b9d88e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6e90005fd0 tx=0x7f6e90045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5987d80ae4d3769d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.123+0000 7f6e94ec9640 1 -- 172.21.15.120:0/1059219556 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e90058530 con 0x55b20b9d84e0 2024-09-07T03:32:37.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.123+0000 7f6e94ec9640 1 -- 172.21.15.120:0/1059219556 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e900586d0 con 0x55b20b9d84e0 2024-09-07T03:32:37.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.123+0000 7f6e94ec9640 1 -- 172.21.15.120:0/1059219556 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e900589d0 con 0x55b20b9d84e0 2024-09-07T03:32:37.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.124+0000 7f6e9a814800 1 -- 172.21.15.120:0/1059219556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 msgr2=0x55b20b9d88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.124+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1059219556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20b9d88e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6e90005fd0 tx=0x7f6e90045c30 comp rx=0 tx=0).stop 2024-09-07T03:32:37.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.124+0000 7f6e9a814800 1 -- 172.21.15.120:0/1059219556 shutdown_connections 2024-09-07T03:32:37.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.124+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1059219556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20b9d88e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.124+0000 7f6e9a814800 1 -- 172.21.15.120:0/1059219556 >> 172.21.15.120:0/1059219556 conn(0x55b20b9d4230 msgr2=0x55b20b9d6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.124+0000 7f6e9a814800 1 -- 172.21.15.120:0/1059219556 shutdown_connections 2024-09-07T03:32:37.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.124+0000 7f6e9a814800 1 -- 172.21.15.120:0/1059219556 wait complete. 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.138+0000 7f6e9a814800 1 Processor -- start 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.138+0000 7f6e9a814800 1 -- start start 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.138+0000 7f6e9a814800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bacb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.138+0000 7f6e9a814800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b20b872dd0 con 0x55b20b9d84e0 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.138+0000 7f6e95ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bacb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.138+0000 7f6e95ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bacb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42542/0 (socket says 172.21.15.120:42542) 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.138+0000 7f6e95ecb640 1 -- 172.21.15.120:0/806271445 learned_addr learned my addr 172.21.15.120:0/806271445 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.138+0000 7f6e95ecb640 1 -- 172.21.15.120:0/806271445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b20b88be10 con 0x55b20b9d84e0 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.138+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/806271445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bacb730 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6e90025a60 tx=0x7f6e90051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70045ecd1dc80967 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6d83e07640 1 -- 172.21.15.120:0/806271445 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e90058a30 con 0x55b20b9d84e0 2024-09-07T03:32:37.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6d83e07640 1 -- 172.21.15.120:0/806271445 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e90068070 con 0x55b20b9d84e0 2024-09-07T03:32:37.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6d83e07640 1 -- 172.21.15.120:0/806271445 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e90058d00 con 0x55b20b9d84e0 2024-09-07T03:32:37.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6e9a814800 1 -- 172.21.15.120:0/806271445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 msgr2=0x55b20bacb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6e9a814800 1 --2- 172.21.15.120:0/806271445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bacb730 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6e90025a60 tx=0x7f6e90051000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6e9a814800 1 -- 172.21.15.120:0/806271445 shutdown_connections 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6e9a814800 1 --2- 172.21.15.120:0/806271445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bacb730 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6e9a814800 1 -- 172.21.15.120:0/806271445 >> 172.21.15.120:0/806271445 conn(0x55b20b9d4230 msgr2=0x55b20bac70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6e9a814800 1 -- 172.21.15.120:0/806271445 shutdown_connections 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.139+0000 7f6e9a814800 1 -- 172.21.15.120:0/806271445 wait complete. 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.140+0000 7f6e9a814800 1 Processor -- start 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.140+0000 7f6e9a814800 1 -- start start 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.140+0000 7f6e9a814800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bad2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.140+0000 7f6e9a814800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b20b9d9da0 con 0x55b20b9d84e0 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.140+0000 7f6e95ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bad2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.140+0000 7f6e95ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bad2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42548/0 (socket says 172.21.15.120:42548) 2024-09-07T03:32:37.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.140+0000 7f6e95ecb640 1 -- 172.21.15.120:0/3495238111 learned_addr learned my addr 172.21.15.120:0/3495238111 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.140+0000 7f6e95ecb640 1 -- 172.21.15.120:0/3495238111 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b20bad3510 con 0x55b20b9d84e0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.140+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bad2fb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6e90005bf0 tx=0x7f6e90003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.141+0000 7f6d82604640 1 -- 172.21.15.120:0/3495238111 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e90063710 con 0x55b20b9d84e0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.141+0000 7f6d82604640 1 -- 172.21.15.120:0/3495238111 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e900638d0 con 0x55b20b9d84e0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.141+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b20bad37a0 con 0x55b20b9d84e0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.141+0000 7f6d82604640 1 -- 172.21.15.120:0/3495238111 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e90063bf0 con 0x55b20b9d84e0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.141+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b20bad41a0 con 0x55b20b9d84e0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.141+0000 7f6d82604640 1 -- 172.21.15.120:0/3495238111 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6e9004f3f0 con 0x55b20b9d84e0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6d82604640 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7c03c780 0x7f6d7c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6d82604640 1 -- 172.21.15.120:0/3495238111 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f6e90097e70 con 0x55b20b9d84e0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6e956ca640 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7c03c780 0x7f6d7c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20b9d8e20 0x55b20bada600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bad4d00 con 0x55b20b9d8e20 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6e966cc640 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20b9d8e20 0x55b20bada600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6e956ca640 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7c03c780 0x7f6d7c03ec40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000c00 tx=0x7f6e800013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6e966cc640 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20b9d8e20 0x55b20bada600 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6e966cc640 1 -- 172.21.15.120:0/3495238111 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20b9d8e20 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20badb500 0x55b20badd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.142+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20baddf20 con 0x55b20badb500 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.143+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20badb500 0x55b20badd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.143+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20badb500 0x55b20badd8f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.143+0000 7f6e95ecb640 1 -- 172.21.15.120:0/3495238111 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e9007e3f0 con 0x55b20badb500 2024-09-07T03:32:37.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.143+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20badf7d0 con 0x55b20badb500 2024-09-07T03:32:37.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.144+0000 7f6e95ecb640 1 -- 172.21.15.120:0/3495238111 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e9007e3f0 con 0x55b20badb500 2024-09-07T03:32:37.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.144+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bade940 con 0x55b20badb500 2024-09-07T03:32:37.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.144+0000 7f6e95ecb640 1 -- 172.21.15.120:0/3495238111 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e9007e3f0 con 0x55b20badb500 2024-09-07T03:32:37.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.144+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20badeda0 con 0x55b20b9d8e20 2024-09-07T03:32:37.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.145+0000 7f6e966cc640 1 -- 172.21.15.120:0/3495238111 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20b9d8e20 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.145+0000 7f6e9a814800 1 Processor -- start 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.145+0000 7f6e9a814800 1 -- start start 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.145+0000 7f6e9a814800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20baedcc0 0x55b20baee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.145+0000 7f6e9a814800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b20b8d0a00 con 0x55b20baedcc0 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.145+0000 7f6e966cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20baedcc0 0x55b20baee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.145+0000 7f6e966cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20baedcc0 0x55b20baee0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42558/0 (socket says 172.21.15.120:42558) 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.145+0000 7f6e966cc640 1 -- 172.21.15.120:0/2788712496 learned_addr learned my addr 172.21.15.120:0/2788712496 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.146+0000 7f6e966cc640 1 -- 172.21.15.120:0/2788712496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b20baee720 con 0x55b20baedcc0 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.146+0000 7f6e966cc640 1 --2- 172.21.15.120:0/2788712496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20baedcc0 0x55b20baee0e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800aa90 tx=0x7f6e8800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.146+0000 7f6d7b7fe640 1 -- 172.21.15.120:0/2788712496 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e88007d70 con 0x55b20baedcc0 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.146+0000 7f6d7b7fe640 1 -- 172.21.15.120:0/2788712496 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e88018430 con 0x55b20baedcc0 2024-09-07T03:32:37.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.146+0000 7f6e9a814800 1 -- 172.21.15.120:0/2788712496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b20baeef50 con 0x55b20baedcc0 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.146+0000 7f6d7b7fe640 1 -- 172.21.15.120:0/2788712496 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e88018750 con 0x55b20baedcc0 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.146+0000 7f6e9a814800 1 -- 172.21.15.120:0/2788712496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b20baef4f0 con 0x55b20baedcc0 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.147+0000 7f6d7b7fe640 1 -- 172.21.15.120:0/2788712496 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6e88020020 con 0x55b20baedcc0 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.147+0000 7f6d7b7fe640 1 --2- 172.21.15.120:0/2788712496 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7003c840 0x7f6d7003ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.147+0000 7f6d7b7fe640 1 -- 172.21.15.120:0/2788712496 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f6e8801e020 con 0x55b20baedcc0 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.147+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/2788712496 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7003c840 0x7f6d7003ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.147+0000 7f6e9a814800 1 Processor -- start 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/2788712496 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7003c840 0x7f6d7003ed00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55b20badacc0 tx=0x7f6e90096130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6e9a814800 1 -- start start 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6e9a814800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bafabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6e9a814800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b20bacbec0 con 0x55b20bafa7c0 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6e966cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bafabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6e966cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bafabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42560/0 (socket says 172.21.15.120:42560) 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6e966cc640 1 -- 172.21.15.120:0/3303226431 learned_addr learned my addr 172.21.15.120:0/3303226431 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6e966cc640 1 -- 172.21.15.120:0/3303226431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b20bafb1b0 con 0x55b20bafa7c0 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6e966cc640 1 --2- 172.21.15.120:0/3303226431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bafabc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e880531c0 tx=0x7f6e880206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd37643c2a511055 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6d797fa640 1 -- 172.21.15.120:0/3303226431 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e88020b70 con 0x55b20bafa7c0 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6d797fa640 1 -- 172.21.15.120:0/3303226431 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e88022410 con 0x55b20bafa7c0 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.148+0000 7f6d797fa640 1 -- 172.21.15.120:0/3303226431 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e8804c590 con 0x55b20bafa7c0 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 -- 172.21.15.120:0/3303226431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 msgr2=0x55b20bafabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3303226431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bafabc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e880531c0 tx=0x7f6e880206e0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 -- 172.21.15.120:0/3303226431 shutdown_connections 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3303226431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bafabc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 -- 172.21.15.120:0/3303226431 >> 172.21.15.120:0/3303226431 conn(0x55b20baf6bc0 msgr2=0x55b20baf4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 -- 172.21.15.120:0/3303226431 shutdown_connections 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 -- 172.21.15.120:0/3303226431 wait complete. 2024-09-07T03:32:37.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 Processor -- start 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 -- start start 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bb01d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e9a814800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b20bafb7d0 con 0x55b20bafa7c0 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e966cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bb01d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e966cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bb01d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42572/0 (socket says 172.21.15.120:42572) 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.149+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 learned_addr learned my addr 172.21.15.120:0/1265339329 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.150+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b20bb022f0 con 0x55b20bafa7c0 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.150+0000 7f6e966cc640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bb01d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6e88020d60 tx=0x7f6e88053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.150+0000 7f6d677fe640 1 -- 172.21.15.120:0/1265339329 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e88017e60 con 0x55b20bafa7c0 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.150+0000 7f6d677fe640 1 -- 172.21.15.120:0/1265339329 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e88031020 con 0x55b20bafa7c0 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.150+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b20bb02580 con 0x55b20bafa7c0 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.150+0000 7f6d677fe640 1 -- 172.21.15.120:0/1265339329 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e88020b70 con 0x55b20bafa7c0 2024-09-07T03:32:37.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.150+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b20bb03110 con 0x55b20bafa7c0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.151+0000 7f6d677fe640 1 -- 172.21.15.120:0/1265339329 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6e88016040 con 0x55b20bafa7c0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.151+0000 7f6d677fe640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d6003c750 0x7f6d6003ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.151+0000 7f6d677fe640 1 -- 172.21.15.120:0/1265339329 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f6e88032030 con 0x55b20bafa7c0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.151+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d6003c750 0x7f6d6003ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.151+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d6003c750 0x7f6d6003ec10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55b20bad45a0 tx=0x7f6e9008c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20bb0d8e0 0x55b20bb0fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb104f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e956ca640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20bb0d8e0 0x55b20bb0fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e956ca640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20bb0d8e0 0x55b20bb0fda0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e9a814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e9a814800 20 realm 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.152+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb0cc30 con 0x55b20bb0d8e0 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e9a814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e9a814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb10fe0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e9a814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20bb11dc0 0x55b20bb141b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb14880 con 0x55b20bb11dc0 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e966cc640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20bb11dc0 0x55b20bb141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e966cc640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20bb11dc0 0x55b20bb141b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.153+0000 7f6e9a814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.154+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.154+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb150d0 con 0x55b20bb11dc0 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.154+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.154+0000 7f6e9a814800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.154+0000 7f6e9a814800 20 searching for the correct realm 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.154+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b20bb16e40 0x55b20bb19290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.154+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb16e40 2024-09-07T03:32:37.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.154+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b20bb16e40 0x55b20bb19290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.154+0000 7f6e95ecb640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b20bb16e40 0x55b20bb19290 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.155+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.155+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb11dc0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.155+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.155+0000 7f6e966cc640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6e8804cbe0 0x7f6e8801f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.155+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x7f6e8804cbe0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.155+0000 7f6e956ca640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6e8804cbe0 0x7f6e8801f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.155+0000 7f6e956ca640 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6e8804cbe0 0x7f6e8801f2c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.155+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x7f6e8804cbe0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.155+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.156+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.156+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.156+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.156+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb16e40 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.156+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.156+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.156+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.156+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb11dc0 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.157+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.157+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb11dc0 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.157+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.157+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.157+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.157+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x7f6e8804cbe0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.157+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x7f6e8804cbe0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.157+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.158+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.158+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x7f6e8804cbe0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.158+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e8000f5f0 con 0x7f6e8804cbe0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.158+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb11dc0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.158+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.158+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb16e40 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.158+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.158+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.159+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.159+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb11dc0 2024-09-07T03:32:37.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.159+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.159+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb16e40 2024-09-07T03:32:37.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.159+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.159+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.159+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.159+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.160+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.160+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.160+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.160+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb16e40 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.160+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.160+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x7f6e8804cbe0 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.160+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x7f6e8804cbe0 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.160+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb0d8e0 2024-09-07T03:32:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.161+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.161+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x7f6e8804cbe0 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.161+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x7f6e8804cbe0 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.161+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb16e40 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.161+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.161+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x7f6e8804cbe0 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.161+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e8000f5f0 con 0x7f6e8804cbe0 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.161+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19960 con 0x55b20bb11dc0 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.162+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.162+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e88068040 con 0x55b20bb11dc0 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.162+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.162+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e88068040 con 0x55b20bb16e40 2024-09-07T03:32:37.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.162+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.162+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e88068040 con 0x55b20bb11dc0 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.162+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.162+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e88068040 con 0x55b20bb11dc0 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb15920 con 0x55b20bb0d8e0 2024-09-07T03:32:37.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x55b20bb0d8e0 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb15d10 con 0x55b20bb11dc0 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb15d10 con 0x55b20bb0d8e0 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e8003c040 con 0x55b20bb0d8e0 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 zone default found 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 4 Realm: () 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 zonegroup default 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.163+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb19de0 con 0x7f6e8804cbe0 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x7f6e8804cbe0 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1bba0 con 0x55b20bb16e40 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1c070 con 0x55b20bb16e40 2024-09-07T03:32:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 20 started sync module instance, tier type = 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.164+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1b010 con 0x55b20bb11dc0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.166+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.166+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94223188735248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1b010 con 0x55b20bb11dc0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.166+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1caf0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.167+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94223188735248] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.167+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x55b20bb0d8e0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.167+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94223188732768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1af80 con 0x55b20bb0d8e0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.167+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1d9b0 con 0x55b20bb11dc0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.168+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94223188732768] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x55b20bb0d8e0 2024-09-07T03:32:37.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.169+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.169+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94223188741856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1d9b0 con 0x55b20bb11dc0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.169+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1e3b0 con 0x7f6e8804cbe0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.170+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94223188741856] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.170+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x7f6e8804cbe0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.170+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94223188743424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1e370 con 0x7f6e8804cbe0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.170+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1eda0 con 0x55b20bb11dc0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.171+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.171+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94223188748464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1eda0 con 0x55b20bb11dc0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.171+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1fd20 con 0x55b20bb16e40 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.172+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94223188743424] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x7f6e8804cbe0 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.172+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.172+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94223188752400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb200c0 con 0x55b20bb16e40 2024-09-07T03:32:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.172+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb20b00 con 0x55b20bb16e40 2024-09-07T03:32:37.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.175+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94223188752400] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.175+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94223188748464] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.178+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.178+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94223188750784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb1dec0 con 0x55b20bb16e40 2024-09-07T03:32:37.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.178+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb213e0 con 0x7f6e8804cbe0 2024-09-07T03:32:37.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x7f6e8804cbe0 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94223188758256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb21390 con 0x7f6e8804cbe0 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e9a814800 20 add_watcher() i=0 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e9a814800 20 add_watcher() i=1 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94223188750784] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e9a814800 20 add_watcher() i=2 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e9a814800 20 add_watcher() i=3 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e9a814800 20 add_watcher() i=4 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e9a814800 20 add_watcher() i=5 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.179+0000 7f6e9a814800 20 add_watcher() i=6 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.180+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94223188758256] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x7f6e8804cbe0 2024-09-07T03:32:37.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.180+0000 7f6e9a814800 20 add_watcher() i=7 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.180+0000 7f6e9a814800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.180+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb205d0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.180+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e8003c040 con 0x55b20bb0d8e0 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.180+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94223188760448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb205d0 con 0x55b20bb0d8e0 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.181+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94223188760448] v34'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x55b20bb0d8e0 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.181+0000 7f6d477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.181+0000 7f6e9a814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.181+0000 7f6e9a814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 5 note: GC not initialized 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6d467fc640 20 reqs_thread_entry: start 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:37.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 20 Filter name: none 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6cb7fff640 20 reqs_thread_entry: start 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb57a20 con 0x7f6e8804cbe0 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x7f6e8804cbe0 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.182+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb560c0 con 0x55b20bb16e40 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.183+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.183+0000 7f6e9a814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.183+0000 7f6e9a814800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-07T03:32:37.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.183+0000 7f6e9a814800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:32:37.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.183+0000 7f6e9a814800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-07T03:32:37.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.183+0000 7f6e9a814800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-07T03:32:37.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.183+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb56990 con 0x7f6e8804cbe0 2024-09-07T03:32:37.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x7f6e8804cbe0 2024-09-07T03:32:37.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6e9a814800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-07T03:32:37.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6e9a814800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6e9a814800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94223188976864 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb5b360 con 0x55b20bb16e40 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== watch-notify(notify (1) cookie 94223188752400 notify 146028888072 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55b20bad41a0 con 0x55b20bb16e40 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6d797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94223188752400 notifier 4484 bl.length()=556 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6d797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6d797fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6d797fa640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6d58003ea0 con 0x55b20bb16e40 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.184+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(65 notify.5 [notify cookie 94223188976864 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.185+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.185+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== watch-notify(notify_complete (2) cookie 94223188976864 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b20bad37a0 con 0x55b20bb16e40 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.185+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb564e0 con 0x55b20bb16e40 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6e9a814800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6e9a814800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6e9a814800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94223188976864 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb5b360 con 0x55b20bb11dc0 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94223188741856 notify 146028888081 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b20bb03110 con 0x55b20bb11dc0 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6d78ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94223188741856 notifier 4484 bl.length()=177 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6d78ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6d78ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(68 notify.2 [notify cookie 94223188976864 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6d78ff9640 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6cc0003400 con 0x55b20bb11dc0 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.186+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94223188976864 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6e8806d020 con 0x55b20bb11dc0 2024-09-07T03:32:37.197 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-07T03:32:37.184176Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:37.184161Z","tags":[],"group_ids":[]} 2024-09-07T03:32:37.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.187+0000 7f6d477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.187+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94223188760448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb55830 con 0x55b20bb0d8e0 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.188+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94223188760448] v34'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x55b20bb0d8e0 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.188+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94223188735248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb55830 con 0x55b20bb11dc0 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.189+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94223188735248] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.189+0000 7f6e9a814800 20 remove_watcher() i=0 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.189+0000 7f6e9a814800 2 removed watcher, disabling cache 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.189+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94223188732768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb55830 con 0x55b20bb0d8e0 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.192+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94223188732768] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x55b20bb0d8e0 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.192+0000 7f6e9a814800 20 remove_watcher() i=1 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.192+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94223188741856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb55830 con 0x55b20bb11dc0 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.193+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94223188741856] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.193+0000 7f6e9a814800 20 remove_watcher() i=2 2024-09-07T03:32:37.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.193+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94223188743424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb55830 con 0x7f6e8804cbe0 2024-09-07T03:32:37.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.196+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94223188743424] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x7f6e8804cbe0 2024-09-07T03:32:37.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.196+0000 7f6e9a814800 20 remove_watcher() i=3 2024-09-07T03:32:37.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.196+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94223188748464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb55830 con 0x55b20bb11dc0 2024-09-07T03:32:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.198+0000 7f6e966cc640 1 -- 172.21.15.120:0/1265339329 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94223188748464] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e880083e0 con 0x55b20bb11dc0 2024-09-07T03:32:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.198+0000 7f6e9a814800 20 remove_watcher() i=4 2024-09-07T03:32:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.198+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94223188752400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb55830 con 0x55b20bb16e40 2024-09-07T03:32:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.199+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94223188752400] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.199+0000 7f6e9a814800 20 remove_watcher() i=5 2024-09-07T03:32:37.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.199+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94223188750784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb55830 con 0x55b20bb16e40 2024-09-07T03:32:37.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.201+0000 7f6e95ecb640 1 -- 172.21.15.120:0/1265339329 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94223188750784] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9009d070 con 0x55b20bb16e40 2024-09-07T03:32:37.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.201+0000 7f6e9a814800 20 remove_watcher() i=6 2024-09-07T03:32:37.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.201+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94223188758256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b20bb55830 con 0x7f6e8804cbe0 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94223188758256] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e8003c040 con 0x7f6e8804cbe0 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 20 remove_watcher() i=7 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20bb11dc0 msgr2=0x55b20bb141b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20bb11dc0 0x55b20bb141b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20bb0d8e0 msgr2=0x55b20bb0fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20bb0d8e0 0x55b20bb0fda0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6e8804cbe0 msgr2=0x7f6e8801f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6e8804cbe0 0x7f6e8801f2c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b20bb16e40 msgr2=0x55b20bb19290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b20bb16e40 0x55b20bb19290 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d6003c750 msgr2=0x7f6d6003ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d6003c750 0x7f6d6003ec10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55b20bad45a0 tx=0x7f6e9008c000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 msgr2=0x55b20bb01d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bb01d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6e88020d60 tx=0x7f6e88053150 comp rx=0 tx=0).stop 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e956ca640 1 -- 172.21.15.120:0/1265339329 reap_dead start 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 shutdown_connections 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 --2- 172.21.15.120:0/1265339329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20bafa7c0 0x55b20bb01d90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 >> 172.21.15.120:0/1265339329 conn(0x55b20baf6bc0 msgr2=0x55b20baf4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 shutdown_connections 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.202+0000 7f6e9a814800 1 -- 172.21.15.120:0/1265339329 wait complete. 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/2788712496 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7003c840 msgr2=0x7f6d7003ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/2788712496 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7003c840 0x7f6d7003ed00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55b20badacc0 tx=0x7f6e90096130 comp rx=0 tx=0).stop 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/2788712496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20baedcc0 msgr2=0x55b20baee0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/2788712496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20baedcc0 0x55b20baee0e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800aa90 tx=0x7f6e8800af50 comp rx=0 tx=0).stop 2024-09-07T03:32:37.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/2788712496 shutdown_connections 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/2788712496 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7003c840 0x7f6d7003ed00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/2788712496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20baedcc0 0x55b20baee0e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/2788712496 >> 172.21.15.120:0/2788712496 conn(0x55b20bae2070 msgr2=0x55b20bae2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/2788712496 shutdown_connections 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/2788712496 wait complete. 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20badb500 msgr2=0x55b20badd8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20badb500 0x55b20badd8f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20b9d8e20 msgr2=0x55b20bada600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20b9d8e20 0x55b20bada600 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7c03c780 msgr2=0x7f6d7c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7c03c780 0x7f6d7c03ec40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000c00 tx=0x7f6e800013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 msgr2=0x55b20bad2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bad2fb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6e90005bf0 tx=0x7f6e90003330 comp rx=0 tx=0).stop 2024-09-07T03:32:37.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 shutdown_connections 2024-09-07T03:32:37.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b20badb500 0x55b20badd8f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b20b9d8e20 0x55b20bada600 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6d7c03c780 0x7f6d7c03ec40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 --2- 172.21.15.120:0/3495238111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b20b9d84e0 0x55b20bad2fb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 >> 172.21.15.120:0/3495238111 conn(0x55b20b9d4230 msgr2=0x55b20bacc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 shutdown_connections 2024-09-07T03:32:37.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.203+0000 7f6e9a814800 1 -- 172.21.15.120:0/3495238111 wait complete. 2024-09-07T03:32:37.213 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-07T03:32:37.184176Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:37.184161Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:37.221 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-07T03:32:37.231 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:37.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-07T03:32:37.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-07T03:32:37.231 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-07T03:32:37.274 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:37.274 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8ab19ad800 1 Processor -- start 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8ab19ad800 1 -- start start 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8ab19ad800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56072880c600 0x56072880e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8ab19ad800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5607286b5e40 con 0x56072880f020 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8ab19ad800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560728680680 con 0x56072880c600 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8aaf497640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56072880c600 0x56072880e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8aaec96640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56072880f020 0x5607288114e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48484/0 (socket says 172.21.15.120:48484) 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8aaec96640 1 -- 172.21.15.120:0/1231842701 learned_addr learned my addr 172.21.15.120:0/1231842701 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8aaf497640 1 -- 172.21.15.120:0/1231842701 >> v1:172.21.15.104:6789/0 conn(0x56072880f020 legacy=0x5607288114e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8aae495640 1 -- 172.21.15.120:0/1231842701 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652160637 0 0) 0x5607286b5e40 con 0x56072880f020 2024-09-07T03:32:37.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.273+0000 7f8aaf497640 1 -- 172.21.15.120:0/1231842701 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072869c6b0 con 0x56072880c600 2024-09-07T03:32:37.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.275+0000 7f8aaf497640 1 --2- 172.21.15.120:0/1231842701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x56072880e9f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0005fd0 tx=0x7f8aa0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613ab2d02479cc1a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.275+0000 7f8aae495640 1 -- 172.21.15.120:0/1231842701 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa0058530 con 0x56072880c600 2024-09-07T03:32:37.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.275+0000 7f8aae495640 1 -- 172.21.15.120:0/1231842701 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa00586d0 con 0x56072880c600 2024-09-07T03:32:37.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.275+0000 7f8aae495640 1 -- 172.21.15.120:0/1231842701 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa00589d0 con 0x56072880c600 2024-09-07T03:32:37.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.276+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1231842701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 msgr2=0x56072880e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.276+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/1231842701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x56072880e9f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0005fd0 tx=0x7f8aa0045c30 comp rx=0 tx=0).stop 2024-09-07T03:32:37.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.276+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1231842701 shutdown_connections 2024-09-07T03:32:37.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.276+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/1231842701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x56072880e9f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.276+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1231842701 >> 172.21.15.120:0/1231842701 conn(0x5607288061c0 msgr2=0x560728808620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.276+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1231842701 shutdown_connections 2024-09-07T03:32:37.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.276+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1231842701 wait complete. 2024-09-07T03:32:37.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.289+0000 7f8ab19ad800 1 Processor -- start 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.289+0000 7f8ab19ad800 1 -- start start 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.289+0000 7f8ab19ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x5607288fb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.289+0000 7f8ab19ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5607286a4dd0 con 0x56072880c600 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.290+0000 7f8aaf497640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x5607288fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.290+0000 7f8aaf497640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x5607288fb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42578/0 (socket says 172.21.15.120:42578) 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.290+0000 7f8aaf497640 1 -- 172.21.15.120:0/3160010028 learned_addr learned my addr 172.21.15.120:0/3160010028 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.290+0000 7f8aaf497640 1 -- 172.21.15.120:0/3160010028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607286bde10 con 0x56072880c600 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.290+0000 7f8aaf497640 1 --2- 172.21.15.120:0/3160010028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x5607288fb520 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0025a60 tx=0x7f8aa0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5c017a9b5e359a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.290+0000 7f899d60a640 1 -- 172.21.15.120:0/3160010028 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa0068070 con 0x56072880c600 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.290+0000 7f899d60a640 1 -- 172.21.15.120:0/3160010028 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa0058880 con 0x56072880c600 2024-09-07T03:32:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.290+0000 7f899d60a640 1 -- 172.21.15.120:0/3160010028 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa0058ba0 con 0x56072880c600 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.291+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3160010028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 msgr2=0x5607288fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.291+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3160010028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x5607288fb520 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0025a60 tx=0x7f8aa0051000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.291+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3160010028 shutdown_connections 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.291+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3160010028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x5607288fb520 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.291+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3160010028 >> 172.21.15.120:0/3160010028 conn(0x5607288061c0 msgr2=0x5607288f6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.291+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3160010028 shutdown_connections 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.291+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3160010028 wait complete. 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.292+0000 7f8ab19ad800 1 Processor -- start 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.292+0000 7f8ab19ad800 1 -- start start 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.292+0000 7f8ab19ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x560728902dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.292+0000 7f8ab19ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560728813040 con 0x56072880c600 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.292+0000 7f8aaf497640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x560728902dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.292+0000 7f8aaf497640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x560728902dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42590/0 (socket says 172.21.15.120:42590) 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.292+0000 7f8aaf497640 1 -- 172.21.15.120:0/2325597761 learned_addr learned my addr 172.21.15.120:0/2325597761 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.292+0000 7f8aaf497640 1 -- 172.21.15.120:0/2325597761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560728903320 con 0x56072880c600 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.292+0000 7f8aaf497640 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x560728902dc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0025a60 tx=0x7f8aa0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.293+0000 7f899be07640 1 -- 172.21.15.120:0/2325597761 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa0068040 con 0x56072880c600 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.293+0000 7f899be07640 1 -- 172.21.15.120:0/2325597761 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa0071070 con 0x56072880c600 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.293+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607289035b0 con 0x56072880c600 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.293+0000 7f899be07640 1 -- 172.21.15.120:0/2325597761 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa00637b0 con 0x56072880c600 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.293+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560728903ee0 con 0x56072880c600 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.293+0000 7f899be07640 1 -- 172.21.15.120:0/2325597761 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8aa0063950 con 0x56072880c600 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f899be07640 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f899403c780 0x7f899403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f899be07640 1 -- 172.21.15.120:0/2325597761 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8aa0097430 con 0x56072880c600 2024-09-07T03:32:37.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f8aaec96640 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f899403c780 0x7f899403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072880f020 0x56072890a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728904b30 con 0x56072880f020 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f8aafc98640 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072880f020 0x56072890a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f8aaec96640 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f899403c780 0x7f899403ec40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4000c00 tx=0x7f8aa40013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f8aafc98640 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072880f020 0x56072890a3c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f8aafc98640 1 -- 172.21.15.120:0/2325597761 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x56072880f020 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56072890b330 0x56072890d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.294+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56072890dd50 con 0x56072890b330 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.295+0000 7f8aaf497640 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56072890b330 0x56072890d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.295+0000 7f8aaf497640 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56072890b330 0x56072890d720 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.295+0000 7f8aaf497640 1 -- 172.21.15.120:0/2325597761 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8aa00970b0 con 0x56072890b330 2024-09-07T03:32:37.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.295+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56072890f600 con 0x56072890b330 2024-09-07T03:32:37.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.296+0000 7f8aaf497640 1 -- 172.21.15.120:0/2325597761 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8aa00970b0 con 0x56072890b330 2024-09-07T03:32:37.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.296+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56072890e740 con 0x56072890b330 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.296+0000 7f8aaf497640 1 -- 172.21.15.120:0/2325597761 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8aa00970b0 con 0x56072890b330 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.296+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56072890eba0 con 0x56072880f020 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.296+0000 7f8aafc98640 1 -- 172.21.15.120:0/2325597761 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8aa80083e0 con 0x56072880f020 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.297+0000 7f8ab19ad800 1 Processor -- start 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.297+0000 7f8ab19ad800 1 -- start start 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.297+0000 7f8ab19ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072891daf0 0x56072891df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.297+0000 7f8ab19ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560728702a00 con 0x56072891daf0 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.297+0000 7f8aafc98640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072891daf0 0x56072891df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.297+0000 7f8aafc98640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072891daf0 0x56072891df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42592/0 (socket says 172.21.15.120:42592) 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.297+0000 7f8aafc98640 1 -- 172.21.15.120:0/3716275248 learned_addr learned my addr 172.21.15.120:0/3716275248 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.297+0000 7f8aafc98640 1 -- 172.21.15.120:0/3716275248 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072891e550 con 0x56072891daf0 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.297+0000 7f8aafc98640 1 --2- 172.21.15.120:0/3716275248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072891daf0 0x56072891df10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800aa90 tx=0x7f8aa800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.298+0000 7f8999602640 1 -- 172.21.15.120:0/3716275248 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa8007d70 con 0x56072891daf0 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.298+0000 7f8999602640 1 -- 172.21.15.120:0/3716275248 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8018430 con 0x56072891daf0 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.298+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3716275248 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56072891ed80 con 0x56072891daf0 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.298+0000 7f8999602640 1 -- 172.21.15.120:0/3716275248 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa8018750 con 0x56072891daf0 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.298+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3716275248 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072891f320 con 0x56072891daf0 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.298+0000 7f8999602640 1 -- 172.21.15.120:0/3716275248 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8aa8020020 con 0x56072891daf0 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8999602640 1 --2- 172.21.15.120:0/3716275248 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f898803c780 0x7f898803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8999602640 1 -- 172.21.15.120:0/3716275248 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8aa801e020 con 0x56072891daf0 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8aaf497640 1 --2- 172.21.15.120:0/3716275248 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f898803c780 0x7f898803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8ab19ad800 1 Processor -- start 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8ab19ad800 1 -- start start 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8aaf497640 1 --2- 172.21.15.120:0/3716275248 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f898803c780 0x7f898803ec40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x56072890aaf0 tx=0x7f8aa0081040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8ab19ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x56072880a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8ab19ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5607288fbcb0 con 0x56072880a600 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8aafc98640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x56072880a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8aafc98640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x56072880a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42606/0 (socket says 172.21.15.120:42606) 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8aafc98640 1 -- 172.21.15.120:0/1030243336 learned_addr learned my addr 172.21.15.120:0/1030243336 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.299+0000 7f8aafc98640 1 -- 172.21.15.120:0/1030243336 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072880afd0 con 0x56072880a600 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8aafc98640 1 --2- 172.21.15.120:0/1030243336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x56072880a9e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80531c0 tx=0x7f8aa80206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7400c5ff6d8cb997 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8992ffd640 1 -- 172.21.15.120:0/1030243336 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa804a070 con 0x56072880a600 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8992ffd640 1 -- 172.21.15.120:0/1030243336 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8020b70 con 0x56072880a600 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8992ffd640 1 -- 172.21.15.120:0/1030243336 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa8022410 con 0x56072880a600 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1030243336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 msgr2=0x56072880a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/1030243336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x56072880a9e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80531c0 tx=0x7f8aa80206e0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1030243336 shutdown_connections 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/1030243336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x56072880a9e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1030243336 >> 172.21.15.120:0/1030243336 conn(0x560728926a10 msgr2=0x560728924c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1030243336 shutdown_connections 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.300+0000 7f8ab19ad800 1 -- 172.21.15.120:0/1030243336 wait complete. 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.301+0000 7f8ab19ad800 1 Processor -- start 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.301+0000 7f8ab19ad800 1 -- start start 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.301+0000 7f8ab19ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x560728933df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.301+0000 7f8ab19ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56072880b660 con 0x56072880a600 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.301+0000 7f8aafc98640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x560728933df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.301+0000 7f8aafc98640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x560728933df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42618/0 (socket says 172.21.15.120:42618) 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.301+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 learned_addr learned my addr 172.21.15.120:0/3373159749 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.301+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560728934350 con 0x56072880a600 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.301+0000 7f8aafc98640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x560728933df0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8052040 tx=0x7f8aa8053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.302+0000 7f89917fa640 1 -- 172.21.15.120:0/3373159749 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa804a070 con 0x56072880a600 2024-09-07T03:32:37.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.302+0000 7f89917fa640 1 -- 172.21.15.120:0/3373159749 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8032020 con 0x56072880a600 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.302+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607289345e0 con 0x56072880a600 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.302+0000 7f89917fa640 1 -- 172.21.15.120:0/3373159749 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa8022410 con 0x56072880a600 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.302+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560728934f60 con 0x56072880a600 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.302+0000 7f89917fa640 1 -- 172.21.15.120:0/3373159749 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8aa8016040 con 0x56072880a600 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.303+0000 7f89917fa640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f897803c730 0x7f897803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.303+0000 7f89917fa640 1 -- 172.21.15.120:0/3373159749 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f8aa8033030 con 0x56072880a600 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.303+0000 7f8aaf497640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f897803c730 0x7f897803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.303+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.303+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072893f8f0 0x560728941db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.303+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728942500 con 0x56072893f8f0 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.303+0000 7f8aaec96640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072893f8f0 0x560728941db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.303+0000 7f8aaf497640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f897803c730 0x7f897803ebf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00973a0 tx=0x7f8aa008a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.303+0000 7f8aaec96640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072893f8f0 0x560728941db0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 20 realm 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56072893ec40 con 0x56072893f8f0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728942fe0 con 0x56072893f8f0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560728943dc0 0x5607289461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728946840 con 0x560728943dc0 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8aafc98640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560728943dc0 0x5607289461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.304+0000 7f8aafc98640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560728943dc0 0x5607289461b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8ab19ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607289470e0 con 0x560728943dc0 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8ab19ad800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8ab19ad800 20 searching for the correct realm 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560728948e50 0x56072894b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56072894b930 con 0x560728948e50 2024-09-07T03:32:37.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8aaf497640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560728948e50 0x56072894b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.305+0000 7f8aaf497640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560728948e50 0x56072894b260 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.306+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.306+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56072894b930 con 0x560728943dc0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.306+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.306+0000 7f8aafc98640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8aa800c0b0 0x7f8aa802ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.306+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56072894b930 con 0x7f8aa800c0b0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.306+0000 7f8aaec96640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8aa800c0b0 0x7f8aa802ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.306+0000 7f8aaec96640 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8aa800c0b0 0x7f8aa802ca90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.307+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x7f8aa800c0b0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.307+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56072894b930 con 0x56072893f8f0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.307+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.307+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56072894b930 con 0x56072893f8f0 2024-09-07T03:32:37.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.307+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.307+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56072894b930 con 0x560728948e50 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.307+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.307+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56072894b930 con 0x56072893f8f0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.308+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.308+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56072894b930 con 0x560728943dc0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.308+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.308+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56072894b930 con 0x560728943dc0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.308+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.308+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x56072893f8f0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.308+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.308+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.309+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x7f8aa800c0b0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.309+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x56072893f8f0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.309+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.309+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.309+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8aa400f5f0 con 0x7f8aa800c0b0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.309+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728943dc0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.310+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.310+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728948e50 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.310+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.310+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x56072893f8f0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.310+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.310+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728943dc0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.310+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.310+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728948e50 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x56072893f8f0 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x56072893f8f0 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x56072893f8f0 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728948e50 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.311+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.312+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x7f8aa800c0b0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.312+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x56072893f8f0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.312+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x56072893f8f0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.312+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.312+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x7f8aa800c0b0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.312+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728948e50 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.312+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.312+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.313+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa400f5f0 con 0x7f8aa800c0b0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.313+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728943dc0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.313+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.313+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728943dc0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.313+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.313+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728948e50 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.313+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.313+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728943dc0 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8aa8066040 con 0x560728943dc0 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728947930 con 0x56072893f8f0 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x56072893f8f0 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728947d20 con 0x560728943dc0 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.314+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728947d20 con 0x56072893f8f0 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8aa403c040 con 0x56072893f8f0 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 20 zone default found 2024-09-07T03:32:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 4 Realm: () 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 20 zonegroup default 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728947560 con 0x7f8aa800c0b0 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56072894d8f0 con 0x560728948e50 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.315+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56072894ddb0 con 0x560728948e50 2024-09-07T03:32:37.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.316+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.316+0000 7f8ab19ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.316+0000 7f8ab19ad800 20 started sync module instance, tier type = 2024-09-07T03:32:37.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.316+0000 7f8ab19ad800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:37.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.316+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56072894cc90 con 0x560728943dc0 2024-09-07T03:32:37.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.317+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.317+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94588745601424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56072894cc90 con 0x560728943dc0 2024-09-07T03:32:37.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.317+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56072894e8f0 con 0x56072893f8f0 2024-09-07T03:32:37.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.318+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x56072893f8f0 2024-09-07T03:32:37.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.318+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94588745606112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56072894f190 con 0x56072893f8f0 2024-09-07T03:32:37.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.318+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94588745601424] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.318+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56072894c800 con 0x560728943dc0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.321+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.321+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94588745611136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56072894f190 con 0x560728943dc0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.321+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728950700 con 0x7f8aa800c0b0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.323+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94588745606112] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x56072893f8f0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.329+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.329+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94588745613808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56072894f190 con 0x7f8aa800c0b0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.329+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728951140 con 0x560728943dc0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.329+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94588745611136] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.330+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94588745613808] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.333+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.333+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94588745616528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56072894f190 con 0x560728943dc0 2024-09-07T03:32:37.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.333+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607289510f0 con 0x560728948e50 2024-09-07T03:32:37.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.335+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.335+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94588745618784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728951e30 con 0x560728948e50 2024-09-07T03:32:37.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.335+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728952920 con 0x560728948e50 2024-09-07T03:32:37.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.337+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94588745618784] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.337+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94588745616528] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.338+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.338+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94588745622512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728951980 con 0x560728948e50 2024-09-07T03:32:37.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.338+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607289531c0 con 0x7f8aa800c0b0 2024-09-07T03:32:37.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94588745622512] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94588745608416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728951980 con 0x7f8aa800c0b0 2024-09-07T03:32:37.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8ab19ad800 20 add_watcher() i=0 2024-09-07T03:32:37.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8ab19ad800 20 add_watcher() i=1 2024-09-07T03:32:37.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8ab19ad800 20 add_watcher() i=2 2024-09-07T03:32:37.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8ab19ad800 20 add_watcher() i=3 2024-09-07T03:32:37.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8ab19ad800 20 add_watcher() i=4 2024-09-07T03:32:37.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8ab19ad800 20 add_watcher() i=5 2024-09-07T03:32:37.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.339+0000 7f8ab19ad800 20 add_watcher() i=6 2024-09-07T03:32:37.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.340+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94588745608416] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.340+0000 7f8ab19ad800 20 add_watcher() i=7 2024-09-07T03:32:37.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.340+0000 7f8ab19ad800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:37.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.340+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728956330 con 0x56072893f8f0 2024-09-07T03:32:37.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.340+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8aa403c040 con 0x56072893f8f0 2024-09-07T03:32:37.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.340+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94588745624848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728953850 con 0x56072893f8f0 2024-09-07T03:32:37.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.341+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94588745624848] v34'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x56072893f8f0 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.341+0000 7f8965fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.341+0000 7f8ab19ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.341+0000 7f8ab19ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.341+0000 7f8ab19ad800 5 note: GC not initialized 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.342+0000 7f8964fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.342+0000 7f8ab19ad800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.342+0000 7f8ab19ad800 20 Filter name: none 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.342+0000 7f88de7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.342+0000 7f8ab19ad800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.342+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560728988e60 con 0x7f8aa800c0b0 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.342+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f8aa403c040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.342+0000 7f8ab19ad800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:37.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.343+0000 7f8965fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.343+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94588745624848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728955420 con 0x56072893f8f0 2024-09-07T03:32:37.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.344+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94588745624848] v34'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x56072893f8f0 2024-09-07T03:32:37.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.345+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94588745601424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728986df0 con 0x560728943dc0 2024-09-07T03:32:37.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.345+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94588745601424] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.345+0000 7f8ab19ad800 20 remove_watcher() i=0 2024-09-07T03:32:37.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.345+0000 7f8ab19ad800 2 removed watcher, disabling cache 2024-09-07T03:32:37.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.345+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94588745606112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728986df0 con 0x56072893f8f0 2024-09-07T03:32:37.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.347+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94588745606112] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x56072893f8f0 2024-09-07T03:32:37.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.347+0000 7f8ab19ad800 20 remove_watcher() i=1 2024-09-07T03:32:37.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.347+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94588745611136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728986df0 con 0x560728943dc0 2024-09-07T03:32:37.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.348+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94588745611136] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.348+0000 7f8ab19ad800 20 remove_watcher() i=2 2024-09-07T03:32:37.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.348+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94588745613808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728986df0 con 0x7f8aa800c0b0 2024-09-07T03:32:37.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.349+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94588745613808] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.349+0000 7f8ab19ad800 20 remove_watcher() i=3 2024-09-07T03:32:37.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.349+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94588745616528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728986df0 con 0x560728943dc0 2024-09-07T03:32:37.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.350+0000 7f8aafc98640 1 -- 172.21.15.120:0/3373159749 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94588745616528] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa80083e0 con 0x560728943dc0 2024-09-07T03:32:37.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.350+0000 7f8ab19ad800 20 remove_watcher() i=4 2024-09-07T03:32:37.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.350+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94588745618784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728986df0 con 0x560728948e50 2024-09-07T03:32:37.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.351+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94588745618784] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.351+0000 7f8ab19ad800 20 remove_watcher() i=5 2024-09-07T03:32:37.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.351+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94588745622512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728986df0 con 0x560728948e50 2024-09-07T03:32:37.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.352+0000 7f8aaf497640 1 -- 172.21.15.120:0/3373159749 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94588745622512] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa00970b0 con 0x560728948e50 2024-09-07T03:32:37.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.353+0000 7f8ab19ad800 20 remove_watcher() i=6 2024-09-07T03:32:37.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.353+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94588745608416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560728986df0 con 0x7f8aa800c0b0 2024-09-07T03:32:37.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.353+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94588745608416] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa403c040 con 0x7f8aa800c0b0 2024-09-07T03:32:37.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.353+0000 7f8ab19ad800 20 remove_watcher() i=7 2024-09-07T03:32:37.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.353+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560728943dc0 msgr2=0x5607289461b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.353+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560728943dc0 0x5607289461b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072893f8f0 msgr2=0x560728941db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072893f8f0 0x560728941db0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8aa800c0b0 msgr2=0x7f8aa802ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8aa800c0b0 0x7f8aa802ca90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560728948e50 msgr2=0x56072894b260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560728948e50 0x56072894b260 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f897803c730 msgr2=0x7f897803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f897803c730 0x7f897803ebf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00973a0 tx=0x7f8aa008a000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 msgr2=0x560728933df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8aaec96640 1 -- 172.21.15.120:0/3373159749 reap_dead start 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x560728933df0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8052040 tx=0x7f8aa8053150 comp rx=0 tx=0).stop 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 shutdown_connections 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3373159749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880a600 0x560728933df0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 >> 172.21.15.120:0/3373159749 conn(0x560728926a10 msgr2=0x560728924c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 shutdown_connections 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3373159749 wait complete. 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3716275248 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f898803c780 msgr2=0x7f898803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3716275248 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f898803c780 0x7f898803ec40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x56072890aaf0 tx=0x7f8aa0081040 comp rx=0 tx=0).stop 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3716275248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072891daf0 msgr2=0x56072891df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3716275248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072891daf0 0x56072891df10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800aa90 tx=0x7f8aa800af50 comp rx=0 tx=0).stop 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3716275248 shutdown_connections 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3716275248 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f898803c780 0x7f898803ec40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/3716275248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072891daf0 0x56072891df10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3716275248 >> 172.21.15.120:0/3716275248 conn(0x560728911ea0 msgr2=0x560728912280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3716275248 shutdown_connections 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.354+0000 7f8ab19ad800 1 -- 172.21.15.120:0/3716275248 wait complete. 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56072890b330 msgr2=0x56072890d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56072890b330 0x56072890d720 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072880f020 msgr2=0x56072890a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072880f020 0x56072890a3c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f899403c780 msgr2=0x7f899403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f899403c780 0x7f899403ec40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4000c00 tx=0x7f8aa40013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 msgr2=0x560728902dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x560728902dc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0025a60 tx=0x7f8aa0003330 comp rx=0 tx=0).stop 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 shutdown_connections 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56072890b330 0x56072890d720 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56072880f020 0x56072890a3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f899403c780 0x7f899403ec40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 --2- 172.21.15.120:0/2325597761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56072880c600 0x560728902dc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 >> 172.21.15.120:0/2325597761 conn(0x5607288061c0 msgr2=0x5607288fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 shutdown_connections 2024-09-07T03:32:37.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.355+0000 7f8ab19ad800 1 -- 172.21.15.120:0/2325597761 wait complete. 2024-09-07T03:32:37.365 INFO:teuthology.orchestra.run.smithi120.stdout:{"key":"bucket:myfoo","ver":{"tag":"_lTnpTWkLcpYMSfiKaZH3CBG","ver":2},"mtime":"2024-09-07T03:32:37.037930Z","data":{"bucket":{"name":"myfoo","marker":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","bucket_id":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-07T03:32:35.744783Z","linked":false,"has_bucket_info":false}} 2024-09-07T03:32:37.366 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_lTnpTWkLcpYMSfiKaZH3CBG', 'ver': 2}, 'mtime': '2024-09-07T03:32:37.037930Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'bucket_id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-07T03:32:35.744783Z', 'linked': False, 'has_bucket_info': False}} 2024-09-07T03:32:37.366 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1'] 2024-09-07T03:32:37.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1'] 2024-09-07T03:32:37.366 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:37.455 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:37.455 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:37.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.453+0000 7f406e0bb800 1 Processor -- start 2024-09-07T03:32:37.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.453+0000 7f406e0bb800 1 -- start start 2024-09-07T03:32:37.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.453+0000 7f406e0bb800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cc2da1c620 0x55cc2da1ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.453+0000 7f406e0bb800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cc2d8c5e40 con 0x55cc2da1f040 2024-09-07T03:32:37.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.454+0000 7f406e0bb800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55cc2d890680 con 0x55cc2da1c620 2024-09-07T03:32:37.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.454+0000 7f406bba5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cc2da1c620 0x55cc2da1ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.454+0000 7f406b3a4640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55cc2da1f040 0x55cc2da21500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48496/0 (socket says 172.21.15.120:48496) 2024-09-07T03:32:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.454+0000 7f406b3a4640 1 -- 172.21.15.120:0/1775681103 learned_addr learned my addr 172.21.15.120:0/1775681103 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.454+0000 7f406bba5640 1 -- 172.21.15.120:0/1775681103 >> v1:172.21.15.104:6789/0 conn(0x55cc2da1f040 legacy=0x55cc2da21500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.454+0000 7f406aba3640 1 -- 172.21.15.120:0/1775681103 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405276371 0 0) 0x55cc2d8c5e40 con 0x55cc2da1f040 2024-09-07T03:32:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.454+0000 7f406bba5640 1 -- 172.21.15.120:0/1775681103 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc2d8ac6b0 con 0x55cc2da1c620 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406bba5640 1 --2- 172.21.15.120:0/1775681103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2da1ea10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f405c00a470 tx=0x7f405c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02813126d5abcbb server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406aba3640 1 -- 172.21.15.120:0/1775681103 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f405c053570 con 0x55cc2da1c620 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406aba3640 1 -- 172.21.15.120:0/1775681103 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c058070 con 0x55cc2da1c620 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406aba3640 1 -- 172.21.15.120:0/1775681103 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f405c053880 con 0x55cc2da1c620 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406e0bb800 1 -- 172.21.15.120:0/1775681103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 msgr2=0x55cc2da1ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1775681103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2da1ea10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f405c00a470 tx=0x7f405c045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406e0bb800 1 -- 172.21.15.120:0/1775681103 shutdown_connections 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1775681103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2da1ea10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406e0bb800 1 -- 172.21.15.120:0/1775681103 >> 172.21.15.120:0/1775681103 conn(0x55cc2da161e0 msgr2=0x55cc2da18640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406e0bb800 1 -- 172.21.15.120:0/1775681103 shutdown_connections 2024-09-07T03:32:37.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.456+0000 7f406e0bb800 1 -- 172.21.15.120:0/1775681103 wait complete. 2024-09-07T03:32:37.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.470+0000 7f406e0bb800 1 Processor -- start 2024-09-07T03:32:37.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.470+0000 7f406e0bb800 1 -- start start 2024-09-07T03:32:37.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.470+0000 7f406e0bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2da1bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.470+0000 7f406e0bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cc2d8b4dd0 con 0x55cc2da1c620 2024-09-07T03:32:37.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.470+0000 7f406bba5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2da1bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.470+0000 7f406bba5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2da1bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42634/0 (socket says 172.21.15.120:42634) 2024-09-07T03:32:37.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.470+0000 7f406bba5640 1 -- 172.21.15.120:0/1318269678 learned_addr learned my addr 172.21.15.120:0/1318269678 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.471+0000 7f406bba5640 1 -- 172.21.15.120:0/1318269678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc2d8cde10 con 0x55cc2da1c620 2024-09-07T03:32:37.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.471+0000 7f406bba5640 1 --2- 172.21.15.120:0/1318269678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2da1bdb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f405c025c20 tx=0x7f405c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea945b6db9c232f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.471+0000 7f3f59e0b640 1 -- 172.21.15.120:0/1318269678 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f405c053a20 con 0x55cc2da1c620 2024-09-07T03:32:37.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.471+0000 7f3f59e0b640 1 -- 172.21.15.120:0/1318269678 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c063070 con 0x55cc2da1c620 2024-09-07T03:32:37.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.471+0000 7f3f59e0b640 1 -- 172.21.15.120:0/1318269678 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f405c053d30 con 0x55cc2da1c620 2024-09-07T03:32:37.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 -- 172.21.15.120:0/1318269678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 msgr2=0x55cc2da1bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1318269678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2da1bdb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f405c025c20 tx=0x7f405c051000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 -- 172.21.15.120:0/1318269678 shutdown_connections 2024-09-07T03:32:37.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1318269678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2da1bdb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 -- 172.21.15.120:0/1318269678 >> 172.21.15.120:0/1318269678 conn(0x55cc2da161e0 msgr2=0x55cc2db06f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 -- 172.21.15.120:0/1318269678 shutdown_connections 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 -- 172.21.15.120:0/1318269678 wait complete. 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 Processor -- start 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 -- start start 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2db15080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406e0bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cc2da23060 con 0x55cc2da1c620 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406bba5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2db15080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406bba5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2db15080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42636/0 (socket says 172.21.15.120:42636) 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.472+0000 7f406bba5640 1 -- 172.21.15.120:0/443795104 learned_addr learned my addr 172.21.15.120:0/443795104 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.473+0000 7f406bba5640 1 -- 172.21.15.120:0/443795104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc2db155e0 con 0x55cc2da1c620 2024-09-07T03:32:37.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.473+0000 7f406bba5640 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2db15080 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f405c025c20 tx=0x7f405c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.473+0000 7f3f53fff640 1 -- 172.21.15.120:0/443795104 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f405c078070 con 0x55cc2da1c620 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.473+0000 7f3f53fff640 1 -- 172.21.15.120:0/443795104 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c073470 con 0x55cc2da1c620 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.473+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc2db15870 con 0x55cc2da1c620 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.473+0000 7f3f53fff640 1 -- 172.21.15.120:0/443795104 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f405c073750 con 0x55cc2da1c620 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.473+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc2db16480 con 0x55cc2da1c620 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.474+0000 7f3f53fff640 1 -- 172.21.15.120:0/443795104 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f405c07b070 con 0x55cc2da1c620 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.474+0000 7f3f53fff640 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f5403c780 0x7f3f5403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.474+0000 7f3f53fff640 1 -- 172.21.15.120:0/443795104 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f405c097b60 con 0x55cc2da1c620 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.474+0000 7f406b3a4640 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f5403c780 0x7f3f5403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.474+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2da1f040 0x55cc2db1c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.474+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db16e60 con 0x55cc2da1f040 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.475+0000 7f406c3a6640 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2da1f040 0x55cc2db1c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.475+0000 7f406b3a4640 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f5403c780 0x7f3f5403ec40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4054000c00 tx=0x7f40540013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.475+0000 7f406c3a6640 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2da1f040 0x55cc2db1c6d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.475+0000 7f406c3a6640 1 -- 172.21.15.120:0/443795104 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f406400a4d0 con 0x55cc2da1f040 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.475+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db1d600 0x55cc2db1f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.475+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db20020 con 0x55cc2db1d600 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.475+0000 7f406bba5640 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db1d600 0x55cc2db1f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.476+0000 7f406bba5640 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db1d600 0x55cc2db1f9f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.476+0000 7f406bba5640 1 -- 172.21.15.120:0/443795104 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f405c07a030 con 0x55cc2db1d600 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.476+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db218d0 con 0x55cc2db1d600 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.476+0000 7f406bba5640 1 -- 172.21.15.120:0/443795104 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f405c07a030 con 0x55cc2db1d600 2024-09-07T03:32:37.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.476+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db20a10 con 0x55cc2db1d600 2024-09-07T03:32:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406bba5640 1 -- 172.21.15.120:0/443795104 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f405c07a030 con 0x55cc2db1d600 2024-09-07T03:32:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db20e70 con 0x55cc2da1f040 2024-09-07T03:32:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406c3a6640 1 -- 172.21.15.120:0/443795104 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f406400a4d0 con 0x55cc2da1f040 2024-09-07T03:32:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406e0bb800 1 Processor -- start 2024-09-07T03:32:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406e0bb800 1 -- start start 2024-09-07T03:32:37.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406e0bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db2fdc0 0x55cc2db301e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406e0bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cc2d912a00 con 0x55cc2db2fdc0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406c3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db2fdc0 0x55cc2db301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406c3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db2fdc0 0x55cc2db301e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42638/0 (socket says 172.21.15.120:42638) 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.477+0000 7f406c3a6640 1 -- 172.21.15.120:0/4274448214 learned_addr learned my addr 172.21.15.120:0/4274448214 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.478+0000 7f406c3a6640 1 -- 172.21.15.120:0/4274448214 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc2db30820 con 0x55cc2db2fdc0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.478+0000 7f406c3a6640 1 --2- 172.21.15.120:0/4274448214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db2fdc0 0x55cc2db301e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4064016d20 tx=0x7f406400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.478+0000 7f3f517fa640 1 -- 172.21.15.120:0/4274448214 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4064017660 con 0x55cc2db2fdc0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.478+0000 7f3f517fa640 1 -- 172.21.15.120:0/4274448214 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f406401b030 con 0x55cc2db2fdc0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.478+0000 7f3f517fa640 1 -- 172.21.15.120:0/4274448214 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4064017950 con 0x55cc2db2fdc0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.478+0000 7f406e0bb800 1 -- 172.21.15.120:0/4274448214 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc2db31050 con 0x55cc2db2fdc0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.478+0000 7f406e0bb800 1 -- 172.21.15.120:0/4274448214 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc2db315f0 con 0x55cc2db2fdc0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.479+0000 7f3f517fa640 1 -- 172.21.15.120:0/4274448214 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4064017b40 con 0x55cc2db2fdc0 2024-09-07T03:32:37.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.479+0000 7f3f517fa640 1 --2- 172.21.15.120:0/4274448214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f4403c730 0x7f3f4403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.479+0000 7f3f517fa640 1 -- 172.21.15.120:0/4274448214 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f406400e040 con 0x55cc2db2fdc0 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.479+0000 7f406bba5640 1 --2- 172.21.15.120:0/4274448214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f4403c730 0x7f3f4403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.479+0000 7f406e0bb800 1 Processor -- start 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.479+0000 7f406bba5640 1 --2- 172.21.15.120:0/4274448214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f4403c730 0x7f3f4403ebf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55cc2db1cdc0 tx=0x7f405c08b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.479+0000 7f406e0bb800 1 -- start start 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f406e0bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db3cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f406e0bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cc2da1a650 con 0x55cc2db3c840 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f406c3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db3cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f406c3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db3cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42650/0 (socket says 172.21.15.120:42650) 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f406c3a6640 1 -- 172.21.15.120:0/1794993525 learned_addr learned my addr 172.21.15.120:0/1794993525 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f406c3a6640 1 -- 172.21.15.120:0/1794993525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc2db3d230 con 0x55cc2db3c840 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f406c3a6640 1 --2- 172.21.15.120:0/1794993525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db3cc40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4064013450 tx=0x7f4064053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3945d4f54cef7f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f3f4affd640 1 -- 172.21.15.120:0/1794993525 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4064014a00 con 0x55cc2db3c840 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f3f4affd640 1 -- 172.21.15.120:0/1794993525 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4064051070 con 0x55cc2db3c840 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.480+0000 7f3f4affd640 1 -- 172.21.15.120:0/1794993525 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4064028350 con 0x55cc2db3c840 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 -- 172.21.15.120:0/1794993525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 msgr2=0x55cc2db3cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1794993525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db3cc40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4064013450 tx=0x7f4064053f40 comp rx=0 tx=0).stop 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 -- 172.21.15.120:0/1794993525 shutdown_connections 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1794993525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db3cc40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 -- 172.21.15.120:0/1794993525 >> 172.21.15.120:0/1794993525 conn(0x55cc2db38c40 msgr2=0x55cc2db36e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 -- 172.21.15.120:0/1794993525 shutdown_connections 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 -- 172.21.15.120:0/1794993525 wait complete. 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 Processor -- start 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 -- start start 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db43ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.481+0000 7f406e0bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cc2db3d850 con 0x55cc2db3c840 2024-09-07T03:32:37.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f406c3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db43ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f406c3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db43ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42662/0 (socket says 172.21.15.120:42662) 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 learned_addr learned my addr 172.21.15.120:0/1135605393 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc2db44440 con 0x55cc2db3c840 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f406c3a6640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db43ee0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4064053f80 tx=0x7f4064053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f3f497fa640 1 -- 172.21.15.120:0/1135605393 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4064005030 con 0x55cc2db3c840 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f3f497fa640 1 -- 172.21.15.120:0/1135605393 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40640051d0 con 0x55cc2db3c840 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc2db446d0 con 0x55cc2db3c840 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f3f497fa640 1 -- 172.21.15.120:0/1135605393 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40640054f0 con 0x55cc2db3c840 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.482+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc2db45050 con 0x55cc2db3c840 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.483+0000 7f3f497fa640 1 -- 172.21.15.120:0/1135605393 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4064055280 con 0x55cc2db3c840 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.483+0000 7f3f497fa640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f3403c780 0x7f3f3403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.483+0000 7f3f497fa640 1 -- 172.21.15.120:0/1135605393 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f4064035c50 con 0x55cc2db3c840 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.483+0000 7f406bba5640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f3403c780 0x7f3f3403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406bba5640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f3403c780 0x7f3f3403ec40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f405c0893f0 tx=0x7f405c08d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2db4f970 0x55cc2db51e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db52580 con 0x55cc2db4f970 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406b3a4640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2db4f970 0x55cc2db51e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406b3a4640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2db4f970 0x55cc2db51e30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406e0bb800 20 realm 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db4ecc0 con 0x55cc2db4f970 2024-09-07T03:32:37.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.484+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406e0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db53070 con 0x55cc2db4f970 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db53e50 0x55cc2db56240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db56910 con 0x55cc2db53e50 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406c3a6640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db53e50 0x55cc2db56240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406c3a6640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db53e50 0x55cc2db56240 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.485+0000 7f406e0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db57160 con 0x55cc2db53e50 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406e0bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406e0bb800 20 searching for the correct realm 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cc2db58ed0 0x55cc2db5b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db58ed0 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406bba5640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cc2db58ed0 0x55cc2db5b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406bba5640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cc2db58ed0 0x55cc2db5b320 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.486+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db53e50 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.487+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.487+0000 7f406c3a6640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f406404e7c0 0x7f4064052170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.487+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x7f406404e7c0 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.487+0000 7f406b3a4640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f406404e7c0 0x7f4064052170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.487+0000 7f406b3a4640 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f406404e7c0 0x7f4064052170 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.487+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x7f406404e7c0 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.487+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.488+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.488+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.488+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.488+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db58ed0 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.488+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.488+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.488+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.488+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db53e50 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db53e50 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x7f406404e7c0 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x7f406404e7c0 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.489+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x7f406404e7c0 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.490+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f405400f5f0 con 0x7f406404e7c0 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.490+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db53e50 2024-09-07T03:32:37.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.490+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.490+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db58ed0 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.490+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.490+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.490+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.491+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db53e50 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.491+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.491+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db58ed0 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.491+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.491+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.491+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.491+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.491+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.491+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.492+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.492+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db58ed0 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.492+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.492+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x7f406404e7c0 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.492+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x7f406404e7c0 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.492+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db4f970 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.492+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x55cc2db4f970 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.492+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x7f406404e7c0 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x7f406404e7c0 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db58ed0 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x7f406404e7c0 2024-09-07T03:32:37.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405400f5f0 con 0x7f406404e7c0 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db53e50 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db53e50 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.493+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db58ed0 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db53e50 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5b9f0 con 0x55cc2db53e50 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406e0bb800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406e0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:37.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406e0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406e0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406e0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406e0bb800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.494+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db57ab0 con 0x55cc2db4f970 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db576f0 con 0x55cc2db53e50 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db57ef0 con 0x55cc2db4f970 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 20 zone default found 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 4 Realm: () 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 20 zonegroup default 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.495+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5c320 con 0x7f406404e7c0 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5e560 con 0x55cc2db58ed0 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5e900 con 0x55cc2db58ed0 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 20 started sync module instance, tier type = 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.496+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5d9a0 con 0x55cc2db53e50 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.497+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.497+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94335428582800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5d9a0 con 0x55cc2db53e50 2024-09-07T03:32:37.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.497+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5f1a0 con 0x55cc2db4f970 2024-09-07T03:32:37.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.498+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.498+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94335428582800] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.498+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94335428586736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5f540 con 0x55cc2db4f970 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.498+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5ff00 con 0x55cc2db53e50 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.499+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94335428586736] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.500+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.500+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94335428580592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db5ff00 con 0x55cc2db53e50 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.500+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db608c0 con 0x7f406404e7c0 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.501+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94335428580592] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.501+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.501+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94335428590160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db608c0 con 0x7f406404e7c0 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.501+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db612c0 con 0x55cc2db53e50 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.502+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.502+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94335428595152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db611f0 con 0x55cc2db53e50 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.502+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db62210 con 0x55cc2db58ed0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.504+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94335428590160] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.504+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.505+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94335428599040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db621d0 con 0x55cc2db58ed0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.505+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db62c20 con 0x55cc2db58ed0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.505+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94335428595152] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.507+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94335428599040] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.507+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.507+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94335428592656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db62be0 con 0x55cc2db58ed0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.507+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db634f0 con 0x7f406404e7c0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.508+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94335428592656] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.508+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94335428601616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db62be0 con 0x7f406404e7c0 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 20 add_watcher() i=0 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 20 add_watcher() i=1 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 20 add_watcher() i=2 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 20 add_watcher() i=3 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 20 add_watcher() i=4 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 20 add_watcher() i=5 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 20 add_watcher() i=6 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94335428601616] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 20 add_watcher() i=7 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.509+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db66690 con 0x55cc2db4f970 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.510+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.510+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94335428603968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db63b80 con 0x55cc2db4f970 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.511+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94335428603968] v34'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.511+0000 7f3f21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.511+0000 7f406e0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.511+0000 7f406e0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.511+0000 7f406e0bb800 5 note: GC not initialized 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.511+0000 7f3f20fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.511+0000 7f406e0bb800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.511+0000 7f406e0bb800 20 Filter name: none 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f3e9a7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db99760 con 0x7f406404e7c0 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 20 rados_obj.operate() r=0 bl.length=380 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db9b6f0 con 0x7f406404e7c0 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 : miss 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.512+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db9d170 con 0x55cc2db4f970 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.513+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.513+0000 7f406e0bb800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.513+0000 7f406e0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.513+0000 7f406e0bb800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.513+0000 7f406e0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.513+0000 7f406e0bb800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.513+0000 7f406e0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.513+0000 7f406e0bb800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.513+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2dba1760 con 0x7f406404e7c0 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.514+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(65 foo.buckets [call] v34'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.514+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2dba74f0 con 0x55cc2db4f970 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v34'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1, ofs0, ns] 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94335428843504 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2dba1b90 con 0x7f406404e7c0 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== watch-notify(notify (1) cookie 94335428590160 notify 146028888073 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55cc2db9d560 con 0x7f406404e7c0 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f3f4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94335428590160 notifier 4498 bl.length()=760 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f3f4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f3f4affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(67 notify.3 [notify cookie 94335428843504 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f3f4affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:37.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f3f4affd640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3f30003ea0 con 0x7f406404e7c0 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== watch-notify(notify_complete (2) cookie 94335428843504 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cc2db9c6b0 con 0x7f406404e7c0 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_sources= new_sources= 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential sources added=[] removed=[] 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_dests= new_dests= 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential dests added=[] removed=[] 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.517+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2dba5e80 con 0x55cc2db4f970 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.519+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(69 fud.buckets [call] v34'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.519+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db9d7f0 con 0x7f406404e7c0 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.520+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v34'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.520+0000 7f406e0bb800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.520+0000 7f406e0bb800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.520+0000 7f406e0bb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.520+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94335428843504 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cc2dba6330 con 0x55cc2db58ed0 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.521+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== watch-notify(notify (1) cookie 94335428592656 notify 146028888073 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55cc2db15870 con 0x55cc2db58ed0 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.521+0000 7f3f4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94335428592656 notifier 4498 bl.length()=314 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.521+0000 7f3f4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.521+0000 7f3f4affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.521+0000 7f3f4affd640 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3f30003ea0 con 0x55cc2db58ed0 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.521+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(71 notify.6 [notify cookie 94335428843504 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.521+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.521+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== watch-notify(notify_complete (2) cookie 94335428843504 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cc2db155e0 con 0x55cc2db58ed0 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.522+0000 7f3f21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.522+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94335428603968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db97620 con 0x55cc2db4f970 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.523+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94335428603968] v34'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.523+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94335428582800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db97620 con 0x55cc2db53e50 2024-09-07T03:32:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.524+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94335428582800] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.524+0000 7f406e0bb800 20 remove_watcher() i=0 2024-09-07T03:32:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.524+0000 7f406e0bb800 2 removed watcher, disabling cache 2024-09-07T03:32:37.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.524+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94335428586736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db97620 con 0x55cc2db4f970 2024-09-07T03:32:37.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.525+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94335428586736] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x55cc2db4f970 2024-09-07T03:32:37.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.525+0000 7f406e0bb800 20 remove_watcher() i=1 2024-09-07T03:32:37.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.525+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94335428580592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db97620 con 0x55cc2db53e50 2024-09-07T03:32:37.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.526+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94335428580592] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.526+0000 7f406e0bb800 20 remove_watcher() i=2 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.526+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94335428590160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db97620 con 0x7f406404e7c0 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.527+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94335428590160] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.527+0000 7f406e0bb800 20 remove_watcher() i=3 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.527+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94335428595152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db97620 con 0x55cc2db53e50 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.528+0000 7f406c3a6640 1 -- 172.21.15.120:0/1135605393 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94335428595152] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4064027070 con 0x55cc2db53e50 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.528+0000 7f406e0bb800 20 remove_watcher() i=4 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.528+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94335428599040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db97620 con 0x55cc2db58ed0 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.530+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94335428599040] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.530+0000 7f406e0bb800 20 remove_watcher() i=5 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.530+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94335428592656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db97620 con 0x55cc2db58ed0 2024-09-07T03:32:37.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.531+0000 7f406bba5640 1 -- 172.21.15.120:0/1135605393 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94335428592656] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405c0a0070 con 0x55cc2db58ed0 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.531+0000 7f406e0bb800 20 remove_watcher() i=6 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.531+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94335428601616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cc2db97620 con 0x7f406404e7c0 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94335428601616] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405403c040 con 0x7f406404e7c0 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 20 remove_watcher() i=7 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db53e50 msgr2=0x55cc2db56240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db53e50 0x55cc2db56240 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2db4f970 msgr2=0x55cc2db51e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2db4f970 0x55cc2db51e30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f406404e7c0 msgr2=0x7f4064052170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f406404e7c0 0x7f4064052170 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cc2db58ed0 msgr2=0x55cc2db5b320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cc2db58ed0 0x55cc2db5b320 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f3403c780 msgr2=0x7f3f3403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f3403c780 0x7f3f3403ec40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f405c0893f0 tx=0x7f405c08d000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 msgr2=0x55cc2db43ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406b3a4640 1 -- 172.21.15.120:0/1135605393 reap_dead start 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db43ee0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4064053f80 tx=0x7f4064053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 shutdown_connections 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/1135605393 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db3c840 0x55cc2db43ee0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 >> 172.21.15.120:0/1135605393 conn(0x55cc2db38c40 msgr2=0x55cc2db36e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 shutdown_connections 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/1135605393 wait complete. 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/4274448214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f4403c730 msgr2=0x7f3f4403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/4274448214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f4403c730 0x7f3f4403ebf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55cc2db1cdc0 tx=0x7f405c08b040 comp rx=0 tx=0).stop 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/4274448214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db2fdc0 msgr2=0x55cc2db301e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/4274448214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db2fdc0 0x55cc2db301e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4064016d20 tx=0x7f406400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/4274448214 shutdown_connections 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/4274448214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f4403c730 0x7f3f4403ebf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 --2- 172.21.15.120:0/4274448214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2db2fdc0 0x55cc2db301e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.532+0000 7f406e0bb800 1 -- 172.21.15.120:0/4274448214 >> 172.21.15.120:0/4274448214 conn(0x55cc2db24170 msgr2=0x55cc2db24550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/4274448214 shutdown_connections 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/4274448214 wait complete. 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db1d600 msgr2=0x55cc2db1f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db1d600 0x55cc2db1f9f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2da1f040 msgr2=0x55cc2db1c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2da1f040 0x55cc2db1c6d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f5403c780 msgr2=0x7f3f5403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f5403c780 0x7f3f5403ec40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4054000c00 tx=0x7f40540013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 msgr2=0x55cc2db15080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2db15080 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f405c025c20 tx=0x7f405c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 shutdown_connections 2024-09-07T03:32:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cc2db1d600 0x55cc2db1f9f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cc2da1f040 0x55cc2db1c6d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3f5403c780 0x7f3f5403ec40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 --2- 172.21.15.120:0/443795104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cc2da1c620 0x55cc2db15080 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 >> 172.21.15.120:0/443795104 conn(0x55cc2da161e0 msgr2=0x55cc2db06a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 shutdown_connections 2024-09-07T03:32:37.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.533+0000 7f406e0bb800 1 -- 172.21.15.120:0/443795104 wait complete. 2024-09-07T03:32:37.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-07T03:32:37.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-07T03:32:37.546 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-07T03:32:37.590 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:37.590 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.589+0000 7fdc85a40800 1 Processor -- start 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.589+0000 7fdc85a40800 1 -- start start 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.589+0000 7fdc85a40800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560adcf644a0 0x560adcf648a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.589+0000 7fdc85a40800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560adce0fe40 con 0x560adcf64de0 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.589+0000 7fdc85a40800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560adcdda680 con 0x560adcf644a0 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.589+0000 7fdc8352a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560adcf644a0 0x560adcf648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.589+0000 7fdc7ad29640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x560adcf64de0 0x560adcf65290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48502/0 (socket says 172.21.15.120:48502) 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.589+0000 7fdc7ad29640 1 -- 172.21.15.120:0/643782504 learned_addr learned my addr 172.21.15.120:0/643782504 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.590+0000 7fdc8352a640 1 -- 172.21.15.120:0/643782504 >> v1:172.21.15.104:6789/0 conn(0x560adcf64de0 legacy=0x560adcf65290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.590+0000 7fdc8352a640 1 -- 172.21.15.120:0/643782504 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560adcdf66b0 con 0x560adcf644a0 2024-09-07T03:32:37.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.590+0000 7fdc82d29640 1 -- 172.21.15.120:0/643782504 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901903622 0 0) 0x560adce0fe40 con 0x560adcf64de0 2024-09-07T03:32:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.591+0000 7fdc8352a640 1 --2- 172.21.15.120:0/643782504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560adcf648a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400a470 tx=0x7fdc74045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a2ac737547fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc82d29640 1 -- 172.21.15.120:0/643782504 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc74053570 con 0x560adcf644a0 2024-09-07T03:32:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc82d29640 1 -- 172.21.15.120:0/643782504 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc74058070 con 0x560adcf644a0 2024-09-07T03:32:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc82d29640 1 -- 172.21.15.120:0/643782504 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc74053880 con 0x560adcf644a0 2024-09-07T03:32:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc85a40800 1 -- 172.21.15.120:0/643782504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 msgr2=0x560adcf648a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc85a40800 1 --2- 172.21.15.120:0/643782504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560adcf648a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400a470 tx=0x7fdc74045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc85a40800 1 -- 172.21.15.120:0/643782504 shutdown_connections 2024-09-07T03:32:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc85a40800 1 --2- 172.21.15.120:0/643782504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560adcf648a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc85a40800 1 -- 172.21.15.120:0/643782504 >> 172.21.15.120:0/643782504 conn(0x560adcf601f0 msgr2=0x560adcf62630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc85a40800 1 -- 172.21.15.120:0/643782504 shutdown_connections 2024-09-07T03:32:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.592+0000 7fdc85a40800 1 -- 172.21.15.120:0/643782504 wait complete. 2024-09-07T03:32:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.606+0000 7fdc85a40800 1 Processor -- start 2024-09-07T03:32:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.606+0000 7fdc85a40800 1 -- start start 2024-09-07T03:32:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.606+0000 7fdc85a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add057670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.606+0000 7fdc85a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560adcdfedd0 con 0x560adcf644a0 2024-09-07T03:32:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.606+0000 7fdc8352a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add057670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.606+0000 7fdc8352a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add057670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42686/0 (socket says 172.21.15.120:42686) 2024-09-07T03:32:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.606+0000 7fdc8352a640 1 -- 172.21.15.120:0/3442072574 learned_addr learned my addr 172.21.15.120:0/3442072574 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.607+0000 7fdc8352a640 1 -- 172.21.15.120:0/3442072574 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560adce17e10 con 0x560adcf644a0 2024-09-07T03:32:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.607+0000 7fdc8352a640 1 --2- 172.21.15.120:0/3442072574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add057670 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdc74025c20 tx=0x7fdc74051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e036fdba73bf3de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.607+0000 7fdb7160a640 1 -- 172.21.15.120:0/3442072574 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc74053a20 con 0x560adcf644a0 2024-09-07T03:32:37.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.607+0000 7fdb7160a640 1 -- 172.21.15.120:0/3442072574 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc74063070 con 0x560adcf644a0 2024-09-07T03:32:37.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.607+0000 7fdb7160a640 1 -- 172.21.15.120:0/3442072574 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc74053d30 con 0x560adcf644a0 2024-09-07T03:32:37.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 -- 172.21.15.120:0/3442072574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 msgr2=0x560add057670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 --2- 172.21.15.120:0/3442072574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add057670 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdc74025c20 tx=0x7fdc74051000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 -- 172.21.15.120:0/3442072574 shutdown_connections 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 --2- 172.21.15.120:0/3442072574 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add057670 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 -- 172.21.15.120:0/3442072574 >> 172.21.15.120:0/3442072574 conn(0x560adcf601f0 msgr2=0x560add052ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 -- 172.21.15.120:0/3442072574 shutdown_connections 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 -- 172.21.15.120:0/3442072574 wait complete. 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 Processor -- start 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 -- start start 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add05efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc85a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560adcf65d60 con 0x560adcf644a0 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc8352a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add05efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc8352a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add05efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42702/0 (socket says 172.21.15.120:42702) 2024-09-07T03:32:37.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.608+0000 7fdc8352a640 1 -- 172.21.15.120:0/62580659 learned_addr learned my addr 172.21.15.120:0/62580659 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.609+0000 7fdc8352a640 1 -- 172.21.15.120:0/62580659 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560add05f500 con 0x560adcf644a0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.609+0000 7fdc8352a640 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add05efa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdc74025c20 tx=0x7fdc74002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.609+0000 7fdb6fe07640 1 -- 172.21.15.120:0/62580659 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc74078070 con 0x560adcf644a0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.609+0000 7fdb6fe07640 1 -- 172.21.15.120:0/62580659 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc74073470 con 0x560adcf644a0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.609+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560add05f790 con 0x560adcf644a0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.609+0000 7fdb6fe07640 1 -- 172.21.15.120:0/62580659 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc74073750 con 0x560adcf644a0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.609+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560add060350 con 0x560adcf644a0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.610+0000 7fdb6fe07640 1 -- 172.21.15.120:0/62580659 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdc7407b070 con 0x560adcf644a0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.610+0000 7fdb6fe07640 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb6803c780 0x7fdb6803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.610+0000 7fdb6fe07640 1 -- 172.21.15.120:0/62580659 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fdc74097ae0 con 0x560adcf644a0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.610+0000 7fdc7ad29640 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb6803c780 0x7fdb6803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.610+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560adcf64de0 0x560add0665a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.610+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add060d10 con 0x560adcf64de0 2024-09-07T03:32:37.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.610+0000 7fdc83d2b640 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560adcf64de0 0x560add0665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.611+0000 7fdc7ad29640 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb6803c780 0x7fdb6803ec40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000c00 tx=0x7fdc6c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.611+0000 7fdc83d2b640 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560adcf64de0 0x560add0665a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.611+0000 7fdc83d2b640 1 -- 172.21.15.120:0/62580659 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc7c00a4d0 con 0x560adcf64de0 2024-09-07T03:32:37.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.611+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add0674d0 0x560add0698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.611+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add069ef0 con 0x560add0674d0 2024-09-07T03:32:37.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.611+0000 7fdc8352a640 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add0674d0 0x560add0698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.611+0000 7fdc8352a640 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add0674d0 0x560add0698c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.612+0000 7fdc8352a640 1 -- 172.21.15.120:0/62580659 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc7407a030 con 0x560add0674d0 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.612+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add06b7a0 con 0x560add0674d0 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.612+0000 7fdc8352a640 1 -- 172.21.15.120:0/62580659 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc7407a030 con 0x560add0674d0 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.612+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add06a8e0 con 0x560add0674d0 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.612+0000 7fdc8352a640 1 -- 172.21.15.120:0/62580659 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc7407a030 con 0x560add0674d0 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.612+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add06ad40 con 0x560adcf64de0 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.613+0000 7fdc83d2b640 1 -- 172.21.15.120:0/62580659 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc7c00a4d0 con 0x560adcf64de0 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.613+0000 7fdc85a40800 1 Processor -- start 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.613+0000 7fdc85a40800 1 -- start start 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.613+0000 7fdc85a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add079c90 0x560add07a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.613+0000 7fdc85a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560adce5ca00 con 0x560add079c90 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.613+0000 7fdc83d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add079c90 0x560add07a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.614+0000 7fdc83d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add079c90 0x560add07a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42710/0 (socket says 172.21.15.120:42710) 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.614+0000 7fdc83d2b640 1 -- 172.21.15.120:0/919977694 learned_addr learned my addr 172.21.15.120:0/919977694 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.614+0000 7fdc83d2b640 1 -- 172.21.15.120:0/919977694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560add07a6f0 con 0x560add079c90 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.614+0000 7fdc83d2b640 1 --2- 172.21.15.120:0/919977694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add079c90 0x560add07a0b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c016d20 tx=0x7fdc7c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.614+0000 7fdb6d602640 1 -- 172.21.15.120:0/919977694 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c017660 con 0x560add079c90 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.614+0000 7fdb6d602640 1 -- 172.21.15.120:0/919977694 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7c01b030 con 0x560add079c90 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.614+0000 7fdc85a40800 1 -- 172.21.15.120:0/919977694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560add07af20 con 0x560add079c90 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.614+0000 7fdb6d602640 1 -- 172.21.15.120:0/919977694 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c017950 con 0x560add079c90 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.614+0000 7fdc85a40800 1 -- 172.21.15.120:0/919977694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560add07b4c0 con 0x560add079c90 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.615+0000 7fdb6d602640 1 -- 172.21.15.120:0/919977694 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdc7c017b40 con 0x560add079c90 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.615+0000 7fdb6d602640 1 --2- 172.21.15.120:0/919977694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb5c03c730 0x7fdb5c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.615+0000 7fdb6d602640 1 -- 172.21.15.120:0/919977694 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fdc7c00e040 con 0x560add079c90 2024-09-07T03:32:37.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.615+0000 7fdc8352a640 1 --2- 172.21.15.120:0/919977694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb5c03c730 0x7fdb5c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc85a40800 1 Processor -- start 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc85a40800 1 -- start start 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc8352a640 1 --2- 172.21.15.120:0/919977694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb5c03c730 0x7fdb5c03ebf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x560add066c90 tx=0x7fdc7408b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc85a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add086b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc85a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560add057e60 con 0x560add086710 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc83d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add086b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc83d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add086b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42722/0 (socket says 172.21.15.120:42722) 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc83d2b640 1 -- 172.21.15.120:0/3971474187 learned_addr learned my addr 172.21.15.120:0/3971474187 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc83d2b640 1 -- 172.21.15.120:0/3971474187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560add087100 con 0x560add086710 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdc83d2b640 1 --2- 172.21.15.120:0/3971474187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add086b10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c013450 tx=0x7fdc7c053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ca3b28bcbc2371 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdb66ffd640 1 -- 172.21.15.120:0/3971474187 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c014a00 con 0x560add086710 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.616+0000 7fdb66ffd640 1 -- 172.21.15.120:0/3971474187 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7c051070 con 0x560add086710 2024-09-07T03:32:37.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdb66ffd640 1 -- 172.21.15.120:0/3971474187 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c028350 con 0x560add086710 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 -- 172.21.15.120:0/3971474187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 msgr2=0x560add086b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 --2- 172.21.15.120:0/3971474187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add086b10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c013450 tx=0x7fdc7c053f40 comp rx=0 tx=0).stop 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 -- 172.21.15.120:0/3971474187 shutdown_connections 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 --2- 172.21.15.120:0/3971474187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add086b10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 -- 172.21.15.120:0/3971474187 >> 172.21.15.120:0/3971474187 conn(0x560add082b10 msgr2=0x560add080d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 -- 172.21.15.120:0/3971474187 shutdown_connections 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 -- 172.21.15.120:0/3971474187 wait complete. 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 Processor -- start 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 -- start start 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add08ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.617+0000 7fdc85a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560add087720 con 0x560add086710 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdc83d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add08ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdc83d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add08ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42726/0 (socket says 172.21.15.120:42726) 2024-09-07T03:32:37.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 learned_addr learned my addr 172.21.15.120:0/790607685 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560add08e310 con 0x560add086710 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdc83d2b640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add08ddb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c053f80 tx=0x7fdc7c053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdb657fa640 1 -- 172.21.15.120:0/790607685 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c005030 con 0x560add086710 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdb657fa640 1 -- 172.21.15.120:0/790607685 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7c0051d0 con 0x560add086710 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560add08e5a0 con 0x560add086710 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdb657fa640 1 -- 172.21.15.120:0/790607685 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c0054f0 con 0x560add086710 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.618+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560add08ef20 con 0x560add086710 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.619+0000 7fdb657fa640 1 -- 172.21.15.120:0/790607685 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdc7c055280 con 0x560add086710 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.619+0000 7fdb657fa640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb4c03c780 0x7fdb4c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.619+0000 7fdb657fa640 1 -- 172.21.15.120:0/790607685 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fdc7c035c50 con 0x560add086710 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.619+0000 7fdc8352a640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb4c03c780 0x7fdb4c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.620+0000 7fdc8352a640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb4c03c780 0x7fdb4c03ec40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc74068e00 tx=0x7fdc7408d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.620+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.620+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560add099840 0x560add09bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.620+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add09c450 con 0x560add099840 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.620+0000 7fdc7ad29640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560add099840 0x560add09bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.620+0000 7fdc7ad29640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560add099840 0x560add09bd00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.620+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.620+0000 7fdc85a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.620+0000 7fdc85a40800 20 realm 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add098b90 con 0x560add099840 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add09cf40 con 0x560add099840 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add09dd20 0x560add0a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0a07e0 con 0x560add09dd20 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc83d2b640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add09dd20 0x560add0a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.621+0000 7fdc83d2b640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add09dd20 0x560add0a0110 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc85a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0a1030 con 0x560add09dd20 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc85a40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc85a40800 20 searching for the correct realm 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560add0a2da0 0x560add0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add0a2da0 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc8352a640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560add0a2da0 0x560add0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.622+0000 7fdc8352a640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560add0a2da0 0x560add0a51f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.623+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.623+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add09dd20 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.623+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.623+0000 7fdc83d2b640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fdc7c04e7c0 0x7fdc7c052170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.623+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.623+0000 7fdc7ad29640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fdc7c04e7c0 0x7fdc7c052170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.623+0000 7fdc7ad29640 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fdc7c04e7c0 0x7fdc7c052170 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add0a2da0 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.624+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add09dd20 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.625+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.625+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add09dd20 2024-09-07T03:32:37.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.625+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.625+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.625+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.625+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.625+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.625+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.626+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.626+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.626+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.626+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add09dd20 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.626+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.626+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add0a2da0 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.627+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.627+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.627+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.627+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add09dd20 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.627+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.627+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add0a2da0 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.627+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.627+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.628+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.628+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.628+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.628+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.628+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.628+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add0a2da0 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.628+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.628+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add099840 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x560add099840 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add0a2da0 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc6c00f5f0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.629+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add09dd20 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.630+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.630+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add09dd20 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.630+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.630+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add0a2da0 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.630+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.630+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add09dd20 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560add0a58c0 con 0x560add09dd20 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:37.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0a19b0 con 0x560add099840 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.631+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0a15f0 con 0x560add09dd20 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0a1df0 con 0x560add099840 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 zone default found 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 4 Realm: () 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 zonegroup default 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0a61f0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0a8430 con 0x560add0a2da0 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.632+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0a87d0 con 0x560add0a2da0 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.633+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.633+0000 7fdc85a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.633+0000 7fdc85a40800 20 started sync module instance, tier type = 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.633+0000 7fdc85a40800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.633+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0a7870 con 0x560add09dd20 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.634+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.634+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94604658113904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0a7870 con 0x560add09dd20 2024-09-07T03:32:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.634+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0a8df0 con 0x560add099840 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.635+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.635+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94604658113904] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.635+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94604658111424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0a9190 con 0x560add099840 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.635+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0a9c80 con 0x560add09dd20 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.636+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94604658111424] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.636+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.636+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94604658120528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0a9c40 con 0x560add09dd20 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.636+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0aa770 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.637+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94604658120528] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.637+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.638+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94604658116928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0aa770 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.638+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ab1d0 con 0x560add09dd20 2024-09-07T03:32:37.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.639+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94604658116928] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.642+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.642+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94604658126000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0aa770 con 0x560add09dd20 2024-09-07T03:32:37.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.642+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0abbe0 con 0x560add0a2da0 2024-09-07T03:32:37.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.643+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.643+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94604658126000] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.643+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94604658123936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0abbe0 con 0x560add0a2da0 2024-09-07T03:32:37.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.643+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ac630 con 0x560add0a2da0 2024-09-07T03:32:37.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.645+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94604658123936] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.645+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.645+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94604658131264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0abbe0 con 0x560add0a2da0 2024-09-07T03:32:37.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.645+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ad0a0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94604658131264] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94604658133904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0abbe0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc85a40800 20 add_watcher() i=0 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc85a40800 20 add_watcher() i=1 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc85a40800 20 add_watcher() i=2 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc85a40800 20 add_watcher() i=3 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc85a40800 20 add_watcher() i=4 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc85a40800 20 add_watcher() i=5 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.648+0000 7fdc85a40800 20 add_watcher() i=6 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.649+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94604658133904] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.649+0000 7fdc85a40800 20 add_watcher() i=7 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.649+0000 7fdc85a40800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.649+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0b0520 con 0x560add099840 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.649+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.650+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94604658129152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ada40 con 0x560add099840 2024-09-07T03:32:37.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.650+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94604658129152] v34'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.651+0000 7fdb39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.651+0000 7fdc85a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:37.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.651+0000 7fdc85a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:37.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.651+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0b8d80 con 0x560add09dd20 2024-09-07T03:32:37.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.652+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'45 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.652+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0b8db0 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.655+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'20 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.655+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0b94b0 con 0x560add0a2da0 2024-09-07T03:32:37.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.656+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.656+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0b9890 con 0x560add099840 2024-09-07T03:32:37.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.657+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'119 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.657+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0b9e00 con 0x560add09dd20 2024-09-07T03:32:37.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.658+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'38 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.659+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0b9e00 con 0x560add0a2da0 2024-09-07T03:32:37.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.660+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.660+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0b9e90 con 0x560add09dd20 2024-09-07T03:32:37.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.661+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.661+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0b9f90 con 0x560add099840 2024-09-07T03:32:37.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.662+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.662+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba450 con 0x560add09dd20 2024-09-07T03:32:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.664+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.664+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba450 con 0x560add09dd20 2024-09-07T03:32:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.665+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.665+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba450 con 0x560add09dd20 2024-09-07T03:32:37.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.666+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.666+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba450 con 0x560add0a2da0 2024-09-07T03:32:37.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.667+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.667+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba450 con 0x560add09dd20 2024-09-07T03:32:37.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.668+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.668+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba450 con 0x560add099840 2024-09-07T03:32:37.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.669+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'39 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.669+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba450 con 0x560add099840 2024-09-07T03:32:37.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.670+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'120 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.670+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba4e0 con 0x560add09dd20 2024-09-07T03:32:37.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.671+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.671+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba4e0 con 0x560add09dd20 2024-09-07T03:32:37.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.672+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.672+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba4e0 con 0x560add0a2da0 2024-09-07T03:32:37.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.673+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.673+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba4e0 con 0x560add09dd20 2024-09-07T03:32:37.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.675+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.675+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add099840 2024-09-07T03:32:37.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.676+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'121 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.676+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add09dd20 2024-09-07T03:32:37.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.676+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.676+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add09dd20 2024-09-07T03:32:37.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.677+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.678+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add0a2da0 2024-09-07T03:32:37.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.679+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.679+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add09dd20 2024-09-07T03:32:37.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.680+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.680+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add0a2da0 2024-09-07T03:32:37.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.681+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.681+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add0a2da0 2024-09-07T03:32:37.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.682+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'34 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.682+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add0a2da0 2024-09-07T03:32:37.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.683+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.683+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add09dd20 2024-09-07T03:32:37.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.684+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.684+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add099840 2024-09-07T03:32:37.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.685+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.685+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add09dd20 2024-09-07T03:32:37.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.686+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.686+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x560add099840 2024-09-07T03:32:37.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.687+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'40 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.687+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0ba620 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.688+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.688+0000 7fdb38fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:37.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.688+0000 7fdc85a40800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:37.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc85a40800 20 Filter name: none 2024-09-07T03:32:37.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdab27fc640 20 reqs_thread_entry: start 2024-09-07T03:32:37.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc85a40800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-07T03:32:37.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc85a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0e5520 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc85a40800 20 rados_obj.operate() r=0 bl.length=380 2024-09-07T03:32:37.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc85a40800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-07T03:32:37.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc85a40800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:32:37.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc85a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x560add099840 2024-09-07T03:32:37.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.689+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.693 INFO:teuthology.orchestra.run.smithi120.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-07T03:32:37.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.690+0000 7fdb39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.690+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94604658129152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x560add099840 2024-09-07T03:32:37.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.691+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94604658129152] v34'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.691+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94604658113904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x560add09dd20 2024-09-07T03:32:37.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.692+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94604658113904] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.692+0000 7fdc85a40800 20 remove_watcher() i=0 2024-09-07T03:32:37.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.692+0000 7fdc85a40800 2 removed watcher, disabling cache 2024-09-07T03:32:37.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.693+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94604658111424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x560add099840 2024-09-07T03:32:37.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.693+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94604658111424] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x560add099840 2024-09-07T03:32:37.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.693+0000 7fdc85a40800 20 remove_watcher() i=1 2024-09-07T03:32:37.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.693+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94604658120528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x560add09dd20 2024-09-07T03:32:37.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.694+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94604658120528] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.694+0000 7fdc85a40800 20 remove_watcher() i=2 2024-09-07T03:32:37.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.694+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94604658116928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.695+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94604658116928] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.695+0000 7fdc85a40800 20 remove_watcher() i=3 2024-09-07T03:32:37.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.695+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94604658126000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x560add09dd20 2024-09-07T03:32:37.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.697+0000 7fdc83d2b640 1 -- 172.21.15.120:0/790607685 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94604658126000] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc7c027070 con 0x560add09dd20 2024-09-07T03:32:37.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.697+0000 7fdc85a40800 20 remove_watcher() i=4 2024-09-07T03:32:37.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.697+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94604658123936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x560add0a2da0 2024-09-07T03:32:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.698+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94604658123936] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.698+0000 7fdc85a40800 20 remove_watcher() i=5 2024-09-07T03:32:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.698+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94604658131264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x560add0a2da0 2024-09-07T03:32:37.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.699+0000 7fdc8352a640 1 -- 172.21.15.120:0/790607685 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94604658131264] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc740a0070 con 0x560add0a2da0 2024-09-07T03:32:37.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.699+0000 7fdc85a40800 20 remove_watcher() i=6 2024-09-07T03:32:37.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.699+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94604658133904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560add0e7b10 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94604658133904] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc6c03c040 con 0x7fdc7c04e7c0 2024-09-07T03:32:37.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 20 remove_watcher() i=7 2024-09-07T03:32:37.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add09dd20 msgr2=0x560add0a0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add09dd20 0x560add0a0110 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560add099840 msgr2=0x560add09bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560add099840 0x560add09bd00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fdc7c04e7c0 msgr2=0x7fdc7c052170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fdc7c04e7c0 0x7fdc7c052170 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560add0a2da0 msgr2=0x560add0a51f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560add0a2da0 0x560add0a51f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb4c03c780 msgr2=0x7fdb4c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb4c03c780 0x7fdb4c03ec40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc74068e00 tx=0x7fdc7408d000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 msgr2=0x560add08ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc7ad29640 1 -- 172.21.15.120:0/790607685 reap_dead start 2024-09-07T03:32:37.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add08ddb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c053f80 tx=0x7fdc7c053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 shutdown_connections 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/790607685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add086710 0x560add08ddb0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 >> 172.21.15.120:0/790607685 conn(0x560add082b10 msgr2=0x560add080d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 shutdown_connections 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/790607685 wait complete. 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/919977694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb5c03c730 msgr2=0x7fdb5c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/919977694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb5c03c730 0x7fdb5c03ebf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x560add066c90 tx=0x7fdc7408b040 comp rx=0 tx=0).stop 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/919977694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add079c90 msgr2=0x560add07a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/919977694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add079c90 0x560add07a0b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c016d20 tx=0x7fdc7c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/919977694 shutdown_connections 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/919977694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb5c03c730 0x7fdb5c03ebf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 --2- 172.21.15.120:0/919977694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560add079c90 0x560add07a0b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/919977694 >> 172.21.15.120:0/919977694 conn(0x560add06e040 msgr2=0x560add06e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/919977694 shutdown_connections 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.700+0000 7fdc85a40800 1 -- 172.21.15.120:0/919977694 wait complete. 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add0674d0 msgr2=0x560add0698c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add0674d0 0x560add0698c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560adcf64de0 msgr2=0x560add0665a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560adcf64de0 0x560add0665a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb6803c780 msgr2=0x7fdb6803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb6803c780 0x7fdb6803ec40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000c00 tx=0x7fdc6c0013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 msgr2=0x560add05efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add05efa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdc74025c20 tx=0x7fdc74002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 shutdown_connections 2024-09-07T03:32:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560add0674d0 0x560add0698c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560adcf64de0 0x560add0665a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdb6803c780 0x7fdb6803ec40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 --2- 172.21.15.120:0/62580659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560adcf644a0 0x560add05efa0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 >> 172.21.15.120:0/62580659 conn(0x560adcf601f0 msgr2=0x560add0588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 shutdown_connections 2024-09-07T03:32:37.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.701+0000 7fdc85a40800 1 -- 172.21.15.120:0/62580659 wait complete. 2024-09-07T03:32:37.711 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-07T03:32:37.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-07T03:32:37.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-07T03:32:37.712 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-07T03:32:37.758 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:37.758 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.757+0000 7f3007a40800 1 Processor -- start 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.757+0000 7f3007a40800 1 -- start start 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.757+0000 7f3007a40800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bed70abfb0 0x55bed70b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.757+0000 7f3007a40800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bed6f55e40 con 0x55bed70aa490 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.757+0000 7f3007a40800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55bed6f20680 con 0x55bed70abfb0 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.757+0000 7f3004d30640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bed70abfb0 0x55bed70b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.757+0000 7f3005531640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55bed70aa490 0x55bed70aa890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48506/0 (socket says 172.21.15.120:48506) 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.757+0000 7f3005531640 1 -- 172.21.15.120:0/2590801749 learned_addr learned my addr 172.21.15.120:0/2590801749 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.758+0000 7f3004d30640 1 -- 172.21.15.120:0/2590801749 >> v1:172.21.15.104:6789/0 conn(0x55bed70aa490 legacy=0x55bed70aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.758+0000 7f3004d30640 1 -- 172.21.15.120:0/2590801749 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed6f3c6b0 con 0x55bed70abfb0 2024-09-07T03:32:37.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.758+0000 7f2ff7fff640 1 -- 172.21.15.120:0/2590801749 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285555061 0 0) 0x55bed6f55e40 con 0x55bed70aa490 2024-09-07T03:32:37.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.759+0000 7f3004d30640 1 --2- 172.21.15.120:0/2590801749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70abfb0 0x55bed70b4ad0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00a470 tx=0x7f2ffc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31def3d28137e8cd server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.759+0000 7f2ff7fff640 1 -- 172.21.15.120:0/2590801749 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc053570 con 0x55bed70abfb0 2024-09-07T03:32:37.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.759+0000 7f2ff7fff640 1 -- 172.21.15.120:0/2590801749 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc058070 con 0x55bed70abfb0 2024-09-07T03:32:37.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.759+0000 7f2ff7fff640 1 -- 172.21.15.120:0/2590801749 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ffc053880 con 0x55bed70abfb0 2024-09-07T03:32:37.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.760+0000 7f3007a40800 1 -- 172.21.15.120:0/2590801749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70abfb0 msgr2=0x55bed70b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.760+0000 7f3007a40800 1 --2- 172.21.15.120:0/2590801749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70abfb0 0x55bed70b4ad0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00a470 tx=0x7f2ffc045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:37.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.760+0000 7f3007a40800 1 -- 172.21.15.120:0/2590801749 shutdown_connections 2024-09-07T03:32:37.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.760+0000 7f3007a40800 1 --2- 172.21.15.120:0/2590801749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70abfb0 0x55bed70b4ad0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.760+0000 7f3007a40800 1 -- 172.21.15.120:0/2590801749 >> 172.21.15.120:0/2590801749 conn(0x55bed70a61c0 msgr2=0x55bed70a8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.760+0000 7f3007a40800 1 -- 172.21.15.120:0/2590801749 shutdown_connections 2024-09-07T03:32:37.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.760+0000 7f3007a40800 1 -- 172.21.15.120:0/2590801749 wait complete. 2024-09-07T03:32:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.774+0000 7f3007a40800 1 Processor -- start 2024-09-07T03:32:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.774+0000 7f3007a40800 1 -- start start 2024-09-07T03:32:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.774+0000 7f3007a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed719d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.774+0000 7f3007a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bed6f44dd0 con 0x55bed70aa490 2024-09-07T03:32:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.774+0000 7f3005531640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed719d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.774+0000 7f3005531640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed719d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42740/0 (socket says 172.21.15.120:42740) 2024-09-07T03:32:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.774+0000 7f3005531640 1 -- 172.21.15.120:0/3834095753 learned_addr learned my addr 172.21.15.120:0/3834095753 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.775+0000 7f3005531640 1 -- 172.21.15.120:0/3834095753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed6f5de10 con 0x55bed70aa490 2024-09-07T03:32:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.775+0000 7f3005531640 1 --2- 172.21.15.120:0/3834095753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed719d6c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8001ea0 tx=0x7f2ff800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26eebd30ebd36e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.775+0000 7f2ef3606640 1 -- 172.21.15.120:0/3834095753 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff8008070 con 0x55bed70aa490 2024-09-07T03:32:37.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.775+0000 7f2ef3606640 1 -- 172.21.15.120:0/3834095753 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff800d500 con 0x55bed70aa490 2024-09-07T03:32:37.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.775+0000 7f2ef3606640 1 -- 172.21.15.120:0/3834095753 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff800d880 con 0x55bed70aa490 2024-09-07T03:32:37.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 -- 172.21.15.120:0/3834095753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 msgr2=0x55bed719d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 --2- 172.21.15.120:0/3834095753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed719d6c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8001ea0 tx=0x7f2ff800b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 -- 172.21.15.120:0/3834095753 shutdown_connections 2024-09-07T03:32:37.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 --2- 172.21.15.120:0/3834095753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed719d6c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 -- 172.21.15.120:0/3834095753 >> 172.21.15.120:0/3834095753 conn(0x55bed70a61c0 msgr2=0x55bed7199040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 -- 172.21.15.120:0/3834095753 shutdown_connections 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 -- 172.21.15.120:0/3834095753 wait complete. 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 Processor -- start 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 -- start start 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed71a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3007a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bed70b52e0 con 0x55bed70aa490 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3005531640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed71a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3005531640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed71a4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42746/0 (socket says 172.21.15.120:42746) 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3005531640 1 -- 172.21.15.120:0/988948424 learned_addr learned my addr 172.21.15.120:0/988948424 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.776+0000 7f3005531640 1 -- 172.21.15.120:0/988948424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed71a5540 con 0x55bed70aa490 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.777+0000 7f3005531640 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed71a4fe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80012f0 tx=0x7f2ff8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.777+0000 7f2ef1e03640 1 -- 172.21.15.120:0/988948424 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff800f9d0 con 0x55bed70aa490 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.777+0000 7f2ef1e03640 1 -- 172.21.15.120:0/988948424 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff800fb70 con 0x55bed70aa490 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.777+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bed71a57d0 con 0x55bed70aa490 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.777+0000 7f2ef1e03640 1 -- 172.21.15.120:0/988948424 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff800fe50 con 0x55bed70aa490 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.777+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bed71a61d0 con 0x55bed70aa490 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.778+0000 7f2ef1e03640 1 -- 172.21.15.120:0/988948424 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2ff8017040 con 0x55bed70aa490 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.778+0000 7f2ef1e03640 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2eec03c920 0x7f2eec03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.778+0000 7f2ef1e03640 1 -- 172.21.15.120:0/988948424 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f2ff8015020 con 0x55bed70aa490 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.778+0000 7f3004d30640 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2eec03c920 0x7f2eec03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.778+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed70abfb0 0x55bed71ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.778+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71acb70 con 0x55bed70abfb0 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.778+0000 7f3005d32640 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed70abfb0 0x55bed71ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.778+0000 7f3004d30640 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2eec03c920 0x7f2eec03ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc057000 tx=0x7f2ffc052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.778+0000 7f3005d32640 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed70abfb0 0x55bed71ac630 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.779+0000 7f3005d32640 1 -- 172.21.15.120:0/988948424 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f300000a4d0 con 0x55bed70abfb0 2024-09-07T03:32:37.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.779+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71ad420 0x55bed71af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.779+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71b0050 con 0x55bed71ad420 2024-09-07T03:32:37.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.779+0000 7f3005531640 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71ad420 0x55bed71af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.779+0000 7f3005531640 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71ad420 0x55bed71af8e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.779+0000 7f3005531640 1 -- 172.21.15.120:0/988948424 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71ad420 2024-09-07T03:32:37.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.779+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71b1900 con 0x55bed71ad420 2024-09-07T03:32:37.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.780+0000 7f3005531640 1 -- 172.21.15.120:0/988948424 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71ad420 2024-09-07T03:32:37.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.780+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71b0a70 con 0x55bed71ad420 2024-09-07T03:32:37.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.780+0000 7f3005531640 1 -- 172.21.15.120:0/988948424 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71ad420 2024-09-07T03:32:37.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.780+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71b0e90 con 0x55bed70abfb0 2024-09-07T03:32:37.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.780+0000 7f3005d32640 1 -- 172.21.15.120:0/988948424 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f300000a4d0 con 0x55bed70abfb0 2024-09-07T03:32:37.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f3007a40800 1 Processor -- start 2024-09-07T03:32:37.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f3007a40800 1 -- start start 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f3007a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71bfdb0 0x55bed71c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f3007a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bed6fa2a00 con 0x55bed71bfdb0 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f3005d32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71bfdb0 0x55bed71c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f3005d32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71bfdb0 0x55bed71c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42752/0 (socket says 172.21.15.120:42752) 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f3005d32640 1 -- 172.21.15.120:0/2088032334 learned_addr learned my addr 172.21.15.120:0/2088032334 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f3005d32640 1 -- 172.21.15.120:0/2088032334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed71c0810 con 0x55bed71bfdb0 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f3005d32640 1 --2- 172.21.15.120:0/2088032334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71bfdb0 0x55bed71c01d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3000016d20 tx=0x7f300000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.781+0000 7f2eeaffd640 1 -- 172.21.15.120:0/2088032334 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3000017660 con 0x55bed71bfdb0 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.782+0000 7f3007a40800 1 -- 172.21.15.120:0/2088032334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bed71c1040 con 0x55bed71bfdb0 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.782+0000 7f2eeaffd640 1 -- 172.21.15.120:0/2088032334 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300001b030 con 0x55bed71bfdb0 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.782+0000 7f2eeaffd640 1 -- 172.21.15.120:0/2088032334 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3000017950 con 0x55bed71bfdb0 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.782+0000 7f3007a40800 1 -- 172.21.15.120:0/2088032334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bed71c15e0 con 0x55bed71bfdb0 2024-09-07T03:32:37.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.782+0000 7f2eeaffd640 1 -- 172.21.15.120:0/2088032334 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3000017b40 con 0x55bed71bfdb0 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f2eeaffd640 1 --2- 172.21.15.120:0/2088032334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2edc03c730 0x7f2edc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f2eeaffd640 1 -- 172.21.15.120:0/2088032334 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f300000e040 con 0x55bed71bfdb0 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f3005531640 1 --2- 172.21.15.120:0/2088032334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2edc03c730 0x7f2edc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f3007a40800 1 Processor -- start 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f3005531640 1 --2- 172.21.15.120:0/2088032334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2edc03c730 0x7f2edc03ebf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55bed71b0590 tx=0x7f2ff800ed70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f3007a40800 1 -- start start 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f3007a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f3007a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bed719df10 con 0x55bed71cc850 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f3005d32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f3005d32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42768/0 (socket says 172.21.15.120:42768) 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.783+0000 7f3005d32640 1 -- 172.21.15.120:0/755966231 learned_addr learned my addr 172.21.15.120:0/755966231 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f3005d32640 1 -- 172.21.15.120:0/755966231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed71cd240 con 0x55bed71cc850 2024-09-07T03:32:37.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f3005d32640 1 --2- 172.21.15.120:0/755966231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71ccc50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3000053e30 tx=0x7f3000013510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f889e05f65af8b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f2ee8ff9640 1 -- 172.21.15.120:0/755966231 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3000014a00 con 0x55bed71cc850 2024-09-07T03:32:37.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f2ee8ff9640 1 -- 172.21.15.120:0/755966231 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3000049030 con 0x55bed71cc850 2024-09-07T03:32:37.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f2ee8ff9640 1 -- 172.21.15.120:0/755966231 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3000028350 con 0x55bed71cc850 2024-09-07T03:32:37.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f3007a40800 1 -- 172.21.15.120:0/755966231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 msgr2=0x55bed71ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f3007a40800 1 --2- 172.21.15.120:0/755966231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71ccc50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3000053e30 tx=0x7f3000013510 comp rx=0 tx=0).stop 2024-09-07T03:32:37.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f3007a40800 1 -- 172.21.15.120:0/755966231 shutdown_connections 2024-09-07T03:32:37.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f3007a40800 1 --2- 172.21.15.120:0/755966231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71ccc50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f3007a40800 1 -- 172.21.15.120:0/755966231 >> 172.21.15.120:0/755966231 conn(0x55bed71c8c50 msgr2=0x55bed71c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f3007a40800 1 -- 172.21.15.120:0/755966231 shutdown_connections 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.784+0000 7f3007a40800 1 -- 172.21.15.120:0/755966231 wait complete. 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.785+0000 7f3007a40800 1 Processor -- start 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.785+0000 7f3007a40800 1 -- start start 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.785+0000 7f3007a40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.785+0000 7f3007a40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bed71cd860 con 0x55bed71cc850 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.785+0000 7f3005d32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.785+0000 7f3005d32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71d3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42772/0 (socket says 172.21.15.120:42772) 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.785+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 learned_addr learned my addr 172.21.15.120:0/1643454867 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.785+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed71d43e0 con 0x55bed71cc850 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.785+0000 7f3005d32640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71d3e80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3000012500 tx=0x7f300001ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.786+0000 7f2edaffd640 1 -- 172.21.15.120:0/1643454867 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3000028480 con 0x55bed71cc850 2024-09-07T03:32:37.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.786+0000 7f2edaffd640 1 -- 172.21.15.120:0/1643454867 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3000051030 con 0x55bed71cc850 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.786+0000 7f2edaffd640 1 -- 172.21.15.120:0/1643454867 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30000553d0 con 0x55bed71cc850 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.786+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bed71d4670 con 0x55bed71cc850 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.786+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bed71d4ff0 con 0x55bed71cc850 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.786+0000 7f2edaffd640 1 -- 172.21.15.120:0/1643454867 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3000055570 con 0x55bed71cc850 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.787+0000 7f2edaffd640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ed003c780 0x7f2ed003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.787+0000 7f2edaffd640 1 -- 172.21.15.120:0/1643454867 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f3000035ce0 con 0x55bed71cc850 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.787+0000 7f3005531640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ed003c780 0x7f2ed003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.787+0000 7f3005531640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ed003c780 0x7f2ed003ec40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8054380 tx=0x7f2ff803f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.787+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.787+0000 7f3007a40800 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed71df940 0x55bed71e1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.787+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71e2550 con 0x55bed71df940 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.787+0000 7f3004d30640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed71df940 0x55bed71e1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3004d30640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed71df940 0x55bed71e1e00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 20 realm 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71e2980 con 0x55bed71df940 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71e3250 con 0x55bed71df940 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71e3c70 0x55bed71e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71e6810 con 0x55bed71e3c70 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.788+0000 7f3005d32640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71e3c70 0x55bed71e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3005d32640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71e3c70 0x55bed71e60a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3007a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71e7060 con 0x55bed71e3c70 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3007a40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3007a40800 20 searching for the correct realm 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3007a40800 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bed71e8dd0 0x55bed71eb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e8dd0 2024-09-07T03:32:37.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.789+0000 7f3005531640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bed71e8dd0 0x55bed71eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.790+0000 7f3005531640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bed71e8dd0 0x55bed71eb240 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.790+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.790+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e3c70 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.790+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.790+0000 7f3005d32640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3000052d50 0x7f3000045980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.790+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x7f3000052d50 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.790+0000 7f3004d30640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3000052d50 0x7f3000045980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.791+0000 7f3004d30640 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3000052d50 0x7f3000045980 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.791+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.791+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.791+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.791+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.791+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.791+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e8dd0 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.792+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.792+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.792+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.792+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e3c70 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.792+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.792+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e3c70 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.792+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.792+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.793+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.793+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x7f3000052d50 2024-09-07T03:32:37.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.793+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.793+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.793+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.793+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x7f3000052d50 2024-09-07T03:32:37.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.793+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.793+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e3c70 2024-09-07T03:32:37.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.794+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.794+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e8dd0 2024-09-07T03:32:37.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.794+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.794+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.794+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.795+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e3c70 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.795+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.795+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e8dd0 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.795+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.795+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.795+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.795+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.795+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.795+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.796+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.796+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e8dd0 2024-09-07T03:32:37.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.796+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.796+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x7f3000052d50 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.796+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.796+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71df940 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.796+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.796+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x7f3000052d50 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.797+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.797+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e8dd0 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.797+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.797+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x7f3000052d50 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.797+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.797+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e3c70 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.798+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.798+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e3c70 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.798+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.798+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e8dd0 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.798+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.798+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e3c70 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.798+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.798+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bed71eb910 con 0x55bed71e3c70 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71e79e0 con 0x55bed71df940 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71e75c0 con 0x55bed71e3c70 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71e8350 con 0x55bed71df940 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 zone default found 2024-09-07T03:32:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 4 Realm: () 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 zonegroup default 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.799+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71ec240 con 0x7f3000052d50 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71ee480 con 0x55bed71e8dd0 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71ee820 con 0x55bed71e8dd0 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 20 started sync module instance, tier type = 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.800+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71ed8c0 con 0x55bed71e3c70 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.802+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.802+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94278141271488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71ed8c0 con 0x55bed71e3c70 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.802+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71ef1e0 con 0x55bed71df940 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.803+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.803+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94278141275440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71efa30 con 0x55bed71df940 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.803+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f04d0 con 0x55bed71e3c70 2024-09-07T03:32:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.803+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94278141271488] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.803+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94278141275440] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.805+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.805+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94278141280160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71ef580 con 0x55bed71e3c70 2024-09-07T03:32:37.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.805+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f0d70 con 0x7f3000052d50 2024-09-07T03:32:37.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.806+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94278141280160] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.809+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.809+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94278141269008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71ef580 con 0x7f3000052d50 2024-09-07T03:32:37.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.809+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f1430 con 0x55bed71e3c70 2024-09-07T03:32:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.812+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94278141269008] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.814+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.814+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94278141284112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f1430 con 0x55bed71e3c70 2024-09-07T03:32:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.815+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f1e40 con 0x55bed71e8dd0 2024-09-07T03:32:37.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.815+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.815+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94278141286800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f2690 con 0x55bed71e8dd0 2024-09-07T03:32:37.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.816+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f3160 con 0x55bed71e8dd0 2024-09-07T03:32:37.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.817+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94278141286800] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.819+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.819+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94278141291600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f3550 con 0x55bed71e8dd0 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.819+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f3fb0 con 0x7f3000052d50 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.820+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94278141284112] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.820+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.820+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94278141291600] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.820+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94278141282352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f3fb0 con 0x7f3000052d50 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.821+0000 7f3007a40800 20 add_watcher() i=0 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.821+0000 7f3007a40800 20 add_watcher() i=1 2024-09-07T03:32:37.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.821+0000 7f3007a40800 20 add_watcher() i=2 2024-09-07T03:32:37.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.821+0000 7f3007a40800 20 add_watcher() i=3 2024-09-07T03:32:37.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.821+0000 7f3007a40800 20 add_watcher() i=4 2024-09-07T03:32:37.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.821+0000 7f3007a40800 20 add_watcher() i=5 2024-09-07T03:32:37.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.821+0000 7f3007a40800 20 add_watcher() i=6 2024-09-07T03:32:37.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.821+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94278141282352] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.822+0000 7f3007a40800 20 add_watcher() i=7 2024-09-07T03:32:37.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.822+0000 7f3007a40800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:37.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.822+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f2270 con 0x55bed71df940 2024-09-07T03:32:37.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.822+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.822+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94278141295248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed71f4750 con 0x55bed71df940 2024-09-07T03:32:37.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.823+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94278141295248] v34'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.823+0000 7f2ebb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.823+0000 7f3007a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.823+0000 7f3007a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.823+0000 7f3007a40800 5 note: GC not initialized 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.823+0000 7f2eba7e4640 20 reqs_thread_entry: start 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.823+0000 7f3007a40800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.823+0000 7f3007a40800 20 Filter name: none 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.823+0000 7f2e2bfff640 20 reqs_thread_entry: start 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed7229f90 con 0x7f3000052d50 2024-09-07T03:32:37.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 20 rados_obj.operate() r=0 bl.length=380 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed722bf20 con 0x7f3000052d50 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 : miss 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.824+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed722d930 con 0x55bed71df940 2024-09-07T03:32:37.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.825+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.825+0000 7f3007a40800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:37.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.825+0000 7f3007a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:37.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.825+0000 7f3007a40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:37.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.825+0000 7f3007a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.825+0000 7f3007a40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:37.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.825+0000 7f3007a40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:37.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.825+0000 7f3007a40800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-07T03:32:37.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.825+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7231070 con 0x55bed71df940 2024-09-07T03:32:37.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 fud.buckets [call] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3007a40800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-07T03:32:37.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3007a40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed72300a0 con 0x7f3000052d50 2024-09-07T03:32:37.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3007a40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3007a40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3007a40800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3007a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.826+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7234bc0 con 0x7f3000052d50 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.827+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v34'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.827+0000 7f3007a40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.827+0000 7f3007a40800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.827+0000 7f3007a40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.827+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94278141543904 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bed7231ec0 con 0x55bed71e8dd0 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.828+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== watch-notify(notify (1) cookie 94278141291600 notify 146028888074 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f2ff805b040 con 0x55bed71e8dd0 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.828+0000 7f2ee8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94278141291600 notifier 4512 bl.length()=338 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.828+0000 7f2ee8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-07T03:32:37.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.828+0000 7f2ee8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.828+0000 7f2ee8ff9640 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2ec8003ea0 con 0x55bed71e8dd0 2024-09-07T03:32:37.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.828+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(68 notify.6 [notify cookie 94278141543904 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.828+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.828+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== watch-notify(notify_complete (2) cookie 94278141543904 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bed71a61d0 con 0x55bed71e8dd0 2024-09-07T03:32:37.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.829+0000 7f2ebb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.829+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94278141295248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7227df0 con 0x55bed71df940 2024-09-07T03:32:37.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.832+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94278141295248] v34'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.832+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94278141271488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7227df0 con 0x55bed71e3c70 2024-09-07T03:32:37.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.834+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94278141271488] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.834+0000 7f3007a40800 20 remove_watcher() i=0 2024-09-07T03:32:37.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.834+0000 7f3007a40800 2 removed watcher, disabling cache 2024-09-07T03:32:37.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.834+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94278141275440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7227df0 con 0x55bed71df940 2024-09-07T03:32:37.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.834+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94278141275440] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x55bed71df940 2024-09-07T03:32:37.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.834+0000 7f3007a40800 20 remove_watcher() i=1 2024-09-07T03:32:37.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.834+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94278141280160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7227df0 con 0x55bed71e3c70 2024-09-07T03:32:37.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.837+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94278141280160] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.837+0000 7f3007a40800 20 remove_watcher() i=2 2024-09-07T03:32:37.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.837+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94278141269008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7227df0 con 0x7f3000052d50 2024-09-07T03:32:37.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.840+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94278141269008] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.840+0000 7f3007a40800 20 remove_watcher() i=3 2024-09-07T03:32:37.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.840+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94278141284112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7227df0 con 0x55bed71e3c70 2024-09-07T03:32:37.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.843+0000 7f3005d32640 1 -- 172.21.15.120:0/1643454867 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94278141284112] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f300003a020 con 0x55bed71e3c70 2024-09-07T03:32:37.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.843+0000 7f3007a40800 20 remove_watcher() i=4 2024-09-07T03:32:37.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.843+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94278141286800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7227df0 con 0x55bed71e8dd0 2024-09-07T03:32:37.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.844+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94278141286800] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.844+0000 7f3007a40800 20 remove_watcher() i=5 2024-09-07T03:32:37.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.844+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94278141291600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7227df0 con 0x55bed71e8dd0 2024-09-07T03:32:37.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.845+0000 7f3005531640 1 -- 172.21.15.120:0/1643454867 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94278141291600] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff802d070 con 0x55bed71e8dd0 2024-09-07T03:32:37.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.845+0000 7f3007a40800 20 remove_watcher() i=6 2024-09-07T03:32:37.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.845+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94278141282352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bed7227df0 con 0x7f3000052d50 2024-09-07T03:32:37.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94278141282352] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ffc051070 con 0x7f3000052d50 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 20 remove_watcher() i=7 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71e3c70 msgr2=0x55bed71e60a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71e3c70 0x55bed71e60a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed71df940 msgr2=0x55bed71e1e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed71df940 0x55bed71e1e00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3000052d50 msgr2=0x7f3000045980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3000052d50 0x7f3000045980 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bed71e8dd0 msgr2=0x55bed71eb240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bed71e8dd0 0x55bed71eb240 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ed003c780 msgr2=0x7f2ed003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2ed003c780 0x7f2ed003ec40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8054380 tx=0x7f2ff803f000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 msgr2=0x55bed71d3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 --2- 172.21.15.120:0/1643454867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71cc850 0x55bed71d3e80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3000012500 tx=0x7f300001ff30 comp rx=0 tx=0).stop 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 reap_dead start 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3004d30640 1 -- 172.21.15.120:0/1643454867 reap_dead start 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 shutdown_connections 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 >> 172.21.15.120:0/1643454867 conn(0x55bed71c8c50 msgr2=0x55bed71c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 shutdown_connections 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.846+0000 7f3007a40800 1 -- 172.21.15.120:0/1643454867 wait complete. 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/2088032334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2edc03c730 msgr2=0x7f2edc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/2088032334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2edc03c730 0x7f2edc03ebf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55bed71b0590 tx=0x7f2ff800ed70 comp rx=0 tx=0).stop 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/2088032334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71bfdb0 msgr2=0x55bed71c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/2088032334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71bfdb0 0x55bed71c01d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3000016d20 tx=0x7f300000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/2088032334 shutdown_connections 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/2088032334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2edc03c730 0x7f2edc03ebf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/2088032334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed71bfdb0 0x55bed71c01d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/2088032334 >> 172.21.15.120:0/2088032334 conn(0x55bed71b4160 msgr2=0x55bed71b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/2088032334 shutdown_connections 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/2088032334 wait complete. 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71ad420 msgr2=0x55bed71af8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71ad420 0x55bed71af8e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed70abfb0 msgr2=0x55bed71ac630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed70abfb0 0x55bed71ac630 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2eec03c920 msgr2=0x7f2eec03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2eec03c920 0x7f2eec03ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc057000 tx=0x7f2ffc052000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 msgr2=0x55bed71a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed71a4fe0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80012f0 tx=0x7f2ff8000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 shutdown_connections 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bed71ad420 0x55bed71af8e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bed70abfb0 0x55bed71ac630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2eec03c920 0x7f2eec03ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 --2- 172.21.15.120:0/988948424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bed70aa490 0x55bed71a4fe0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 >> 172.21.15.120:0/988948424 conn(0x55bed70a61c0 msgr2=0x55bed719e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 shutdown_connections 2024-09-07T03:32:37.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.847+0000 7f3007a40800 1 -- 172.21.15.120:0/988948424 wait complete. 2024-09-07T03:32:37.858 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1'] 2024-09-07T03:32:37.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1'] 2024-09-07T03:32:37.858 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:37.908 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.906+0000 7f0f83e40800 1 Processor -- start 2024-09-07T03:32:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.906+0000 7f0f83e40800 1 -- start start 2024-09-07T03:32:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.906+0000 7f0f83e40800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558dec0826b0 0x558dec084aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.906+0000 7f0f83e40800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558debf2be40 con 0x558dec085040 2024-09-07T03:32:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.906+0000 7f0f83e40800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x558debef6680 con 0x558dec0826b0 2024-09-07T03:32:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.906+0000 7f0f8192a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558dec0826b0 0x558dec084aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.906+0000 7f0f8192a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558dec0826b0 0x558dec084aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42784/0 (socket says 172.21.15.120:42784) 2024-09-07T03:32:37.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.906+0000 7f0f8192a640 1 -- 172.21.15.120:0/3815710088 learned_addr learned my addr 172.21.15.120:0/3815710088 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.906+0000 7f0f81129640 1 --1- 172.21.15.120:0/3815710088 >> v1:172.21.15.104:6789/0 conn(0x558dec085040 0x558dec087500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48520/0 (socket says 172.21.15.120:48520) 2024-09-07T03:32:37.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.907+0000 7f0f8192a640 1 -- 172.21.15.120:0/3815710088 >> v1:172.21.15.104:6789/0 conn(0x558dec085040 legacy=0x558dec087500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.907+0000 7f0f8192a640 1 -- 172.21.15.120:0/3815710088 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558debf126b0 con 0x558dec0826b0 2024-09-07T03:32:37.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.907+0000 7f0f80928640 1 -- 172.21.15.120:0/3815710088 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594520026 0 0) 0x558debf2be40 con 0x558dec085040 2024-09-07T03:32:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.908+0000 7f0f8192a640 1 --2- 172.21.15.120:0/3815710088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec0826b0 0x558dec084aa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00a520 tx=0x7f0f6c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bb99d967f52dba server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.908+0000 7f0f80928640 1 -- 172.21.15.120:0/3815710088 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c055070 con 0x558dec0826b0 2024-09-07T03:32:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.909+0000 7f0f80928640 1 -- 172.21.15.120:0/3815710088 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c0515b0 con 0x558dec0826b0 2024-09-07T03:32:37.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.909+0000 7f0f80928640 1 -- 172.21.15.120:0/3815710088 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c0518d0 con 0x558dec0826b0 2024-09-07T03:32:37.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.909+0000 7f0f83e40800 1 -- 172.21.15.120:0/3815710088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec0826b0 msgr2=0x558dec084aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.909+0000 7f0f83e40800 1 --2- 172.21.15.120:0/3815710088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec0826b0 0x558dec084aa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00a520 tx=0x7f0f6c045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.909+0000 7f0f83e40800 1 -- 172.21.15.120:0/3815710088 shutdown_connections 2024-09-07T03:32:37.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.909+0000 7f0f83e40800 1 --2- 172.21.15.120:0/3815710088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec0826b0 0x558dec084aa0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.909+0000 7f0f83e40800 1 -- 172.21.15.120:0/3815710088 >> 172.21.15.120:0/3815710088 conn(0x558dec07c210 msgr2=0x558dec07e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.909+0000 7f0f83e40800 1 -- 172.21.15.120:0/3815710088 shutdown_connections 2024-09-07T03:32:37.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.909+0000 7f0f83e40800 1 -- 172.21.15.120:0/3815710088 wait complete. 2024-09-07T03:32:37.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.923+0000 7f0f83e40800 1 Processor -- start 2024-09-07T03:32:37.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.923+0000 7f0f83e40800 1 -- start start 2024-09-07T03:32:37.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.923+0000 7f0f83e40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec1716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.923+0000 7f0f83e40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558debf1add0 con 0x558dec085040 2024-09-07T03:32:37.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.923+0000 7f0f8192a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec1716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.923+0000 7f0f8192a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec1716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42798/0 (socket says 172.21.15.120:42798) 2024-09-07T03:32:37.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.923+0000 7f0f8192a640 1 -- 172.21.15.120:0/2273179973 learned_addr learned my addr 172.21.15.120:0/2273179973 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.923+0000 7f0f8192a640 1 -- 172.21.15.120:0/2273179973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558debf33e10 con 0x558dec085040 2024-09-07T03:32:37.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.924+0000 7f0f8192a640 1 --2- 172.21.15.120:0/2273179973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec1716a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c046050 tx=0x7f0f6c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f2e539ad86c036 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.924+0000 7f0e6fe07640 1 -- 172.21.15.120:0/2273179973 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c051890 con 0x558dec085040 2024-09-07T03:32:37.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.924+0000 7f0e6fe07640 1 -- 172.21.15.120:0/2273179973 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c051a30 con 0x558dec085040 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.924+0000 7f0e6fe07640 1 -- 172.21.15.120:0/2273179973 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c051d10 con 0x558dec085040 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.924+0000 7f0f83e40800 1 -- 172.21.15.120:0/2273179973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 msgr2=0x558dec1716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.924+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2273179973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec1716a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c046050 tx=0x7f0f6c051000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.924+0000 7f0f83e40800 1 -- 172.21.15.120:0/2273179973 shutdown_connections 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.924+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2273179973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec1716a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.924+0000 7f0f83e40800 1 -- 172.21.15.120:0/2273179973 >> 172.21.15.120:0/2273179973 conn(0x558dec07c210 msgr2=0x558dec16cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f83e40800 1 -- 172.21.15.120:0/2273179973 shutdown_connections 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f83e40800 1 -- 172.21.15.120:0/2273179973 wait complete. 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f83e40800 1 Processor -- start 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f83e40800 1 -- start start 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f83e40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec081db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f83e40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558dec089060 con 0x558dec085040 2024-09-07T03:32:37.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f8192a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec081db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f8192a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec081db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42802/0 (socket says 172.21.15.120:42802) 2024-09-07T03:32:37.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f8192a640 1 -- 172.21.15.120:0/1345417320 learned_addr learned my addr 172.21.15.120:0/1345417320 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.925+0000 7f0f8192a640 1 -- 172.21.15.120:0/1345417320 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dec082310 con 0x558dec085040 2024-09-07T03:32:37.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.926+0000 7f0f8192a640 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec081db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c025da0 tx=0x7f0f6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.926+0000 7f0e6e604640 1 -- 172.21.15.120:0/1345417320 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c05a640 con 0x558dec085040 2024-09-07T03:32:37.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.926+0000 7f0e6e604640 1 -- 172.21.15.120:0/1345417320 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c073070 con 0x558dec085040 2024-09-07T03:32:37.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.926+0000 7f0e6e604640 1 -- 172.21.15.120:0/1345417320 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c05a950 con 0x558dec085040 2024-09-07T03:32:37.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.926+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dec0806c0 con 0x558dec085040 2024-09-07T03:32:37.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.926+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dec080ce0 con 0x558dec085040 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.927+0000 7f0e6e604640 1 -- 172.21.15.120:0/1345417320 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0f6c058070 con 0x558dec085040 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.927+0000 7f0e6e604640 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e6803c780 0x7f0e6803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.927+0000 7f0e6e604640 1 -- 172.21.15.120:0/1345417320 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f0f6c06b040 con 0x558dec085040 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.927+0000 7f0f81129640 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e6803c780 0x7f0e6803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.927+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec180370 0x558dec182760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.927+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec182ce0 con 0x558dec180370 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.927+0000 7f0f8212b640 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec180370 0x558dec182760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.927+0000 7f0f81129640 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e6803c780 0x7f0e6803ec40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f74000c00 tx=0x7f0f740013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.927+0000 7f0f8212b640 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec180370 0x558dec182760 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.928+0000 7f0f8212b640 1 -- 172.21.15.120:0/1345417320 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f7c00a4d0 con 0x558dec180370 2024-09-07T03:32:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.928+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec183ab0 0x558dec185ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.928+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1864d0 con 0x558dec183ab0 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.928+0000 7f0f8192a640 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec183ab0 0x558dec185ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.928+0000 7f0f8192a640 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec183ab0 0x558dec185ea0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.929+0000 7f0f8192a640 1 -- 172.21.15.120:0/1345417320 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f6c057030 con 0x558dec183ab0 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.929+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec187d80 con 0x558dec183ab0 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.929+0000 7f0f8192a640 1 -- 172.21.15.120:0/1345417320 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f6c057030 con 0x558dec183ab0 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.929+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec186ef0 con 0x558dec183ab0 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.929+0000 7f0f8192a640 1 -- 172.21.15.120:0/1345417320 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f6c057030 con 0x558dec183ab0 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.929+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec187310 con 0x558dec180370 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.930+0000 7f0f8212b640 1 -- 172.21.15.120:0/1345417320 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f7c00a4d0 con 0x558dec180370 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.930+0000 7f0f83e40800 1 Processor -- start 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.930+0000 7f0f83e40800 1 -- start start 2024-09-07T03:32:37.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.930+0000 7f0f83e40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec196240 0x558dec196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.930+0000 7f0f83e40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558debf78a00 con 0x558dec196240 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.930+0000 7f0f8212b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec196240 0x558dec196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.930+0000 7f0f8212b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec196240 0x558dec196660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42816/0 (socket says 172.21.15.120:42816) 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.930+0000 7f0f8212b640 1 -- 172.21.15.120:0/20025071 learned_addr learned my addr 172.21.15.120:0/20025071 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.931+0000 7f0f8212b640 1 -- 172.21.15.120:0/20025071 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dec196ca0 con 0x558dec196240 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.931+0000 7f0f8212b640 1 --2- 172.21.15.120:0/20025071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec196240 0x558dec196660 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c016d20 tx=0x7f0f7c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.931+0000 7f0e677fe640 1 -- 172.21.15.120:0/20025071 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f7c017660 con 0x558dec196240 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.931+0000 7f0e677fe640 1 -- 172.21.15.120:0/20025071 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c01b030 con 0x558dec196240 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.931+0000 7f0f83e40800 1 -- 172.21.15.120:0/20025071 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dec1974d0 con 0x558dec196240 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.931+0000 7f0e677fe640 1 -- 172.21.15.120:0/20025071 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f7c017950 con 0x558dec196240 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.931+0000 7f0f83e40800 1 -- 172.21.15.120:0/20025071 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dec197a70 con 0x558dec196240 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.932+0000 7f0e677fe640 1 -- 172.21.15.120:0/20025071 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0f7c017af0 con 0x558dec196240 2024-09-07T03:32:37.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.932+0000 7f0e677fe640 1 --2- 172.21.15.120:0/20025071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e5c03c780 0x7f0e5c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.932+0000 7f0e677fe640 1 -- 172.21.15.120:0/20025071 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f0f7c00e040 con 0x558dec196240 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.932+0000 7f0f8192a640 1 --2- 172.21.15.120:0/20025071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e5c03c780 0x7f0e5c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.932+0000 7f0f83e40800 1 Processor -- start 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.932+0000 7f0f83e40800 1 -- start start 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.932+0000 7f0f8192a640 1 --2- 172.21.15.120:0/20025071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e5c03c780 0x7f0e5c03ec40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x558dec183270 tx=0x7f0f6c084040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.932+0000 7f0f83e40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1a3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.932+0000 7f0f83e40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558dec171e30 con 0x558dec1a2d40 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0f8212b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1a3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0f8212b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1a3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42820/0 (socket says 172.21.15.120:42820) 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0f8212b640 1 -- 172.21.15.120:0/3155358057 learned_addr learned my addr 172.21.15.120:0/3155358057 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0f8212b640 1 -- 172.21.15.120:0/3155358057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dec1a3730 con 0x558dec1a2d40 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0f8212b640 1 --2- 172.21.15.120:0/3155358057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1a3140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00dd50 tx=0x7f0f7c013450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e24da4032568921 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0e657fa640 1 -- 172.21.15.120:0/3155358057 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f7c051070 con 0x558dec1a2d40 2024-09-07T03:32:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0e657fa640 1 -- 172.21.15.120:0/3155358057 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c014e00 con 0x558dec1a2d40 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0e657fa640 1 -- 172.21.15.120:0/3155358057 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f7c014ae0 con 0x558dec1a2d40 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0f83e40800 1 -- 172.21.15.120:0/3155358057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 msgr2=0x558dec1a3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.933+0000 7f0f83e40800 1 --2- 172.21.15.120:0/3155358057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1a3140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00dd50 tx=0x7f0f7c013450 comp rx=0 tx=0).stop 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f83e40800 1 -- 172.21.15.120:0/3155358057 shutdown_connections 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f83e40800 1 --2- 172.21.15.120:0/3155358057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1a3140 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f83e40800 1 -- 172.21.15.120:0/3155358057 >> 172.21.15.120:0/3155358057 conn(0x558dec19f140 msgr2=0x558dec19d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f83e40800 1 -- 172.21.15.120:0/3155358057 shutdown_connections 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f83e40800 1 -- 172.21.15.120:0/3155358057 wait complete. 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f83e40800 1 Processor -- start 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f83e40800 1 -- start start 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f83e40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f83e40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558dec1a3d50 con 0x558dec1a2d40 2024-09-07T03:32:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f8212b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f8212b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1aa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42834/0 (socket says 172.21.15.120:42834) 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.934+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 learned_addr learned my addr 172.21.15.120:0/2219130266 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.935+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dec1aa850 con 0x558dec1a2d40 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.935+0000 7f0f8212b640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1aa2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c012730 tx=0x7f0f7c053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.935+0000 7f0e537fe640 1 -- 172.21.15.120:0/2219130266 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f7c012e50 con 0x558dec1a2d40 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.935+0000 7f0e537fe640 1 -- 172.21.15.120:0/2219130266 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c02e030 con 0x558dec1a2d40 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.935+0000 7f0e537fe640 1 -- 172.21.15.120:0/2219130266 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f7c0136f0 con 0x558dec1a2d40 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.935+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dec1aaae0 con 0x558dec1a2d40 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.935+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dec1ab460 con 0x558dec1a2d40 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.935+0000 7f0e537fe640 1 -- 172.21.15.120:0/2219130266 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0f7c04d050 con 0x558dec1a2d40 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.936+0000 7f0e537fe640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e4c03c920 0x7f0e4c03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.936+0000 7f0e537fe640 1 -- 172.21.15.120:0/2219130266 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f0f7c03f4f0 con 0x558dec1a2d40 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.936+0000 7f0f8192a640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e4c03c920 0x7f0e4c03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.936+0000 7f0f8192a640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e4c03c920 0x7f0e4c03ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c065fd0 tx=0x7f0f6c08d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.936+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.936+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec1b5c60 0x558dec1b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.936+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1b8870 con 0x558dec1b5c60 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f81129640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec1b5c60 0x558dec1b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f81129640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec1b5c60 0x558dec1b8120 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 20 realm 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1b4fb0 con 0x558dec1b5c60 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1b9360 con 0x558dec1b5c60 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.937+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec1ba140 0x558dec1bc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.938+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1bcc00 con 0x558dec1ba140 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.938+0000 7f0f8212b640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec1ba140 0x558dec1bc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.938+0000 7f0f8212b640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec1ba140 0x558dec1bc530 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.938+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.938+0000 7f0f83e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.938+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.938+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1bd450 con 0x558dec1ba140 2024-09-07T03:32:37.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f83e40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f83e40800 20 searching for the correct realm 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558dec1bf1c0 0x558dec1c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1bf1c0 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f8192a640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558dec1bf1c0 0x558dec1c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f8192a640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558dec1bf1c0 0x558dec1c15f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1ba140 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.939+0000 7f0f8212b640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0f7c014440 0x7f0f7c021030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.940+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x7f0f7c014440 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.940+0000 7f0f81129640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0f7c014440 0x7f0f7c021030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:37.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.940+0000 7f0f81129640 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0f7c014440 0x7f0f7c021030 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.940+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x7f0f7c014440 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.940+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.940+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.940+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.941+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.941+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1bf1c0 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.941+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.941+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.941+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.941+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1ba140 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.941+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.941+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1ba140 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x7f0f7c014440 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x7f0f7c014440 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x7f0f7c014440 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0f7400f5f0 con 0x7f0f7c014440 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.942+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1ba140 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.943+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.943+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1bf1c0 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.943+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.943+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.943+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.943+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1ba140 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.943+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.943+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1bf1c0 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.944+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.944+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.944+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.944+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.944+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.944+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.944+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.944+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1bf1c0 2024-09-07T03:32:37.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x7f0f7c014440 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x7f0f7c014440 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1b5c60 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x558dec1b5c60 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x7f0f7c014440 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x7f0f7c014440 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1bf1c0 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.945+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x7f0f7c014440 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.946+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7400f5f0 con 0x7f0f7c014440 2024-09-07T03:32:37.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.946+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1ba140 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.946+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.946+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1ba140 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.946+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.946+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1bf1c0 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.946+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.946+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1ba140 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c1cc0 con 0x558dec1ba140 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:37.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1bddd0 con 0x558dec1b5c60 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1bda10 con 0x558dec1ba140 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.947+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1be210 con 0x558dec1b5c60 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 20 zone default found 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 4 Realm: () 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 20 zonegroup default 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c25f0 con 0x7f0f7c014440 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x7f0f7c014440 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c4830 con 0x558dec1bf1c0 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c4bd0 con 0x558dec1bf1c0 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.948+0000 7f0f83e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.949+0000 7f0f83e40800 20 started sync module instance, tier type = 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.949+0000 7f0f83e40800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.949+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c3c70 con 0x558dec1ba140 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.950+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.950+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94068040024160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c4480 con 0x558dec1ba140 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.950+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c5a40 con 0x558dec1b5c60 2024-09-07T03:32:37.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.951+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94068040024160] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.951+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.951+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94068040028016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c6290 con 0x558dec1b5c60 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.951+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c6b60 con 0x558dec1ba140 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.954+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94068040028016] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.954+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.954+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94068040031712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c66b0 con 0x558dec1ba140 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.954+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c7630 con 0x7f0f7c014440 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.959+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94068040031712] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.959+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x7f0f7c014440 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.959+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94068040036640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c66b0 con 0x7f0f7c014440 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.960+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c80b0 con 0x558dec1ba140 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.960+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94068040036640] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x7f0f7c014440 2024-09-07T03:32:37.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.961+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.961+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94068040032768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c8070 con 0x558dec1ba140 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.961+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c8ac0 con 0x558dec1bf1c0 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.962+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.962+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94068040041904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c9360 con 0x558dec1bf1c0 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.962+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c9e00 con 0x558dec1bf1c0 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.962+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94068040032768] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.963+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94068040041904] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.963+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.963+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94068040046800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c8eb0 con 0x558dec1bf1c0 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.963+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1ca6a0 con 0x7f0f7c014440 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94068040046800] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x7f0f7c014440 2024-09-07T03:32:37.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94068040039360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1c8eb0 con 0x7f0f7c014440 2024-09-07T03:32:37.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f83e40800 20 add_watcher() i=0 2024-09-07T03:32:37.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f83e40800 20 add_watcher() i=1 2024-09-07T03:32:37.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f83e40800 20 add_watcher() i=2 2024-09-07T03:32:37.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f83e40800 20 add_watcher() i=3 2024-09-07T03:32:37.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f83e40800 20 add_watcher() i=4 2024-09-07T03:32:37.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f83e40800 20 add_watcher() i=5 2024-09-07T03:32:37.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.964+0000 7f0f83e40800 20 add_watcher() i=6 2024-09-07T03:32:37.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.965+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94068040039360] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x7f0f7c014440 2024-09-07T03:32:37.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.965+0000 7f0f83e40800 20 add_watcher() i=7 2024-09-07T03:32:37.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.965+0000 7f0f83e40800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:37.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.965+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec1cd810 con 0x558dec1b5c60 2024-09-07T03:32:37.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.965+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.966+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94068040049136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1cad30 con 0x558dec1b5c60 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94068040049136] v34'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0e2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0f83e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0f83e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0f83e40800 5 note: GC not initialized 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0e2a7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0f83e40800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0f83e40800 20 Filter name: none 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0da3fff640 20 reqs_thread_entry: start 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0f83e40800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.967+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec2008f0 con 0x558dec1b5c60 2024-09-07T03:32:37.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec202880 con 0x7f0f7c014440 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0f7403c040 con 0x7f0f7c014440 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 : miss 2024-09-07T03:32:37.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.968+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec204100 con 0x558dec1b5c60 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.969+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(64 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.969+0000 7f0f83e40800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.969+0000 7f0f83e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.969+0000 7f0f83e40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.969+0000 7f0f83e40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.969+0000 7f0f83e40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.969+0000 7f0f83e40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.969+0000 7f0f83e40800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.969+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec208840 con 0x558dec1b5c60 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.970+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 fud.buckets [call] v34'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.970+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec20e610 con 0x558dec1b5c60 2024-09-07T03:32:37.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(66 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v34'5 uv5 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f0f7403c040 con 0x558dec1b5c60 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0f83e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0f83e40800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0f83e40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0f83e40800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1, ofs0, ns] 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94068040288192 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec208c70 con 0x7f0f7c014440 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== watch-notify(notify (1) cookie 94068040036640 notify 146028888074 ret 0) ==== 802+0+0 (crc 0 0 0) 0x558dec2044f0 con 0x7f0f7c014440 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0e657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94068040036640 notifier 4519 bl.length()=760 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0e657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0e657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0e657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0e657fa640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0e44003ea0 con 0x7f0f7c014440 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(67 notify.3 [notify cookie 94068040288192 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f74047040 con 0x7f0f7c014440 2024-09-07T03:32:37.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.971+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74047040 con 0x7f0f7c014440 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.972+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== watch-notify(notify_complete (2) cookie 94068040288192 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558dec203620 con 0x7f0f7c014440 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.972+0000 7f0f83e40800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_sources= new_sources= 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.972+0000 7f0f83e40800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential sources added=[] removed=[] 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.972+0000 7f0f83e40800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_dests= new_dests= 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.972+0000 7f0f83e40800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential dests added=[] removed=[] 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.972+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec20cf60 con 0x7f0f7c014440 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.973+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(69 foo.buckets [call] v34'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0f74047040 con 0x7f0f7c014440 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.973+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec2047a0 con 0x7f0f7c014440 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v34'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f0f74047040 con 0x7f0f7c014440 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0f83e40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0f83e40800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0f83e40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94068040288160 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558dec20d410 con 0x558dec1bf1c0 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== watch-notify(notify (1) cookie 94068040046800 notify 146028888075 ret 0) ==== 356+0+0 (crc 0 0 0) 0x558dec080ce0 con 0x558dec1bf1c0 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0e64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888075 cookie 94068040046800 notifier 4519 bl.length()=314 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0e64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0e64ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0e64ff9640 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0dac003400 con 0x558dec1bf1c0 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(71 notify.6 [notify cookie 94068040288160 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.974+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.975+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== watch-notify(notify_complete (2) cookie 94068040288160 notify 146028888075 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558dec0806c0 con 0x558dec1bf1c0 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.975+0000 7f0e2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.975+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94068040049136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1fe790 con 0x558dec1b5c60 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.977+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94068040049136] v34'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f74047040 con 0x558dec1b5c60 2024-09-07T03:32:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.977+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94068040024160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1fe790 con 0x558dec1ba140 2024-09-07T03:32:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.978+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94068040024160] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.978+0000 7f0f83e40800 20 remove_watcher() i=0 2024-09-07T03:32:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.978+0000 7f0f83e40800 2 removed watcher, disabling cache 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.978+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94068040028016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1fe790 con 0x558dec1b5c60 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.979+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94068040028016] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74047040 con 0x558dec1b5c60 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.979+0000 7f0f83e40800 20 remove_watcher() i=1 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.979+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94068040031712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1fe790 con 0x558dec1ba140 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.980+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94068040031712] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.980+0000 7f0f83e40800 20 remove_watcher() i=2 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.980+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94068040036640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1fe790 con 0x7f0f7c014440 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.981+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94068040036640] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74047040 con 0x7f0f7c014440 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.981+0000 7f0f83e40800 20 remove_watcher() i=3 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.981+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94068040032768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1fe790 con 0x558dec1ba140 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.982+0000 7f0f8212b640 1 -- 172.21.15.120:0/2219130266 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94068040032768] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f7c03a070 con 0x558dec1ba140 2024-09-07T03:32:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.982+0000 7f0f83e40800 20 remove_watcher() i=4 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.982+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94068040041904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1fe790 con 0x558dec1bf1c0 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.983+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94068040041904] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.983+0000 7f0f83e40800 20 remove_watcher() i=5 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.983+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94068040046800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1fe790 con 0x558dec1bf1c0 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.984+0000 7f0f8192a640 1 -- 172.21.15.120:0/2219130266 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94068040046800] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c0a0030 con 0x558dec1bf1c0 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.984+0000 7f0f83e40800 20 remove_watcher() i=6 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.984+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94068040039360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558dec1fe790 con 0x7f0f7c014440 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94068040039360] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74047040 con 0x7f0f7c014440 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 20 remove_watcher() i=7 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec1ba140 msgr2=0x558dec1bc530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec1ba140 0x558dec1bc530 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec1b5c60 msgr2=0x558dec1b8120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec1b5c60 0x558dec1b8120 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0f7c014440 msgr2=0x7f0f7c021030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0f7c014440 0x7f0f7c021030 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558dec1bf1c0 msgr2=0x558dec1c15f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558dec1bf1c0 0x558dec1c15f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e4c03c920 msgr2=0x7f0e4c03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e4c03c920 0x7f0e4c03ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c065fd0 tx=0x7f0f6c08d000 comp rx=0 tx=0).stop 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 msgr2=0x558dec1aa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f81129640 1 -- 172.21.15.120:0/2219130266 reap_dead start 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1aa2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c012730 tx=0x7f0f7c053d50 comp rx=0 tx=0).stop 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 shutdown_connections 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 --2- 172.21.15.120:0/2219130266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec1a2d40 0x558dec1aa2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 >> 172.21.15.120:0/2219130266 conn(0x558dec19f140 msgr2=0x558dec19d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 shutdown_connections 2024-09-07T03:32:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.985+0000 7f0f83e40800 1 -- 172.21.15.120:0/2219130266 wait complete. 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/20025071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e5c03c780 msgr2=0x7f0e5c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/20025071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e5c03c780 0x7f0e5c03ec40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x558dec183270 tx=0x7f0f6c084040 comp rx=0 tx=0).stop 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/20025071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec196240 msgr2=0x558dec196660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/20025071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec196240 0x558dec196660 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c016d20 tx=0x7f0f7c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/20025071 shutdown_connections 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/20025071 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e5c03c780 0x7f0e5c03ec40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/20025071 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec196240 0x558dec196660 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/20025071 >> 172.21.15.120:0/20025071 conn(0x558dec18a5f0 msgr2=0x558dec18a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/20025071 shutdown_connections 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/20025071 wait complete. 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec183ab0 msgr2=0x558dec185ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec183ab0 0x558dec185ea0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec180370 msgr2=0x558dec182760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec180370 0x558dec182760 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e6803c780 msgr2=0x7f0e6803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e6803c780 0x7f0e6803ec40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f74000c00 tx=0x7f0f740013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 msgr2=0x558dec081db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec081db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c025da0 tx=0x7f0f6c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 shutdown_connections 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558dec183ab0 0x558dec185ea0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558dec180370 0x558dec182760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0e6803c780 0x7f0e6803ec40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 --2- 172.21.15.120:0/1345417320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558dec085040 0x558dec081db0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 >> 172.21.15.120:0/1345417320 conn(0x558dec07c210 msgr2=0x558dec16b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 shutdown_connections 2024-09-07T03:32:37.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:37.986+0000 7f0f83e40800 1 -- 172.21.15.120:0/1345417320 wait complete. 2024-09-07T03:32:37.997 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-07T03:32:37.997 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-07T03:32:37.997 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-07T03:32:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:38.041 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.040+0000 7efc3b323800 1 Processor -- start 2024-09-07T03:32:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.040+0000 7efc3b323800 1 -- start start 2024-09-07T03:32:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.040+0000 7efc3b323800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a0464bdf80 0x55a0464c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.040+0000 7efc3b323800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a046367e40 con 0x55a0464bc460 2024-09-07T03:32:38.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.040+0000 7efc3b323800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a046332680 con 0x55a0464bdf80 2024-09-07T03:32:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.040+0000 7efc36812640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a0464bdf80 0x55a0464c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.040+0000 7efc37013640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55a0464bc460 0x55a0464bc860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48530/0 (socket says 172.21.15.120:48530) 2024-09-07T03:32:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.040+0000 7efc37013640 1 -- 172.21.15.120:0/2713108301 learned_addr learned my addr 172.21.15.120:0/2713108301 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.041+0000 7efc36812640 1 -- 172.21.15.120:0/2713108301 >> v1:172.21.15.104:6789/0 conn(0x55a0464bc460 legacy=0x55a0464bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.041+0000 7efc36011640 1 -- 172.21.15.120:0/2713108301 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671872691 0 0) 0x55a046367e40 con 0x55a0464bc460 2024-09-07T03:32:38.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.041+0000 7efc36812640 1 -- 172.21.15.120:0/2713108301 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04634e6b0 con 0x55a0464bdf80 2024-09-07T03:32:38.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.042+0000 7efc36812640 1 --2- 172.21.15.120:0/2713108301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bdf80 0x55a0464c6aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00a470 tx=0x7efc2c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ee08e3c35d0232 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.042+0000 7efc36011640 1 -- 172.21.15.120:0/2713108301 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc2c053570 con 0x55a0464bdf80 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.043+0000 7efc36011640 1 -- 172.21.15.120:0/2713108301 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c058070 con 0x55a0464bdf80 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.043+0000 7efc36011640 1 -- 172.21.15.120:0/2713108301 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc2c053880 con 0x55a0464bdf80 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.043+0000 7efc3b323800 1 -- 172.21.15.120:0/2713108301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bdf80 msgr2=0x55a0464c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.043+0000 7efc3b323800 1 --2- 172.21.15.120:0/2713108301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bdf80 0x55a0464c6aa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00a470 tx=0x7efc2c045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.043+0000 7efc3b323800 1 -- 172.21.15.120:0/2713108301 shutdown_connections 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.043+0000 7efc3b323800 1 --2- 172.21.15.120:0/2713108301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bdf80 0x55a0464c6aa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.043+0000 7efc3b323800 1 -- 172.21.15.120:0/2713108301 >> 172.21.15.120:0/2713108301 conn(0x55a0464b81b0 msgr2=0x55a0464ba610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.043+0000 7efc3b323800 1 -- 172.21.15.120:0/2713108301 shutdown_connections 2024-09-07T03:32:38.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.043+0000 7efc3b323800 1 -- 172.21.15.120:0/2713108301 wait complete. 2024-09-07T03:32:38.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.057+0000 7efc3b323800 1 Processor -- start 2024-09-07T03:32:38.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.057+0000 7efc3b323800 1 -- start start 2024-09-07T03:32:38.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.057+0000 7efc3b323800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.057+0000 7efc3b323800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a046356dd0 con 0x55a0464bc460 2024-09-07T03:32:38.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.057+0000 7efc37013640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.057+0000 7efc37013640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42860/0 (socket says 172.21.15.120:42860) 2024-09-07T03:32:38.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.057+0000 7efc37013640 1 -- 172.21.15.120:0/845018200 learned_addr learned my addr 172.21.15.120:0/845018200 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.058+0000 7efc37013640 1 -- 172.21.15.120:0/845018200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04636fe10 con 0x55a0464bc460 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.058+0000 7efc37013640 1 --2- 172.21.15.120:0/845018200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465af670 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc28001ea0 tx=0x7efc2800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575b9bffa150368f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.058+0000 7efb2560a640 1 -- 172.21.15.120:0/845018200 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc28008070 con 0x55a0464bc460 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.058+0000 7efb2560a640 1 -- 172.21.15.120:0/845018200 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2800d500 con 0x55a0464bc460 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.058+0000 7efb2560a640 1 -- 172.21.15.120:0/845018200 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc2800d880 con 0x55a0464bc460 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 -- 172.21.15.120:0/845018200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 msgr2=0x55a0465af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 --2- 172.21.15.120:0/845018200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465af670 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc28001ea0 tx=0x7efc2800b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 -- 172.21.15.120:0/845018200 shutdown_connections 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 --2- 172.21.15.120:0/845018200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465af670 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 -- 172.21.15.120:0/845018200 >> 172.21.15.120:0/845018200 conn(0x55a0464b81b0 msgr2=0x55a0465aaff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 -- 172.21.15.120:0/845018200 shutdown_connections 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 -- 172.21.15.120:0/845018200 wait complete. 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 Processor -- start 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 -- start start 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.059+0000 7efc3b323800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a0464c72e0 con 0x55a0464bc460 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efc37013640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efc37013640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42864/0 (socket says 172.21.15.120:42864) 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efc37013640 1 -- 172.21.15.120:0/3260444053 learned_addr learned my addr 172.21.15.120:0/3260444053 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efc37013640 1 -- 172.21.15.120:0/3260444053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0465b74e0 con 0x55a0464bc460 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efc37013640 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465b6f80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc28000f60 tx=0x7efc28000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efb23e07640 1 -- 172.21.15.120:0/3260444053 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc2800f8d0 con 0x55a0464bc460 2024-09-07T03:32:38.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efb23e07640 1 -- 172.21.15.120:0/3260444053 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2800fa70 con 0x55a0464bc460 2024-09-07T03:32:38.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0465b7770 con 0x55a0464bc460 2024-09-07T03:32:38.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efb23e07640 1 -- 172.21.15.120:0/3260444053 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc2800fd50 con 0x55a0464bc460 2024-09-07T03:32:38.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.060+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0465b8170 con 0x55a0464bc460 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.061+0000 7efb23e07640 1 -- 172.21.15.120:0/3260444053 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efc28017040 con 0x55a0464bc460 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.061+0000 7efb23e07640 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1c03c7d0 0x7efb1c03ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.061+0000 7efb23e07640 1 -- 172.21.15.120:0/3260444053 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7efc28015020 con 0x55a0464bc460 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.061+0000 7efc36812640 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1c03c7d0 0x7efb1c03ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.061+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0464bdf80 0x55a0465be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.061+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465beb10 con 0x55a0464bdf80 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.062+0000 7efc37814640 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0464bdf80 0x55a0465be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.062+0000 7efc36812640 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1c03c7d0 0x7efb1c03ec90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efc2c057000 tx=0x7efc2c052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.062+0000 7efc37814640 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0464bdf80 0x55a0465be5d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.062+0000 7efc37814640 1 -- 172.21.15.120:0/3260444053 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc3000a4d0 con 0x55a0464bdf80 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.062+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465bf3c0 0x55a0465c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.062+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465c1fc0 con 0x55a0465bf3c0 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.062+0000 7efc37013640 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465bf3c0 0x55a0465c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.063+0000 7efc37013640 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465bf3c0 0x55a0465c1850 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.063+0000 7efc37013640 1 -- 172.21.15.120:0/3260444053 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465bf3c0 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.063+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465c3870 con 0x55a0465bf3c0 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.063+0000 7efc37013640 1 -- 172.21.15.120:0/3260444053 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465bf3c0 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.063+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465c29e0 con 0x55a0465bf3c0 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.064+0000 7efc37013640 1 -- 172.21.15.120:0/3260444053 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465bf3c0 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.064+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465c2e40 con 0x55a0464bdf80 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.064+0000 7efc37814640 1 -- 172.21.15.120:0/3260444053 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efc3000a4d0 con 0x55a0464bdf80 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.064+0000 7efc3b323800 1 Processor -- start 2024-09-07T03:32:38.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.064+0000 7efc3b323800 1 -- start start 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.064+0000 7efc3b323800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465d1d60 0x55a0465d2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.064+0000 7efc3b323800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a0463b4a00 con 0x55a0465d1d60 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efc37814640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465d1d60 0x55a0465d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efc37814640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465d1d60 0x55a0465d2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42866/0 (socket says 172.21.15.120:42866) 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efc37814640 1 -- 172.21.15.120:0/3409066909 learned_addr learned my addr 172.21.15.120:0/3409066909 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efc37814640 1 -- 172.21.15.120:0/3409066909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0465d27c0 con 0x55a0465d1d60 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efc37814640 1 --2- 172.21.15.120:0/3409066909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465d1d60 0x55a0465d2180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc30016d20 tx=0x7efc3000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efb21602640 1 -- 172.21.15.120:0/3409066909 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc30017660 con 0x55a0465d1d60 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efb21602640 1 -- 172.21.15.120:0/3409066909 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3001b030 con 0x55a0465d1d60 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efc3b323800 1 -- 172.21.15.120:0/3409066909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0465d2ff0 con 0x55a0465d1d60 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efb21602640 1 -- 172.21.15.120:0/3409066909 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc30017950 con 0x55a0465d1d60 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.065+0000 7efc3b323800 1 -- 172.21.15.120:0/3409066909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0465d3590 con 0x55a0465d1d60 2024-09-07T03:32:38.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.066+0000 7efb21602640 1 -- 172.21.15.120:0/3409066909 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efc30017af0 con 0x55a0465d1d60 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.066+0000 7efb21602640 1 --2- 172.21.15.120:0/3409066909 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1003c840 0x7efb1003ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.066+0000 7efb21602640 1 -- 172.21.15.120:0/3409066909 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7efc3000e040 con 0x55a0465d1d60 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.066+0000 7efc37013640 1 --2- 172.21.15.120:0/3409066909 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1003c840 0x7efb1003ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.067+0000 7efc3b323800 1 Processor -- start 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.067+0000 7efc37013640 1 --2- 172.21.15.120:0/3409066909 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1003c840 0x7efb1003ed00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55a0465b8690 tx=0x7efc2800ff30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.067+0000 7efc3b323800 1 -- start start 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.067+0000 7efc3b323800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465dec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.067+0000 7efc3b323800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a0465afec0 con 0x55a0465de800 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.067+0000 7efc37814640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.067+0000 7efc37814640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465dec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42874/0 (socket says 172.21.15.120:42874) 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.067+0000 7efc37814640 1 -- 172.21.15.120:0/3967932327 learned_addr learned my addr 172.21.15.120:0/3967932327 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.067+0000 7efc37814640 1 -- 172.21.15.120:0/3967932327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0465df1f0 con 0x55a0465de800 2024-09-07T03:32:38.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc37814640 1 --2- 172.21.15.120:0/3967932327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465dec00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efc30054030 tx=0x7efc30054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed72a9824ffd1e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efb1affd640 1 -- 172.21.15.120:0/3967932327 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc30014d40 con 0x55a0465de800 2024-09-07T03:32:38.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efb1affd640 1 -- 172.21.15.120:0/3967932327 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc300149b0 con 0x55a0465de800 2024-09-07T03:32:38.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efb1affd640 1 -- 172.21.15.120:0/3967932327 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc30028350 con 0x55a0465de800 2024-09-07T03:32:38.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc3b323800 1 -- 172.21.15.120:0/3967932327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 msgr2=0x55a0465dec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc3b323800 1 --2- 172.21.15.120:0/3967932327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465dec00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efc30054030 tx=0x7efc30054060 comp rx=0 tx=0).stop 2024-09-07T03:32:38.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc3b323800 1 -- 172.21.15.120:0/3967932327 shutdown_connections 2024-09-07T03:32:38.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc3b323800 1 --2- 172.21.15.120:0/3967932327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465dec00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc3b323800 1 -- 172.21.15.120:0/3967932327 >> 172.21.15.120:0/3967932327 conn(0x55a0465dac00 msgr2=0x55a0465d8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc3b323800 1 -- 172.21.15.120:0/3967932327 shutdown_connections 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc3b323800 1 -- 172.21.15.120:0/3967932327 wait complete. 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc3b323800 1 Processor -- start 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.068+0000 7efc3b323800 1 -- start start 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efc3b323800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efc3b323800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a0465df7e0 con 0x55a0465de800 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efc37814640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efc37814640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465e5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42886/0 (socket says 172.21.15.120:42886) 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 learned_addr learned my addr 172.21.15.120:0/2414001348 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0465e63b0 con 0x55a0465de800 2024-09-07T03:32:38.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efc37814640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465e5e50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efc30053d10 tx=0x7efc30053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efb197fa640 1 -- 172.21.15.120:0/2414001348 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc30012570 con 0x55a0465de800 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efb197fa640 1 -- 172.21.15.120:0/2414001348 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc30005500 con 0x55a0465de800 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0465e6640 con 0x55a0465de800 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efb197fa640 1 -- 172.21.15.120:0/2414001348 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc30055570 con 0x55a0465de800 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.069+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0465e71d0 con 0x55a0465de800 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.070+0000 7efb197fa640 1 -- 172.21.15.120:0/2414001348 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efc300127a0 con 0x55a0465de800 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.070+0000 7efb197fa640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb0003c730 0x7efb0003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.070+0000 7efb197fa640 1 -- 172.21.15.120:0/2414001348 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7efc30048920 con 0x55a0465de800 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.070+0000 7efc37013640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb0003c730 0x7efb0003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.071+0000 7efc37013640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb0003c730 0x7efb0003ebf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc28054290 tx=0x7efc28042000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.071+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.071+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0465f1920 0x55a0465f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.071+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465f4530 con 0x55a0465f1920 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.071+0000 7efc36812640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0465f1920 0x55a0465f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.071+0000 7efc36812640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0465f1920 0x55a0465f3de0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 20 realm 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465f4960 con 0x55a0465f1920 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465f5230 con 0x55a0465f1920 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465f5c50 0x55a0465f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465f87f0 con 0x55a0465f5c50 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc37814640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465f5c50 0x55a0465f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.072+0000 7efc37814640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465f5c50 0x55a0465f8080 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc3b323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465f9040 con 0x55a0465f5c50 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc3b323800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc3b323800 20 searching for the correct realm 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a0465fadb0 0x55a0465fd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465fadb0 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc37013640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a0465fadb0 0x55a0465fd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.073+0000 7efc37013640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a0465fadb0 0x55a0465fd1e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.074+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.074+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f5c50 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.074+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.074+0000 7efc37814640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efc30014440 0x7efc3003bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.074+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x7efc30014440 2024-09-07T03:32:38.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.074+0000 7efc36812640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efc30014440 0x7efc3003bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.075+0000 7efc36812640 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efc30014440 0x7efc3003bab0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.075+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.075+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.075+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.075+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.075+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.075+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465fadb0 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.075+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.075+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.076+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.076+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f5c50 2024-09-07T03:32:38.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.076+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.076+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f5c50 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.076+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.076+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.076+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.076+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x7efc30014440 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.077+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.077+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.077+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.077+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x7efc30014440 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.077+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.077+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f5c50 2024-09-07T03:32:38.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.077+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.077+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465fadb0 2024-09-07T03:32:38.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.078+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.078+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.078+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.078+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f5c50 2024-09-07T03:32:38.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.078+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.078+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465fadb0 2024-09-07T03:32:38.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.078+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.078+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465fadb0 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x7efc30014440 2024-09-07T03:32:38.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.079+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f1920 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.080+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.080+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x7efc30014440 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.080+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.080+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465fadb0 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.080+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.080+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x7efc30014440 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.080+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.080+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f5c50 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.081+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.081+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f5c50 2024-09-07T03:32:38.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.081+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.081+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465fadb0 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.081+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.081+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f5c50 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fd8b0 con 0x55a0465f5c50 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:38.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465f9990 con 0x55a0465f1920 2024-09-07T03:32:38.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.082+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465f95a0 con 0x55a0465f5c50 2024-09-07T03:32:38.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fa300 con 0x55a0465f1920 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 20 zone default found 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 4 Realm: () 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 20 zonegroup default 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0465fe1e0 con 0x7efc30014440 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a046600420 con 0x55a0465fadb0 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.083+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.084+0000 7efc3b323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.084+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.084+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a0466007c0 con 0x55a0465fadb0 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.084+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.084+0000 7efc3b323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.084+0000 7efc3b323800 20 started sync module instance, tier type = 2024-09-07T03:32:38.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.084+0000 7efc3b323800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:38.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.084+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0465ff860 con 0x55a0465f5c50 2024-09-07T03:32:38.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.085+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.085+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94146863823952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046600070 con 0x55a0465f5c50 2024-09-07T03:32:38.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.085+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046601630 con 0x55a0465f1920 2024-09-07T03:32:38.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.086+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.086+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94146863831504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466022a0 con 0x55a0465f1920 2024-09-07T03:32:38.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.086+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046602c60 con 0x55a0465f5c50 2024-09-07T03:32:38.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.087+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94146863823952] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.087+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94146863831504] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.088+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.088+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94146863832560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046602210 con 0x55a0465f5c50 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.088+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046603110 con 0x7efc30014440 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.089+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94146863832560] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.089+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.090+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94146863835056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046603080 con 0x7efc30014440 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.090+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046603b40 con 0x55a0465f5c50 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.091+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.091+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94146863838832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046603b40 con 0x55a0465f5c50 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.091+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046604aa0 con 0x55a0465fadb0 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.091+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94146863835056] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.092+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94146863838832] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.092+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.092+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94146863841072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046604580 con 0x55a0465fadb0 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.092+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046605340 con 0x55a0465fadb0 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.093+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94146863841072] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.093+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.093+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94146863836112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046605340 con 0x55a0465fadb0 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.093+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046605dc0 con 0x7efc30014440 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94146863847632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466062c0 con 0x7efc30014440 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc3b323800 20 add_watcher() i=0 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc3b323800 20 add_watcher() i=1 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc3b323800 20 add_watcher() i=2 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc3b323800 20 add_watcher() i=3 2024-09-07T03:32:38.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc3b323800 20 add_watcher() i=4 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc3b323800 20 add_watcher() i=5 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94146863836112] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.094+0000 7efc3b323800 20 add_watcher() i=6 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.095+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94146863847632] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.095+0000 7efc3b323800 20 add_watcher() i=7 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.095+0000 7efc3b323800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.095+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a046604e90 con 0x55a0465f1920 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.095+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.095+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94146863848816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046604e90 con 0x55a0465f1920 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.096+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94146863848816] v34'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.096+0000 7efaedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.096+0000 7efc3b323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.096+0000 7efc3b323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:38.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.096+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046611ca0 con 0x55a0465f5c50 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.097+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'46 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.098+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046611d80 con 0x7efc30014440 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.098+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'21 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.099+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466124e0 con 0x55a0465fadb0 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.099+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.099+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046612990 con 0x55a0465f1920 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.100+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'128 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.101+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466113a0 con 0x55a0465f5c50 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.101+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'41 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.101+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466113a0 con 0x55a0465fadb0 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.103+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.103+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466113a0 con 0x55a0465f5c50 2024-09-07T03:32:38.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.104+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.104+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466114b0 con 0x55a0465f1920 2024-09-07T03:32:38.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.105+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.105+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466136c0 con 0x55a0465f5c50 2024-09-07T03:32:38.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.106+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.106+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466136c0 con 0x55a0465f5c50 2024-09-07T03:32:38.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.107+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.107+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466136c0 con 0x55a0465f5c50 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.108+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.108+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466136c0 con 0x55a0465fadb0 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.109+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.109+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466136c0 con 0x55a0465f5c50 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.110+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.110+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466136c0 con 0x55a0465f1920 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.111+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'41 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.111+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466139a0 con 0x55a0465f1920 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.112+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'129 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.112+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466139a0 con 0x55a0465f5c50 2024-09-07T03:32:38.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.113+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.113+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466139a0 con 0x55a0465f5c50 2024-09-07T03:32:38.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.114+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.114+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466139a0 con 0x55a0465fadb0 2024-09-07T03:32:38.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.115+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.115+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a30 con 0x55a0465f5c50 2024-09-07T03:32:38.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.116+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.116+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a30 con 0x55a0465f1920 2024-09-07T03:32:38.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.117+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'130 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.117+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a30 con 0x55a0465f5c50 2024-09-07T03:32:38.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.118+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.118+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a30 con 0x55a0465f5c50 2024-09-07T03:32:38.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.119+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.119+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a30 con 0x55a0465fadb0 2024-09-07T03:32:38.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.120+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.120+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a30 con 0x55a0465f5c50 2024-09-07T03:32:38.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.121+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.121+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a50 con 0x55a0465fadb0 2024-09-07T03:32:38.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.122+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.122+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a50 con 0x55a0465fadb0 2024-09-07T03:32:38.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.123+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'36 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.123+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a50 con 0x55a0465fadb0 2024-09-07T03:32:38.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.124+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.124+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a70 con 0x55a0465f5c50 2024-09-07T03:32:38.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.125+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.125+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a70 con 0x55a0465f1920 2024-09-07T03:32:38.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.126+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.126+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a70 con 0x55a0465f5c50 2024-09-07T03:32:38.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.127+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.127+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a70 con 0x55a0465f1920 2024-09-07T03:32:38.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.128+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'42 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.128+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046613a90 con 0x7efc30014440 2024-09-07T03:32:38.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.129+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.129+0000 7efaecfe1640 20 reqs_thread_entry: start 2024-09-07T03:32:38.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.129+0000 7efc3b323800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:38.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.129+0000 7efc3b323800 20 Filter name: none 2024-09-07T03:32:38.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.129+0000 7efa667fc640 20 reqs_thread_entry: start 2024-09-07T03:32:38.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-07T03:32:38.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04663ea50 con 0x7efc30014440 2024-09-07T03:32:38.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 20 rados_obj.operate() r=0 bl.length=380 2024-09-07T03:32:38.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-07T03:32:38.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:32:38.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:38.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a046640eb0 con 0x55a0465f1920 2024-09-07T03:32:38.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-07T03:32:38.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.130+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04663ee50 con 0x55a0465fadb0 2024-09-07T03:32:38.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.131+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v34'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.131+0000 7efc3b323800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.131+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94146864081408 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a046640720 con 0x55a0465f5c50 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.132+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== watch-notify(notify (1) cookie 94146863832560 notify 146028888082 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a0466114b0 con 0x55a0465f5c50 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.132+0000 7efb1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94146863832560 notifier 4526 bl.length()=170 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.132+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(97 notify.2 [notify cookie 94146864081408 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.132+0000 7efb1affd640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efafc003d60 con 0x55a0465f5c50 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.132+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.132+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== watch-notify(notify_complete (2) cookie 94146864081408 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efc30069020 con 0x55a0465f5c50 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.132+0000 7efc3b323800 10 removing email index: 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.132+0000 7efc3b323800 10 removing user buckets index 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.132+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04663e9d0 con 0x55a0465f1920 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.133+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(99 fud.buckets [delete] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.133+0000 7efc3b323800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.133+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94146864081360 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a046640270 con 0x55a0465fadb0 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.133+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== watch-notify(notify (1) cookie 94146863836112 notify 146028888076 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a0466119b0 con 0x55a0465fadb0 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.134+0000 7efb1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94146863836112 notifier 4526 bl.length()=160 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.134+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(100 notify.6 [notify cookie 94146864081360 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.134+0000 7efb1affd640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efafc003d60 con 0x55a0465fadb0 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.134+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.134+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== watch-notify(notify_complete (2) cookie 94146864081360 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a04660b720 con 0x55a0465fadb0 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.134+0000 7efc3b323800 10 removing user index: fud 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.134+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046640270 con 0x7efc30014440 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.135+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(102 fud [call,call,delete] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.135+0000 7efc3b323800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-07T03:32:38.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.135+0000 7efc3b323800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.135+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94146864088704 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a046640270 con 0x55a0465fadb0 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.135+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== watch-notify(notify (1) cookie 94146863841072 notify 146028888077 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55a04660b720 con 0x55a0465fadb0 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.135+0000 7efb1a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 94146863841072 notifier 4526 bl.length()=152 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.135+0000 7efb1a7fc640 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efa6c0032c0 con 0x55a0465fadb0 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.135+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== osd_op_reply(103 notify.5 [notify cookie 94146864088704 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.135+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.136+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== watch-notify(notify_complete (2) cookie 94146864088704 notify 146028888077 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a04660b550 con 0x55a0465fadb0 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.136+0000 7efaedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.136+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94146863848816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046640680 con 0x55a0465f1920 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.137+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94146863848816] v34'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.137+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94146863823952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046640680 con 0x55a0465f5c50 2024-09-07T03:32:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.138+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94146863823952] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.138+0000 7efc3b323800 20 remove_watcher() i=0 2024-09-07T03:32:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.138+0000 7efc3b323800 2 removed watcher, disabling cache 2024-09-07T03:32:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.138+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94146863831504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046640680 con 0x55a0465f1920 2024-09-07T03:32:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.139+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94146863831504] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x55a0465f1920 2024-09-07T03:32:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.139+0000 7efc3b323800 20 remove_watcher() i=1 2024-09-07T03:32:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.139+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94146863832560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0466019d0 con 0x55a0465f5c50 2024-09-07T03:32:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.140+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94146863832560] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.140+0000 7efc3b323800 20 remove_watcher() i=2 2024-09-07T03:32:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.140+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94146863835056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0465ffc50 con 0x7efc30014440 2024-09-07T03:32:38.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.141+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94146863835056] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.141+0000 7efc3b323800 20 remove_watcher() i=3 2024-09-07T03:32:38.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.141+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94146863838832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0465ffc50 con 0x55a0465f5c50 2024-09-07T03:32:38.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.147+0000 7efc37814640 1 -- 172.21.15.120:0/2414001348 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94146863838832] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc30027070 con 0x55a0465f5c50 2024-09-07T03:32:38.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.147+0000 7efc3b323800 20 remove_watcher() i=4 2024-09-07T03:32:38.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.147+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94146863841072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a046603670 con 0x55a0465fadb0 2024-09-07T03:32:38.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.148+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94146863841072] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.148+0000 7efc3b323800 20 remove_watcher() i=5 2024-09-07T03:32:38.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.148+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94146863836112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0465ffc50 con 0x55a0465fadb0 2024-09-07T03:32:38.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.149+0000 7efc37013640 1 -- 172.21.15.120:0/2414001348 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94146863836112] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2802d070 con 0x55a0465fadb0 2024-09-07T03:32:38.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.149+0000 7efc3b323800 20 remove_watcher() i=6 2024-09-07T03:32:38.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.149+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94146863847632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a0465ffc50 con 0x7efc30014440 2024-09-07T03:32:38.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94146863847632] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc2c051070 con 0x7efc30014440 2024-09-07T03:32:38.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 20 remove_watcher() i=7 2024-09-07T03:32:38.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465f5c50 msgr2=0x55a0465f8080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465f5c50 0x55a0465f8080 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0465f1920 msgr2=0x55a0465f3de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0465f1920 0x55a0465f3de0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efc30014440 msgr2=0x7efc3003bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efc30014440 0x7efc3003bab0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a0465fadb0 msgr2=0x55a0465fd1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a0465fadb0 0x55a0465fd1e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb0003c730 msgr2=0x7efb0003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb0003c730 0x7efb0003ebf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc28054290 tx=0x7efc28042000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 msgr2=0x55a0465e5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc36812640 1 -- 172.21.15.120:0/2414001348 reap_dead start 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465e5e50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efc30053d10 tx=0x7efc30053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 shutdown_connections 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/2414001348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465de800 0x55a0465e5e50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 >> 172.21.15.120:0/2414001348 conn(0x55a0465dac00 msgr2=0x55a0465d8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 shutdown_connections 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/2414001348 wait complete. 2024-09-07T03:32:38.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/3409066909 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1003c840 msgr2=0x7efb1003ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/3409066909 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1003c840 0x7efb1003ed00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55a0465b8690 tx=0x7efc2800ff30 comp rx=0 tx=0).stop 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/3409066909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465d1d60 msgr2=0x55a0465d2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/3409066909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465d1d60 0x55a0465d2180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc30016d20 tx=0x7efc3000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/3409066909 shutdown_connections 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/3409066909 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1003c840 0x7efb1003ed00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 --2- 172.21.15.120:0/3409066909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0465d1d60 0x55a0465d2180 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/3409066909 >> 172.21.15.120:0/3409066909 conn(0x55a0465c6110 msgr2=0x55a0465c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/3409066909 shutdown_connections 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.150+0000 7efc3b323800 1 -- 172.21.15.120:0/3409066909 wait complete. 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465bf3c0 msgr2=0x55a0465c1850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465bf3c0 0x55a0465c1850 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0464bdf80 msgr2=0x55a0465be5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0464bdf80 0x55a0465be5d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1c03c7d0 msgr2=0x7efb1c03ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1c03c7d0 0x7efb1c03ec90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efc2c057000 tx=0x7efc2c052000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 msgr2=0x55a0465b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465b6f80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc28000f60 tx=0x7efc28000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 shutdown_connections 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a0465bf3c0 0x55a0465c1850 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a0464bdf80 0x55a0465be5d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efb1c03c7d0 0x7efb1c03ec90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 --2- 172.21.15.120:0/3260444053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a0464bc460 0x55a0465b6f80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 >> 172.21.15.120:0/3260444053 conn(0x55a0464b81b0 msgr2=0x55a0465b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 shutdown_connections 2024-09-07T03:32:38.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.151+0000 7efc3b323800 1 -- 172.21.15.120:0/3260444053 wait complete. 2024-09-07T03:32:38.162 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-07T03:32:38.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-07T03:32:38.162 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-07T03:32:38.217 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:38.217 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:38.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0dabb21800 1 Processor -- start 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0dabb21800 1 -- start start 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0dabb21800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b09c44de60 0x55b09c44eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0dabb21800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b09c2f8e40 con 0x55b09c44f0a0 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0dabb21800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b09c2c3680 con 0x55b09c44de60 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0da780c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b09c44de60 0x55b09c44eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0da700b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b09c44f0a0 0x55b09c453e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:48538/0 (socket says 172.21.15.120:48538) 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0da780c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b09c44de60 0x55b09c44eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42902/0 (socket says 172.21.15.120:42902) 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0da700b640 1 -- 172.21.15.120:0/3612163222 learned_addr learned my addr 172.21.15.120:0/3612163222 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0da780c640 1 -- 172.21.15.120:0/3612163222 >> v1:172.21.15.104:6789/0 conn(0x55b09c44f0a0 legacy=0x55b09c453e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.216+0000 7f0da780c640 1 -- 172.21.15.120:0/3612163222 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09c2df6b0 con 0x55b09c44de60 2024-09-07T03:32:38.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.218+0000 7f0da780c640 1 --2- 172.21.15.120:0/3612163222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c44eb60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800a470 tx=0x7f0d98045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ed21578c9dd233 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.218+0000 7f0da680a640 1 -- 172.21.15.120:0/3612163222 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d98053570 con 0x55b09c44de60 2024-09-07T03:32:38.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.219+0000 7f0da680a640 1 -- 172.21.15.120:0/3612163222 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d98058070 con 0x55b09c44de60 2024-09-07T03:32:38.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.219+0000 7f0da680a640 1 -- 172.21.15.120:0/3612163222 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d98053880 con 0x55b09c44de60 2024-09-07T03:32:38.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.219+0000 7f0dabb21800 1 -- 172.21.15.120:0/3612163222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 msgr2=0x55b09c44eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.219+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3612163222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c44eb60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800a470 tx=0x7f0d98045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:38.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.219+0000 7f0dabb21800 1 -- 172.21.15.120:0/3612163222 shutdown_connections 2024-09-07T03:32:38.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.219+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3612163222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c44eb60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.219+0000 7f0dabb21800 1 -- 172.21.15.120:0/3612163222 >> 172.21.15.120:0/3612163222 conn(0x55b09c449250 msgr2=0x55b09c44b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.219+0000 7f0dabb21800 1 -- 172.21.15.120:0/3612163222 shutdown_connections 2024-09-07T03:32:38.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.219+0000 7f0dabb21800 1 -- 172.21.15.120:0/3612163222 wait complete. 2024-09-07T03:32:38.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.233+0000 7f0dabb21800 1 Processor -- start 2024-09-07T03:32:38.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.233+0000 7f0dabb21800 1 -- start start 2024-09-07T03:32:38.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.233+0000 7f0dabb21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c3c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.233+0000 7f0dabb21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b09c2e7dd0 con 0x55b09c44de60 2024-09-07T03:32:38.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.233+0000 7f0da780c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c3c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.233+0000 7f0da780c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c3c2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42908/0 (socket says 172.21.15.120:42908) 2024-09-07T03:32:38.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.233+0000 7f0da780c640 1 -- 172.21.15.120:0/2438503669 learned_addr learned my addr 172.21.15.120:0/2438503669 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.234+0000 7f0da780c640 1 -- 172.21.15.120:0/2438503669 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09c300e10 con 0x55b09c44de60 2024-09-07T03:32:38.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.234+0000 7f0da780c640 1 --2- 172.21.15.120:0/2438503669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c3c2630 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0d98025c20 tx=0x7f0d98051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5479ce42bfc4cf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.234+0000 7f0c95e0b640 1 -- 172.21.15.120:0/2438503669 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d98053570 con 0x55b09c44de60 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.234+0000 7f0c95e0b640 1 -- 172.21.15.120:0/2438503669 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d98063070 con 0x55b09c44de60 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.234+0000 7f0c95e0b640 1 -- 172.21.15.120:0/2438503669 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d98053840 con 0x55b09c44de60 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 -- 172.21.15.120:0/2438503669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 msgr2=0x55b09c3c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 --2- 172.21.15.120:0/2438503669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c3c2630 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0d98025c20 tx=0x7f0d98051000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 -- 172.21.15.120:0/2438503669 shutdown_connections 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 --2- 172.21.15.120:0/2438503669 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c3c2630 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 -- 172.21.15.120:0/2438503669 >> 172.21.15.120:0/2438503669 conn(0x55b09c449250 msgr2=0x55b09c538fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 -- 172.21.15.120:0/2438503669 shutdown_connections 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 -- 172.21.15.120:0/2438503669 wait complete. 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 Processor -- start 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 -- start start 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c545f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0dabb21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b09c44f790 con 0x55b09c44de60 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.235+0000 7f0da780c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c545f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.236+0000 7f0da780c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c545f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42914/0 (socket says 172.21.15.120:42914) 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.236+0000 7f0da780c640 1 -- 172.21.15.120:0/476096467 learned_addr learned my addr 172.21.15.120:0/476096467 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.236+0000 7f0da780c640 1 -- 172.21.15.120:0/476096467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09c5464d0 con 0x55b09c44de60 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.236+0000 7f0da780c640 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c545f70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0d98053d60 tx=0x7f0d98002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.236+0000 7f0c8ffff640 1 -- 172.21.15.120:0/476096467 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d98068470 con 0x55b09c44de60 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.236+0000 7f0c8ffff640 1 -- 172.21.15.120:0/476096467 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d98068610 con 0x55b09c44de60 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.236+0000 7f0c8ffff640 1 -- 172.21.15.120:0/476096467 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d980688f0 con 0x55b09c44de60 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.236+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b09c546760 con 0x55b09c44de60 2024-09-07T03:32:38.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.236+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09c547160 con 0x55b09c44de60 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.237+0000 7f0c8ffff640 1 -- 172.21.15.120:0/476096467 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0d98068a90 con 0x55b09c44de60 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.237+0000 7f0c8ffff640 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c9003c780 0x7f0c9003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.237+0000 7f0c8ffff640 1 -- 172.21.15.120:0/476096467 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f0d98097f40 con 0x55b09c44de60 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.237+0000 7f0da700b640 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c9003c780 0x7f0c9003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.237+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c44f0a0 0x55b09c54d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.238+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c547d10 con 0x55b09c44f0a0 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.238+0000 7f0da800d640 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c44f0a0 0x55b09c54d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.238+0000 7f0da700b640 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c9003c780 0x7f0c9003ec40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c001d70 tx=0x7f0d9c0012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.238+0000 7f0da800d640 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c44f0a0 0x55b09c54d5c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.238+0000 7f0da800d640 1 -- 172.21.15.120:0/476096467 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0da000a4d0 con 0x55b09c44f0a0 2024-09-07T03:32:38.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.238+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c54e4f0 0x55b09c5508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.238+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c550f40 con 0x55b09c54e4f0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.238+0000 7f0da780c640 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c54e4f0 0x55b09c5508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.239+0000 7f0da780c640 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c54e4f0 0x55b09c5508e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.239+0000 7f0da780c640 1 -- 172.21.15.120:0/476096467 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c54e4f0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.239+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5527f0 con 0x55b09c54e4f0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.239+0000 7f0da780c640 1 -- 172.21.15.120:0/476096467 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c54e4f0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.239+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c551870 con 0x55b09c54e4f0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.239+0000 7f0da780c640 1 -- 172.21.15.120:0/476096467 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c54e4f0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.239+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c551cd0 con 0x55b09c44f0a0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.240+0000 7f0da800d640 1 -- 172.21.15.120:0/476096467 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0da000a4d0 con 0x55b09c44f0a0 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.240+0000 7f0dabb21800 1 Processor -- start 2024-09-07T03:32:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.240+0000 7f0dabb21800 1 -- start start 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.240+0000 7f0dabb21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c560cd0 0x55b09c5610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.240+0000 7f0dabb21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b09c345a00 con 0x55b09c560cd0 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.240+0000 7f0da800d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c560cd0 0x55b09c5610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.240+0000 7f0da800d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c560cd0 0x55b09c5610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42928/0 (socket says 172.21.15.120:42928) 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.240+0000 7f0da800d640 1 -- 172.21.15.120:0/1214241789 learned_addr learned my addr 172.21.15.120:0/1214241789 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.241+0000 7f0da800d640 1 -- 172.21.15.120:0/1214241789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09c561730 con 0x55b09c560cd0 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.241+0000 7f0da800d640 1 --2- 172.21.15.120:0/1214241789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c560cd0 0x55b09c5610f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0da0016d20 tx=0x7f0da000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.241+0000 7f0c8d7fa640 1 -- 172.21.15.120:0/1214241789 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da0017660 con 0x55b09c560cd0 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.241+0000 7f0c8d7fa640 1 -- 172.21.15.120:0/1214241789 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da001b030 con 0x55b09c560cd0 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.241+0000 7f0c8d7fa640 1 -- 172.21.15.120:0/1214241789 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da0017950 con 0x55b09c560cd0 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.241+0000 7f0dabb21800 1 -- 172.21.15.120:0/1214241789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b09c561f60 con 0x55b09c560cd0 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.241+0000 7f0dabb21800 1 -- 172.21.15.120:0/1214241789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09c562500 con 0x55b09c560cd0 2024-09-07T03:32:38.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.242+0000 7f0c8d7fa640 1 -- 172.21.15.120:0/1214241789 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0da0017af0 con 0x55b09c560cd0 2024-09-07T03:32:38.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.242+0000 7f0c8d7fa640 1 --2- 172.21.15.120:0/1214241789 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c8003c780 0x7f0c8003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.242+0000 7f0c8d7fa640 1 -- 172.21.15.120:0/1214241789 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f0da000e040 con 0x55b09c560cd0 2024-09-07T03:32:38.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.242+0000 7f0da780c640 1 --2- 172.21.15.120:0/1214241789 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c8003c780 0x7f0c8003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.242+0000 7f0dabb21800 1 Processor -- start 2024-09-07T03:32:38.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.242+0000 7f0dabb21800 1 -- start start 2024-09-07T03:32:38.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.242+0000 7f0da780c640 1 --2- 172.21.15.120:0/1214241789 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c8003c780 0x7f0c8003ec40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55b09c54dcb0 tx=0x7f0d98089040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0dabb21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c56db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0dabb21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b09c5413b0 con 0x55b09c56d750 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0da800d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c56db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0da800d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c56db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42942/0 (socket says 172.21.15.120:42942) 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0da800d640 1 -- 172.21.15.120:0/2004037304 learned_addr learned my addr 172.21.15.120:0/2004037304 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0da800d640 1 -- 172.21.15.120:0/2004037304 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09c56e140 con 0x55b09c56d750 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0da800d640 1 --2- 172.21.15.120:0/2004037304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c56db50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0da0054030 tx=0x7f0da0054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1daee864157afaa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0c86ffd640 1 -- 172.21.15.120:0/2004037304 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da0014d40 con 0x55b09c56d750 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0c86ffd640 1 -- 172.21.15.120:0/2004037304 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da00149b0 con 0x55b09c56d750 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.243+0000 7f0c86ffd640 1 -- 172.21.15.120:0/2004037304 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da0028350 con 0x55b09c56d750 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 -- 172.21.15.120:0/2004037304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 msgr2=0x55b09c56db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 --2- 172.21.15.120:0/2004037304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c56db50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0da0054030 tx=0x7f0da0054060 comp rx=0 tx=0).stop 2024-09-07T03:32:38.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 -- 172.21.15.120:0/2004037304 shutdown_connections 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 --2- 172.21.15.120:0/2004037304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c56db50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 -- 172.21.15.120:0/2004037304 >> 172.21.15.120:0/2004037304 conn(0x55b09c569b50 msgr2=0x55b09c567d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 -- 172.21.15.120:0/2004037304 shutdown_connections 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 -- 172.21.15.120:0/2004037304 wait complete. 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 Processor -- start 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 -- start start 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c574d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.244+0000 7f0dabb21800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b09c56e730 con 0x55b09c56d750 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0da800d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c574d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0da800d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c574d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:42948/0 (socket says 172.21.15.120:42948) 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 learned_addr learned my addr 172.21.15.120:0/3152779183 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09c575280 con 0x55b09c56d750 2024-09-07T03:32:38.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0da800d640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c574d20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0da0053d10 tx=0x7f0da0053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0c857fa640 1 -- 172.21.15.120:0/3152779183 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da0028be0 con 0x55b09c56d750 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0c857fa640 1 -- 172.21.15.120:0/3152779183 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da0055230 con 0x55b09c56d750 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b09c575510 con 0x55b09c56d750 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0c857fa640 1 -- 172.21.15.120:0/3152779183 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da0055550 con 0x55b09c56d750 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.245+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09c5760a0 con 0x55b09c56d750 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.246+0000 7f0c857fa640 1 -- 172.21.15.120:0/3152779183 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0da00556f0 con 0x55b09c56d750 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.246+0000 7f0c857fa640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c7003c7d0 0x7f0c7003ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.246+0000 7f0c857fa640 1 -- 172.21.15.120:0/3152779183 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f0da0048920 con 0x55b09c56d750 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.246+0000 7f0da780c640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c7003c7d0 0x7f0c7003ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.246+0000 7f0da780c640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c7003c7d0 0x7f0c7003ec90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55b09c5475a0 tx=0x7f0d98090000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c580810 0x55b09c582cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c583420 con 0x55b09c580810 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0da700b640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c580810 0x55b09c582cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0da700b640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c580810 0x55b09c582cd0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d9c009050 con 0x55b09c580810 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0dabb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0dabb21800 20 realm 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.247+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c57fb60 con 0x55b09c580810 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d9c009050 con 0x55b09c580810 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0dabb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0dabb21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:38.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c583f10 con 0x55b09c580810 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d9c009050 con 0x55b09c580810 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0dabb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c584cf0 0x55b09c5870e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5877b0 con 0x55b09c584cf0 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0da800d640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c584cf0 0x55b09c5870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.248+0000 7f0da800d640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c584cf0 0x55b09c5870e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0dabb21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c588050 con 0x55b09c584cf0 2024-09-07T03:32:38.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0dabb21800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0dabb21800 20 searching for the correct realm 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09c589dc0 0x55b09c58c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c589dc0 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0da780c640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09c589dc0 0x55b09c58c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0da780c640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09c589dc0 0x55b09c58c210 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.249+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c584cf0 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.250+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.250+0000 7f0da800d640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0da0014440 0x7f0da0032ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.250+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x7f0da0014440 2024-09-07T03:32:38.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.250+0000 7f0da700b640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0da0014440 0x7f0da0032ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.250+0000 7f0da700b640 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0da0014440 0x7f0da0032ac0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.250+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c009050 con 0x7f0da0014440 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.250+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.251+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c009050 con 0x55b09c580810 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.251+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.251+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.251+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c589dc0 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.251+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.251+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.251+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.251+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c584cf0 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c584cf0 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x7f0da0014440 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.252+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x7f0da0014440 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.253+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.253+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c584cf0 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.253+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.253+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c589dc0 2024-09-07T03:32:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.253+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.253+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.253+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.253+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c584cf0 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.254+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.254+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c589dc0 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.254+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.254+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.254+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.254+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.254+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.254+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c589dc0 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x7f0da0014440 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c580810 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x7f0da0014440 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.255+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c589dc0 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.256+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.256+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x7f0da0014440 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.256+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.256+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c584cf0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.256+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.256+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c584cf0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.256+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.256+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c589dc0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c584cf0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58c8e0 con 0x55b09c584cf0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:38.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c588a00 con 0x55b09c580810 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.257+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c588610 con 0x55b09c584cf0 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c589330 con 0x55b09c580810 2024-09-07T03:32:38.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 zone default found 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 4 Realm: () 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 zonegroup default 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58d210 con 0x7f0da0014440 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58f450 con 0x55b09c589dc0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.258+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.259+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58f7f0 con 0x55b09c589dc0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.259+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.259+0000 7f0dabb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.259+0000 7f0dabb21800 20 started sync module instance, tier type = 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.259+0000 7f0dabb21800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.259+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58e890 con 0x55b09c584cf0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.260+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.260+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94217025678464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c58e890 con 0x55b09c584cf0 2024-09-07T03:32:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.260+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c590090 con 0x55b09c580810 2024-09-07T03:32:38.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.261+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94217025678464] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.261+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.261+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94217025676528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c590090 con 0x55b09c580810 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.261+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5908e0 con 0x55b09c584cf0 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.262+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94217025676528] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.264+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.264+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94217025682880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c590810 con 0x55b09c584cf0 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.264+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c591380 con 0x7f0da0014440 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.265+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.265+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94217025687152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c591340 con 0x7f0da0014440 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.265+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c592330 con 0x55b09c584cf0 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.265+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94217025682880] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.266+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94217025687152] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.267+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.267+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94217025689456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c592330 con 0x55b09c584cf0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.267+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c592bd0 con 0x55b09c589dc0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.268+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.268+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94217025693472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c592330 con 0x55b09c589dc0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.268+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c593770 con 0x55b09c589dc0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.268+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94217025689456] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.269+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94217025693472] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.271+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.271+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94217025696320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c593730 con 0x55b09c589dc0 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.271+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c594010 con 0x7f0da0014440 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94217025698656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c594430 con 0x7f0da0014440 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0dabb21800 20 add_watcher() i=0 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0dabb21800 20 add_watcher() i=1 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0dabb21800 20 add_watcher() i=2 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0dabb21800 20 add_watcher() i=3 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0dabb21800 20 add_watcher() i=4 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0dabb21800 20 add_watcher() i=5 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94217025696320] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.272+0000 7f0dabb21800 20 add_watcher() i=6 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.273+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94217025698656] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.273+0000 7f0dabb21800 20 add_watcher() i=7 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.273+0000 7f0dabb21800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:38.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.273+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c597460 con 0x55b09c580810 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.273+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.273+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94217025699712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c594850 con 0x55b09c580810 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.274+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94217025699712] v34'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.274+0000 7f0c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.274+0000 7f0dabb21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.274+0000 7f0dabb21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.274+0000 7f0dabb21800 5 note: GC not initialized 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.274+0000 7f0c5cfe1640 20 reqs_thread_entry: start 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 20 Filter name: none 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0bd67fc640 20 reqs_thread_entry: start 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5ca420 con 0x55b09c589dc0 2024-09-07T03:32:38.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8a10 con 0x55b09c589dc0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.275+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c9290 con 0x55b09c589dc0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.276+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v34'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.276+0000 7f0dabb21800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.276+0000 7f0dabb21800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.276+0000 7f0dabb21800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94217025916384 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5cdd60 con 0x7f0da0014440 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== watch-notify(notify (1) cookie 94217025687152 notify 146028888075 ret 0) ==== 652+0+0 (crc 0 0 0) 0x55b09c2f8e40 con 0x7f0da0014440 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0c86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888075 cookie 94217025687152 notifier 4533 bl.length()=610 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0c86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0c86ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(65 notify.3 [notify cookie 94217025916384 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0c86ffd640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0c6c003ea0 con 0x7f0da0014440 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== watch-notify(notify_complete (2) cookie 94217025916384 notify 146028888075 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0d9c02e740 con 0x7f0da0014440 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.277+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8db0 con 0x55b09c589dc0 2024-09-07T03:32:38.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.278+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v34'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.278+0000 7f0dabb21800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.278+0000 7f0dabb21800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.278+0000 7f0dabb21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.278+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94217025916304 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5cdd60 con 0x55b09c584cf0 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.279+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94217025682880 notify 146028888083 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55b09c5760a0 con 0x55b09c584cf0 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.279+0000 7f0c867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94217025682880 notifier 4533 bl.length()=192 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.279+0000 7f0c867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.279+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(68 notify.2 [notify cookie 94217025916304 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.279+0000 7f0c867fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.279+0000 7f0c867fc640 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0bdc003400 con 0x55b09c584cf0 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.279+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== watch-notify(notify_complete (2) cookie 94217025916304 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b09c575510 con 0x55b09c584cf0 2024-09-07T03:32:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.279+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.291 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-07T03:32:38.277828Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:38.277814Z","tags":[],"group_ids":[]} 2024-09-07T03:32:38.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.280+0000 7f0c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.280+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94217025699712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8080 con 0x55b09c580810 2024-09-07T03:32:38.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.281+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94217025699712] v34'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.281+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94217025678464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8080 con 0x55b09c584cf0 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.282+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94217025678464] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.282+0000 7f0dabb21800 20 remove_watcher() i=0 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.282+0000 7f0dabb21800 2 removed watcher, disabling cache 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.282+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94217025676528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8080 con 0x55b09c580810 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.283+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94217025676528] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x55b09c580810 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.283+0000 7f0dabb21800 20 remove_watcher() i=1 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.283+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94217025682880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8080 con 0x55b09c584cf0 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.284+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94217025682880] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.284+0000 7f0dabb21800 20 remove_watcher() i=2 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.284+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94217025687152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8080 con 0x7f0da0014440 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.285+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94217025687152] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.285+0000 7f0dabb21800 20 remove_watcher() i=3 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.285+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94217025689456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8080 con 0x55b09c584cf0 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.286+0000 7f0da800d640 1 -- 172.21.15.120:0/3152779183 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94217025689456] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da0027070 con 0x55b09c584cf0 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.286+0000 7f0dabb21800 20 remove_watcher() i=4 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.286+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94217025693472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8080 con 0x55b09c589dc0 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.287+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94217025693472] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.287+0000 7f0dabb21800 20 remove_watcher() i=5 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.287+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94217025696320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8080 con 0x55b09c589dc0 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.288+0000 7f0da780c640 1 -- 172.21.15.120:0/3152779183 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94217025696320] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d98079020 con 0x55b09c589dc0 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.288+0000 7f0dabb21800 20 remove_watcher() i=6 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.288+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94217025698656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b09c5c8080 con 0x7f0da0014440 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94217025698656] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d9c028040 con 0x7f0da0014440 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 20 remove_watcher() i=7 2024-09-07T03:32:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c584cf0 msgr2=0x55b09c5870e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c584cf0 0x55b09c5870e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c580810 msgr2=0x55b09c582cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c580810 0x55b09c582cd0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0da0014440 msgr2=0x7f0da0032ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0da0014440 0x7f0da0032ac0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09c589dc0 msgr2=0x55b09c58c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09c589dc0 0x55b09c58c210 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c7003c7d0 msgr2=0x7f0c7003ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c7003c7d0 0x7f0c7003ec90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55b09c5475a0 tx=0x7f0d98090000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 msgr2=0x55b09c574d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 --2- 172.21.15.120:0/3152779183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c56d750 0x55b09c574d20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0da0053d10 tx=0x7f0da0053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 reap_dead start 2024-09-07T03:32:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0da700b640 1 -- 172.21.15.120:0/3152779183 reap_dead start 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 shutdown_connections 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 >> 172.21.15.120:0/3152779183 conn(0x55b09c569b50 msgr2=0x55b09c567d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 shutdown_connections 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.289+0000 7f0dabb21800 1 -- 172.21.15.120:0/3152779183 wait complete. 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/1214241789 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c8003c780 msgr2=0x7f0c8003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/1214241789 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c8003c780 0x7f0c8003ec40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55b09c54dcb0 tx=0x7f0d98089040 comp rx=0 tx=0).stop 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/1214241789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c560cd0 msgr2=0x55b09c5610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/1214241789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c560cd0 0x55b09c5610f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0da0016d20 tx=0x7f0da000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/1214241789 shutdown_connections 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/1214241789 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c8003c780 0x7f0c8003ec40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/1214241789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c560cd0 0x55b09c5610f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/1214241789 >> 172.21.15.120:0/1214241789 conn(0x55b09c555080 msgr2=0x55b09c555460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/1214241789 shutdown_connections 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/1214241789 wait complete. 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c54e4f0 msgr2=0x55b09c5508e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c54e4f0 0x55b09c5508e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c44f0a0 msgr2=0x55b09c54d5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c44f0a0 0x55b09c54d5c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c9003c780 msgr2=0x7f0c9003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c9003c780 0x7f0c9003ec40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c001d70 tx=0x7f0d9c0012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 msgr2=0x55b09c545f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c545f70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0d98053d60 tx=0x7f0d98002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 shutdown_connections 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b09c54e4f0 0x55b09c5508e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b09c44f0a0 0x55b09c54d5c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0c9003c780 0x7f0c9003ec40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 --2- 172.21.15.120:0/476096467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b09c44de60 0x55b09c545f70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 >> 172.21.15.120:0/476096467 conn(0x55b09c449250 msgr2=0x55b09c5377b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 shutdown_connections 2024-09-07T03:32:38.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.290+0000 7f0dabb21800 1 -- 172.21.15.120:0/476096467 wait complete. 2024-09-07T03:32:38.303 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-07T03:32:38.277828Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:38.277814Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:38.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-07T03:32:38.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-07T03:32:38.303 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-07T03:32:38.351 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:38.351 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:38.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.349+0000 7fbe84328800 1 Processor -- start 2024-09-07T03:32:38.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.349+0000 7fbe84328800 1 -- start start 2024-09-07T03:32:38.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe84328800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558bc429d020 0x558bc42a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe84328800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558bc4146e40 con 0x558bc429b500 2024-09-07T03:32:38.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe84328800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x558bc4111680 con 0x558bc429d020 2024-09-07T03:32:38.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe7775c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558bc429d020 0x558bc42a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe7ff5d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x558bc429b500 0x558bc429b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42236/0 (socket says 172.21.15.120:42236) 2024-09-07T03:32:38.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe7775c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558bc429d020 0x558bc42a5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:51998/0 (socket says 172.21.15.120:51998) 2024-09-07T03:32:38.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3748217496 learned_addr learned my addr 172.21.15.120:0/3748217496 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:38.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe7775c640 1 -- 172.21.15.120:0/3748217496 >> v1:172.21.15.104:6789/0 conn(0x558bc429b500 legacy=0x558bc429b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe7f75c640 1 -- 172.21.15.120:0/3748217496 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785094540 0 0) 0x558bc4146e40 con 0x558bc429b500 2024-09-07T03:32:38.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.350+0000 7fbe7775c640 1 -- 172.21.15.120:0/3748217496 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc412d6b0 con 0x558bc429d020 2024-09-07T03:32:38.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.352+0000 7fbe7775c640 1 --2- 172.21.15.120:0/3748217496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429d020 0x558bc42a5b40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800a470 tx=0x7fbe68045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67dc6c3bd11c752 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.352+0000 7fbe7f75c640 1 -- 172.21.15.120:0/3748217496 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe68053570 con 0x558bc429d020 2024-09-07T03:32:38.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.352+0000 7fbe7f75c640 1 -- 172.21.15.120:0/3748217496 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe68058070 con 0x558bc429d020 2024-09-07T03:32:38.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.352+0000 7fbe7f75c640 1 -- 172.21.15.120:0/3748217496 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe68053880 con 0x558bc429d020 2024-09-07T03:32:38.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.353+0000 7fbe84328800 1 -- 172.21.15.120:0/3748217496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429d020 msgr2=0x558bc42a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.353+0000 7fbe84328800 1 --2- 172.21.15.120:0/3748217496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429d020 0x558bc42a5b40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800a470 tx=0x7fbe68045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:38.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.353+0000 7fbe84328800 1 -- 172.21.15.120:0/3748217496 shutdown_connections 2024-09-07T03:32:38.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.353+0000 7fbe84328800 1 --2- 172.21.15.120:0/3748217496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429d020 0x558bc42a5b40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.353+0000 7fbe84328800 1 -- 172.21.15.120:0/3748217496 >> 172.21.15.120:0/3748217496 conn(0x558bc4297210 msgr2=0x558bc4299650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.353+0000 7fbe84328800 1 -- 172.21.15.120:0/3748217496 shutdown_connections 2024-09-07T03:32:38.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.353+0000 7fbe84328800 1 -- 172.21.15.120:0/3748217496 wait complete. 2024-09-07T03:32:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.366+0000 7fbe84328800 1 Processor -- start 2024-09-07T03:32:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.367+0000 7fbe84328800 1 -- start start 2024-09-07T03:32:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.367+0000 7fbe84328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc438e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.367+0000 7fbe84328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558bc4135dd0 con 0x558bc429b500 2024-09-07T03:32:38.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.367+0000 7fbe7ff5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc438e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.367+0000 7fbe7ff5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc438e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52008/0 (socket says 172.21.15.120:52008) 2024-09-07T03:32:38.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.367+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3650119576 learned_addr learned my addr 172.21.15.120:0/3650119576 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.367+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3650119576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc414ee10 con 0x558bc429b500 2024-09-07T03:32:38.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.367+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/3650119576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc438e620 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbe70001ea0 tx=0x7fbe7000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7e0121030396bc server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbd6de0b640 1 -- 172.21.15.120:0/3650119576 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe70008070 con 0x558bc429b500 2024-09-07T03:32:38.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbd6de0b640 1 -- 172.21.15.120:0/3650119576 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7000d500 con 0x558bc429b500 2024-09-07T03:32:38.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbd6de0b640 1 -- 172.21.15.120:0/3650119576 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7000d880 con 0x558bc429b500 2024-09-07T03:32:38.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbe84328800 1 -- 172.21.15.120:0/3650119576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 msgr2=0x558bc438e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbe84328800 1 --2- 172.21.15.120:0/3650119576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc438e620 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbe70001ea0 tx=0x7fbe7000b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbe84328800 1 -- 172.21.15.120:0/3650119576 shutdown_connections 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbe84328800 1 --2- 172.21.15.120:0/3650119576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc438e620 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbe84328800 1 -- 172.21.15.120:0/3650119576 >> 172.21.15.120:0/3650119576 conn(0x558bc4297210 msgr2=0x558bc4389fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbe84328800 1 -- 172.21.15.120:0/3650119576 shutdown_connections 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.368+0000 7fbe84328800 1 -- 172.21.15.120:0/3650119576 wait complete. 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.369+0000 7fbe84328800 1 Processor -- start 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.369+0000 7fbe84328800 1 -- start start 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.369+0000 7fbe84328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc4395f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.369+0000 7fbe84328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558bc42a6380 con 0x558bc429b500 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.369+0000 7fbe7ff5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc4395f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.369+0000 7fbe7ff5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc4395f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52020/0 (socket says 172.21.15.120:52020) 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.369+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/2639333638 learned_addr learned my addr 172.21.15.120:0/2639333638 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.369+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/2639333638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc43964a0 con 0x558bc429b500 2024-09-07T03:32:38.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.370+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc4395f40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbe700012f0 tx=0x7fbe70000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.370+0000 7fbd67fff640 1 -- 172.21.15.120:0/2639333638 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7000f9d0 con 0x558bc429b500 2024-09-07T03:32:38.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.370+0000 7fbd67fff640 1 -- 172.21.15.120:0/2639333638 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7000fb70 con 0x558bc429b500 2024-09-07T03:32:38.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.370+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bc4396730 con 0x558bc429b500 2024-09-07T03:32:38.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.370+0000 7fbd67fff640 1 -- 172.21.15.120:0/2639333638 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7000fe50 con 0x558bc429b500 2024-09-07T03:32:38.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.370+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc4397130 con 0x558bc429b500 2024-09-07T03:32:38.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.371+0000 7fbd67fff640 1 -- 172.21.15.120:0/2639333638 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbe70017040 con 0x558bc429b500 2024-09-07T03:32:38.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.371+0000 7fbd67fff640 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd6803c920 0x7fbd6803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.371+0000 7fbd67fff640 1 -- 172.21.15.120:0/2639333638 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fbe70015020 con 0x558bc429b500 2024-09-07T03:32:38.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.371+0000 7fbe7775c640 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd6803c920 0x7fbd6803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.371+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc429d020 0x558bc439d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.371+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc439dad0 con 0x558bc429d020 2024-09-07T03:32:38.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.371+0000 7fbe8075e640 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc429d020 0x558bc439d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.371+0000 7fbe7775c640 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd6803c920 0x7fbd6803ede0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe68057000 tx=0x7fbe68052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.371+0000 7fbe8075e640 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc429d020 0x558bc439d590 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.372+0000 7fbe8075e640 1 -- 172.21.15.120:0/2639333638 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe7800a4d0 con 0x558bc429d020 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.372+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc439e380 0x558bc43a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.372+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43a0fb0 con 0x558bc439e380 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.372+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc439e380 0x558bc43a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.372+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc439e380 0x558bc43a0840 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.372+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/2639333638 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc439e380 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.372+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43a2860 con 0x558bc439e380 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.373+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/2639333638 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc439e380 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.373+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43a19d0 con 0x558bc439e380 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.373+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/2639333638 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc439e380 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.373+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43a1df0 con 0x558bc429d020 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.374+0000 7fbe8075e640 1 -- 172.21.15.120:0/2639333638 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe7800a4d0 con 0x558bc429d020 2024-09-07T03:32:38.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.374+0000 7fbe84328800 1 Processor -- start 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.374+0000 7fbe84328800 1 -- start start 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.374+0000 7fbe84328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43b0d10 0x558bc43b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.374+0000 7fbe84328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558bc4193a00 con 0x558bc43b0d10 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.374+0000 7fbe8075e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43b0d10 0x558bc43b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.374+0000 7fbe8075e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43b0d10 0x558bc43b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52034/0 (socket says 172.21.15.120:52034) 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.374+0000 7fbe8075e640 1 -- 172.21.15.120:0/3456419281 learned_addr learned my addr 172.21.15.120:0/3456419281 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.374+0000 7fbe8075e640 1 -- 172.21.15.120:0/3456419281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc43b1770 con 0x558bc43b0d10 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.375+0000 7fbe8075e640 1 --2- 172.21.15.120:0/3456419281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43b0d10 0x558bc43b1130 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbe78016d20 tx=0x7fbe7800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.375+0000 7fbd657fa640 1 -- 172.21.15.120:0/3456419281 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe78017660 con 0x558bc43b0d10 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.375+0000 7fbd657fa640 1 -- 172.21.15.120:0/3456419281 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7801b030 con 0x558bc43b0d10 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.375+0000 7fbd657fa640 1 -- 172.21.15.120:0/3456419281 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe78017950 con 0x558bc43b0d10 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.375+0000 7fbe84328800 1 -- 172.21.15.120:0/3456419281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bc43b1fa0 con 0x558bc43b0d10 2024-09-07T03:32:38.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.375+0000 7fbe84328800 1 -- 172.21.15.120:0/3456419281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc43b2540 con 0x558bc43b0d10 2024-09-07T03:32:38.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.376+0000 7fbd657fa640 1 -- 172.21.15.120:0/3456419281 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbe78017af0 con 0x558bc43b0d10 2024-09-07T03:32:38.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.376+0000 7fbd657fa640 1 --2- 172.21.15.120:0/3456419281 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd5803c780 0x7fbd5803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.376+0000 7fbd657fa640 1 -- 172.21.15.120:0/3456419281 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fbe7800e040 con 0x558bc43b0d10 2024-09-07T03:32:38.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.376+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/3456419281 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd5803c780 0x7fbd5803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.376+0000 7fbe84328800 1 Processor -- start 2024-09-07T03:32:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.376+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/3456419281 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd5803c780 0x7fbd5803ec40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x558bc43a14f0 tx=0x7fbe7000ed70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.376+0000 7fbe84328800 1 -- start start 2024-09-07T03:32:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.376+0000 7fbe84328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43bdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.376+0000 7fbe84328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558bc438ee70 con 0x558bc43bd7b0 2024-09-07T03:32:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.377+0000 7fbe8075e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43bdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.377+0000 7fbe8075e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43bdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52042/0 (socket says 172.21.15.120:52042) 2024-09-07T03:32:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.377+0000 7fbe8075e640 1 -- 172.21.15.120:0/3041454277 learned_addr learned my addr 172.21.15.120:0/3041454277 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.377+0000 7fbe8075e640 1 -- 172.21.15.120:0/3041454277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc43be1a0 con 0x558bc43bd7b0 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.377+0000 7fbe8075e640 1 --2- 172.21.15.120:0/3041454277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43bdbb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbe78053de0 tx=0x7fbe78054030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25a350c373c85d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.377+0000 7fbd5effd640 1 -- 172.21.15.120:0/3041454277 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7804b070 con 0x558bc43bd7b0 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.377+0000 7fbd5effd640 1 -- 172.21.15.120:0/3041454277 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe78014d40 con 0x558bc43bd7b0 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.377+0000 7fbd5effd640 1 -- 172.21.15.120:0/3041454277 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe78052070 con 0x558bc43bd7b0 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 -- 172.21.15.120:0/3041454277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 msgr2=0x558bc43bdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 --2- 172.21.15.120:0/3041454277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43bdbb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbe78053de0 tx=0x7fbe78054030 comp rx=0 tx=0).stop 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 -- 172.21.15.120:0/3041454277 shutdown_connections 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 --2- 172.21.15.120:0/3041454277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43bdbb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 -- 172.21.15.120:0/3041454277 >> 172.21.15.120:0/3041454277 conn(0x558bc43b9bb0 msgr2=0x558bc43b7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 -- 172.21.15.120:0/3041454277 shutdown_connections 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 -- 172.21.15.120:0/3041454277 wait complete. 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 Processor -- start 2024-09-07T03:32:38.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 -- start start 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe84328800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558bc43be7c0 con 0x558bc43bd7b0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe8075e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe8075e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52048/0 (socket says 172.21.15.120:52048) 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 learned_addr learned my addr 172.21.15.120:0/3489252012 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.378+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc43c5380 con 0x558bc43bd7b0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.379+0000 7fbe8075e640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43c4e20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbe78052c30 tx=0x7fbe78053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.379+0000 7fbd5d7fa640 1 -- 172.21.15.120:0/3489252012 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7804b070 con 0x558bc43bd7b0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.379+0000 7fbd5d7fa640 1 -- 172.21.15.120:0/3489252012 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7802e070 con 0x558bc43bd7b0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.379+0000 7fbd5d7fa640 1 -- 172.21.15.120:0/3489252012 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe780127a0 con 0x558bc43bd7b0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.379+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bc43c5610 con 0x558bc43bd7b0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.379+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc43c61a0 con 0x558bc43bd7b0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.379+0000 7fbd5d7fa640 1 -- 172.21.15.120:0/3489252012 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbe78012940 con 0x558bc43bd7b0 2024-09-07T03:32:38.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.380+0000 7fbd5d7fa640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd4803c780 0x7fbd4803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.380+0000 7fbd5d7fa640 1 -- 172.21.15.120:0/3489252012 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fbe78034cd0 con 0x558bc43bd7b0 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.380+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd4803c780 0x7fbd4803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.380+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd4803c780 0x7fbd4803ec40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000bbf0 tx=0x7fbe7003f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.380+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.380+0000 7fbe84328800 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc43d0930 0x558bc43d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.380+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43d3540 con 0x558bc43d0930 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.380+0000 7fbe7775c640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc43d0930 0x558bc43d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe7775c640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc43d0930 0x558bc43d2df0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 20 realm 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43d3970 con 0x558bc43d0930 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43d4240 con 0x558bc43d0930 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc43d4c60 0x558bc43d7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.381+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43d7800 con 0x558bc43d4c60 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.382+0000 7fbe8075e640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc43d4c60 0x558bc43d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.382+0000 7fbe8075e640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc43d4c60 0x558bc43d7090 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.382+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.382+0000 7fbe84328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.382+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.382+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43d8050 con 0x558bc43d4c60 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.382+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.382+0000 7fbe84328800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe84328800 20 searching for the correct realm 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe84328800 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558bc43d9dc0 0x558bc43dc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d9dc0 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558bc43d9dc0 0x558bc43dc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe7ff5d640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558bc43d9dc0 0x558bc43dc210 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d4c60 2024-09-07T03:32:38.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe8075e640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbe78014440 0x7fbe78029a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.383+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x7fbe78014440 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.384+0000 7fbe7775c640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbe78014440 0x7fbe78029a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.384+0000 7fbe7775c640 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbe78014440 0x7fbe78029a70 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.384+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.384+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.384+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.384+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.384+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.384+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d9dc0 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.385+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.385+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.385+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.385+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d4c60 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.385+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.385+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d4c60 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.385+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.385+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.386+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.386+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x7fbe78014440 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.386+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.386+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.386+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.386+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x7fbe78014440 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.386+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.386+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d4c60 2024-09-07T03:32:38.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d9dc0 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d4c60 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d9dc0 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.387+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.388+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.388+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.388+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.388+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.388+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.388+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d9dc0 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.388+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.388+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x7fbe78014440 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d0930 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x7fbe78014440 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d9dc0 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x7fbe78014440 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.389+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d4c60 2024-09-07T03:32:38.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.390+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.390+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d4c60 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.390+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.390+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d9dc0 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.390+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.390+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d4c60 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dc8e0 con 0x558bc43d4c60 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:38.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43d89d0 con 0x558bc43d0930 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43d8610 con 0x558bc43d4c60 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.391+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43d8e10 con 0x558bc43d0930 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 20 zone default found 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 4 Realm: () 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 20 zonegroup default 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43dd210 con 0x7fbe78014440 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43df450 con 0x558bc43d9dc0 2024-09-07T03:32:38.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.392+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43df7f0 con 0x558bc43d9dc0 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.393+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.393+0000 7fbe84328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.393+0000 7fbe84328800 20 started sync module instance, tier type = 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.393+0000 7fbe84328800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.393+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43de890 con 0x558bc43d4c60 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.394+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.394+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94058781208000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43de890 con 0x558bc43d4c60 2024-09-07T03:32:38.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.394+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43de890 con 0x558bc43d0930 2024-09-07T03:32:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.395+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.395+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94058781213232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e0b00 con 0x558bc43d0930 2024-09-07T03:32:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.395+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e1580 con 0x558bc43d4c60 2024-09-07T03:32:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.395+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94058781208000] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.396+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94058781213232] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.399+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.399+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94058781216880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e0650 con 0x558bc43d4c60 2024-09-07T03:32:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.399+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e1b60 con 0x7fbe78014440 2024-09-07T03:32:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.402+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94058781216880] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.407+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.407+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94058781205472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e1b60 con 0x7fbe78014440 2024-09-07T03:32:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.407+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e2520 con 0x558bc43d4c60 2024-09-07T03:32:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.408+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94058781205472] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.411+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.411+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94058781218960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e2520 con 0x558bc43d4c60 2024-09-07T03:32:38.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.411+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e2ee0 con 0x558bc43d9dc0 2024-09-07T03:32:38.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.412+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.412+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94058781223472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e3730 con 0x558bc43d9dc0 2024-09-07T03:32:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.412+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e41f0 con 0x558bc43d9dc0 2024-09-07T03:32:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.413+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.413+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94058781228320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e4ac0 con 0x558bc43d9dc0 2024-09-07T03:32:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.413+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94058781223472] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.413+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e5590 con 0x7fbe78014440 2024-09-07T03:32:38.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94058781228320] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94058781218960] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94058781233280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e4610 con 0x7fbe78014440 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe84328800 20 add_watcher() i=0 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe84328800 20 add_watcher() i=1 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe84328800 20 add_watcher() i=2 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe84328800 20 add_watcher() i=3 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe84328800 20 add_watcher() i=4 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe84328800 20 add_watcher() i=5 2024-09-07T03:32:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.416+0000 7fbe84328800 20 add_watcher() i=6 2024-09-07T03:32:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.417+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94058781233280] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.417+0000 7fbe84328800 20 add_watcher() i=7 2024-09-07T03:32:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.417+0000 7fbe84328800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.417+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e4610 con 0x558bc43d0930 2024-09-07T03:32:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.417+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.417+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94058781220976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc43e4610 con 0x558bc43d0930 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94058781220976] v34'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbd35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbe84328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbe84328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbe84328800 5 note: GC not initialized 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbd34fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbe84328800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbe84328800 20 Filter name: none 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbcae7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbe84328800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.419+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc441b190 con 0x558bc43d9dc0 2024-09-07T03:32:38.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 20 rados_obj.operate() r=0 bl.length=419 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc441ccb0 con 0x7fbe78014440 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 : miss 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.420+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc441e830 con 0x558bc43d0930 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.421+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.421+0000 7fbe84328800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.421+0000 7fbe84328800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.421+0000 7fbe84328800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.421+0000 7fbe84328800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.421+0000 7fbe84328800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.421+0000 7fbe84328800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.421+0000 7fbe84328800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.421+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4422dd0 con 0x7fbe78014440 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.422+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(65 foo.buckets [call] v34'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.422+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:66 8.1c 8:3b53f263:root::.bucket.meta.testx%3amyfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc44266e0 con 0x558bc43d9dc0 2024-09-07T03:32:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.423+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [create,call,writefull 0~420,setxattr (203)] v34'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.423+0000 7fbe84328800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x7 2024-09-07T03:32:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.423+0000 7fbe84328800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.423+0000 7fbe84328800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-07T03:32:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.423+0000 7fbe84328800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1, ofs0, ns] 2024-09-07T03:32:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.423+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94058781492496 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc44260d0 con 0x558bc43d4c60 2024-09-07T03:32:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94058781216880 notify 146028888084 ret 0) ==== 897+0+0 (crc 0 0 0) 0x558bc43c61a0 con 0x558bc43d4c60 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbd5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94058781216880 notifier 4540 bl.length()=855 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbd5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x7 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbd5effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbd5effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbd5effd640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbd44003ea0 con 0x558bc43d4c60 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 notify.2 [notify cookie 94058781492496 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94058781492496 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558bc43c5610 con 0x558bc43d4c60 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbe84328800 20 handle_bi_update(): bucket=testx:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_sources= new_sources= 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbe84328800 20 handle_bi_update(): bucket=testx:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential sources added=[] removed=[] 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbe84328800 20 handle_bi_update(): bucket=testx:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_dests= new_dests= 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbe84328800 20 handle_bi_update(): bucket=testx:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential dests added=[] removed=[] 2024-09-07T03:32:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.424+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc44261d0 con 0x558bc43d0930 2024-09-07T03:32:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.425+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v34'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.425+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc44261d0 con 0x558bc43d0930 2024-09-07T03:32:38.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.430+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.430+0000 7fbe84328800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-07T03:32:38.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.430+0000 7fbe84328800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-07T03:32:38.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.430+0000 7fbe84328800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-07T03:32:38.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.430+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94058781498656 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc4426140 con 0x558bc43d4c60 2024-09-07T03:32:38.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.431+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== watch-notify(notify (1) cookie 94058781218960 notify 146028888085 ret 0) ==== 390+0+0 (crc 0 0 0) 0x7fbe78069040 con 0x558bc43d4c60 2024-09-07T03:32:38.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.431+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(71 notify.4 [notify cookie 94058781498656 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.431+0000 7fbd5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94058781218960 notifier 4540 bl.length()=348 2024-09-07T03:32:38.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.431+0000 7fbd5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-07T03:32:38.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.431+0000 7fbd5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-07T03:32:38.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.431+0000 7fbd5e7fc640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbcb4003400 con 0x558bc43d4c60 2024-09-07T03:32:38.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.431+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== watch-notify(notify_complete (2) cookie 94058781498656 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558bc43c5610 con 0x558bc43d4c60 2024-09-07T03:32:38.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.431+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.431+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc44261d0 con 0x7fbe78014440 2024-09-07T03:32:38.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.432+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(73 myfoo [call,delete] v34'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.432+0000 7fbe84328800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.432+0000 7fbe84328800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.432+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94058781498656 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc4426140 con 0x558bc43d9dc0 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.433+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== watch-notify(notify (1) cookie 94058781228320 notify 146028888078 ret 0) ==== 191+0+0 (crc 0 0 0) 0x558bc4426a80 con 0x558bc43d9dc0 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.433+0000 7fbd5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94058781228320 notifier 4540 bl.length()=149 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.433+0000 7fbd5e7fc640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbcb4003400 con 0x558bc43d9dc0 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.433+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(74 notify.6 [notify cookie 94058781498656 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.433+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.433+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== watch-notify(notify_complete (2) cookie 94058781498656 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558bc44228d0 con 0x558bc43d9dc0 2024-09-07T03:32:38.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.433+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc44261d0 con 0x558bc43d0930 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.434+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(76 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call,delete] v34'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.434+0000 7fbe84328800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 from cache 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.434+0000 7fbe84328800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1, ofs0, ns] 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.434+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94058781470384 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558bc44261d0 con 0x7fbe78014440 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.434+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== watch-notify(notify (1) cookie 94058781205472 notify 146028888076 ret 0) ==== 248+0+0 (crc 0 0 0) 0x558bc4426570 con 0x7fbe78014440 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.434+0000 7fbd5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94058781205472 notifier 4540 bl.length()=206 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.434+0000 7fbd5effd640 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbd44003ea0 con 0x7fbe78014440 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.434+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(77 notify.3 [notify cookie 94058781470384 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.435+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.435+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== watch-notify(notify_complete (2) cookie 94058781470384 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558bc4425520 con 0x7fbe78014440 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.435+0000 7fbd35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.435+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94058781220976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4418ec0 con 0x558bc43d0930 2024-09-07T03:32:38.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.437+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94058781220976] v34'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.437+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94058781208000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4418ec0 con 0x558bc43d4c60 2024-09-07T03:32:38.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.438+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94058781208000] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.438+0000 7fbe84328800 20 remove_watcher() i=0 2024-09-07T03:32:38.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.438+0000 7fbe84328800 2 removed watcher, disabling cache 2024-09-07T03:32:38.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.438+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94058781213232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4418ec0 con 0x558bc43d0930 2024-09-07T03:32:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.443+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94058781213232] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x558bc43d0930 2024-09-07T03:32:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.443+0000 7fbe84328800 20 remove_watcher() i=1 2024-09-07T03:32:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.443+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94058781216880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4418ec0 con 0x558bc43d4c60 2024-09-07T03:32:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.444+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94058781216880] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.444+0000 7fbe84328800 20 remove_watcher() i=2 2024-09-07T03:32:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.444+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94058781205472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4418ec0 con 0x7fbe78014440 2024-09-07T03:32:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.447+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94058781205472] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.447+0000 7fbe84328800 20 remove_watcher() i=3 2024-09-07T03:32:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.447+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94058781218960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4418ec0 con 0x558bc43d4c60 2024-09-07T03:32:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.450+0000 7fbe8075e640 1 -- 172.21.15.120:0/3489252012 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94058781218960] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78027070 con 0x558bc43d4c60 2024-09-07T03:32:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.450+0000 7fbe84328800 20 remove_watcher() i=4 2024-09-07T03:32:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.450+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94058781223472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4418ec0 con 0x558bc43d9dc0 2024-09-07T03:32:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.451+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94058781223472] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.451+0000 7fbe84328800 20 remove_watcher() i=5 2024-09-07T03:32:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.451+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94058781228320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4418ec0 con 0x558bc43d9dc0 2024-09-07T03:32:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.452+0000 7fbe7ff5d640 1 -- 172.21.15.120:0/3489252012 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94058781228320] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7002d070 con 0x558bc43d9dc0 2024-09-07T03:32:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.452+0000 7fbe84328800 20 remove_watcher() i=6 2024-09-07T03:32:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.452+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94058781233280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558bc4418ec0 con 0x7fbe78014440 2024-09-07T03:32:38.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94058781233280] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68051070 con 0x7fbe78014440 2024-09-07T03:32:38.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 20 remove_watcher() i=7 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc43d4c60 msgr2=0x558bc43d7090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc43d4c60 0x558bc43d7090 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc43d0930 msgr2=0x558bc43d2df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc43d0930 0x558bc43d2df0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbe78014440 msgr2=0x7fbe78029a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fbe78014440 0x7fbe78029a70 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558bc43d9dc0 msgr2=0x558bc43dc210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558bc43d9dc0 0x558bc43dc210 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd4803c780 msgr2=0x7fbd4803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd4803c780 0x7fbd4803ec40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000bbf0 tx=0x7fbe7003f000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 msgr2=0x558bc43c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 --2- 172.21.15.120:0/3489252012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43bd7b0 0x558bc43c4e20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbe78052c30 tx=0x7fbe78053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 reap_dead start 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe7775c640 1 -- 172.21.15.120:0/3489252012 reap_dead start 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 shutdown_connections 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 >> 172.21.15.120:0/3489252012 conn(0x558bc43b9bb0 msgr2=0x558bc43b7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 shutdown_connections 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.453+0000 7fbe84328800 1 -- 172.21.15.120:0/3489252012 wait complete. 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/3456419281 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd5803c780 msgr2=0x7fbd5803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/3456419281 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd5803c780 0x7fbd5803ec40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x558bc43a14f0 tx=0x7fbe7000ed70 comp rx=0 tx=0).stop 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/3456419281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43b0d10 msgr2=0x558bc43b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/3456419281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43b0d10 0x558bc43b1130 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbe78016d20 tx=0x7fbe7800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/3456419281 shutdown_connections 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/3456419281 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd5803c780 0x7fbd5803ec40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/3456419281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc43b0d10 0x558bc43b1130 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/3456419281 >> 172.21.15.120:0/3456419281 conn(0x558bc43a50c0 msgr2=0x558bc43a54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/3456419281 shutdown_connections 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/3456419281 wait complete. 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc439e380 msgr2=0x558bc43a0840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc439e380 0x558bc43a0840 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc429d020 msgr2=0x558bc439d590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc429d020 0x558bc439d590 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd6803c920 msgr2=0x7fbd6803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd6803c920 0x7fbd6803ede0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe68057000 tx=0x7fbe68052000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 msgr2=0x558bc4395f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc4395f40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbe700012f0 tx=0x7fbe70000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 shutdown_connections 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558bc439e380 0x558bc43a0840 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558bc429d020 0x558bc439d590 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd6803c920 0x7fbd6803ede0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 --2- 172.21.15.120:0/2639333638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558bc429b500 0x558bc4395f40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 >> 172.21.15.120:0/2639333638 conn(0x558bc4297210 msgr2=0x558bc438f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 shutdown_connections 2024-09-07T03:32:38.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.454+0000 7fbe84328800 1 -- 172.21.15.120:0/2639333638 wait complete. 2024-09-07T03:32:38.465 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-07T03:32:38.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-07T03:32:38.466 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-07T03:32:38.509 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:38.509 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:38.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.507+0000 7efdc81af800 1 Processor -- start 2024-09-07T03:32:38.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.507+0000 7efdc81af800 1 -- start start 2024-09-07T03:32:38.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.507+0000 7efdc81af800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56360490bff0 0x56360490cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.507+0000 7efdc81af800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5636047b5e40 con 0x56360490d0f0 2024-09-07T03:32:38.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.507+0000 7efdc81af800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x563604780680 con 0x56360490bff0 2024-09-07T03:32:38.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.508+0000 7efdc5c99640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56360490bff0 0x56360490cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.508+0000 7efdbd498640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56360490d0f0 0x563604911e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42252/0 (socket says 172.21.15.120:42252) 2024-09-07T03:32:38.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.508+0000 7efdbd498640 1 -- 172.21.15.120:0/3344802336 learned_addr learned my addr 172.21.15.120:0/3344802336 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:38.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.508+0000 7efdc5c99640 1 -- 172.21.15.120:0/3344802336 >> v1:172.21.15.104:6789/0 conn(0x56360490d0f0 legacy=0x563604911e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.508+0000 7efdc5c99640 1 -- 172.21.15.120:0/3344802336 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56360479c6b0 con 0x56360490bff0 2024-09-07T03:32:38.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.508+0000 7efdc5498640 1 -- 172.21.15.120:0/3344802336 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256362926 0 0) 0x5636047b5e40 con 0x56360490d0f0 2024-09-07T03:32:38.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc5c99640 1 --2- 172.21.15.120:0/3344802336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x56360490cbb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efdb800a470 tx=0x7efdb8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dc3d5c5d116cce server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc5498640 1 -- 172.21.15.120:0/3344802336 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb8053570 con 0x56360490bff0 2024-09-07T03:32:38.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc5498640 1 -- 172.21.15.120:0/3344802336 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb8058070 con 0x56360490bff0 2024-09-07T03:32:38.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc5498640 1 -- 172.21.15.120:0/3344802336 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb8053880 con 0x56360490bff0 2024-09-07T03:32:38.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc81af800 1 -- 172.21.15.120:0/3344802336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 msgr2=0x56360490cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc81af800 1 --2- 172.21.15.120:0/3344802336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x56360490cbb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efdb800a470 tx=0x7efdb8045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:38.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc81af800 1 -- 172.21.15.120:0/3344802336 shutdown_connections 2024-09-07T03:32:38.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc81af800 1 --2- 172.21.15.120:0/3344802336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x56360490cbb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc81af800 1 -- 172.21.15.120:0/3344802336 >> 172.21.15.120:0/3344802336 conn(0x5636049073c0 msgr2=0x563604909820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc81af800 1 -- 172.21.15.120:0/3344802336 shutdown_connections 2024-09-07T03:32:38.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.510+0000 7efdc81af800 1 -- 172.21.15.120:0/3344802336 wait complete. 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.524+0000 7efdc81af800 1 Processor -- start 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.524+0000 7efdc81af800 1 -- start start 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.524+0000 7efdc81af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x5636048816d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.524+0000 7efdc81af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5636047a4dd0 con 0x56360490bff0 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.525+0000 7efdc5c99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x5636048816d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.525+0000 7efdc5c99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x5636048816d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52064/0 (socket says 172.21.15.120:52064) 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.525+0000 7efdc5c99640 1 -- 172.21.15.120:0/1036681700 learned_addr learned my addr 172.21.15.120:0/1036681700 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.525+0000 7efdc5c99640 1 -- 172.21.15.120:0/1036681700 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636047bde10 con 0x56360490bff0 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.525+0000 7efdc5c99640 1 --2- 172.21.15.120:0/1036681700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x5636048816d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efdb8025c20 tx=0x7efdb8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac19566cb6a4877 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.525+0000 7efcb3e07640 1 -- 172.21.15.120:0/1036681700 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb8053a20 con 0x56360490bff0 2024-09-07T03:32:38.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.525+0000 7efcb3e07640 1 -- 172.21.15.120:0/1036681700 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb8063070 con 0x56360490bff0 2024-09-07T03:32:38.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.525+0000 7efcb3e07640 1 -- 172.21.15.120:0/1036681700 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb8053d30 con 0x56360490bff0 2024-09-07T03:32:38.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 -- 172.21.15.120:0/1036681700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 msgr2=0x5636048816d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 --2- 172.21.15.120:0/1036681700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x5636048816d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efdb8025c20 tx=0x7efdb8051000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 -- 172.21.15.120:0/1036681700 shutdown_connections 2024-09-07T03:32:38.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 --2- 172.21.15.120:0/1036681700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x5636048816d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 -- 172.21.15.120:0/1036681700 >> 172.21.15.120:0/1036681700 conn(0x5636049073c0 msgr2=0x5636049f6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 -- 172.21.15.120:0/1036681700 shutdown_connections 2024-09-07T03:32:38.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 -- 172.21.15.120:0/1036681700 wait complete. 2024-09-07T03:32:38.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 Processor -- start 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 -- start start 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x563604a04fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.526+0000 7efdc81af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56360490d7e0 con 0x56360490bff0 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efdc5c99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x563604a04fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efdc5c99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x563604a04fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52072/0 (socket says 172.21.15.120:52072) 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efdc5c99640 1 -- 172.21.15.120:0/829232691 learned_addr learned my addr 172.21.15.120:0/829232691 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efdc5c99640 1 -- 172.21.15.120:0/829232691 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563604a05520 con 0x56360490bff0 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efdc5c99640 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x563604a04fc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efdb8025c20 tx=0x7efdb8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efcb2604640 1 -- 172.21.15.120:0/829232691 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb8078070 con 0x56360490bff0 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efcb2604640 1 -- 172.21.15.120:0/829232691 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb8073470 con 0x56360490bff0 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563604a057b0 con 0x56360490bff0 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efcb2604640 1 -- 172.21.15.120:0/829232691 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb8073750 con 0x56360490bff0 2024-09-07T03:32:38.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.527+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563604a063c0 con 0x56360490bff0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.528+0000 7efcb2604640 1 -- 172.21.15.120:0/829232691 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efdb807b070 con 0x56360490bff0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.528+0000 7efcb2604640 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efcac03c780 0x7efcac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.528+0000 7efcb2604640 1 -- 172.21.15.120:0/829232691 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7efdb8097ba0 con 0x56360490bff0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.528+0000 7efdbd498640 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efcac03c780 0x7efcac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.529+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56360490d0f0 0x563604a0c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.529+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a06d80 con 0x56360490d0f0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.529+0000 7efdc649a640 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56360490d0f0 0x563604a0c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.529+0000 7efdbd498640 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efcac03c780 0x7efcac03ec40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efdb0000c00 tx=0x7efdb00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.529+0000 7efdc649a640 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56360490d0f0 0x563604a0c610 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.529+0000 7efdc649a640 1 -- 172.21.15.120:0/829232691 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc000a4d0 con 0x56360490d0f0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.529+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a0d540 0x563604a0f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.529+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a0ff60 con 0x563604a0d540 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.530+0000 7efdc5c99640 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a0d540 0x563604a0f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.530+0000 7efdc5c99640 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a0d540 0x563604a0f930 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.530+0000 7efdc5c99640 1 -- 172.21.15.120:0/829232691 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdb807a030 con 0x563604a0d540 2024-09-07T03:32:38.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.530+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a11810 con 0x563604a0d540 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.531+0000 7efdc5c99640 1 -- 172.21.15.120:0/829232691 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efdb807a030 con 0x563604a0d540 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.531+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a10980 con 0x563604a0d540 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.531+0000 7efdc5c99640 1 -- 172.21.15.120:0/829232691 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdb807a030 con 0x563604a0d540 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.531+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a10da0 con 0x56360490d0f0 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.531+0000 7efdc649a640 1 -- 172.21.15.120:0/829232691 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efdc000a4d0 con 0x56360490d0f0 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.532+0000 7efdc81af800 1 Processor -- start 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.532+0000 7efdc81af800 1 -- start start 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.532+0000 7efdc81af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a1fcd0 0x563604a200f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.532+0000 7efdc81af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563604802a00 con 0x563604a1fcd0 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.532+0000 7efdc649a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a1fcd0 0x563604a200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.532+0000 7efdc649a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a1fcd0 0x563604a200f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52086/0 (socket says 172.21.15.120:52086) 2024-09-07T03:32:38.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.532+0000 7efdc649a640 1 -- 172.21.15.120:0/694989269 learned_addr learned my addr 172.21.15.120:0/694989269 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.532+0000 7efdc649a640 1 -- 172.21.15.120:0/694989269 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563604a20730 con 0x563604a1fcd0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.533+0000 7efdc649a640 1 --2- 172.21.15.120:0/694989269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a1fcd0 0x563604a200f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efdc0016d20 tx=0x7efdc000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.533+0000 7efcab7fe640 1 -- 172.21.15.120:0/694989269 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0017660 con 0x563604a1fcd0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.533+0000 7efcab7fe640 1 -- 172.21.15.120:0/694989269 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc001b030 con 0x563604a1fcd0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.533+0000 7efdc81af800 1 -- 172.21.15.120:0/694989269 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563604a20f60 con 0x563604a1fcd0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.533+0000 7efcab7fe640 1 -- 172.21.15.120:0/694989269 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0017950 con 0x563604a1fcd0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.533+0000 7efdc81af800 1 -- 172.21.15.120:0/694989269 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563604a21500 con 0x563604a1fcd0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.534+0000 7efcab7fe640 1 -- 172.21.15.120:0/694989269 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efdc0017af0 con 0x563604a1fcd0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.534+0000 7efcab7fe640 1 --2- 172.21.15.120:0/694989269 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efca003c780 0x7efca003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.534+0000 7efcab7fe640 1 -- 172.21.15.120:0/694989269 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7efdc000e040 con 0x563604a1fcd0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.534+0000 7efdc5c99640 1 --2- 172.21.15.120:0/694989269 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efca003c780 0x7efca003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.534+0000 7efdc81af800 1 Processor -- start 2024-09-07T03:32:38.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.534+0000 7efdc81af800 1 -- start start 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.534+0000 7efdc5c99640 1 --2- 172.21.15.120:0/694989269 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efca003c780 0x7efca003ec40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x563604a0cd00 tx=0x7efdb808b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.534+0000 7efdc81af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a2cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.534+0000 7efdc81af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56360487ff70 con 0x563604a2c7d0 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efdc649a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a2cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efdc649a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a2cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52094/0 (socket says 172.21.15.120:52094) 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efdc649a640 1 -- 172.21.15.120:0/29259414 learned_addr learned my addr 172.21.15.120:0/29259414 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efdc649a640 1 -- 172.21.15.120:0/29259414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563604a2d1c0 con 0x563604a2c7d0 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efdc649a640 1 --2- 172.21.15.120:0/29259414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a2cbd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efdc0053e00 tx=0x7efdc0017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c43bfd136beba3d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efca97fa640 1 -- 172.21.15.120:0/29259414 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0014d40 con 0x563604a2c7d0 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efca97fa640 1 -- 172.21.15.120:0/29259414 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc0051070 con 0x563604a2c7d0 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efca97fa640 1 -- 172.21.15.120:0/29259414 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc00149b0 con 0x563604a2c7d0 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efdc81af800 1 -- 172.21.15.120:0/29259414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 msgr2=0x563604a2cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.535+0000 7efdc81af800 1 --2- 172.21.15.120:0/29259414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a2cbd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efdc0053e00 tx=0x7efdc0017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc81af800 1 -- 172.21.15.120:0/29259414 shutdown_connections 2024-09-07T03:32:38.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc81af800 1 --2- 172.21.15.120:0/29259414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a2cbd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc81af800 1 -- 172.21.15.120:0/29259414 >> 172.21.15.120:0/29259414 conn(0x563604a28bd0 msgr2=0x563604a26e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc81af800 1 -- 172.21.15.120:0/29259414 shutdown_connections 2024-09-07T03:32:38.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc81af800 1 -- 172.21.15.120:0/29259414 wait complete. 2024-09-07T03:32:38.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc81af800 1 Processor -- start 2024-09-07T03:32:38.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc81af800 1 -- start start 2024-09-07T03:32:38.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc81af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a33e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc81af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563604a2d7e0 con 0x563604a2c7d0 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc649a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a33e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc649a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a33e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52100/0 (socket says 172.21.15.120:52100) 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 learned_addr learned my addr 172.21.15.120:0/878483879 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.536+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563604a343a0 con 0x563604a2c7d0 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.537+0000 7efdc649a640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a33e40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efdc0012500 tx=0x7efdc0053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.537+0000 7efc977fe640 1 -- 172.21.15.120:0/878483879 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0012570 con 0x563604a2c7d0 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.537+0000 7efc977fe640 1 -- 172.21.15.120:0/878483879 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc002e070 con 0x563604a2c7d0 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.537+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563604a34630 con 0x563604a2c7d0 2024-09-07T03:32:38.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.537+0000 7efc977fe640 1 -- 172.21.15.120:0/878483879 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0028820 con 0x563604a2c7d0 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.537+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563604a34fb0 con 0x563604a2c7d0 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.537+0000 7efc977fe640 1 -- 172.21.15.120:0/878483879 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efdc0039060 con 0x563604a2c7d0 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.538+0000 7efc977fe640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efc9003c780 0x7efc9003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.538+0000 7efc977fe640 1 -- 172.21.15.120:0/878483879 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7efdc003d910 con 0x563604a2c7d0 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.538+0000 7efdc5c99640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efc9003c780 0x7efc9003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.538+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.538+0000 7efdc81af800 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563604a3f940 0x563604a41e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.538+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a42550 con 0x563604a3f940 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.538+0000 7efdbd498640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563604a3f940 0x563604a41e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.538+0000 7efdc5c99640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efc9003c780 0x7efc9003ec40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efdb805db10 tx=0x7efdb808d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.538+0000 7efdbd498640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563604a3f940 0x563604a41e00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 20 realm 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a3ec90 con 0x563604a3f940 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a43030 con 0x563604a3f940 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a43e10 0x563604a46200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a46890 con 0x563604a43e10 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.539+0000 7efdc649a640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a43e10 0x563604a46200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc649a640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a43e10 0x563604a46200 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc81af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a47130 con 0x563604a43e10 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc81af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc81af800 20 searching for the correct realm 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc81af800 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563604a48ea0 0x563604a4b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a48ea0 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.540+0000 7efdc5c99640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563604a48ea0 0x563604a4b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.541+0000 7efdc5c99640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563604a48ea0 0x563604a4b2b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.541+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.541+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a43e10 2024-09-07T03:32:38.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.541+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.541+0000 7efdc649a640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efdc004e050 0x7efdc004e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.541+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x7efdc004e050 2024-09-07T03:32:38.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.541+0000 7efdbd498640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efdc004e050 0x7efdc004e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.542+0000 7efdbd498640 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efdc004e050 0x7efdc004e8b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.542+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x7efdc004e050 2024-09-07T03:32:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.542+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.542+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.542+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.542+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.542+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a48ea0 2024-09-07T03:32:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a43e10 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a43e10 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.543+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x7efdc004e050 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.544+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x7efdc004e050 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.544+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.544+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.544+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x7efdc004e050 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.544+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efdb000f5f0 con 0x7efdc004e050 2024-09-07T03:32:38.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.544+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a43e10 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.544+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.544+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a48ea0 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.545+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.545+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.545+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.545+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a43e10 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.545+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.545+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a48ea0 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.545+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.545+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.546+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.546+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.546+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.546+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.546+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.546+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a48ea0 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.546+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.546+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x7efdc004e050 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x7efdc004e050 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a3f940 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x563604a3f940 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x7efdc004e050 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x7efdc004e050 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a48ea0 2024-09-07T03:32:38.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x7efdc004e050 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb000f5f0 con 0x7efdc004e050 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.547+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a43e10 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.548+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.548+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a43e10 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.548+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.548+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a48ea0 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.548+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.548+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a43e10 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.548+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.548+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563604a4b980 con 0x563604a43e10 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a47ae0 con 0x563604a3f940 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x563604a3f940 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a47f30 con 0x563604a43e10 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.549+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a48390 con 0x563604a3f940 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efdb003c040 con 0x563604a3f940 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 zone default found 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 4 Realm: () 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 zonegroup default 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a47690 con 0x7efdc004e050 2024-09-07T03:32:38.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x7efdc004e050 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a4e1f0 con 0x563604a48ea0 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a4e5c0 con 0x563604a48ea0 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 started sync module instance, tier type = 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.550+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4d630 con 0x563604a43e10 2024-09-07T03:32:38.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.552+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.552+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94790006133120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4ea20 con 0x563604a43e10 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.552+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4f270 con 0x563604a3f940 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.553+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94790006133120] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.553+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x563604a3f940 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.553+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94790006139424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4ee40 con 0x563604a3f940 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.553+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4ff70 con 0x563604a43e10 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.555+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94790006139424] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x563604a3f940 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.558+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.558+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94790006142480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4fee0 con 0x563604a43e10 2024-09-07T03:32:38.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.558+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a509c0 con 0x7efdc004e050 2024-09-07T03:32:38.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.561+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94790006142480] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.566+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x7efdc004e050 2024-09-07T03:32:38.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.566+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94790006146256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4fee0 con 0x7efdc004e050 2024-09-07T03:32:38.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.566+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a513d0 con 0x563604a43e10 2024-09-07T03:32:38.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.567+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94790006146256] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x7efdc004e050 2024-09-07T03:32:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.570+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.570+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94790006144016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a513d0 con 0x563604a43e10 2024-09-07T03:32:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.570+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a51dd0 con 0x563604a48ea0 2024-09-07T03:32:38.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.571+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.571+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94790006151392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a51d60 con 0x563604a48ea0 2024-09-07T03:32:38.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.571+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a52d80 con 0x563604a48ea0 2024-09-07T03:32:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.572+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94790006151392] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.572+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.572+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94790006153664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a52d80 con 0x563604a48ea0 2024-09-07T03:32:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.572+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a53810 con 0x7efdc004e050 2024-09-07T03:32:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.573+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94790006144016] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.573+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94790006153664] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.573+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x7efdc004e050 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94790006158048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a537d0 con 0x7efdc004e050 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 20 add_watcher() i=0 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 20 add_watcher() i=1 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 20 add_watcher() i=2 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 20 add_watcher() i=3 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 20 add_watcher() i=4 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 20 add_watcher() i=5 2024-09-07T03:32:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 20 add_watcher() i=6 2024-09-07T03:32:38.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94790006158048] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x7efdc004e050 2024-09-07T03:32:38.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 20 add_watcher() i=7 2024-09-07T03:32:38.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:38.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.574+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a52860 con 0x563604a3f940 2024-09-07T03:32:38.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.575+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efdb003c040 con 0x563604a3f940 2024-09-07T03:32:38.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.575+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94790006148896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a52860 con 0x563604a3f940 2024-09-07T03:32:38.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.576+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94790006148896] v34'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x563604a3f940 2024-09-07T03:32:38.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.576+0000 7efc77fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.576+0000 7efdc81af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:38.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.576+0000 7efdc81af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:38.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.576+0000 7efdc81af800 5 note: GC not initialized 2024-09-07T03:32:38.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.576+0000 7efc76ffd640 20 reqs_thread_entry: start 2024-09-07T03:32:38.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.576+0000 7efdc81af800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:38.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.576+0000 7efdc81af800 20 Filter name: none 2024-09-07T03:32:38.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.577+0000 7efc74ff9640 20 reqs_thread_entry: start 2024-09-07T03:32:38.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.577+0000 7efdc81af800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.577+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563604a892f0 con 0x563604a3f940 2024-09-07T03:32:38.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.577+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7efdb003c040 con 0x563604a3f940 2024-09-07T03:32:38.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.577+0000 7efdc81af800 20 rados_obj.operate() r=0 bl.length=193 2024-09-07T03:32:38.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.578+0000 7efc77fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.578+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94790006148896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a540e0 con 0x563604a3f940 2024-09-07T03:32:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.579+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94790006148896] v34'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x563604a3f940 2024-09-07T03:32:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.579+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94790006133120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a50f20 con 0x563604a43e10 2024-09-07T03:32:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.580+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94790006133120] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.580+0000 7efdc81af800 20 remove_watcher() i=0 2024-09-07T03:32:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.580+0000 7efdc81af800 2 removed watcher, disabling cache 2024-09-07T03:32:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.580+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94790006139424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4d180 con 0x563604a3f940 2024-09-07T03:32:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.581+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94790006139424] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x563604a3f940 2024-09-07T03:32:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.581+0000 7efdc81af800 20 remove_watcher() i=1 2024-09-07T03:32:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.581+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94790006142480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4d180 con 0x563604a43e10 2024-09-07T03:32:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.582+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94790006142480] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.582+0000 7efdc81af800 20 remove_watcher() i=2 2024-09-07T03:32:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.582+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94790006146256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4f610 con 0x7efdc004e050 2024-09-07T03:32:38.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.584+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94790006146256] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x7efdc004e050 2024-09-07T03:32:38.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.584+0000 7efdc81af800 20 remove_watcher() i=3 2024-09-07T03:32:38.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.584+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94790006144016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4d180 con 0x563604a43e10 2024-09-07T03:32:38.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.585+0000 7efdc649a640 1 -- 172.21.15.120:0/878483879 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94790006144016] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc0027070 con 0x563604a43e10 2024-09-07T03:32:38.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.585+0000 7efdc81af800 20 remove_watcher() i=4 2024-09-07T03:32:38.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.585+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94790006151392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4f610 con 0x563604a48ea0 2024-09-07T03:32:38.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.586+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94790006151392] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.586+0000 7efdc81af800 20 remove_watcher() i=5 2024-09-07T03:32:38.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.586+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94790006153664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a4d180 con 0x563604a48ea0 2024-09-07T03:32:38.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.587+0000 7efdc5c99640 1 -- 172.21.15.120:0/878483879 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94790006153664] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb80a0070 con 0x563604a48ea0 2024-09-07T03:32:38.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.587+0000 7efdc81af800 20 remove_watcher() i=6 2024-09-07T03:32:38.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.587+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94790006158048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563604a518e0 con 0x7efdc004e050 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94790006158048] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdb003c040 con 0x7efdc004e050 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 20 remove_watcher() i=7 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a43e10 msgr2=0x563604a46200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a43e10 0x563604a46200 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563604a3f940 msgr2=0x563604a41e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563604a3f940 0x563604a41e00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efdc004e050 msgr2=0x7efdc004e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7efdc004e050 0x7efdc004e8b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563604a48ea0 msgr2=0x563604a4b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563604a48ea0 0x563604a4b2b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efc9003c780 msgr2=0x7efc9003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efc9003c780 0x7efc9003ec40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efdb805db10 tx=0x7efdb808d000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 msgr2=0x563604a33e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 --2- 172.21.15.120:0/878483879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a2c7d0 0x563604a33e40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efdc0012500 tx=0x7efdc0053d60 comp rx=0 tx=0).stop 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdbd498640 1 -- 172.21.15.120:0/878483879 reap_dead start 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 shutdown_connections 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 >> 172.21.15.120:0/878483879 conn(0x563604a28bd0 msgr2=0x563604a26de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 shutdown_connections 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.588+0000 7efdc81af800 1 -- 172.21.15.120:0/878483879 wait complete. 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/694989269 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efca003c780 msgr2=0x7efca003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/694989269 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efca003c780 0x7efca003ec40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x563604a0cd00 tx=0x7efdb808b040 comp rx=0 tx=0).stop 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/694989269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a1fcd0 msgr2=0x563604a200f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/694989269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a1fcd0 0x563604a200f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efdc0016d20 tx=0x7efdc000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/694989269 shutdown_connections 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/694989269 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efca003c780 0x7efca003ec40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/694989269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563604a1fcd0 0x563604a200f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/694989269 >> 172.21.15.120:0/694989269 conn(0x563604a14080 msgr2=0x563604a14460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/694989269 shutdown_connections 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/694989269 wait complete. 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a0d540 msgr2=0x563604a0f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a0d540 0x563604a0f930 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56360490d0f0 msgr2=0x563604a0c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56360490d0f0 0x563604a0c610 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efcac03c780 msgr2=0x7efcac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efcac03c780 0x7efcac03ec40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efdb0000c00 tx=0x7efdb00013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 msgr2=0x563604a04fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x563604a04fc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efdb8025c20 tx=0x7efdb8002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 shutdown_connections 2024-09-07T03:32:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563604a0d540 0x563604a0f930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56360490d0f0 0x563604a0c610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7efcac03c780 0x7efcac03ec40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 --2- 172.21.15.120:0/829232691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360490bff0 0x563604a04fc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 >> 172.21.15.120:0/829232691 conn(0x5636049073c0 msgr2=0x5636049f69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 shutdown_connections 2024-09-07T03:32:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.589+0000 7efdc81af800 1 -- 172.21.15.120:0/829232691 wait complete. 2024-09-07T03:32:38.600 INFO:teuthology.orchestra.run.smithi120.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"E9R03uPmovDmzMMAq9AI0vFH","ver":2},"mtime":"2024-09-07T03:32:38.427386Z","data":{"bucket":{"name":"myfoo","marker":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","bucket_id":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-07T03:32:35.744783Z","linked":true,"has_bucket_info":false}} 2024-09-07T03:32:38.600 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'E9R03uPmovDmzMMAq9AI0vFH', 'ver': 2}, 'mtime': '2024-09-07T03:32:38.427386Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'bucket_id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-07T03:32:35.744783Z', 'linked': True, 'has_bucket_info': False}} 2024-09-07T03:32:38.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-07T03:32:38.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-07T03:32:38.601 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-07T03:32:38.688 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:38.688 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:38.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.686+0000 7fb2b7b19800 1 Processor -- start 2024-09-07T03:32:38.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.686+0000 7fb2b7b19800 1 -- start start 2024-09-07T03:32:38.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.686+0000 7fb2b7b19800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5555db0f2200 0x5555db0f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.686+0000 7fb2b7b19800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555daf9be40 con 0x5555db0f0df0 2024-09-07T03:32:38.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.686+0000 7fb2b7b19800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5555daf66680 con 0x5555db0f2200 2024-09-07T03:32:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.687+0000 7fb2b4e02640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5555db0f2200 0x5555db0f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.687+0000 7fb2b5603640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5555db0f0df0 0x5555db0f1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42256/0 (socket says 172.21.15.120:42256) 2024-09-07T03:32:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.687+0000 7fb2b5603640 1 -- 172.21.15.120:0/2415015029 learned_addr learned my addr 172.21.15.120:0/2415015029 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.687+0000 7fb2b4e02640 1 -- 172.21.15.120:0/2415015029 >> v1:172.21.15.104:6789/0 conn(0x5555db0f0df0 legacy=0x5555db0f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.687+0000 7fb2affff640 1 -- 172.21.15.120:0/2415015029 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568272036 0 0) 0x5555daf9be40 con 0x5555db0f0df0 2024-09-07T03:32:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.687+0000 7fb2b4e02640 1 -- 172.21.15.120:0/2415015029 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555daf826b0 con 0x5555db0f2200 2024-09-07T03:32:38.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.689+0000 7fb2b4e02640 1 --2- 172.21.15.120:0/2415015029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f2200 0x5555db0f7da0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000a470 tx=0x7fb2a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae6914562fd3de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.689+0000 7fb2affff640 1 -- 172.21.15.120:0/2415015029 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a0053570 con 0x5555db0f2200 2024-09-07T03:32:38.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.689+0000 7fb2affff640 1 -- 172.21.15.120:0/2415015029 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a0058070 con 0x5555db0f2200 2024-09-07T03:32:38.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.689+0000 7fb2affff640 1 -- 172.21.15.120:0/2415015029 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a0053880 con 0x5555db0f2200 2024-09-07T03:32:38.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.690+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2415015029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f2200 msgr2=0x5555db0f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.690+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/2415015029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f2200 0x5555db0f7da0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000a470 tx=0x7fb2a0045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.690+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2415015029 shutdown_connections 2024-09-07T03:32:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.690+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/2415015029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f2200 0x5555db0f7da0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.690+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2415015029 >> 172.21.15.120:0/2415015029 conn(0x5555db0ec1c0 msgr2=0x5555db0ee620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.690+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2415015029 shutdown_connections 2024-09-07T03:32:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.690+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2415015029 wait complete. 2024-09-07T03:32:38.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.703+0000 7fb2b7b19800 1 Processor -- start 2024-09-07T03:32:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.704+0000 7fb2b7b19800 1 -- start start 2024-09-07T03:32:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.704+0000 7fb2b7b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db0655e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.704+0000 7fb2b7b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555daf8add0 con 0x5555db0f0df0 2024-09-07T03:32:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.704+0000 7fb2b5603640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db0655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.704+0000 7fb2b5603640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db0655e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52122/0 (socket says 172.21.15.120:52122) 2024-09-07T03:32:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.704+0000 7fb2b5603640 1 -- 172.21.15.120:0/3826244576 learned_addr learned my addr 172.21.15.120:0/3826244576 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.704+0000 7fb2b5603640 1 -- 172.21.15.120:0/3826244576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555dafa3e10 con 0x5555db0f0df0 2024-09-07T03:32:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.704+0000 7fb2b5603640 1 --2- 172.21.15.120:0/3826244576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db0655e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0001ea0 tx=0x7fb2b000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b6df0342fc0003 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb1a3606640 1 -- 172.21.15.120:0/3826244576 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b0008070 con 0x5555db0f0df0 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb1a3606640 1 -- 172.21.15.120:0/3826244576 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b000d500 con 0x5555db0f0df0 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb1a3606640 1 -- 172.21.15.120:0/3826244576 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b000d880 con 0x5555db0f0df0 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3826244576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 msgr2=0x5555db0655e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3826244576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db0655e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0001ea0 tx=0x7fb2b000b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3826244576 shutdown_connections 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3826244576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db0655e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3826244576 >> 172.21.15.120:0/3826244576 conn(0x5555db0ec1c0 msgr2=0x5555db1dbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3826244576 shutdown_connections 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.705+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3826244576 wait complete. 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.706+0000 7fb2b7b19800 1 Processor -- start 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.706+0000 7fb2b7b19800 1 -- start start 2024-09-07T03:32:38.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.706+0000 7fb2b7b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db1e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.706+0000 7fb2b7b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555db0f28f0 con 0x5555db0f0df0 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.706+0000 7fb2b5603640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db1e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.706+0000 7fb2b5603640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db1e8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52138/0 (socket says 172.21.15.120:52138) 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.706+0000 7fb2b5603640 1 -- 172.21.15.120:0/668723129 learned_addr learned my addr 172.21.15.120:0/668723129 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.706+0000 7fb2b5603640 1 -- 172.21.15.120:0/668723129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555db1e9370 con 0x5555db0f0df0 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.706+0000 7fb2b5603640 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db1e8e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00012f0 tx=0x7fb2b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.707+0000 7fb1a1e03640 1 -- 172.21.15.120:0/668723129 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b000f9d0 con 0x5555db0f0df0 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.707+0000 7fb1a1e03640 1 -- 172.21.15.120:0/668723129 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b000fb70 con 0x5555db0f0df0 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.707+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555db1e9600 con 0x5555db0f0df0 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.707+0000 7fb1a1e03640 1 -- 172.21.15.120:0/668723129 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b000fe50 con 0x5555db0f0df0 2024-09-07T03:32:38.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.707+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555db1ea000 con 0x5555db0f0df0 2024-09-07T03:32:38.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.708+0000 7fb1a1e03640 1 -- 172.21.15.120:0/668723129 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb2b0017040 con 0x5555db0f0df0 2024-09-07T03:32:38.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.708+0000 7fb1a1e03640 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb19c03c920 0x7fb19c03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.708+0000 7fb1a1e03640 1 -- 172.21.15.120:0/668723129 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fb2b0015020 con 0x5555db0f0df0 2024-09-07T03:32:38.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.708+0000 7fb2b4e02640 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb19c03c920 0x7fb19c03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.708+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db0f2200 0x5555db1f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.708+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db1f09a0 con 0x5555db0f2200 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.708+0000 7fb2b5e04640 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db0f2200 0x5555db1f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.709+0000 7fb2b4e02640 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb19c03c920 0x7fb19c03ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0057000 tx=0x7fb2a0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.709+0000 7fb2b5e04640 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db0f2200 0x5555db1f0460 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.709+0000 7fb2b5e04640 1 -- 172.21.15.120:0/668723129 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a800a4d0 con 0x5555db0f2200 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.709+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db1f1250 0x5555db1f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.709+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db1f3e80 con 0x5555db1f1250 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.709+0000 7fb2b5603640 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db1f1250 0x5555db1f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.709+0000 7fb2b5603640 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db1f1250 0x5555db1f3710 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.710+0000 7fb2b5603640 1 -- 172.21.15.120:0/668723129 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db1f1250 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.710+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db1f5730 con 0x5555db1f1250 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.710+0000 7fb2b5603640 1 -- 172.21.15.120:0/668723129 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db1f1250 2024-09-07T03:32:38.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.710+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db1f48a0 con 0x5555db1f1250 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.710+0000 7fb2b5603640 1 -- 172.21.15.120:0/668723129 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db1f1250 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.710+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db1f4cc0 con 0x5555db0f2200 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.711+0000 7fb2b5e04640 1 -- 172.21.15.120:0/668723129 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb2a800a4d0 con 0x5555db0f2200 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.711+0000 7fb2b7b19800 1 Processor -- start 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.711+0000 7fb2b7b19800 1 -- start start 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.711+0000 7fb2b7b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db203be0 0x5555db204000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.711+0000 7fb2b7b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555dafe8a00 con 0x5555db203be0 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.711+0000 7fb2b5e04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db203be0 0x5555db204000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.711+0000 7fb2b5e04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db203be0 0x5555db204000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52154/0 (socket says 172.21.15.120:52154) 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.711+0000 7fb2b5e04640 1 -- 172.21.15.120:0/1651074029 learned_addr learned my addr 172.21.15.120:0/1651074029 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.712+0000 7fb2b5e04640 1 -- 172.21.15.120:0/1651074029 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555db204640 con 0x5555db203be0 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.712+0000 7fb2b5e04640 1 --2- 172.21.15.120:0/1651074029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db203be0 0x5555db204000 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8016d20 tx=0x7fb2a800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.712+0000 7fb19affd640 1 -- 172.21.15.120:0/1651074029 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a8017660 con 0x5555db203be0 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.712+0000 7fb19affd640 1 -- 172.21.15.120:0/1651074029 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a801b030 con 0x5555db203be0 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.712+0000 7fb2b7b19800 1 -- 172.21.15.120:0/1651074029 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555db204e70 con 0x5555db203be0 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.712+0000 7fb19affd640 1 -- 172.21.15.120:0/1651074029 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a8017950 con 0x5555db203be0 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.712+0000 7fb2b7b19800 1 -- 172.21.15.120:0/1651074029 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555db205410 con 0x5555db203be0 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.713+0000 7fb19affd640 1 -- 172.21.15.120:0/1651074029 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb2a8017b40 con 0x5555db203be0 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.713+0000 7fb19affd640 1 --2- 172.21.15.120:0/1651074029 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18c03c730 0x7fb18c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.713+0000 7fb19affd640 1 -- 172.21.15.120:0/1651074029 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fb2a800e040 con 0x5555db203be0 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.713+0000 7fb2b5603640 1 --2- 172.21.15.120:0/1651074029 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18c03c730 0x7fb18c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.713+0000 7fb2b7b19800 1 Processor -- start 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.713+0000 7fb2b5603640 1 --2- 172.21.15.120:0/1651074029 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18c03c730 0x7fb18c03ebf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5555db1f43c0 tx=0x7fb2b0001460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.713+0000 7fb2b7b19800 1 -- start start 2024-09-07T03:32:38.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.713+0000 7fb2b7b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db210ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.714+0000 7fb2b7b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555db1e41a0 con 0x5555db2106e0 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.714+0000 7fb2b5e04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db210ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.714+0000 7fb2b5e04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db210ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52162/0 (socket says 172.21.15.120:52162) 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.714+0000 7fb2b5e04640 1 -- 172.21.15.120:0/2446383295 learned_addr learned my addr 172.21.15.120:0/2446383295 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.714+0000 7fb2b5e04640 1 -- 172.21.15.120:0/2446383295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555db2110d0 con 0x5555db2106e0 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.714+0000 7fb2b5e04640 1 --2- 172.21.15.120:0/2446383295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db210ae0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8053e70 tx=0x7fb2a8054040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bf7fc349bf0f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.714+0000 7fb198ff9640 1 -- 172.21.15.120:0/2446383295 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a8048020 con 0x5555db2106e0 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.714+0000 7fb198ff9640 1 -- 172.21.15.120:0/2446383295 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a8051030 con 0x5555db2106e0 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.714+0000 7fb198ff9640 1 -- 172.21.15.120:0/2446383295 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a8014a00 con 0x5555db2106e0 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2446383295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 msgr2=0x5555db210ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/2446383295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db210ae0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8053e70 tx=0x7fb2a8054040 comp rx=0 tx=0).stop 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2446383295 shutdown_connections 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/2446383295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db210ae0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2446383295 >> 172.21.15.120:0/2446383295 conn(0x5555db20cae0 msgr2=0x5555db20ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2446383295 shutdown_connections 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 -- 172.21.15.120:0/2446383295 wait complete. 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 Processor -- start 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 -- start start 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db217cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b7b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5555db2116f0 con 0x5555db2106e0 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b5e04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db217cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b5e04640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db217cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52178/0 (socket says 172.21.15.120:52178) 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.715+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 learned_addr learned my addr 172.21.15.120:0/3262808218 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.716+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555db218250 con 0x5555db2106e0 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.716+0000 7fb2b5e04640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db217cf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800dd00 tx=0x7fb2a8053dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.716+0000 7fb18affd640 1 -- 172.21.15.120:0/3262808218 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a8028350 con 0x5555db2106e0 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.716+0000 7fb18affd640 1 -- 172.21.15.120:0/3262808218 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a80284f0 con 0x5555db2106e0 2024-09-07T03:32:38.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.716+0000 7fb18affd640 1 -- 172.21.15.120:0/3262808218 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2a80287d0 con 0x5555db2106e0 2024-09-07T03:32:38.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.716+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555db2184e0 con 0x5555db2106e0 2024-09-07T03:32:38.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.716+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555db218e60 con 0x5555db2106e0 2024-09-07T03:32:38.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.716+0000 7fb18affd640 1 -- 172.21.15.120:0/3262808218 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb2a804b020 con 0x5555db2106e0 2024-09-07T03:32:38.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.717+0000 7fb18affd640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18003c730 0x7fb18003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.717+0000 7fb2b5603640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18003c730 0x7fb18003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.717+0000 7fb18affd640 1 -- 172.21.15.120:0/3262808218 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fb2a8035ca0 con 0x5555db2106e0 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.717+0000 7fb2b5603640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18003c730 0x7fb18003ebf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000efd0 tx=0x7fb2b0043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.717+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.717+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db223880 0x5555db225d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db226490 con 0x5555db223880 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b4e02640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db223880 0x5555db225d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b4e02640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db223880 0x5555db225d40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b7b19800 20 realm 2024-09-07T03:32:38.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db2268c0 con 0x5555db223880 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b7b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.718+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db227190 con 0x5555db223880 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db227bb0 0x5555db229fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db22a750 con 0x5555db227bb0 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b5e04640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db227bb0 0x5555db229fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b5e04640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db227bb0 0x5555db229fe0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b7b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.719+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db22afa0 con 0x5555db227bb0 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b7b19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b7b19800 20 searching for the correct realm 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5555db22cd10 0x5555db22f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db22cd10 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b5603640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5555db22cd10 0x5555db22f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b5603640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5555db22cd10 0x5555db22f180 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db227bb0 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b5e04640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2a804d030 0x7fb2a80293e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.720+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x7fb2a804d030 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.721+0000 7fb2b4e02640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2a804d030 0x7fb2a80293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.721+0000 7fb2b4e02640 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2a804d030 0x7fb2a80293e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.721+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.721+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.721+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.721+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.722+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.722+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db22cd10 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.722+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.722+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.722+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.722+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db227bb0 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.722+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.722+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db227bb0 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x7fb2a804d030 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x7fb2a804d030 2024-09-07T03:32:38.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.723+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db227bb0 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.724+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.724+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db22cd10 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.724+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.724+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.724+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.724+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db227bb0 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.724+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.724+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db22cd10 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db22cd10 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.725+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x7fb2a804d030 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.726+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.726+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db223880 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.726+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.726+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x7fb2a804d030 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.726+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.726+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db22cd10 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.726+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.726+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x7fb2a804d030 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.727+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.727+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db227bb0 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.727+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.727+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db227bb0 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.727+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.727+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db22cd10 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.727+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.727+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db227bb0 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5555db22f850 con 0x5555db227bb0 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db22b920 con 0x5555db223880 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db22b500 con 0x5555db227bb0 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.728+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db22c290 con 0x5555db223880 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 zone default found 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 4 Realm: () 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 zonegroup default 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db230180 con 0x7fb2a804d030 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db2323c0 con 0x5555db22cd10 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db232760 con 0x5555db22cd10 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 started sync module instance, tier type = 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.729+0000 7fb2b7b19800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.730+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db231800 con 0x5555db227bb0 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.731+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.731+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93827237092384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db231460 con 0x5555db227bb0 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.731+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db233460 con 0x5555db223880 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.732+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93827237092384] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.732+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.732+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93827237096192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db233800 con 0x5555db223880 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.732+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db234260 con 0x5555db227bb0 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.733+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93827237096192] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.734+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.734+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93827237100816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db234220 con 0x5555db227bb0 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.734+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db234cf0 con 0x7fb2a804d030 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.735+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93827237100816] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.735+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.735+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93827237103648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db234cf0 con 0x7fb2a804d030 2024-09-07T03:32:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.735+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db235740 con 0x5555db227bb0 2024-09-07T03:32:38.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.737+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93827237103648] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.737+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.737+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93827237097248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db235700 con 0x5555db227bb0 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.737+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db236150 con 0x5555db22cd10 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.738+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.738+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93827237108896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db2369f0 con 0x5555db22cd10 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.738+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db237490 con 0x5555db22cd10 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.738+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93827237097248] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.739+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.739+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93827237113696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db237880 con 0x5555db22cd10 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.739+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db238280 con 0x7fb2a804d030 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.739+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93827237108896] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93827237111104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db238240 con 0x7fb2a804d030 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b7b19800 20 add_watcher() i=0 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b7b19800 20 add_watcher() i=1 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b7b19800 20 add_watcher() i=2 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b7b19800 20 add_watcher() i=3 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b7b19800 20 add_watcher() i=4 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b7b19800 20 add_watcher() i=5 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93827237113696] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.740+0000 7fb2b7b19800 20 add_watcher() i=6 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.741+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93827237111104] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.741+0000 7fb2b7b19800 20 add_watcher() i=7 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.741+0000 7fb2b7b19800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.741+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db235250 con 0x5555db223880 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.741+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.741+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93827237117328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db235250 con 0x5555db223880 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.742+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93827237117328] v34'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.742+0000 7fb16b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.742+0000 7fb2b7b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.742+0000 7fb2b7b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 5 note: GC not initialized 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb16a7e4640 20 reqs_thread_entry: start 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 20 Filter name: none 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb0dbfff640 20 reqs_thread_entry: start 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db26e320 con 0x5555db223880 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.743+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db26dd80 con 0x5555db223880 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 20 rados_obj.operate() r=0 bl.length=193 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 : miss 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 8.1c 8:3b53f263:root::.bucket.meta.testx%3amyfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db271b00 con 0x5555db22cd10 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 20 rados_obj.operate() r=0 bl.length=420 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.744+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db2761a0 con 0x5555db223880 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.745+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v34'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.745+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db279ab0 con 0x5555db223880 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.746+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(66 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [create,call,writefull 0~387,setxattr (123)] v34'7 uv7 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.746+0000 7fb2b7b19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x7 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.746+0000 7fb2b7b19800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.746+0000 7fb2b7b19800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.746+0000 7fb2b7b19800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1, ofs0, ns] 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.746+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 93827237378032 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db279410 con 0x7fb2a804d030 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== watch-notify(notify (1) cookie 93827237103648 notify 146028888077 ret 0) ==== 778+0+0 (crc 0 0 0) 0x5555db279e50 con 0x7fb2a804d030 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb198ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 93827237103648 notifier 4554 bl.length()=736 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb198ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x7 2024-09-07T03:32:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb198ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb198ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(67 notify.3 [notify cookie 93827237378032 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb198ff9640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb178003ea0 con 0x7fb2a804d030 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== watch-notify(notify_complete (2) cookie 93827237378032 notify 146028888077 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555db275bd0 con 0x7fb2a804d030 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb2b7b19800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_sources= new_sources= 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb2b7b19800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential sources added=[] removed=[] 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb2b7b19800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_dests= new_dests= 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb2b7b19800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential dests added=[] removed=[] 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.747+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db2752c0 con 0x7fb2a804d030 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.748+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(69 foo.buckets [call] v34'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.748+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db2752c0 con 0x7fb2a804d030 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.749+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v34'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.749+0000 7fb2b7b19800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.749+0000 7fb2b7b19800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.749+0000 7fb2b7b19800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.749+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93827237367312 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db275230 con 0x5555db22cd10 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.750+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== watch-notify(notify (1) cookie 93827237113696 notify 146028888079 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5555db26fff0 con 0x5555db22cd10 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.750+0000 7fb18bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 93827237113696 notifier 4554 bl.length()=314 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.750+0000 7fb18bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.750+0000 7fb18bfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.750+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(71 notify.6 [notify cookie 93827237367312 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.750+0000 7fb18bfff640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb0e8003400 con 0x5555db22cd10 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.750+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== watch-notify(notify_complete (2) cookie 93827237367312 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555db1ea000 con 0x5555db22cd10 2024-09-07T03:32:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.750+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.750+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db2752c0 con 0x5555db223880 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.751+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.751+0000 7fb2b7b19800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.751+0000 7fb2b7b19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.751+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 93827237367312 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db275230 con 0x5555db227bb0 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.752+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 93827237097248 notify 146028888086 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5555db218e60 con 0x5555db227bb0 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.752+0000 7fb198ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 93827237097248 notifier 4554 bl.length()=155 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.752+0000 7fb198ff9640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb178003ea0 con 0x5555db227bb0 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.752+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(74 notify.4 [notify cookie 93827237367312 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.752+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.752+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 93827237367312 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555db2184e0 con 0x5555db227bb0 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.752+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 8.1c 8:3b53f263:root::.bucket.meta.testx%3amyfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275280 con 0x5555db22cd10 2024-09-07T03:32:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.753+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call,delete] v34'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.753+0000 7fb2b7b19800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 from cache 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.753+0000 7fb2b7b19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1, ofs0, ns] 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.753+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 93827237355936 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555db275280 con 0x5555db227bb0 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.753+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== watch-notify(notify (1) cookie 93827237100816 notify 146028888087 ret 0) ==== 254+0+0 (crc 0 0 0) 0x5555db2184e0 con 0x5555db227bb0 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.753+0000 7fb18bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 93827237100816 notifier 4554 bl.length()=212 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.753+0000 7fb18bfff640 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb0e8003470 con 0x5555db227bb0 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.753+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(77 notify.2 [notify cookie 93827237355936 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.753+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.754+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== watch-notify(notify_complete (2) cookie 93827237355936 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555db218250 con 0x5555db227bb0 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.754+0000 7fb16b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.754+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93827237117328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275830 con 0x5555db223880 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.755+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93827237117328] v34'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.755+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93827237092384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275830 con 0x5555db227bb0 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.756+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93827237092384] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.756+0000 7fb2b7b19800 20 remove_watcher() i=0 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.756+0000 7fb2b7b19800 2 removed watcher, disabling cache 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.756+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93827237096192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275830 con 0x5555db223880 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.757+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93827237096192] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x5555db223880 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.757+0000 7fb2b7b19800 20 remove_watcher() i=1 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.757+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93827237100816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275830 con 0x5555db227bb0 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.758+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93827237100816] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.758+0000 7fb2b7b19800 20 remove_watcher() i=2 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.758+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93827237103648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275830 con 0x7fb2a804d030 2024-09-07T03:32:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.759+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93827237103648] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.759+0000 7fb2b7b19800 20 remove_watcher() i=3 2024-09-07T03:32:38.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.759+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93827237097248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275830 con 0x5555db227bb0 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.761+0000 7fb2b5e04640 1 -- 172.21.15.120:0/3262808218 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93827237097248] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a803a020 con 0x5555db227bb0 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.761+0000 7fb2b7b19800 20 remove_watcher() i=4 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.761+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93827237108896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275830 con 0x5555db22cd10 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.762+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93827237108896] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.762+0000 7fb2b7b19800 20 remove_watcher() i=5 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.762+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93827237113696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275830 con 0x5555db22cd10 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.763+0000 7fb2b5603640 1 -- 172.21.15.120:0/3262808218 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93827237113696] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b002d070 con 0x5555db22cd10 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.763+0000 7fb2b7b19800 20 remove_watcher() i=6 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.763+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93827237111104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5555db275830 con 0x7fb2a804d030 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93827237111104] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2a0051070 con 0x7fb2a804d030 2024-09-07T03:32:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 20 remove_watcher() i=7 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db227bb0 msgr2=0x5555db229fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db227bb0 0x5555db229fe0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db223880 msgr2=0x5555db225d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db223880 0x5555db225d40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2a804d030 msgr2=0x7fb2a80293e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2a804d030 0x7fb2a80293e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5555db22cd10 msgr2=0x5555db22f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5555db22cd10 0x5555db22f180 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18003c730 msgr2=0x7fb18003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18003c730 0x7fb18003ebf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000efd0 tx=0x7fb2b0043000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 msgr2=0x5555db217cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db217cf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800dd00 tx=0x7fb2a8053dd0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b4e02640 1 -- 172.21.15.120:0/3262808218 reap_dead start 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 shutdown_connections 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/3262808218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db2106e0 0x5555db217cf0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 >> 172.21.15.120:0/3262808218 conn(0x5555db20cae0 msgr2=0x5555db20acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 shutdown_connections 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/3262808218 wait complete. 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/1651074029 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18c03c730 msgr2=0x7fb18c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/1651074029 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18c03c730 0x7fb18c03ebf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5555db1f43c0 tx=0x7fb2b0001460 comp rx=0 tx=0).stop 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/1651074029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db203be0 msgr2=0x5555db204000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/1651074029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db203be0 0x5555db204000 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8016d20 tx=0x7fb2a800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/1651074029 shutdown_connections 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/1651074029 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb18c03c730 0x7fb18c03ebf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/1651074029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db203be0 0x5555db204000 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/1651074029 >> 172.21.15.120:0/1651074029 conn(0x5555db1f7f90 msgr2=0x5555db1f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/1651074029 shutdown_connections 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.764+0000 7fb2b7b19800 1 -- 172.21.15.120:0/1651074029 wait complete. 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db1f1250 msgr2=0x5555db1f3710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db1f1250 0x5555db1f3710 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db0f2200 msgr2=0x5555db1f0460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db0f2200 0x5555db1f0460 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb19c03c920 msgr2=0x7fb19c03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb19c03c920 0x7fb19c03ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0057000 tx=0x7fb2a0052000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 msgr2=0x5555db1e8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db1e8e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00012f0 tx=0x7fb2b0000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 shutdown_connections 2024-09-07T03:32:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5555db1f1250 0x5555db1f3710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5555db0f2200 0x5555db1f0460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb19c03c920 0x7fb19c03ede0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 --2- 172.21.15.120:0/668723129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5555db0f0df0 0x5555db1e8e10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 >> 172.21.15.120:0/668723129 conn(0x5555db0ec1c0 msgr2=0x5555db1da540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 shutdown_connections 2024-09-07T03:32:38.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.765+0000 7fb2b7b19800 1 -- 172.21.15.120:0/668723129 wait complete. 2024-09-07T03:32:38.782 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-07T03:32:38.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-07T03:32:38.782 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-07T03:32:38.828 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:38.829 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:38.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.827+0000 7fca7dd40800 1 Processor -- start 2024-09-07T03:32:38.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.827+0000 7fca7dd40800 1 -- start start 2024-09-07T03:32:38.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.827+0000 7fca7dd40800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a2b44fd460 0x55a2b4503dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.827+0000 7fca7dd40800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a2b43a7e40 con 0x55a2b44fe670 2024-09-07T03:32:38.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.827+0000 7fca7dd40800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a2b4372680 con 0x55a2b44fd460 2024-09-07T03:32:38.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.828+0000 7fca79285640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a2b44fd460 0x55a2b4503dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.828+0000 7fca79285640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a2b44fd460 0x55a2b4503dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52190/0 (socket says 172.21.15.120:52190) 2024-09-07T03:32:38.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.828+0000 7fca79285640 1 -- 172.21.15.120:0/1333846025 learned_addr learned my addr 172.21.15.120:0/1333846025 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.828+0000 7fca79a86640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55a2b44fe670 0x55a2b44fcd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42270/0 (socket says 172.21.15.120:42270) 2024-09-07T03:32:38.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.828+0000 7fca79285640 1 -- 172.21.15.120:0/1333846025 >> v1:172.21.15.104:6789/0 conn(0x55a2b44fe670 legacy=0x55a2b44fcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.828+0000 7fca78a84640 1 -- 172.21.15.120:0/1333846025 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005736622 0 0) 0x55a2b43a7e40 con 0x55a2b44fe670 2024-09-07T03:32:38.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.828+0000 7fca79285640 1 -- 172.21.15.120:0/1333846025 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b438e6b0 con 0x55a2b44fd460 2024-09-07T03:32:38.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca79285640 1 --2- 172.21.15.120:0/1333846025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b4503dc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fca7000a6b0 tx=0x7fca70047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df439a57a1891af1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca78a84640 1 -- 172.21.15.120:0/1333846025 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca7000a200 con 0x55a2b44fd460 2024-09-07T03:32:38.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca78a84640 1 -- 172.21.15.120:0/1333846025 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7000a3a0 con 0x55a2b44fd460 2024-09-07T03:32:38.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca78a84640 1 -- 172.21.15.120:0/1333846025 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca70008700 con 0x55a2b44fd460 2024-09-07T03:32:38.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca7dd40800 1 -- 172.21.15.120:0/1333846025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 msgr2=0x55a2b4503dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca7dd40800 1 --2- 172.21.15.120:0/1333846025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b4503dc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fca7000a6b0 tx=0x7fca70047e30 comp rx=0 tx=0).stop 2024-09-07T03:32:38.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca7dd40800 1 -- 172.21.15.120:0/1333846025 shutdown_connections 2024-09-07T03:32:38.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca7dd40800 1 --2- 172.21.15.120:0/1333846025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b4503dc0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca7dd40800 1 -- 172.21.15.120:0/1333846025 >> 172.21.15.120:0/1333846025 conn(0x55a2b44f7930 msgr2=0x55a2b44f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca7dd40800 1 -- 172.21.15.120:0/1333846025 shutdown_connections 2024-09-07T03:32:38.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.830+0000 7fca7dd40800 1 -- 172.21.15.120:0/1333846025 wait complete. 2024-09-07T03:32:38.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.844+0000 7fca7dd40800 1 Processor -- start 2024-09-07T03:32:38.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.844+0000 7fca7dd40800 1 -- start start 2024-09-07T03:32:38.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.844+0000 7fca7dd40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45eb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.844+0000 7fca7dd40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a2b4396dd0 con 0x55a2b44fd460 2024-09-07T03:32:38.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.845+0000 7fca79a86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.845+0000 7fca79a86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45eb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52198/0 (socket says 172.21.15.120:52198) 2024-09-07T03:32:38.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.845+0000 7fca79a86640 1 -- 172.21.15.120:0/2506179575 learned_addr learned my addr 172.21.15.120:0/2506179575 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.845+0000 7fca79a86640 1 -- 172.21.15.120:0/2506179575 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b43afe10 con 0x55a2b44fd460 2024-09-07T03:32:38.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.845+0000 7fca79a86640 1 --2- 172.21.15.120:0/2506179575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45eb490 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fca6c001ea0 tx=0x7fca6c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d1be44a101ce40 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.845+0000 7fc967e07640 1 -- 172.21.15.120:0/2506179575 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca6c00e5c0 con 0x55a2b44fd460 2024-09-07T03:32:38.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.845+0000 7fc967e07640 1 -- 172.21.15.120:0/2506179575 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c014070 con 0x55a2b44fd460 2024-09-07T03:32:38.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.845+0000 7fc967e07640 1 -- 172.21.15.120:0/2506179575 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca6c00e930 con 0x55a2b44fd460 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.846+0000 7fca7dd40800 1 -- 172.21.15.120:0/2506179575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 msgr2=0x55a2b45eb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.846+0000 7fca7dd40800 1 --2- 172.21.15.120:0/2506179575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45eb490 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fca6c001ea0 tx=0x7fca6c00b6c0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.846+0000 7fca7dd40800 1 -- 172.21.15.120:0/2506179575 shutdown_connections 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.846+0000 7fca7dd40800 1 --2- 172.21.15.120:0/2506179575 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45eb490 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.846+0000 7fca7dd40800 1 -- 172.21.15.120:0/2506179575 >> 172.21.15.120:0/2506179575 conn(0x55a2b44f7930 msgr2=0x55a2b45e6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.846+0000 7fca7dd40800 1 -- 172.21.15.120:0/2506179575 shutdown_connections 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.846+0000 7fca7dd40800 1 -- 172.21.15.120:0/2506179575 wait complete. 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.846+0000 7fca7dd40800 1 Processor -- start 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.846+0000 7fca7dd40800 1 -- start start 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.847+0000 7fca7dd40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.847+0000 7fca7dd40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a2b44fbc40 con 0x55a2b44fd460 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.847+0000 7fca79a86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.847+0000 7fca79a86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45f2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52204/0 (socket says 172.21.15.120:52204) 2024-09-07T03:32:38.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.847+0000 7fca79a86640 1 -- 172.21.15.120:0/4106861928 learned_addr learned my addr 172.21.15.120:0/4106861928 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.847+0000 7fca79a86640 1 -- 172.21.15.120:0/4106861928 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b45f32f0 con 0x55a2b44fd460 2024-09-07T03:32:38.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.847+0000 7fca79a86640 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45f2d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c010 tx=0x7fca6c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.848+0000 7fc966604640 1 -- 172.21.15.120:0/4106861928 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca6c00fa30 con 0x55a2b44fd460 2024-09-07T03:32:38.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.848+0000 7fc966604640 1 -- 172.21.15.120:0/4106861928 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c006070 con 0x55a2b44fd460 2024-09-07T03:32:38.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.848+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b45f3580 con 0x55a2b44fd460 2024-09-07T03:32:38.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.848+0000 7fc966604640 1 -- 172.21.15.120:0/4106861928 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca6c00fd40 con 0x55a2b44fd460 2024-09-07T03:32:38.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.848+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b45f4190 con 0x55a2b44fd460 2024-09-07T03:32:38.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.848+0000 7fc966604640 1 -- 172.21.15.120:0/4106861928 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fca6c019430 con 0x55a2b44fd460 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.849+0000 7fc966604640 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc96003c780 0x7fc96003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.849+0000 7fc966604640 1 -- 172.21.15.120:0/4106861928 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fca6c053be0 con 0x55a2b44fd460 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.849+0000 7fca79285640 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc96003c780 0x7fc96003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.849+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b44fe670 0x55a2b45fa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.849+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b45fa920 con 0x55a2b44fe670 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.849+0000 7fca7a287640 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b44fe670 0x55a2b45fa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.849+0000 7fca79285640 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc96003c780 0x7fc96003ec40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca70058000 tx=0x7fca70053000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.849+0000 7fca7a287640 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b44fe670 0x55a2b45fa3e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.849+0000 7fca7a287640 1 -- 172.21.15.120:0/4106861928 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca7400a4d0 con 0x55a2b44fe670 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.850+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b45fb1d0 0x55a2b45fd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.850+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b45fdde0 con 0x55a2b45fb1d0 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.850+0000 7fca79a86640 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b45fb1d0 0x55a2b45fd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.850+0000 7fca79a86640 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b45fb1d0 0x55a2b45fd670 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.850+0000 7fca79a86640 1 -- 172.21.15.120:0/4106861928 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca6c02d070 con 0x55a2b45fb1d0 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.850+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b45ff690 con 0x55a2b45fb1d0 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.851+0000 7fca79a86640 1 -- 172.21.15.120:0/4106861928 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b45fb1d0 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.851+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b45fe7a0 con 0x55a2b45fb1d0 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.851+0000 7fca79a86640 1 -- 172.21.15.120:0/4106861928 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b45fb1d0 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.851+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b45fec00 con 0x55a2b44fe670 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.851+0000 7fca7a287640 1 -- 172.21.15.120:0/4106861928 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca7400a4d0 con 0x55a2b44fe670 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.851+0000 7fca7dd40800 1 Processor -- start 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.851+0000 7fca7dd40800 1 -- start start 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fca7dd40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b4611f80 0x55a2b46123a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fca7dd40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a2b43f4a00 con 0x55a2b4611f80 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fca7a287640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b4611f80 0x55a2b46123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fca7a287640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b4611f80 0x55a2b46123a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52212/0 (socket says 172.21.15.120:52212) 2024-09-07T03:32:38.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fca7a287640 1 -- 172.21.15.120:0/2683692039 learned_addr learned my addr 172.21.15.120:0/2683692039 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fca7a287640 1 -- 172.21.15.120:0/2683692039 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b46129e0 con 0x55a2b4611f80 2024-09-07T03:32:38.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fca7a287640 1 --2- 172.21.15.120:0/2683692039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b4611f80 0x55a2b46123a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fca74016d20 tx=0x7fca7400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fc95f7fe640 1 -- 172.21.15.120:0/2683692039 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74017660 con 0x55a2b4611f80 2024-09-07T03:32:38.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fc95f7fe640 1 -- 172.21.15.120:0/2683692039 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7401b030 con 0x55a2b4611f80 2024-09-07T03:32:38.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fca7dd40800 1 -- 172.21.15.120:0/2683692039 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b4613210 con 0x55a2b4611f80 2024-09-07T03:32:38.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fc95f7fe640 1 -- 172.21.15.120:0/2683692039 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74017950 con 0x55a2b4611f80 2024-09-07T03:32:38.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.852+0000 7fca7dd40800 1 -- 172.21.15.120:0/2683692039 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b46137b0 con 0x55a2b4611f80 2024-09-07T03:32:38.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.853+0000 7fc95f7fe640 1 -- 172.21.15.120:0/2683692039 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fca74017b40 con 0x55a2b4611f80 2024-09-07T03:32:38.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.853+0000 7fc95f7fe640 1 --2- 172.21.15.120:0/2683692039 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc95403c730 0x7fc95403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.853+0000 7fc95f7fe640 1 -- 172.21.15.120:0/2683692039 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fca7400e040 con 0x55a2b4611f80 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.853+0000 7fca79a86640 1 --2- 172.21.15.120:0/2683692039 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc95403c730 0x7fc95403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.854+0000 7fca7dd40800 1 Processor -- start 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.854+0000 7fca79a86640 1 --2- 172.21.15.120:0/2683692039 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc95403c730 0x7fc95403ebf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a2b45f4580 tx=0x7fca6c046340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.854+0000 7fca7dd40800 1 -- start start 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.854+0000 7fca7dd40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b461eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.854+0000 7fca7dd40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a2b45ebce0 con 0x55a2b461eaa0 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.854+0000 7fca7a287640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b461eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.854+0000 7fca7a287640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b461eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52220/0 (socket says 172.21.15.120:52220) 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.854+0000 7fca7a287640 1 -- 172.21.15.120:0/1050510641 learned_addr learned my addr 172.21.15.120:0/1050510641 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.854+0000 7fca7a287640 1 -- 172.21.15.120:0/1050510641 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b461f490 con 0x55a2b461eaa0 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fca7a287640 1 --2- 172.21.15.120:0/1050510641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b461eea0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fca74053e70 tx=0x7fca74054040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e600e61d72075b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fc95d7fa640 1 -- 172.21.15.120:0/1050510641 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74048020 con 0x55a2b461eaa0 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fc95d7fa640 1 -- 172.21.15.120:0/1050510641 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca74051030 con 0x55a2b461eaa0 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fc95d7fa640 1 -- 172.21.15.120:0/1050510641 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74014a00 con 0x55a2b461eaa0 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fca7dd40800 1 -- 172.21.15.120:0/1050510641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 msgr2=0x55a2b461eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fca7dd40800 1 --2- 172.21.15.120:0/1050510641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b461eea0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fca74053e70 tx=0x7fca74054040 comp rx=0 tx=0).stop 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fca7dd40800 1 -- 172.21.15.120:0/1050510641 shutdown_connections 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fca7dd40800 1 --2- 172.21.15.120:0/1050510641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b461eea0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fca7dd40800 1 -- 172.21.15.120:0/1050510641 >> 172.21.15.120:0/1050510641 conn(0x55a2b461aea0 msgr2=0x55a2b46190e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fca7dd40800 1 -- 172.21.15.120:0/1050510641 shutdown_connections 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.855+0000 7fca7dd40800 1 -- 172.21.15.120:0/1050510641 wait complete. 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7dd40800 1 Processor -- start 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7dd40800 1 -- start start 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7dd40800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b4626090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7dd40800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a2b461fab0 con 0x55a2b461eaa0 2024-09-07T03:32:38.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7a287640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b4626090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7a287640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b4626090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52226/0 (socket says 172.21.15.120:52226) 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 learned_addr learned my addr 172.21.15.120:0/3878490031 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b46265f0 con 0x55a2b461eaa0 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7a287640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b4626090 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fca7400dd00 tx=0x7fca74053dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fc94b7fe640 1 -- 172.21.15.120:0/3878490031 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74028350 con 0x55a2b461eaa0 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fc94b7fe640 1 -- 172.21.15.120:0/3878490031 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca740284f0 con 0x55a2b461eaa0 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b4626880 con 0x55a2b461eaa0 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fc94b7fe640 1 -- 172.21.15.120:0/3878490031 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca740287d0 con 0x55a2b461eaa0 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.856+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b4627200 con 0x55a2b461eaa0 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.857+0000 7fc94b7fe640 1 -- 172.21.15.120:0/3878490031 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fca7404b020 con 0x55a2b461eaa0 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.857+0000 7fc94b7fe640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc94403c780 0x7fc94403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.857+0000 7fc94b7fe640 1 -- 172.21.15.120:0/3878490031 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fca74035ce0 con 0x55a2b461eaa0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.857+0000 7fca79a86640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc94403c780 0x7fc94403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.858+0000 7fca79a86640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc94403c780 0x7fc94403ec40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca6c053ed0 tx=0x7fca6c049000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.858+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.858+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b4631bc0 0x55a2b4634080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.858+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46347d0 con 0x55a2b4631bc0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.858+0000 7fca79285640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b4631bc0 0x55a2b4634080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.858+0000 7fca79285640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b4631bc0 0x55a2b4634080 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 20 realm 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4634c00 con 0x55a2b4631bc0 2024-09-07T03:32:38.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46354d0 con 0x55a2b4631bc0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b4635ef0 0x55a2b4638320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4638a90 con 0x55a2b4635ef0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.859+0000 7fca7a287640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b4635ef0 0x55a2b4638320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7a287640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b4635ef0 0x55a2b4638320 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7dd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46392e0 con 0x55a2b4635ef0 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7dd40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7dd40800 20 searching for the correct realm 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a2b463b050 0x55a2b463d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b463b050 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.860+0000 7fca79a86640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a2b463b050 0x55a2b463d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.861+0000 7fca79a86640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a2b463b050 0x55a2b463d480 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.861+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.861+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4635ef0 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.861+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.861+0000 7fca7a287640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca7404d030 0x7fca74020420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.861+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x7fca7404d030 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.861+0000 7fca79285640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca7404d030 0x7fca74020420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.861+0000 7fca79285640 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca7404d030 0x7fca74020420 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.862+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.862+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.862+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.862+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.862+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.862+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b463b050 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.862+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.862+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4635ef0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4635ef0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x7fca7404d030 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.863+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.864+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.864+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x7fca7404d030 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.864+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.864+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4635ef0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.864+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.864+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b463b050 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.864+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.864+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.865+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.865+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4635ef0 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.865+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.865+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b463b050 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.865+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.865+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.865+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.865+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b463b050 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x7fca7404d030 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4631bc0 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.866+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x7fca7404d030 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.867+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.867+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b463b050 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.867+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.867+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x7fca7404d030 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.867+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.867+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4635ef0 2024-09-07T03:32:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.867+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.867+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4635ef0 2024-09-07T03:32:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b463b050 2024-09-07T03:32:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4635ef0 2024-09-07T03:32:38.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463db50 con 0x55a2b4635ef0 2024-09-07T03:32:38.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7dd40800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:38.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7dd40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:38.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7dd40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7dd40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7dd40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7dd40800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.868+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4639c60 con 0x55a2b4631bc0 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46398a0 con 0x55a2b4635ef0 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:38.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463a0a0 con 0x55a2b4631bc0 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 20 zone default found 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 4 Realm: () 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 20 zonegroup default 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.869+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463e480 con 0x7fca7404d030 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4640310 con 0x55a2b463b050 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4640790 con 0x55a2b463b050 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 20 started sync module instance, tier type = 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.870+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463f6b0 con 0x55a2b4635ef0 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.871+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.871+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94157299514016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46410a0 con 0x55a2b4635ef0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.871+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46418f0 con 0x55a2b4631bc0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.872+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94157299514016] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.872+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.873+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94157299518448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46415a0 con 0x55a2b4631bc0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.873+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46420c0 con 0x55a2b4635ef0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.873+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94157299518448] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.874+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.874+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94157299522448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4642080 con 0x55a2b4635ef0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.874+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4642b70 con 0x7fca7404d030 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.875+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94157299522448] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.876+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.876+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94157299525248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4642b70 con 0x7fca7404d030 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.876+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46435b0 con 0x55a2b4635ef0 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.877+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94157299525248] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.879+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.879+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94157299519504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46435b0 con 0x55a2b4635ef0 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.879+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4643fc0 con 0x55a2b463b050 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.881+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94157299519504] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.881+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.881+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94157299527936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4643520 con 0x55a2b463b050 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.881+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4644e30 con 0x55a2b463b050 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.883+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94157299527936] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.883+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.883+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94157299532640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4644e30 con 0x55a2b463b050 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.883+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46457f0 con 0x7fca7404d030 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94157299532640] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94157299537184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4644e30 con 0x7fca7404d030 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca7dd40800 20 add_watcher() i=0 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca7dd40800 20 add_watcher() i=1 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca7dd40800 20 add_watcher() i=2 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca7dd40800 20 add_watcher() i=3 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca7dd40800 20 add_watcher() i=4 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca7dd40800 20 add_watcher() i=5 2024-09-07T03:32:38.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.885+0000 7fca7dd40800 20 add_watcher() i=6 2024-09-07T03:32:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.886+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94157299537184] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.886+0000 7fca7dd40800 20 add_watcher() i=7 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.886+0000 7fca7dd40800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.886+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4648ca0 con 0x55a2b4631bc0 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.886+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.886+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94157299534672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46461c0 con 0x55a2b4631bc0 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.887+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94157299534672] v34'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.887+0000 7fc92b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.888+0000 7fca7dd40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.888+0000 7fca7dd40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.888+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4651520 con 0x55a2b4635ef0 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.889+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'47 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.889+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46515f0 con 0x7fca7404d030 2024-09-07T03:32:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.890+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'22 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.890+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4651d00 con 0x55a2b463b050 2024-09-07T03:32:38.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.891+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.891+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46521b0 con 0x55a2b4631bc0 2024-09-07T03:32:38.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.892+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'141 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.892+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b464f470 con 0x55a2b4635ef0 2024-09-07T03:32:38.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.893+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'44 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.893+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b464f470 con 0x55a2b463b050 2024-09-07T03:32:38.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.894+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.894+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4650480 con 0x55a2b4635ef0 2024-09-07T03:32:38.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.895+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.895+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4650650 con 0x55a2b4631bc0 2024-09-07T03:32:38.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.896+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.896+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652d10 con 0x55a2b4635ef0 2024-09-07T03:32:38.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.897+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.897+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652d10 con 0x55a2b4635ef0 2024-09-07T03:32:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.898+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.898+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652d10 con 0x55a2b4635ef0 2024-09-07T03:32:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.899+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.899+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652d10 con 0x55a2b463b050 2024-09-07T03:32:38.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.900+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.900+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652d10 con 0x55a2b4635ef0 2024-09-07T03:32:38.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.901+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.901+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652d10 con 0x55a2b4631bc0 2024-09-07T03:32:38.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.902+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'43 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.902+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652d10 con 0x55a2b4631bc0 2024-09-07T03:32:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.904+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.904+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652da0 con 0x55a2b4635ef0 2024-09-07T03:32:38.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.905+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.905+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652da0 con 0x55a2b4635ef0 2024-09-07T03:32:38.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.906+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.906+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652da0 con 0x55a2b463b050 2024-09-07T03:32:38.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.909+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.909+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652da0 con 0x55a2b4635ef0 2024-09-07T03:32:38.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.910+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.910+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652e00 con 0x55a2b4631bc0 2024-09-07T03:32:38.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.912+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'143 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.912+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652e90 con 0x55a2b4635ef0 2024-09-07T03:32:38.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.913+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.913+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652e90 con 0x55a2b4635ef0 2024-09-07T03:32:38.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.914+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.914+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652e90 con 0x55a2b463b050 2024-09-07T03:32:38.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.915+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.915+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652e90 con 0x55a2b4635ef0 2024-09-07T03:32:38.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.916+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.916+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652ed0 con 0x55a2b463b050 2024-09-07T03:32:38.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.917+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.917+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652ed0 con 0x55a2b463b050 2024-09-07T03:32:38.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.919+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'38 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.919+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652ef0 con 0x55a2b463b050 2024-09-07T03:32:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.920+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.920+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652f30 con 0x55a2b4635ef0 2024-09-07T03:32:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.921+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.921+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652f30 con 0x55a2b4631bc0 2024-09-07T03:32:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.922+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.922+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652f30 con 0x55a2b4635ef0 2024-09-07T03:32:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.923+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.923+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652f30 con 0x55a2b4631bc0 2024-09-07T03:32:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.924+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'44 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.924+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4652f30 con 0x7fca7404d030 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.925+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.925+0000 7fc92a7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.925+0000 7fca7dd40800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 20 Filter name: none 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fc89bfff640 20 reqs_thread_entry: start 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 20 rados->read ofs=0 len=0 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b467de50 con 0x55a2b463b050 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-07T03:32:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-07T03:32:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-07T03:32:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b46802f0 con 0x55a2b4631bc0 2024-09-07T03:32:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-07T03:32:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.926+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b467e1d0 con 0x55a2b463b050 2024-09-07T03:32:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.927+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v34'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.927+0000 7fca7dd40800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-07T03:32:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.927+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94157299772816 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4680bc0 con 0x55a2b4635ef0 2024-09-07T03:32:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.928+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== watch-notify(notify (1) cookie 94157299522448 notify 146028888088 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a2b4650ad0 con 0x55a2b4635ef0 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.928+0000 7fc95d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94157299522448 notifier 4561 bl.length()=170 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.928+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(97 notify.2 [notify cookie 94157299772816 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.928+0000 7fc95d7fa640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc93c003d60 con 0x55a2b4635ef0 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.928+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.928+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== watch-notify(notify_complete (2) cookie 94157299772816 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2b4626880 con 0x55a2b4635ef0 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.928+0000 7fca7dd40800 10 removing email index: 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.928+0000 7fca7dd40800 10 removing user buckets index 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.928+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b467e200 con 0x55a2b4631bc0 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.929+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v34'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.929+0000 7fca7dd40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.929+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94157299768656 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b467e170 con 0x55a2b4635ef0 2024-09-07T03:32:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.929+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== watch-notify(notify (1) cookie 94157299519504 notify 146028888089 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55a2b4626880 con 0x55a2b4635ef0 2024-09-07T03:32:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.929+0000 7fc95cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94157299519504 notifier 4561 bl.length()=175 2024-09-07T03:32:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.929+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(100 notify.4 [notify cookie 94157299768656 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.929+0000 7fc95cff9640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc8a40032c0 con 0x55a2b4635ef0 2024-09-07T03:32:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.930+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.930+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== watch-notify(notify_complete (2) cookie 94157299768656 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2b46265f0 con 0x55a2b4635ef0 2024-09-07T03:32:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.930+0000 7fca7dd40800 10 removing user index: testx$tenanteduser 2024-09-07T03:32:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.930+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b467f610 con 0x55a2b463b050 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v34'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fca7dd40800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fca7dd40800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94157299776272 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2b467f610 con 0x7fca7404d030 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== watch-notify(notify (1) cookie 94157299525248 notify 146028888078 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55a2b4650650 con 0x7fca7404d030 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fc95d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94157299525248 notifier 4561 bl.length()=167 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fc95d7fa640 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc93c003d60 con 0x7fca7404d030 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(103 notify.3 [notify cookie 94157299776272 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== watch-notify(notify_complete (2) cookie 94157299776272 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2b4651190 con 0x7fca7404d030 2024-09-07T03:32:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.931+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.932+0000 7fc92b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.932+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94157299534672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b464e5e0 con 0x55a2b4631bc0 2024-09-07T03:32:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.933+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94157299534672] v34'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.933+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94157299514016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b464e5e0 con 0x55a2b4635ef0 2024-09-07T03:32:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.934+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94157299514016] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.934+0000 7fca7dd40800 20 remove_watcher() i=0 2024-09-07T03:32:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.934+0000 7fca7dd40800 2 removed watcher, disabling cache 2024-09-07T03:32:38.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.934+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94157299518448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463faa0 con 0x55a2b4631bc0 2024-09-07T03:32:38.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.937+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94157299518448] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x55a2b4631bc0 2024-09-07T03:32:38.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.937+0000 7fca7dd40800 20 remove_watcher() i=1 2024-09-07T03:32:38.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.937+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94157299522448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463faa0 con 0x55a2b4635ef0 2024-09-07T03:32:38.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.938+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94157299522448] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.938+0000 7fca7dd40800 20 remove_watcher() i=2 2024-09-07T03:32:38.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.938+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94157299525248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463faa0 con 0x7fca7404d030 2024-09-07T03:32:38.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.939+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94157299525248] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.939+0000 7fca7dd40800 20 remove_watcher() i=3 2024-09-07T03:32:38.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.939+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94157299519504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b4642680 con 0x55a2b4635ef0 2024-09-07T03:32:38.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.940+0000 7fca7a287640 1 -- 172.21.15.120:0/3878490031 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94157299519504] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7403a020 con 0x55a2b4635ef0 2024-09-07T03:32:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.940+0000 7fca7dd40800 20 remove_watcher() i=4 2024-09-07T03:32:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.940+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94157299527936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463faa0 con 0x55a2b463b050 2024-09-07T03:32:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.942+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94157299527936] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.942+0000 7fca7dd40800 20 remove_watcher() i=5 2024-09-07T03:32:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.942+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94157299532640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463faa0 con 0x55a2b463b050 2024-09-07T03:32:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.943+0000 7fca79a86640 1 -- 172.21.15.120:0/3878490031 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94157299532640] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c045040 con 0x55a2b463b050 2024-09-07T03:32:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.943+0000 7fca7dd40800 20 remove_watcher() i=6 2024-09-07T03:32:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.943+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94157299537184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2b463faa0 con 0x7fca7404d030 2024-09-07T03:32:38.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94157299537184] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca70050040 con 0x7fca7404d030 2024-09-07T03:32:38.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 20 remove_watcher() i=7 2024-09-07T03:32:38.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b4635ef0 msgr2=0x55a2b4638320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b4635ef0 0x55a2b4638320 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b4631bc0 msgr2=0x55a2b4634080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b4631bc0 0x55a2b4634080 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca7404d030 msgr2=0x7fca74020420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fca7404d030 0x7fca74020420 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a2b463b050 msgr2=0x55a2b463d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a2b463b050 0x55a2b463d480 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc94403c780 msgr2=0x7fc94403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc94403c780 0x7fc94403ec40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca6c053ed0 tx=0x7fca6c049000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 msgr2=0x55a2b4626090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca79285640 1 -- 172.21.15.120:0/3878490031 reap_dead start 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b4626090 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fca7400dd00 tx=0x7fca74053dd0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 shutdown_connections 2024-09-07T03:32:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/3878490031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b461eaa0 0x55a2b4626090 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 >> 172.21.15.120:0/3878490031 conn(0x55a2b461aea0 msgr2=0x55a2b46190b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 shutdown_connections 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/3878490031 wait complete. 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/2683692039 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc95403c730 msgr2=0x7fc95403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/2683692039 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc95403c730 0x7fc95403ebf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a2b45f4580 tx=0x7fca6c046340 comp rx=0 tx=0).stop 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/2683692039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b4611f80 msgr2=0x55a2b46123a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/2683692039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b4611f80 0x55a2b46123a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fca74016d20 tx=0x7fca7400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/2683692039 shutdown_connections 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/2683692039 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc95403c730 0x7fc95403ebf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 --2- 172.21.15.120:0/2683692039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b4611f80 0x55a2b46123a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/2683692039 >> 172.21.15.120:0/2683692039 conn(0x55a2b4601f20 msgr2=0x55a2b4602300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/2683692039 shutdown_connections 2024-09-07T03:32:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.944+0000 7fca7dd40800 1 -- 172.21.15.120:0/2683692039 wait complete. 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b45fb1d0 msgr2=0x55a2b45fd670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b45fb1d0 0x55a2b45fd670 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b44fe670 msgr2=0x55a2b45fa3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b44fe670 0x55a2b45fa3e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc96003c780 msgr2=0x7fc96003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc96003c780 0x7fc96003ec40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca70058000 tx=0x7fca70053000 comp rx=0 tx=0).stop 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 msgr2=0x55a2b45f2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45f2d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c010 tx=0x7fca6c000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 shutdown_connections 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a2b45fb1d0 0x55a2b45fd670 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a2b44fe670 0x55a2b45fa3e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc96003c780 0x7fc96003ec40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 --2- 172.21.15.120:0/4106861928 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a2b44fd460 0x55a2b45f2d90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:38.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 >> 172.21.15.120:0/4106861928 conn(0x55a2b44f7930 msgr2=0x55a2b45ec770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:38.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 shutdown_connections 2024-09-07T03:32:38.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:38.945+0000 7fca7dd40800 1 -- 172.21.15.120:0/4106861928 wait complete. 2024-09-07T03:32:38.962 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-07T03:32:38.972 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-07T03:32:39.017 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:39.018 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-07T03:32:39.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-07T03:32:39.018 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-07T03:32:39.065 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:39.065 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:39.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.063+0000 7fb4c6125800 1 Processor -- start 2024-09-07T03:32:39.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.063+0000 7fb4c6125800 1 -- start start 2024-09-07T03:32:39.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.063+0000 7fb4c6125800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5609970cd210 0x5609970cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.063+0000 7fb4c6125800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560996f72e40 con 0x5609970c96a0 2024-09-07T03:32:39.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.063+0000 7fb4c6125800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560996f3d680 con 0x5609970cd210 2024-09-07T03:32:39.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.064+0000 7fb4bbfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5609970cd210 0x5609970cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.064+0000 7fb4c1dae640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5609970c96a0 0x5609970cba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42278/0 (socket says 172.21.15.120:42278) 2024-09-07T03:32:39.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.064+0000 7fb4c1dae640 1 -- 172.21.15.120:0/2868264176 learned_addr learned my addr 172.21.15.120:0/2868264176 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:39.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.064+0000 7fb4bbfff640 1 -- 172.21.15.120:0/2868264176 >> v1:172.21.15.104:6789/0 conn(0x5609970c96a0 legacy=0x5609970cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.064+0000 7fb4bbfff640 1 -- 172.21.15.120:0/2868264176 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560996f596b0 con 0x5609970cd210 2024-09-07T03:32:39.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.064+0000 7fb4c15ad640 1 -- 172.21.15.120:0/2868264176 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3933645868 0 0) 0x560996f72e40 con 0x5609970c96a0 2024-09-07T03:32:39.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4bbfff640 1 --2- 172.21.15.120:0/2868264176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970cd210 0x5609970cf6d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00a470 tx=0x7fb4ac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749825d38f58f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c15ad640 1 -- 172.21.15.120:0/2868264176 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4ac053570 con 0x5609970cd210 2024-09-07T03:32:39.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c15ad640 1 -- 172.21.15.120:0/2868264176 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ac058070 con 0x5609970cd210 2024-09-07T03:32:39.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c15ad640 1 -- 172.21.15.120:0/2868264176 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4ac053880 con 0x5609970cd210 2024-09-07T03:32:39.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c6125800 1 -- 172.21.15.120:0/2868264176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970cd210 msgr2=0x5609970cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2868264176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970cd210 0x5609970cf6d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00a470 tx=0x7fb4ac045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:39.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c6125800 1 -- 172.21.15.120:0/2868264176 shutdown_connections 2024-09-07T03:32:39.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2868264176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970cd210 0x5609970cf6d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c6125800 1 -- 172.21.15.120:0/2868264176 >> 172.21.15.120:0/2868264176 conn(0x5609970c3200 msgr2=0x5609970c5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c6125800 1 -- 172.21.15.120:0/2868264176 shutdown_connections 2024-09-07T03:32:39.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.066+0000 7fb4c6125800 1 -- 172.21.15.120:0/2868264176 wait complete. 2024-09-07T03:32:39.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.080+0000 7fb4c6125800 1 Processor -- start 2024-09-07T03:32:39.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.080+0000 7fb4c6125800 1 -- start start 2024-09-07T03:32:39.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.081+0000 7fb4c6125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.081+0000 7fb4c6125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560996f61dd0 con 0x5609970c96a0 2024-09-07T03:32:39.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.081+0000 7fb4c1dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.081+0000 7fb4c1dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971b8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52248/0 (socket says 172.21.15.120:52248) 2024-09-07T03:32:39.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.081+0000 7fb4c1dae640 1 -- 172.21.15.120:0/3248867152 learned_addr learned my addr 172.21.15.120:0/3248867152 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.081+0000 7fb4c1dae640 1 -- 172.21.15.120:0/3248867152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560996f7ae10 con 0x5609970c96a0 2024-09-07T03:32:39.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.081+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/3248867152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971b8450 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4001ea0 tx=0x7fb4b400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245aa415e42b174d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb3afe07640 1 -- 172.21.15.120:0/3248867152 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4b4008070 con 0x5609970c96a0 2024-09-07T03:32:39.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb3afe07640 1 -- 172.21.15.120:0/3248867152 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b400d500 con 0x5609970c96a0 2024-09-07T03:32:39.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb3afe07640 1 -- 172.21.15.120:0/3248867152 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4b400d880 con 0x5609970c96a0 2024-09-07T03:32:39.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb4c6125800 1 -- 172.21.15.120:0/3248867152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 msgr2=0x5609971b8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb4c6125800 1 --2- 172.21.15.120:0/3248867152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971b8450 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4001ea0 tx=0x7fb4b400b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb4c6125800 1 -- 172.21.15.120:0/3248867152 shutdown_connections 2024-09-07T03:32:39.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb4c6125800 1 --2- 172.21.15.120:0/3248867152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971b8450 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb4c6125800 1 -- 172.21.15.120:0/3248867152 >> 172.21.15.120:0/3248867152 conn(0x5609970c3200 msgr2=0x5609971b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb4c6125800 1 -- 172.21.15.120:0/3248867152 shutdown_connections 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.082+0000 7fb4c6125800 1 -- 172.21.15.120:0/3248867152 wait complete. 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.083+0000 7fb4c6125800 1 Processor -- start 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.083+0000 7fb4c6125800 1 -- start start 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.083+0000 7fb4c6125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.083+0000 7fb4c6125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5609970d0050 con 0x5609970c96a0 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.083+0000 7fb4c1dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.083+0000 7fb4c1dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971bfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52256/0 (socket says 172.21.15.120:52256) 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.083+0000 7fb4c1dae640 1 -- 172.21.15.120:0/2079576466 learned_addr learned my addr 172.21.15.120:0/2079576466 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.084+0000 7fb4c1dae640 1 -- 172.21.15.120:0/2079576466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609971c03a0 con 0x5609970c96a0 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.084+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971bfe40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40012f0 tx=0x7fb4b4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.084+0000 7fb3ae604640 1 -- 172.21.15.120:0/2079576466 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4b400f9d0 con 0x5609970c96a0 2024-09-07T03:32:39.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.084+0000 7fb3ae604640 1 -- 172.21.15.120:0/2079576466 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b400fb70 con 0x5609970c96a0 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.084+0000 7fb3ae604640 1 -- 172.21.15.120:0/2079576466 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4b400fe50 con 0x5609970c96a0 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.084+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609971c0630 con 0x5609970c96a0 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.084+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609971c1030 con 0x5609970c96a0 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.085+0000 7fb3ae604640 1 -- 172.21.15.120:0/2079576466 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb4b4017040 con 0x5609970c96a0 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.085+0000 7fb3ae604640 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb3a803c920 0x7fb3a803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.085+0000 7fb3ae604640 1 -- 172.21.15.120:0/2079576466 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fb4b4015020 con 0x5609970c96a0 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.085+0000 7fb4bbfff640 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb3a803c920 0x7fb3a803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.085+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609970cd210 0x5609971c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.085+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609971c79d0 con 0x5609970cd210 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.085+0000 7fb4c25af640 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609970cd210 0x5609971c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.085+0000 7fb4bbfff640 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb3a803c920 0x7fb3a803ede0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac057000 tx=0x7fb4ac052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.086+0000 7fb4c25af640 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609970cd210 0x5609971c7490 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.086+0000 7fb4c25af640 1 -- 172.21.15.120:0/2079576466 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4bc00a4d0 con 0x5609970cd210 2024-09-07T03:32:39.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.086+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971c8280 0x5609971ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.086+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609971caeb0 con 0x5609971c8280 2024-09-07T03:32:39.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.086+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971c8280 0x5609971ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.087+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971c8280 0x5609971ca740 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.087+0000 7fb4c1dae640 1 -- 172.21.15.120:0/2079576466 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4b402d070 con 0x5609971c8280 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.087+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609971cc760 con 0x5609971c8280 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.087+0000 7fb4c1dae640 1 -- 172.21.15.120:0/2079576466 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb4b402d070 con 0x5609971c8280 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.087+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609971cb8d0 con 0x5609971c8280 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.087+0000 7fb4c1dae640 1 -- 172.21.15.120:0/2079576466 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4b402d070 con 0x5609971c8280 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.087+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609971cbcf0 con 0x5609970cd210 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.088+0000 7fb4c25af640 1 -- 172.21.15.120:0/2079576466 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb4bc00a4d0 con 0x5609970cd210 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.088+0000 7fb4c6125800 1 Processor -- start 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.088+0000 7fb4c6125800 1 -- start start 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.088+0000 7fb4c6125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971daba0 0x5609971dafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.088+0000 7fb4c6125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560996fbfa00 con 0x5609971daba0 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.088+0000 7fb4c25af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971daba0 0x5609971dafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.089+0000 7fb4c25af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971daba0 0x5609971dafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52272/0 (socket says 172.21.15.120:52272) 2024-09-07T03:32:39.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.089+0000 7fb4c25af640 1 -- 172.21.15.120:0/616453939 learned_addr learned my addr 172.21.15.120:0/616453939 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.089+0000 7fb4c25af640 1 -- 172.21.15.120:0/616453939 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609971db600 con 0x5609971daba0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.089+0000 7fb4c25af640 1 --2- 172.21.15.120:0/616453939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971daba0 0x5609971dafc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc016d20 tx=0x7fb4bc00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.089+0000 7fb3a77fe640 1 -- 172.21.15.120:0/616453939 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc017660 con 0x5609971daba0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.089+0000 7fb3a77fe640 1 -- 172.21.15.120:0/616453939 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4bc01b030 con 0x5609971daba0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.089+0000 7fb4c6125800 1 -- 172.21.15.120:0/616453939 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609971dbe30 con 0x5609971daba0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.089+0000 7fb3a77fe640 1 -- 172.21.15.120:0/616453939 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc017950 con 0x5609971daba0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.089+0000 7fb4c6125800 1 -- 172.21.15.120:0/616453939 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609971dc3d0 con 0x5609971daba0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.090+0000 7fb3a77fe640 1 -- 172.21.15.120:0/616453939 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb4bc017af0 con 0x5609971daba0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.090+0000 7fb3a77fe640 1 --2- 172.21.15.120:0/616453939 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb39c03c780 0x7fb39c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.090+0000 7fb3a77fe640 1 -- 172.21.15.120:0/616453939 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fb4bc00e040 con 0x5609971daba0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.090+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/616453939 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb39c03c780 0x7fb39c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c6125800 1 Processor -- start 2024-09-07T03:32:39.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/616453939 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb39c03c780 0x7fb39c03ec40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5609971cb3f0 tx=0x7fb4b4001460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c6125800 1 -- start start 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c6125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971e7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c6125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5609971b8ca0 con 0x5609971e7640 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c25af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971e7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c25af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971e7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52278/0 (socket says 172.21.15.120:52278) 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c25af640 1 -- 172.21.15.120:0/1327183234 learned_addr learned my addr 172.21.15.120:0/1327183234 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c25af640 1 -- 172.21.15.120:0/1327183234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609971e8030 con 0x5609971e7640 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb4c25af640 1 --2- 172.21.15.120:0/1327183234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971e7a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc054030 tx=0x7fb4bc054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f2708751ab4ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb3a57fa640 1 -- 172.21.15.120:0/1327183234 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc014d40 con 0x5609971e7640 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb3a57fa640 1 -- 172.21.15.120:0/1327183234 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4bc0149b0 con 0x5609971e7640 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.091+0000 7fb3a57fa640 1 -- 172.21.15.120:0/1327183234 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc028350 con 0x5609971e7640 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 -- 172.21.15.120:0/1327183234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 msgr2=0x5609971e7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 --2- 172.21.15.120:0/1327183234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971e7a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc054030 tx=0x7fb4bc054060 comp rx=0 tx=0).stop 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 -- 172.21.15.120:0/1327183234 shutdown_connections 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 --2- 172.21.15.120:0/1327183234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971e7a40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 -- 172.21.15.120:0/1327183234 >> 172.21.15.120:0/1327183234 conn(0x5609971e3a40 msgr2=0x5609971e1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 -- 172.21.15.120:0/1327183234 shutdown_connections 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 -- 172.21.15.120:0/1327183234 wait complete. 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 Processor -- start 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 -- start start 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971eec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.092+0000 7fb4c6125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5609971e8620 con 0x5609971e7640 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb4c25af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb4c25af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971eec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52294/0 (socket says 172.21.15.120:52294) 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 learned_addr learned my addr 172.21.15.120:0/799593552 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609971ef190 con 0x5609971e7640 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb4c25af640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971eec30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc053d10 tx=0x7fb4bc053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb3937fe640 1 -- 172.21.15.120:0/799593552 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc012570 con 0x5609971e7640 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb3937fe640 1 -- 172.21.15.120:0/799593552 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4bc005500 con 0x5609971e7640 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609971ef420 con 0x5609971e7640 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb3937fe640 1 -- 172.21.15.120:0/799593552 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4bc055570 con 0x5609971e7640 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.093+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609971effb0 con 0x5609971e7640 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.094+0000 7fb3937fe640 1 -- 172.21.15.120:0/799593552 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb4bc0127a0 con 0x5609971e7640 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.094+0000 7fb3937fe640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb38c03c730 0x7fb38c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.094+0000 7fb3937fe640 1 -- 172.21.15.120:0/799593552 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fb4bc048920 con 0x5609971e7640 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.094+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb38c03c730 0x7fb38c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.095+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb38c03c730 0x7fb38c03ebf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400bbf0 tx=0x7fb4b4043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.095+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.095+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609971fa790 0x5609971fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.095+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609971fd3a0 con 0x5609971fa790 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.095+0000 7fb4bbfff640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609971fa790 0x5609971fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.095+0000 7fb4bbfff640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609971fa790 0x5609971fcc50 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.095+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 20 realm 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609971fd7d0 con 0x5609971fa790 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:39.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609971fe0a0 con 0x5609971fa790 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971feac0 0x560997200ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997201660 con 0x5609971feac0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c25af640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971feac0 0x560997200ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.096+0000 7fb4c25af640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971feac0 0x560997200ef0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c6125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997201eb0 con 0x5609971feac0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c6125800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c6125800 20 searching for the correct realm 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560997203c20 0x560997206050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x560997203c20 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560997203c20 0x560997206050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.097+0000 7fb4c1dae640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560997203c20 0x560997206050 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.098+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.098+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971feac0 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.098+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.098+0000 7fb4c25af640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb4bc014440 0x7fb4bc03bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.098+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x7fb4bc014440 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.098+0000 7fb4bbfff640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb4bc014440 0x7fb4bc03bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.098+0000 7fb4bbfff640 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb4bc014440 0x7fb4bc03bab0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.099+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.099+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.099+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.099+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.099+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.099+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x560997203c20 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.099+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.099+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.100+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.100+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971feac0 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.100+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.100+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971feac0 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.100+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.100+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.100+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.100+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x7fb4bc014440 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.100+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.101+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.101+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.101+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x7fb4bc014440 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.101+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.101+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971feac0 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.101+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.101+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x560997203c20 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.102+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.102+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.102+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.102+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971feac0 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.102+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.102+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x560997203c20 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.102+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.102+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.102+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.103+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.103+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.103+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.103+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.103+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x560997203c20 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.103+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.103+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x7fb4bc014440 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.103+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.103+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971fa790 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.104+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.104+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x7fb4bc014440 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.104+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.104+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x560997203c20 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.104+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.104+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x7fb4bc014440 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.104+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.104+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971feac0 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.105+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.105+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971feac0 2024-09-07T03:32:39.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.105+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.105+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x560997203c20 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.105+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.105+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971feac0 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.105+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.105+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560997206720 con 0x5609971feac0 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.105+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:39.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997202830 con 0x5609971fa790 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997202410 con 0x5609971feac0 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997203150 con 0x5609971fa790 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 zone default found 2024-09-07T03:32:39.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 4 Realm: () 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 zonegroup default 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.106+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997207050 con 0x7fb4bc014440 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997209290 con 0x560997203c20 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997209630 con 0x560997203c20 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 20 started sync module instance, tier type = 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.107+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609972086d0 con 0x5609971feac0 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.109+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.109+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599190186736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560997208330 con 0x5609971feac0 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.109+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720a330 con 0x5609971fa790 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.109+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599190186736] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.110+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.110+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599190190544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720a6d0 con 0x5609971fa790 2024-09-07T03:32:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.110+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720b170 con 0x5609971feac0 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.113+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599190190544] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.113+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.113+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599190195264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720b130 con 0x5609971feac0 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.113+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720bbf0 con 0x7fb4bc014440 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.114+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599190195264] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.114+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.114+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599190198016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720bbf0 con 0x7fb4bc014440 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.114+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720c600 con 0x5609971feac0 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.115+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599190198016] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.116+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.116+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599190191600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720c600 con 0x5609971feac0 2024-09-07T03:32:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.116+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720d040 con 0x560997203c20 2024-09-07T03:32:39.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.117+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.117+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599190203280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720d8e0 con 0x560997203c20 2024-09-07T03:32:39.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.117+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720e350 con 0x560997203c20 2024-09-07T03:32:39.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.117+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599190191600] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.119+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599190203280] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.119+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.119+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599190205488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720c150 con 0x560997203c20 2024-09-07T03:32:39.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.119+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720ebf0 con 0x7fb4bc014440 2024-09-07T03:32:39.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599190210368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720eba0 con 0x7fb4bc014440 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4c6125800 20 add_watcher() i=0 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4c6125800 20 add_watcher() i=1 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4c6125800 20 add_watcher() i=2 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4c6125800 20 add_watcher() i=3 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4c6125800 20 add_watcher() i=4 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4c6125800 20 add_watcher() i=5 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599190205488] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.120+0000 7fb4c6125800 20 add_watcher() i=6 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.121+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599190210368] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.121+0000 7fb4c6125800 20 add_watcher() i=7 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.121+0000 7fb4c6125800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.121+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099720de20 con 0x5609971fa790 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.122+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.122+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599190212496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720de20 con 0x5609971fa790 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.123+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599190212496] v34'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.123+0000 7fb3737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.123+0000 7fb4c6125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.123+0000 7fb4c6125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.123+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721aad0 con 0x5609971feac0 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.124+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'48 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.124+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721aad0 con 0x7fb4bc014440 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.125+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.125+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721aad0 con 0x560997203c20 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.126+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.126+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721b530 con 0x5609971fa790 2024-09-07T03:32:39.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.127+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'146 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.127+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721baa0 con 0x5609971feac0 2024-09-07T03:32:39.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.128+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'47 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.128+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721bb30 con 0x560997203c20 2024-09-07T03:32:39.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.129+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'39 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.129+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c0c0 con 0x5609971feac0 2024-09-07T03:32:39.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.130+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.130+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c0a0 con 0x5609971fa790 2024-09-07T03:32:39.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.131+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.131+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c610 con 0x5609971feac0 2024-09-07T03:32:39.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.132+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.132+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c610 con 0x5609971feac0 2024-09-07T03:32:39.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.133+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.133+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c610 con 0x5609971feac0 2024-09-07T03:32:39.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.134+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.134+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c610 con 0x560997203c20 2024-09-07T03:32:39.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.135+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.135+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c610 con 0x5609971feac0 2024-09-07T03:32:39.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.136+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.136+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c610 con 0x5609971fa790 2024-09-07T03:32:39.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.137+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'45 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.137+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c9f0 con 0x5609971fa790 2024-09-07T03:32:39.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.139+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'147 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.139+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c700 con 0x5609971feac0 2024-09-07T03:32:39.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.140+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.140+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c6e0 con 0x5609971feac0 2024-09-07T03:32:39.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.141+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.141+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c6e0 con 0x560997203c20 2024-09-07T03:32:39.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.142+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.142+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c6e0 con 0x5609971feac0 2024-09-07T03:32:39.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.143+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.143+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c6e0 con 0x5609971fa790 2024-09-07T03:32:39.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.144+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'148 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.144+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c6e0 con 0x5609971feac0 2024-09-07T03:32:39.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.145+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.145+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c6e0 con 0x5609971feac0 2024-09-07T03:32:39.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.146+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.146+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c6e0 con 0x560997203c20 2024-09-07T03:32:39.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.147+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.147+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c6e0 con 0x5609971feac0 2024-09-07T03:32:39.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.148+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.148+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c700 con 0x560997203c20 2024-09-07T03:32:39.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.149+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.149+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c700 con 0x560997203c20 2024-09-07T03:32:39.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.150+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'40 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.150+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c700 con 0x560997203c20 2024-09-07T03:32:39.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.151+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.151+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c700 con 0x5609971feac0 2024-09-07T03:32:39.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.152+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.152+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c730 con 0x5609971fa790 2024-09-07T03:32:39.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.153+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.153+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c730 con 0x5609971feac0 2024-09-07T03:32:39.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.155+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.155+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c740 con 0x5609971fa790 2024-09-07T03:32:39.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.156+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'46 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.156+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099721c720 con 0x7fb4bc014440 2024-09-07T03:32:39.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.157+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.157+0000 7fb3727fc640 20 reqs_thread_entry: start 2024-09-07T03:32:39.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.157+0000 7fb4c6125800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:39.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.157+0000 7fb4c6125800 20 Filter name: none 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.157+0000 7fb2e3fff640 20 reqs_thread_entry: start 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.157+0000 7fb4c6125800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.157+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.157+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997247640 con 0x7fb4bc014440 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 : miss 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:95 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560997249040 con 0x5609971fa790 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(95 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 20 get_obj_state: octx=0x7fb4ac053600 obj=myfoo:four state=0x560997249dd8 s->prefetch_data=0 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:96 3.1bs0 3:d9a20653:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56099724af00 con 0x560997203c20 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(96 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 10 manifest: total_size = 4 2024-09-07T03:32:39.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 20 get_obj_state: setting s->obj_tag to cf0fab6f-a978-4ce5-bacd-166891c31743.4225.4499819711175693626 2024-09-07T03:32:39.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 20 get_obj_state: octx=0x7fb4ac053600 obj=myfoo:four state=0x560997249dd8 s->prefetch_data=0 2024-09-07T03:32:39.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 20 prepare_atomic_modification: state is not atomic. state=0x560997249dd8 2024-09-07T03:32:39.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6 2024-09-07T03:32:39.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.158+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 4.5 4:a0612de6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099724f940 con 0x5609971feac0 2024-09-07T03:32:39.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.160+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(97 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.160+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:98 3.1bs0 3:d9a20653:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099724f940 con 0x560997203c20 2024-09-07T03:32:39.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.161+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(98 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1_four [call] v34'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.161+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 4.5 4:a0612de6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560997250270 con 0x5609971feac0 2024-09-07T03:32:39.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.162+0000 7fb3737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.162+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(99 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.162+0000 7fb3a57fa640 20 handle_completion(): completion ok for obj=four 2024-09-07T03:32:39.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.162+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599190212496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560997250270 con 0x5609971fa790 2024-09-07T03:32:39.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.163+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94599190212496] v34'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.163+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599190186736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560997250270 con 0x5609971feac0 2024-09-07T03:32:39.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.165+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94599190186736] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.165+0000 7fb4c6125800 20 remove_watcher() i=0 2024-09-07T03:32:39.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.165+0000 7fb4c6125800 2 removed watcher, disabling cache 2024-09-07T03:32:39.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.165+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599190190544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720ef90 con 0x5609971fa790 2024-09-07T03:32:39.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.166+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94599190190544] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x5609971fa790 2024-09-07T03:32:39.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.166+0000 7fb4c6125800 20 remove_watcher() i=1 2024-09-07T03:32:39.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.166+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599190195264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720ef90 con 0x5609971feac0 2024-09-07T03:32:39.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.167+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94599190195264] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.167+0000 7fb4c6125800 20 remove_watcher() i=2 2024-09-07T03:32:39.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.167+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599190198016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720ac40 con 0x7fb4bc014440 2024-09-07T03:32:39.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.168+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94599190198016] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.168+0000 7fb4c6125800 20 remove_watcher() i=3 2024-09-07T03:32:39.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.168+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599190191600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720ef90 con 0x5609971feac0 2024-09-07T03:32:39.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.169+0000 7fb4c25af640 1 -- 172.21.15.120:0/799593552 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94599190191600] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4bc027070 con 0x5609971feac0 2024-09-07T03:32:39.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.169+0000 7fb4c6125800 20 remove_watcher() i=4 2024-09-07T03:32:39.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.169+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599190203280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720ef90 con 0x560997203c20 2024-09-07T03:32:39.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.170+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94599190203280] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.170+0000 7fb4c6125800 20 remove_watcher() i=5 2024-09-07T03:32:39.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.170+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599190205488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720cb90 con 0x560997203c20 2024-09-07T03:32:39.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.170+0000 7fb4c1dae640 1 -- 172.21.15.120:0/799593552 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94599190205488] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4b402d070 con 0x560997203c20 2024-09-07T03:32:39.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.170+0000 7fb4c6125800 20 remove_watcher() i=6 2024-09-07T03:32:39.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.170+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599190210368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56099720ef90 con 0x7fb4bc014440 2024-09-07T03:32:39.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.171+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94599190210368] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4ac051070 con 0x7fb4bc014440 2024-09-07T03:32:39.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.171+0000 7fb4c6125800 20 remove_watcher() i=7 2024-09-07T03:32:39.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971feac0 msgr2=0x560997200ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971feac0 0x560997200ef0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609971fa790 msgr2=0x5609971fcc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609971fa790 0x5609971fcc50 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb4bc014440 msgr2=0x7fb4bc03bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb4bc014440 0x7fb4bc03bab0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560997203c20 msgr2=0x560997206050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560997203c20 0x560997206050 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb38c03c730 msgr2=0x7fb38c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb38c03c730 0x7fb38c03ebf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400bbf0 tx=0x7fb4b4043000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 msgr2=0x5609971eec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971eec30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc053d10 tx=0x7fb4bc053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4bbfff640 1 -- 172.21.15.120:0/799593552 reap_dead start 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 shutdown_connections 2024-09-07T03:32:39.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/799593552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971e7640 0x5609971eec30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 >> 172.21.15.120:0/799593552 conn(0x5609971e3a40 msgr2=0x5609971e1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 shutdown_connections 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/799593552 wait complete. 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/616453939 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb39c03c780 msgr2=0x7fb39c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/616453939 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb39c03c780 0x7fb39c03ec40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5609971cb3f0 tx=0x7fb4b4001460 comp rx=0 tx=0).stop 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/616453939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971daba0 msgr2=0x5609971dafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/616453939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971daba0 0x5609971dafc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc016d20 tx=0x7fb4bc00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/616453939 shutdown_connections 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/616453939 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb39c03c780 0x7fb39c03ec40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 --2- 172.21.15.120:0/616453939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609971daba0 0x5609971dafc0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/616453939 >> 172.21.15.120:0/616453939 conn(0x5609971cef50 msgr2=0x5609971cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/616453939 shutdown_connections 2024-09-07T03:32:39.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.172+0000 7fb4c6125800 1 -- 172.21.15.120:0/616453939 wait complete. 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971c8280 msgr2=0x5609971ca740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971c8280 0x5609971ca740 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609970cd210 msgr2=0x5609971c7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609970cd210 0x5609971c7490 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb3a803c920 msgr2=0x7fb3a803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb3a803c920 0x7fb3a803ede0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac057000 tx=0x7fb4ac052000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 msgr2=0x5609971bfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971bfe40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40012f0 tx=0x7fb4b4000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 shutdown_connections 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5609971c8280 0x5609971ca740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5609970cd210 0x5609971c7490 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb3a803c920 0x7fb3a803ede0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 --2- 172.21.15.120:0/2079576466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5609970c96a0 0x5609971bfe40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 >> 172.21.15.120:0/2079576466 conn(0x5609970c3200 msgr2=0x5609971b9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 shutdown_connections 2024-09-07T03:32:39.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.173+0000 7fb4c6125800 1 -- 172.21.15.120:0/2079576466 wait complete. 2024-09-07T03:32:39.184 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-07T03:32:39.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-07T03:32:39.184 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-07T03:32:39.228 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:39.228 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:39.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.227+0000 7f3870498800 1 Processor -- start 2024-09-07T03:32:39.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.227+0000 7f3870498800 1 -- start start 2024-09-07T03:32:39.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.227+0000 7f3870498800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560906db9fc0 0x560906dc2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.227+0000 7f3870498800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560906c63e40 con 0x560906db84a0 2024-09-07T03:32:39.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.227+0000 7f3870498800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560906c2e680 con 0x560906db9fc0 2024-09-07T03:32:39.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.227+0000 7f3865781640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560906db9fc0 0x560906dc2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.227+0000 7f3865781640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560906db9fc0 0x560906dc2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52302/0 (socket says 172.21.15.120:52302) 2024-09-07T03:32:39.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.227+0000 7f3865781640 1 -- 172.21.15.120:0/3649227751 learned_addr learned my addr 172.21.15.120:0/3649227751 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.227+0000 7f386df82640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x560906db84a0 0x560906db88a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42292/0 (socket says 172.21.15.120:42292) 2024-09-07T03:32:39.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.228+0000 7f3865781640 1 -- 172.21.15.120:0/3649227751 >> v1:172.21.15.104:6789/0 conn(0x560906db84a0 legacy=0x560906db88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.228+0000 7f386d781640 1 -- 172.21.15.120:0/3649227751 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029740946 0 0) 0x560906c63e40 con 0x560906db84a0 2024-09-07T03:32:39.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.228+0000 7f3865781640 1 -- 172.21.15.120:0/3649227751 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560906c4a6b0 con 0x560906db9fc0 2024-09-07T03:32:39.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.229+0000 7f3865781640 1 --2- 172.21.15.120:0/3649227751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db9fc0 0x560906dc2ae0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f385800a520 tx=0x7f3858045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4c7faa1d71867e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f386d781640 1 -- 172.21.15.120:0/3649227751 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3858055070 con 0x560906db9fc0 2024-09-07T03:32:39.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f386d781640 1 -- 172.21.15.120:0/3649227751 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38580515b0 con 0x560906db9fc0 2024-09-07T03:32:39.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f386d781640 1 -- 172.21.15.120:0/3649227751 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38580518d0 con 0x560906db9fc0 2024-09-07T03:32:39.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f3870498800 1 -- 172.21.15.120:0/3649227751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db9fc0 msgr2=0x560906dc2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f3870498800 1 --2- 172.21.15.120:0/3649227751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db9fc0 0x560906dc2ae0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f385800a520 tx=0x7f3858045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f3870498800 1 -- 172.21.15.120:0/3649227751 shutdown_connections 2024-09-07T03:32:39.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f3870498800 1 --2- 172.21.15.120:0/3649227751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db9fc0 0x560906dc2ae0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f3870498800 1 -- 172.21.15.120:0/3649227751 >> 172.21.15.120:0/3649227751 conn(0x560906db41f0 msgr2=0x560906db6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f3870498800 1 -- 172.21.15.120:0/3649227751 shutdown_connections 2024-09-07T03:32:39.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.230+0000 7f3870498800 1 -- 172.21.15.120:0/3649227751 wait complete. 2024-09-07T03:32:39.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.244+0000 7f3870498800 1 Processor -- start 2024-09-07T03:32:39.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.244+0000 7f3870498800 1 -- start start 2024-09-07T03:32:39.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.244+0000 7f3870498800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.244+0000 7f3870498800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560906c52dd0 con 0x560906db84a0 2024-09-07T03:32:39.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.244+0000 7f386df82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.244+0000 7f386df82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eab620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52318/0 (socket says 172.21.15.120:52318) 2024-09-07T03:32:39.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.244+0000 7f386df82640 1 -- 172.21.15.120:0/1004434662 learned_addr learned my addr 172.21.15.120:0/1004434662 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.245+0000 7f386df82640 1 -- 172.21.15.120:0/1004434662 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560906c6be10 con 0x560906db84a0 2024-09-07T03:32:39.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.245+0000 7f386df82640 1 --2- 172.21.15.120:0/1004434662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eab620 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3860001ea0 tx=0x7f386000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e0fcc0c260883a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.245+0000 7f375be07640 1 -- 172.21.15.120:0/1004434662 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3860008070 con 0x560906db84a0 2024-09-07T03:32:39.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.245+0000 7f375be07640 1 -- 172.21.15.120:0/1004434662 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386000d500 con 0x560906db84a0 2024-09-07T03:32:39.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.245+0000 7f375be07640 1 -- 172.21.15.120:0/1004434662 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386000d880 con 0x560906db84a0 2024-09-07T03:32:39.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 -- 172.21.15.120:0/1004434662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 msgr2=0x560906eab620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 --2- 172.21.15.120:0/1004434662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eab620 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3860001ea0 tx=0x7f386000b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 -- 172.21.15.120:0/1004434662 shutdown_connections 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 --2- 172.21.15.120:0/1004434662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eab620 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 -- 172.21.15.120:0/1004434662 >> 172.21.15.120:0/1004434662 conn(0x560906db41f0 msgr2=0x560906ea6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 -- 172.21.15.120:0/1004434662 shutdown_connections 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 -- 172.21.15.120:0/1004434662 wait complete. 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 Processor -- start 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 -- start start 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eb2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f3870498800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560906dc32f0 con 0x560906db84a0 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.246+0000 7f386df82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eb2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.247+0000 7f386df82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eb2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52324/0 (socket says 172.21.15.120:52324) 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.247+0000 7f386df82640 1 -- 172.21.15.120:0/2381112401 learned_addr learned my addr 172.21.15.120:0/2381112401 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.247+0000 7f386df82640 1 -- 172.21.15.120:0/2381112401 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560906eb3530 con 0x560906db84a0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.247+0000 7f386df82640 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eb2fd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f38600012f0 tx=0x7f3860000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.247+0000 7f375a604640 1 -- 172.21.15.120:0/2381112401 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386000f9d0 con 0x560906db84a0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.247+0000 7f375a604640 1 -- 172.21.15.120:0/2381112401 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386000fb70 con 0x560906db84a0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.247+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560906eb37c0 con 0x560906db84a0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.247+0000 7f375a604640 1 -- 172.21.15.120:0/2381112401 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386000fe50 con 0x560906db84a0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.247+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560906eb41c0 con 0x560906db84a0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.248+0000 7f375a604640 1 -- 172.21.15.120:0/2381112401 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3860017040 con 0x560906db84a0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.248+0000 7f375a604640 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f375403c920 0x7f375403ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.248+0000 7f375a604640 1 -- 172.21.15.120:0/2381112401 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f3860015020 con 0x560906db84a0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.248+0000 7f3865781640 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f375403c920 0x7f375403ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.248+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906db9fc0 0x560906eba620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.248+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ebab60 con 0x560906db9fc0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.249+0000 7f386e783640 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906db9fc0 0x560906eba620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.249+0000 7f3865781640 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f375403c920 0x7f375403ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3858057000 tx=0x7f3858052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.249+0000 7f386e783640 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906db9fc0 0x560906eba620 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.249+0000 7f386e783640 1 -- 172.21.15.120:0/2381112401 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f386800a4d0 con 0x560906db9fc0 2024-09-07T03:32:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.249+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ebb410 0x560906ebd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.249+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ebdff0 con 0x560906ebb410 2024-09-07T03:32:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.249+0000 7f386df82640 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ebb410 0x560906ebd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.250+0000 7f386df82640 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ebb410 0x560906ebd880 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.250+0000 7f386df82640 1 -- 172.21.15.120:0/2381112401 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f386002d070 con 0x560906ebb410 2024-09-07T03:32:39.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.250+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ebf8a0 con 0x560906ebb410 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.250+0000 7f386df82640 1 -- 172.21.15.120:0/2381112401 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f386002d070 con 0x560906ebb410 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.250+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ebea10 con 0x560906ebb410 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.250+0000 7f386df82640 1 -- 172.21.15.120:0/2381112401 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f386002d070 con 0x560906ebb410 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.250+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ebee30 con 0x560906db9fc0 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.251+0000 7f386e783640 1 -- 172.21.15.120:0/2381112401 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f386800a4d0 con 0x560906db9fc0 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.251+0000 7f3870498800 1 Processor -- start 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.251+0000 7f3870498800 1 -- start start 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.251+0000 7f3870498800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906ecdd50 0x560906ece170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.251+0000 7f3870498800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560906cb0a00 con 0x560906ecdd50 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f386e783640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906ecdd50 0x560906ece170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f386e783640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906ecdd50 0x560906ece170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52326/0 (socket says 172.21.15.120:52326) 2024-09-07T03:32:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f386e783640 1 -- 172.21.15.120:0/3449104255 learned_addr learned my addr 172.21.15.120:0/3449104255 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f386e783640 1 -- 172.21.15.120:0/3449104255 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560906ece7b0 con 0x560906ecdd50 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f386e783640 1 --2- 172.21.15.120:0/3449104255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906ecdd50 0x560906ece170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3868016d20 tx=0x7f386800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f37537fe640 1 -- 172.21.15.120:0/3449104255 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868017660 con 0x560906ecdd50 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f37537fe640 1 -- 172.21.15.120:0/3449104255 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386801b030 con 0x560906ecdd50 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f3870498800 1 -- 172.21.15.120:0/3449104255 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560906ecefe0 con 0x560906ecdd50 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f37537fe640 1 -- 172.21.15.120:0/3449104255 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868017950 con 0x560906ecdd50 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.252+0000 7f3870498800 1 -- 172.21.15.120:0/3449104255 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560906ecf580 con 0x560906ecdd50 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.253+0000 7f37537fe640 1 -- 172.21.15.120:0/3449104255 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3868017b40 con 0x560906ecdd50 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.253+0000 7f37537fe640 1 --2- 172.21.15.120:0/3449104255 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374803c730 0x7f374803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.253+0000 7f37537fe640 1 -- 172.21.15.120:0/3449104255 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f386800e040 con 0x560906ecdd50 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.253+0000 7f386df82640 1 --2- 172.21.15.120:0/3449104255 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374803c730 0x7f374803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.253+0000 7f3870498800 1 Processor -- start 2024-09-07T03:32:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.253+0000 7f386df82640 1 --2- 172.21.15.120:0/3449104255 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374803c730 0x7f374803ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x560906ebe530 tx=0x7f3860001460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f3870498800 1 -- start start 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f3870498800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906edabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f3870498800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560906eabe70 con 0x560906eda7f0 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f386e783640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906edabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f386e783640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906edabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52330/0 (socket says 172.21.15.120:52330) 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f386e783640 1 -- 172.21.15.120:0/1276244788 learned_addr learned my addr 172.21.15.120:0/1276244788 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f386e783640 1 -- 172.21.15.120:0/1276244788 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560906edb1e0 con 0x560906eda7f0 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f386e783640 1 --2- 172.21.15.120:0/1276244788 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906edabf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3868013450 tx=0x7f3868053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa69d16e68c4d16f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f37517fa640 1 -- 172.21.15.120:0/1276244788 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868014a00 con 0x560906eda7f0 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f37517fa640 1 -- 172.21.15.120:0/1276244788 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3868051070 con 0x560906eda7f0 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.254+0000 7f37517fa640 1 -- 172.21.15.120:0/1276244788 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868028350 con 0x560906eda7f0 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 -- 172.21.15.120:0/1276244788 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 msgr2=0x560906edabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 --2- 172.21.15.120:0/1276244788 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906edabf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3868013450 tx=0x7f3868053f40 comp rx=0 tx=0).stop 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 -- 172.21.15.120:0/1276244788 shutdown_connections 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 --2- 172.21.15.120:0/1276244788 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906edabf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 -- 172.21.15.120:0/1276244788 >> 172.21.15.120:0/1276244788 conn(0x560906ed6bf0 msgr2=0x560906ed4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 -- 172.21.15.120:0/1276244788 shutdown_connections 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 -- 172.21.15.120:0/1276244788 wait complete. 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 Processor -- start 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 -- start start 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906ee1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.255+0000 7f3870498800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560906edb800 con 0x560906eda7f0 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f386e783640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906ee1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f386e783640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906ee1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52342/0 (socket says 172.21.15.120:52342) 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 learned_addr learned my addr 172.21.15.120:0/1509337286 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560906ee2360 con 0x560906eda7f0 2024-09-07T03:32:39.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f386e783640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906ee1e00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3868053f80 tx=0x7f3868053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f373f7fe640 1 -- 172.21.15.120:0/1509337286 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868005030 con 0x560906eda7f0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f373f7fe640 1 -- 172.21.15.120:0/1509337286 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38680051d0 con 0x560906eda7f0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560906ee25f0 con 0x560906eda7f0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f373f7fe640 1 -- 172.21.15.120:0/1509337286 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38680054f0 con 0x560906eda7f0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.256+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560906ee2f70 con 0x560906eda7f0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.257+0000 7f373f7fe640 1 -- 172.21.15.120:0/1509337286 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3868055280 con 0x560906eda7f0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.257+0000 7f373f7fe640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f373803c730 0x7f373803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.257+0000 7f373f7fe640 1 -- 172.21.15.120:0/1509337286 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f3868035ca0 con 0x560906eda7f0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.257+0000 7f386df82640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f373803c730 0x7f373803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.257+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.257+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906eed890 0x560906eefd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.257+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ef04a0 con 0x560906eed890 2024-09-07T03:32:39.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.257+0000 7f386df82640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f373803c730 0x7f373803ebf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f386000efd0 tx=0x7f3860043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3865781640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906eed890 0x560906eefd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3865781640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906eed890 0x560906eefd50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3870498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3870498800 20 realm 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ef08d0 con 0x560906eed890 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3870498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3870498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.258+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ef11a0 con 0x560906eed890 2024-09-07T03:32:39.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f3870498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ef1bc0 0x560906ef3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ef4720 con 0x560906ef1bc0 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f386e783640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ef1bc0 0x560906ef3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f386e783640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ef1bc0 0x560906ef3fb0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f3870498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.259+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ef4fc0 con 0x560906ef1bc0 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.260+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.260+0000 7f3870498800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:39.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.260+0000 7f3870498800 20 searching for the correct realm 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.260+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560906ef6d30 0x560906ef9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.260+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef6d30 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.260+0000 7f386df82640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560906ef6d30 0x560906ef9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.260+0000 7f386df82640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560906ef6d30 0x560906ef9140 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.260+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.260+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef1bc0 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.261+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.261+0000 7f386e783640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f386804e7c0 0x7f3868052170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.261+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x7f386804e7c0 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.261+0000 7f3865781640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f386804e7c0 0x7f3868052170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.261+0000 7f3865781640 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f386804e7c0 0x7f3868052170 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.261+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.261+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.261+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.261+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.262+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.262+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef6d30 2024-09-07T03:32:39.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.262+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.262+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.262+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.262+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef1bc0 2024-09-07T03:32:39.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.262+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.262+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef1bc0 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x7f386804e7c0 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x7f386804e7c0 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.263+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef1bc0 2024-09-07T03:32:39.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.264+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.264+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef6d30 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.264+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.264+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.264+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.264+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef1bc0 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.264+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.264+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef6d30 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef6d30 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.265+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x7f386804e7c0 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.266+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.266+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906eed890 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.266+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.266+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x7f386804e7c0 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.266+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.266+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef6d30 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.266+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.266+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x7f386804e7c0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef1bc0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef1bc0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef6d30 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef1bc0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.267+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560906ef9810 con 0x560906ef1bc0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:39.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ef5940 con 0x560906eed890 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ef5d90 con 0x560906ef1bc0 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.268+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ef61f0 con 0x560906eed890 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 zone default found 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 4 Realm: () 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 zonegroup default 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906ef54c0 con 0x7f386804e7c0 2024-09-07T03:32:39.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906efbf10 con 0x560906ef6d30 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906efc3d0 con 0x560906ef6d30 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 started sync module instance, tier type = 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.269+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906efad10 con 0x560906ef1bc0 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.270+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.270+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596771066384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906efad10 con 0x560906ef1bc0 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.270+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906efcf80 con 0x560906eed890 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.271+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94596771066384] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.271+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.272+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596771072592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906efd320 con 0x560906eed890 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.272+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906efdd90 con 0x560906ef1bc0 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.272+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94596771072592] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.273+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.273+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94596771076192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906efdd50 con 0x560906ef1bc0 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.273+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906efe890 con 0x7f386804e7c0 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.274+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94596771076192] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.274+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.274+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94596771079072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906efe890 con 0x7f386804e7c0 2024-09-07T03:32:39.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.274+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906eff2d0 con 0x560906ef1bc0 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.275+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94596771079072] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.275+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.275+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596771063904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906eff2d0 con 0x560906ef1bc0 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.275+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906effce0 con 0x560906ef6d30 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.276+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.276+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94596771063904] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.276+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596771081760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906eff240 con 0x560906ef6d30 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.276+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f00ba0 con 0x560906ef6d30 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.277+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94596771081760] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.277+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.277+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94596771088112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f00fc0 con 0x560906ef6d30 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.277+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f01980 con 0x7f386804e7c0 2024-09-07T03:32:39.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94596771088112] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94596771089648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f01980 con 0x7f386804e7c0 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 20 add_watcher() i=0 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 20 add_watcher() i=1 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 20 add_watcher() i=2 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 20 add_watcher() i=3 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 20 add_watcher() i=4 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 20 add_watcher() i=5 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 20 add_watcher() i=6 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94596771089648] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 20 add_watcher() i=7 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.279+0000 7f3870498800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:39.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.280+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f04db0 con 0x560906eed890 2024-09-07T03:32:39.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.280+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.280+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94596771092128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f02230 con 0x560906eed890 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.281+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94596771092128] v34'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.281+0000 7f371f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 5 note: GC not initialized 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f371e7fc640 20 reqs_thread_entry: start 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 20 Filter name: none 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f368ffff640 20 reqs_thread_entry: start 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f37e90 con 0x7f386804e7c0 2024-09-07T03:32:39.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.282+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f38720 con 0x560906eed890 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3870498800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3870498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f37140 con 0x7f386804e7c0 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3870498800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3870498800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f39d30 con 0x560906eed890 2024-09-07T03:32:39.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.283+0000 7f3870498800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 4.1c 4:39102d40:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f3b7a0 con 0x7f386804e7c0 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 4.31 4:8df6caeb:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f3e360 con 0x560906ef1bc0 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:68 4.19 4:985013a3:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f40e40 con 0x560906ef6d30 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 4.25 4:a77a67e6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f436b0 con 0x560906ef1bc0 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 4.5 4:a27908f1:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f45f20 con 0x560906ef1bc0 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 4.20 4:066752fa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f483f0 con 0x560906ef1bc0 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 4.5 4:a0612de6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f4b120 con 0x560906ef1bc0 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 4.23 4:c790c41e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f4de40 con 0x560906ef6d30 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:74 4.16 4:6b625f27:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f506b0 con 0x560906ef6d30 2024-09-07T03:32:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 4.38 4:1d9d37b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f52fa0 con 0x560906ef1bc0 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:76 4.30 4:0fa4adf5:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560906f55990 con 0x560906ef1bc0 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(66 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(68 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(74 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(67 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(69 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(71 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(75 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.6 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.284+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(76 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.285+0000 7f371f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.285+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94596771092128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f55990 con 0x560906eed890 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.286+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94596771092128] v34'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.287+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94596771066384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f357f0 con 0x560906ef1bc0 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.288+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94596771066384] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.288+0000 7f3870498800 20 remove_watcher() i=0 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.288+0000 7f3870498800 2 removed watcher, disabling cache 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.288+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94596771072592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f357f0 con 0x560906eed890 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.289+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94596771072592] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3858057030 con 0x560906eed890 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.289+0000 7f3870498800 20 remove_watcher() i=1 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.289+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94596771076192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f357f0 con 0x560906ef1bc0 2024-09-07T03:32:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.289+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94596771076192] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.289+0000 7f3870498800 20 remove_watcher() i=2 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.289+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94596771079072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f357f0 con 0x7f386804e7c0 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.290+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94596771079072] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.290+0000 7f3870498800 20 remove_watcher() i=3 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.291+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94596771063904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f357f0 con 0x560906ef1bc0 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.291+0000 7f386e783640 1 -- 172.21.15.120:0/1509337286 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94596771063904] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386803b070 con 0x560906ef1bc0 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.291+0000 7f3870498800 20 remove_watcher() i=4 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.291+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94596771081760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f357f0 con 0x560906ef6d30 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.292+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94596771081760] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.292+0000 7f3870498800 20 remove_watcher() i=5 2024-09-07T03:32:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.292+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94596771088112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f357f0 con 0x560906ef6d30 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.293+0000 7f386df82640 1 -- 172.21.15.120:0/1509337286 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94596771088112] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386002d070 con 0x560906ef6d30 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.293+0000 7f3870498800 20 remove_watcher() i=6 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.293+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94596771089648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560906f357f0 con 0x7f386804e7c0 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.294+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94596771089648] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3858057030 con 0x7f386804e7c0 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.294+0000 7f3870498800 20 remove_watcher() i=7 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.294+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ef1bc0 msgr2=0x560906ef3fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.294+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ef1bc0 0x560906ef3fb0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.294+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906eed890 msgr2=0x560906eefd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.294+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906eed890 0x560906eefd50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f386804e7c0 msgr2=0x7f3868052170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f386804e7c0 0x7f3868052170 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560906ef6d30 msgr2=0x560906ef9140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560906ef6d30 0x560906ef9140 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f373803c730 msgr2=0x7f373803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f373803c730 0x7f373803ebf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f386000efd0 tx=0x7f3860043000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3865781640 1 -- 172.21.15.120:0/1509337286 reap_dead start 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 msgr2=0x560906ee1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906ee1e00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3868053f80 tx=0x7f3868053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 shutdown_connections 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/1509337286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906eda7f0 0x560906ee1e00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 >> 172.21.15.120:0/1509337286 conn(0x560906ed6bf0 msgr2=0x560906ed4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 shutdown_connections 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/1509337286 wait complete. 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/3449104255 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374803c730 msgr2=0x7f374803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/3449104255 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374803c730 0x7f374803ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x560906ebe530 tx=0x7f3860001460 comp rx=0 tx=0).stop 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/3449104255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906ecdd50 msgr2=0x560906ece170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/3449104255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906ecdd50 0x560906ece170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3868016d20 tx=0x7f386800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/3449104255 shutdown_connections 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/3449104255 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f374803c730 0x7f374803ebf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/3449104255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906ecdd50 0x560906ece170 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/3449104255 >> 172.21.15.120:0/3449104255 conn(0x560906ec2100 msgr2=0x560906ec24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/3449104255 shutdown_connections 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/3449104255 wait complete. 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ebb410 msgr2=0x560906ebd880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ebb410 0x560906ebd880 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906db9fc0 msgr2=0x560906eba620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.295+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906db9fc0 0x560906eba620 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f375403c920 msgr2=0x7f375403ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f375403c920 0x7f375403ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3858057000 tx=0x7f3858052000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 msgr2=0x560906eb2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eb2fd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f38600012f0 tx=0x7f3860000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 shutdown_connections 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560906ebb410 0x560906ebd880 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560906db9fc0 0x560906eba620 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f375403c920 0x7f375403ede0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 --2- 172.21.15.120:0/2381112401 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560906db84a0 0x560906eb2fd0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 >> 172.21.15.120:0/2381112401 conn(0x560906db41f0 msgr2=0x560906eac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 shutdown_connections 2024-09-07T03:32:39.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.296+0000 7f3870498800 1 -- 172.21.15.120:0/2381112401 wait complete. 2024-09-07T03:32:39.313 INFO:teuthology.orchestra.run.smithi120.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1445b2f9-7226-49a1-ba30-52d0fcf4c719","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","marker":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-07T03:32:38.747628Z","creation_time":"2024-09-07T03:32:35.744783Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-07T03:32:39.314 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1445b2f9-7226-49a1-ba30-52d0fcf4c719', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-07T03:32:38.747628Z', 'creation_time': '2024-09-07T03:32:35.744783Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-07T03:32:39.314 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-07T03:32:39.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-07T03:32:39.314 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-07T03:32:39.356 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:39.357 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.355+0000 7f165abaf800 1 Processor -- start 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.355+0000 7f165abaf800 1 -- start start 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.355+0000 7f165abaf800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e4fe3f2210 0x55e4fe3f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.355+0000 7f165abaf800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4fe297e40 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.355+0000 7f165abaf800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e4fe262680 con 0x55e4fe3f2210 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.355+0000 7f1657e9f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e4fe3f2210 0x55e4fe3f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.355+0000 7f16586a0640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55e4fe3ee6a0 0x55e4fe3f0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42294/0 (socket says 172.21.15.120:42294) 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.355+0000 7f16586a0640 1 -- 172.21.15.120:0/1506515098 learned_addr learned my addr 172.21.15.120:0/1506515098 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.356+0000 7f1657e9f640 1 -- 172.21.15.120:0/1506515098 >> v1:172.21.15.104:6789/0 conn(0x55e4fe3ee6a0 legacy=0x55e4fe3f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.356+0000 7f165769e640 1 -- 172.21.15.120:0/1506515098 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673684717 0 0) 0x55e4fe297e40 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.356+0000 7f1657e9f640 1 -- 172.21.15.120:0/1506515098 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4fe27e6b0 con 0x55e4fe3f2210 2024-09-07T03:32:39.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.357+0000 7f1657e9f640 1 --2- 172.21.15.120:0/1506515098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3f2210 0x55e4fe3f46b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f164000a470 tx=0x7f1640045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5ff408399f4dda server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.357+0000 7f165769e640 1 -- 172.21.15.120:0/1506515098 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1640053570 con 0x55e4fe3f2210 2024-09-07T03:32:39.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.358+0000 7f165769e640 1 -- 172.21.15.120:0/1506515098 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1640058070 con 0x55e4fe3f2210 2024-09-07T03:32:39.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.358+0000 7f165769e640 1 -- 172.21.15.120:0/1506515098 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1640053880 con 0x55e4fe3f2210 2024-09-07T03:32:39.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.358+0000 7f165abaf800 1 -- 172.21.15.120:0/1506515098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3f2210 msgr2=0x55e4fe3f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.358+0000 7f165abaf800 1 --2- 172.21.15.120:0/1506515098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3f2210 0x55e4fe3f46b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f164000a470 tx=0x7f1640045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:39.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.358+0000 7f165abaf800 1 -- 172.21.15.120:0/1506515098 shutdown_connections 2024-09-07T03:32:39.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.358+0000 7f165abaf800 1 --2- 172.21.15.120:0/1506515098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3f2210 0x55e4fe3f46b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.358+0000 7f165abaf800 1 -- 172.21.15.120:0/1506515098 >> 172.21.15.120:0/1506515098 conn(0x55e4fe3e81e0 msgr2=0x55e4fe3ea620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.358+0000 7f165abaf800 1 -- 172.21.15.120:0/1506515098 shutdown_connections 2024-09-07T03:32:39.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.358+0000 7f165abaf800 1 -- 172.21.15.120:0/1506515098 wait complete. 2024-09-07T03:32:39.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.371+0000 7f165abaf800 1 Processor -- start 2024-09-07T03:32:39.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.372+0000 7f165abaf800 1 -- start start 2024-09-07T03:32:39.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.372+0000 7f165abaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4dd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.372+0000 7f165abaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4fe286dd0 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.372+0000 7f16586a0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4dd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.372+0000 7f16586a0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4dd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52348/0 (socket says 172.21.15.120:52348) 2024-09-07T03:32:39.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.372+0000 7f16586a0640 1 -- 172.21.15.120:0/1608800469 learned_addr learned my addr 172.21.15.120:0/1608800469 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.372+0000 7f16586a0640 1 -- 172.21.15.120:0/1608800469 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4fe29fe10 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.372+0000 7f16586a0640 1 --2- 172.21.15.120:0/1608800469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4dd470 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1648001ea0 tx=0x7f164800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51ab63864fa0abb server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f154660c640 1 -- 172.21.15.120:0/1608800469 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1648008070 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f154660c640 1 -- 172.21.15.120:0/1608800469 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f164800d500 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f154660c640 1 -- 172.21.15.120:0/1608800469 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f164800d880 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f165abaf800 1 -- 172.21.15.120:0/1608800469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 msgr2=0x55e4fe4dd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f165abaf800 1 --2- 172.21.15.120:0/1608800469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4dd470 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1648001ea0 tx=0x7f164800b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f165abaf800 1 -- 172.21.15.120:0/1608800469 shutdown_connections 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f165abaf800 1 --2- 172.21.15.120:0/1608800469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4dd470 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f165abaf800 1 -- 172.21.15.120:0/1608800469 >> 172.21.15.120:0/1608800469 conn(0x55e4fe3e81e0 msgr2=0x55e4fe4d8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f165abaf800 1 -- 172.21.15.120:0/1608800469 shutdown_connections 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.373+0000 7f165abaf800 1 -- 172.21.15.120:0/1608800469 wait complete. 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.374+0000 7f165abaf800 1 Processor -- start 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.374+0000 7f165abaf800 1 -- start start 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.374+0000 7f165abaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.374+0000 7f165abaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4fe3f5030 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.374+0000 7f16586a0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.374+0000 7f16586a0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4e4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52350/0 (socket says 172.21.15.120:52350) 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.374+0000 7f16586a0640 1 -- 172.21.15.120:0/2989696104 learned_addr learned my addr 172.21.15.120:0/2989696104 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.374+0000 7f16586a0640 1 -- 172.21.15.120:0/2989696104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4fe4e5320 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.375+0000 7f16586a0640 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4e4dc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f16480012f0 tx=0x7f1648000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.375+0000 7f1544e09640 1 -- 172.21.15.120:0/2989696104 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f164800f9d0 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.375+0000 7f1544e09640 1 -- 172.21.15.120:0/2989696104 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f164800fb70 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.375+0000 7f1544e09640 1 -- 172.21.15.120:0/2989696104 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f164800fe50 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.375+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4fe4e55b0 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.375+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4fe4e5fb0 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.376+0000 7f1544e09640 1 -- 172.21.15.120:0/2989696104 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1648017040 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.376+0000 7f1544e09640 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f154003c8d0 0x7f154003ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.376+0000 7f1544e09640 1 -- 172.21.15.120:0/2989696104 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1648015020 con 0x55e4fe3ee6a0 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.376+0000 7f1657e9f640 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f154003c8d0 0x7f154003ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.376+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe3f2210 0x55e4fe4ec410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.376+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe4ec950 con 0x55e4fe3f2210 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.376+0000 7f1658ea1640 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe3f2210 0x55e4fe4ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.376+0000 7f1657e9f640 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f154003c8d0 0x7f154003ed90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1640057000 tx=0x7f1640052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.376+0000 7f1658ea1640 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe3f2210 0x55e4fe4ec410 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.377+0000 7f1658ea1640 1 -- 172.21.15.120:0/2989696104 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f165000a4d0 con 0x55e4fe3f2210 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.377+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe4ed200 0x55e4fe4ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.377+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe4efe30 con 0x55e4fe4ed200 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.377+0000 7f16586a0640 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe4ed200 0x55e4fe4ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.377+0000 7f16586a0640 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe4ed200 0x55e4fe4ef6c0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.377+0000 7f16586a0640 1 -- 172.21.15.120:0/2989696104 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe4ed200 2024-09-07T03:32:39.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.378+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe4f16e0 con 0x55e4fe4ed200 2024-09-07T03:32:39.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.378+0000 7f16586a0640 1 -- 172.21.15.120:0/2989696104 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe4ed200 2024-09-07T03:32:39.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.378+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe4f07f0 con 0x55e4fe4ed200 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.378+0000 7f16586a0640 1 -- 172.21.15.120:0/2989696104 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe4ed200 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.378+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe4f0c50 con 0x55e4fe3f2210 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.378+0000 7f1658ea1640 1 -- 172.21.15.120:0/2989696104 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f165000a4d0 con 0x55e4fe3f2210 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.379+0000 7f165abaf800 1 Processor -- start 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.379+0000 7f165abaf800 1 -- start start 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.379+0000 7f165abaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe4ffb80 0x55e4fe4fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.379+0000 7f165abaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4fe2e4a00 con 0x55e4fe4ffb80 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.379+0000 7f1658ea1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe4ffb80 0x55e4fe4fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.379+0000 7f1658ea1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe4ffb80 0x55e4fe4fffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52354/0 (socket says 172.21.15.120:52354) 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.379+0000 7f1658ea1640 1 -- 172.21.15.120:0/2946567365 learned_addr learned my addr 172.21.15.120:0/2946567365 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.379+0000 7f1658ea1640 1 -- 172.21.15.120:0/2946567365 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4fe5005e0 con 0x55e4fe4ffb80 2024-09-07T03:32:39.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.379+0000 7f1658ea1640 1 --2- 172.21.15.120:0/2946567365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe4ffb80 0x55e4fe4fffa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1650016d20 tx=0x7f165000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.380+0000 7f153dffb640 1 -- 172.21.15.120:0/2946567365 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1650017660 con 0x55e4fe4ffb80 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.380+0000 7f153dffb640 1 -- 172.21.15.120:0/2946567365 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165001b030 con 0x55e4fe4ffb80 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.380+0000 7f165abaf800 1 -- 172.21.15.120:0/2946567365 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4fe500e10 con 0x55e4fe4ffb80 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.380+0000 7f153dffb640 1 -- 172.21.15.120:0/2946567365 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1650017950 con 0x55e4fe4ffb80 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.380+0000 7f165abaf800 1 -- 172.21.15.120:0/2946567365 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4fe5013b0 con 0x55e4fe4ffb80 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.380+0000 7f153dffb640 1 -- 172.21.15.120:0/2946567365 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1650017b40 con 0x55e4fe4ffb80 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f153dffb640 1 --2- 172.21.15.120:0/2946567365 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f153003c730 0x7f153003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f153dffb640 1 -- 172.21.15.120:0/2946567365 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f165000e040 con 0x55e4fe4ffb80 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f16586a0640 1 --2- 172.21.15.120:0/2946567365 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f153003c730 0x7f153003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f165abaf800 1 Processor -- start 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f165abaf800 1 -- start start 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f16586a0640 1 --2- 172.21.15.120:0/2946567365 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f153003c730 0x7f153003ebf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55e4fe4efdd0 tx=0x7f1648052690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f165abaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe50ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f165abaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4fe4ddcc0 con 0x55e4fe50c620 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f1658ea1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe50ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f1658ea1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe50ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52358/0 (socket says 172.21.15.120:52358) 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.381+0000 7f1658ea1640 1 -- 172.21.15.120:0/237318242 learned_addr learned my addr 172.21.15.120:0/237318242 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f1658ea1640 1 -- 172.21.15.120:0/237318242 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4fe50d010 con 0x55e4fe50c620 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f1658ea1640 1 --2- 172.21.15.120:0/237318242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe50ca20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1650013450 tx=0x7f1650053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337ea7a232655498 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f15377fe640 1 -- 172.21.15.120:0/237318242 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1650014a00 con 0x55e4fe50c620 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f15377fe640 1 -- 172.21.15.120:0/237318242 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1650051070 con 0x55e4fe50c620 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f15377fe640 1 -- 172.21.15.120:0/237318242 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1650028350 con 0x55e4fe50c620 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f165abaf800 1 -- 172.21.15.120:0/237318242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 msgr2=0x55e4fe50ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f165abaf800 1 --2- 172.21.15.120:0/237318242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe50ca20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1650013450 tx=0x7f1650053f40 comp rx=0 tx=0).stop 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f165abaf800 1 -- 172.21.15.120:0/237318242 shutdown_connections 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f165abaf800 1 --2- 172.21.15.120:0/237318242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe50ca20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f165abaf800 1 -- 172.21.15.120:0/237318242 >> 172.21.15.120:0/237318242 conn(0x55e4fe508a20 msgr2=0x55e4fe506c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f165abaf800 1 -- 172.21.15.120:0/237318242 shutdown_connections 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.382+0000 7f165abaf800 1 -- 172.21.15.120:0/237318242 wait complete. 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f165abaf800 1 Processor -- start 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f165abaf800 1 -- start start 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f165abaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe513c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f165abaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4fe50d630 con 0x55e4fe50c620 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f1658ea1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe513c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f1658ea1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe513c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52366/0 (socket says 172.21.15.120:52366) 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 learned_addr learned my addr 172.21.15.120:0/425112047 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4fe5141b0 con 0x55e4fe50c620 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f1658ea1640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe513c50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1650053f80 tx=0x7f1650053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f1535ffb640 1 -- 172.21.15.120:0/425112047 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1650005030 con 0x55e4fe50c620 2024-09-07T03:32:39.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f1535ffb640 1 -- 172.21.15.120:0/425112047 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16500051d0 con 0x55e4fe50c620 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f1535ffb640 1 -- 172.21.15.120:0/425112047 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16500054f0 con 0x55e4fe50c620 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.383+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4fe514440 con 0x55e4fe50c620 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.384+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4fe514dc0 con 0x55e4fe50c620 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.384+0000 7f1535ffb640 1 -- 172.21.15.120:0/425112047 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1650055280 con 0x55e4fe50c620 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.385+0000 7f1535ffb640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f152803c780 0x7f152803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.385+0000 7f1535ffb640 1 -- 172.21.15.120:0/425112047 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f1650035c50 con 0x55e4fe50c620 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.385+0000 7f16586a0640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f152803c780 0x7f152803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.385+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.385+0000 7f165abaf800 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe51f740 0x55e4fe521c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.385+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe522350 con 0x55e4fe51f740 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.385+0000 7f1657e9f640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe51f740 0x55e4fe521c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.385+0000 7f16586a0640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f152803c780 0x7f152803ec40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1648054480 tx=0x7f1648048000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.385+0000 7f1657e9f640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe51f740 0x55e4fe521c00 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 20 realm 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe522780 con 0x55e4fe51f740 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe523050 con 0x55e4fe51f740 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe523a70 0x55e4fe525e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe5265d0 con 0x55e4fe523a70 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.386+0000 7f1658ea1640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe523a70 0x55e4fe525e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f1658ea1640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe523a70 0x55e4fe525e60 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f165abaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe526e70 con 0x55e4fe523a70 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f165abaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f165abaf800 20 searching for the correct realm 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f165abaf800 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e4fe528be0 0x55e4fe52b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe528be0 2024-09-07T03:32:39.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.387+0000 7f16586a0640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e4fe528be0 0x55e4fe52b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.388+0000 7f16586a0640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e4fe528be0 0x55e4fe52b010 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.388+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.388+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe523a70 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.388+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.388+0000 7f1658ea1640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f165004e7c0 0x7f1650052170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.388+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x7f165004e7c0 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.388+0000 7f1657e9f640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f165004e7c0 0x7f1650052170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.389+0000 7f1657e9f640 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f165004e7c0 0x7f1650052170 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.389+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.389+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.389+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.389+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.389+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.389+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe528be0 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.389+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.389+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.390+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.390+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe523a70 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.390+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.390+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe523a70 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.390+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.390+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.390+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.390+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x7f165004e7c0 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.391+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.391+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.391+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.391+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x7f165004e7c0 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.391+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.391+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe523a70 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.391+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.391+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe528be0 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.392+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.392+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.392+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.392+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe523a70 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.392+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.392+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe528be0 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.392+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.392+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.393+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.393+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.393+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.393+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.393+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.393+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe528be0 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.393+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.393+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x7f165004e7c0 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.393+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.394+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe51f740 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.394+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.394+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x7f165004e7c0 2024-09-07T03:32:39.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.394+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.394+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe528be0 2024-09-07T03:32:39.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.394+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.394+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x7f165004e7c0 2024-09-07T03:32:39.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.394+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.394+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe523a70 2024-09-07T03:32:39.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.395+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.395+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe523a70 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.395+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.395+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe528be0 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.395+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.395+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe523a70 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.395+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.395+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52b6e0 con 0x55e4fe523a70 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:39.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe5277c0 con 0x55e4fe51f740 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe527bb0 con 0x55e4fe523a70 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe527fa0 con 0x55e4fe51f740 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:39.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 zone default found 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 4 Realm: () 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 zonegroup default 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.396+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52bbb0 con 0x7f165004e7c0 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52ddf0 con 0x55e4fe528be0 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52e1c0 con 0x55e4fe528be0 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 20 started sync module instance, tier type = 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.397+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52d280 con 0x55e4fe523a70 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.399+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.399+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94442007746464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52d280 con 0x55e4fe523a70 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.399+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52ed10 con 0x55e4fe51f740 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.400+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94442007746464] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.400+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.400+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94442007743952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52d1f0 con 0x55e4fe51f740 2024-09-07T03:32:39.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.400+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52fbd0 con 0x55e4fe523a70 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.401+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.401+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94442007743952] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.401+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94442007752960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52fbd0 con 0x55e4fe523a70 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.401+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe5305d0 con 0x7f165004e7c0 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.402+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94442007752960] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.402+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.402+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94442007757024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52fbd0 con 0x7f165004e7c0 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.402+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531010 con 0x55e4fe523a70 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.403+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94442007757024] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.403+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.403+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94442007760192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52fbd0 con 0x55e4fe523a70 2024-09-07T03:32:39.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.403+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.404+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94442007760192] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.404+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.404+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94442007754528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52fb40 con 0x55e4fe528be0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.404+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe5328e0 con 0x55e4fe528be0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.405+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94442007754528] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.405+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.405+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94442007764496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe5328e0 con 0x55e4fe528be0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.405+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe5332a0 con 0x7f165004e7c0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94442007768560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe533270 con 0x7f165004e7c0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f165abaf800 20 add_watcher() i=0 2024-09-07T03:32:39.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f165abaf800 20 add_watcher() i=1 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f165abaf800 20 add_watcher() i=2 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f165abaf800 20 add_watcher() i=3 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f165abaf800 20 add_watcher() i=4 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f165abaf800 20 add_watcher() i=5 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94442007764496] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.408+0000 7f165abaf800 20 add_watcher() i=6 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.409+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94442007768560] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.409+0000 7f165abaf800 20 add_watcher() i=7 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.409+0000 7f165abaf800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.409+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe532430 con 0x55e4fe51f740 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.409+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.409+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94442007770688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe532430 con 0x55e4fe51f740 2024-09-07T03:32:39.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.410+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94442007770688] v34'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.411+0000 7f150efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.411+0000 7f165abaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.411+0000 7f165abaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.411+0000 7f165abaf800 5 note: GC not initialized 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.411+0000 7f150dfe3640 20 reqs_thread_entry: start 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.411+0000 7f165abaf800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.411+0000 7f165abaf800 20 Filter name: none 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.411+0000 7f15077fe640 20 reqs_thread_entry: start 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.411+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe568fa0 con 0x55e4fe51f740 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.412+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 [pgnls start_epoch 34 out=254b] v34'46 uv30 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.412+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52ed10 con 0x55e4fe51f740 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.412+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(63 [pgnls start_epoch 34 out=131b] v34'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.412+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52ed10 con 0x55e4fe523a70 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.412+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 [pgnls start_epoch 34 out=295b] v34'35 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.412+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe527bb0 con 0x7f165004e7c0 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.412+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(65 [pgnls start_epoch 34 out=172b] v34'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.412+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe527bb0 con 0x55e4fe51f740 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.413+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(66 [pgnls start_epoch 34 out=335b] v34'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.413+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe527bb0 con 0x7f165004e7c0 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.413+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(67 [pgnls start_epoch 34 out=213b] v34'22 uv22 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.413+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe527bb0 con 0x55e4fe528be0 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.413+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(68 [pgnls start_epoch 34 out=254b] v34'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.413+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.414+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(69 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.414+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.414+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 [pgnls start_epoch 34 out=213b] v34'16 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.414+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.414+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(71 [pgnls start_epoch 34 out=172b] v34'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f1650027070 con 0x55e4fe523a70 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.414+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.414+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(72 [pgnls start_epoch 34 out=336b] v34'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.415+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.415+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(73 [pgnls start_epoch 34 out=131b] v34'29 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.415+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.415+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(74 [pgnls start_epoch 34 out=254b] v34'13 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.415+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.415+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(75 [pgnls start_epoch 34 out=90b] v34'29 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.415+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.416+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(76 [pgnls start_epoch 34 out=213b] v34'26 uv18 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.416+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.416+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(77 [pgnls start_epoch 34 out=254b] v34'18 uv17 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.416+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe51f740 2024-09-07T03:32:39.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.416+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(78 [pgnls start_epoch 34 out=254b] v34'20 uv20 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.416+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.417+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(79 [pgnls start_epoch 34 out=213b] v34'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.417+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.417+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(80 [pgnls start_epoch 34 out=172b] v34'40 uv24 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.417+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.417+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(81 [pgnls start_epoch 34 out=295b] v34'48 uv40 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.417+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.418+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(82 [pgnls start_epoch 34 out=276b] v34'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.418+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.418+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(83 [pgnls start_epoch 34 out=172b] v34'24 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.418+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.418+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(84 [pgnls start_epoch 34 out=295b] v34'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.418+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe51f740 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.419+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(85 [pgnls start_epoch 34 out=172b] v34'34 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.419+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.419+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(86 [pgnls start_epoch 34 out=213b] v34'49 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.419+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.419+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(87 [pgnls start_epoch 34 out=172b] v34'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.419+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.419+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(88 [pgnls start_epoch 34 out=172b] v34'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.419+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.420+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(89 [pgnls start_epoch 34 out=90b] v34'19 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.420+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe523a70 2024-09-07T03:32:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.420+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(90 [pgnls start_epoch 34 out=90b] v34'43 uv19 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.420+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe51f740 2024-09-07T03:32:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.420+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(91 [pgnls start_epoch 34 out=131b] v34'12 uv12 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.420+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x7f165004e7c0 2024-09-07T03:32:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.420+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(92 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f1640051070 con 0x7f165004e7c0 2024-09-07T03:32:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.420+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe531a20 con 0x55e4fe528be0 2024-09-07T03:32:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.421+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(93 [pgnls start_epoch 34 out=213b] v34'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.435 INFO:teuthology.orchestra.run.smithi120.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.422+0000 7f150efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.422+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94442007770688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe527bb0 con 0x55e4fe51f740 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.423+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94442007770688] v34'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1640051070 con 0x55e4fe51f740 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.423+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94442007746464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe5672f0 con 0x55e4fe523a70 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.424+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94442007746464] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.424+0000 7f165abaf800 20 remove_watcher() i=0 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.424+0000 7f165abaf800 2 removed watcher, disabling cache 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.424+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94442007743952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe533640 con 0x55e4fe51f740 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.425+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94442007743952] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1640093040 con 0x55e4fe51f740 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.425+0000 7f165abaf800 20 remove_watcher() i=1 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.425+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94442007752960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe533640 con 0x55e4fe523a70 2024-09-07T03:32:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.426+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94442007752960] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.426+0000 7f165abaf800 20 remove_watcher() i=2 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.426+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94442007757024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe52f100 con 0x7f165004e7c0 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.427+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94442007757024] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1640093040 con 0x7f165004e7c0 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.427+0000 7f165abaf800 20 remove_watcher() i=3 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.427+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94442007760192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe533640 con 0x55e4fe523a70 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.429+0000 7f1658ea1640 1 -- 172.21.15.120:0/425112047 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94442007760192] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1650074040 con 0x55e4fe523a70 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.429+0000 7f165abaf800 20 remove_watcher() i=4 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.429+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94442007754528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe5300e0 con 0x55e4fe528be0 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.429+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94442007754528] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.429+0000 7f165abaf800 20 remove_watcher() i=5 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.429+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94442007764496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe530d40 con 0x55e4fe528be0 2024-09-07T03:32:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.430+0000 7f16586a0640 1 -- 172.21.15.120:0/425112047 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94442007764496] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f164802d070 con 0x55e4fe528be0 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.430+0000 7f165abaf800 20 remove_watcher() i=6 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.430+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94442007768560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4fe533640 con 0x7f165004e7c0 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94442007768560] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1640093040 con 0x7f165004e7c0 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f165abaf800 20 remove_watcher() i=7 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe523a70 msgr2=0x55e4fe525e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f165abaf800 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe523a70 0x55e4fe525e60 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe51f740 msgr2=0x55e4fe521c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f165abaf800 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe51f740 0x55e4fe521c00 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f165004e7c0 msgr2=0x7f1650052170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f165abaf800 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f165004e7c0 0x7f1650052170 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e4fe528be0 msgr2=0x55e4fe52b010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.431+0000 7f165abaf800 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e4fe528be0 0x55e4fe52b010 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f152803c780 msgr2=0x7f152803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f152803c780 0x7f152803ec40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1648054480 tx=0x7f1648048000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 msgr2=0x55e4fe513c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 --2- 172.21.15.120:0/425112047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe50c620 0x55e4fe513c50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1650053f80 tx=0x7f1650053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 reap_dead start 2024-09-07T03:32:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f1657e9f640 1 -- 172.21.15.120:0/425112047 reap_dead start 2024-09-07T03:32:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 shutdown_connections 2024-09-07T03:32:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 >> 172.21.15.120:0/425112047 conn(0x55e4fe508a20 msgr2=0x55e4fe506c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 shutdown_connections 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/425112047 wait complete. 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/2946567365 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f153003c730 msgr2=0x7f153003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 --2- 172.21.15.120:0/2946567365 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f153003c730 0x7f153003ebf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55e4fe4efdd0 tx=0x7f1648052690 comp rx=0 tx=0).stop 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/2946567365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe4ffb80 msgr2=0x55e4fe4fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 --2- 172.21.15.120:0/2946567365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe4ffb80 0x55e4fe4fffa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1650016d20 tx=0x7f165000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/2946567365 shutdown_connections 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 --2- 172.21.15.120:0/2946567365 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f153003c730 0x7f153003ebf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 --2- 172.21.15.120:0/2946567365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe4ffb80 0x55e4fe4fffa0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/2946567365 >> 172.21.15.120:0/2946567365 conn(0x55e4fe4f3f30 msgr2=0x55e4fe4f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/2946567365 shutdown_connections 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/2946567365 wait complete. 2024-09-07T03:32:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe4ed200 msgr2=0x55e4fe4ef6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.432+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe4ed200 0x55e4fe4ef6c0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe3f2210 msgr2=0x55e4fe4ec410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe3f2210 0x55e4fe4ec410 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f154003c8d0 msgr2=0x7f154003ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f154003c8d0 0x7f154003ed90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1640057000 tx=0x7f1640052000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 msgr2=0x55e4fe4e4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4e4dc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f16480012f0 tx=0x7f1648000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 shutdown_connections 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e4fe4ed200 0x55e4fe4ef6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e4fe3f2210 0x55e4fe4ec410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f154003c8d0 0x7f154003ed90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 --2- 172.21.15.120:0/2989696104 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4fe3ee6a0 0x55e4fe4e4dc0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 >> 172.21.15.120:0/2989696104 conn(0x55e4fe3e81e0 msgr2=0x55e4fe4de750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 shutdown_connections 2024-09-07T03:32:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.433+0000 7f165abaf800 1 -- 172.21.15.120:0/2989696104 wait complete. 2024-09-07T03:32:39.447 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-07T03:32:39.447 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-07T03:32:39.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-07T03:32:39.447 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-07T03:32:39.532 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:39.532 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:39.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.530+0000 7fba4f9ab800 1 Processor -- start 2024-09-07T03:32:39.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.530+0000 7fba4f9ab800 1 -- start start 2024-09-07T03:32:39.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.530+0000 7fba4f9ab800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561df872c200 0x561df8731da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.530+0000 7fba4f9ab800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561df85d5e40 con 0x561df872adf0 2024-09-07T03:32:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.530+0000 7fba4f9ab800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x561df85a0680 con 0x561df872c200 2024-09-07T03:32:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.531+0000 7fba4cc94640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561df872c200 0x561df8731da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.531+0000 7fba4d495640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x561df872adf0 0x561df872baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42296/0 (socket says 172.21.15.120:42296) 2024-09-07T03:32:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.531+0000 7fba4d495640 1 -- 172.21.15.120:0/1963064172 learned_addr learned my addr 172.21.15.120:0/1963064172 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.531+0000 7fba4cc94640 1 -- 172.21.15.120:0/1963064172 >> v1:172.21.15.104:6789/0 conn(0x561df872adf0 legacy=0x561df872baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.531+0000 7fba3ffff640 1 -- 172.21.15.120:0/1963064172 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610156150 0 0) 0x561df85d5e40 con 0x561df872adf0 2024-09-07T03:32:39.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.531+0000 7fba4cc94640 1 -- 172.21.15.120:0/1963064172 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df85bc6b0 con 0x561df872c200 2024-09-07T03:32:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.533+0000 7fba4cc94640 1 --2- 172.21.15.120:0/1963064172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872c200 0x561df8731da0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fba4400a470 tx=0x7fba44045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb98466fc612cc0e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.533+0000 7fba3ffff640 1 -- 172.21.15.120:0/1963064172 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba44053570 con 0x561df872c200 2024-09-07T03:32:39.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.533+0000 7fba3ffff640 1 -- 172.21.15.120:0/1963064172 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba44058070 con 0x561df872c200 2024-09-07T03:32:39.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.533+0000 7fba3ffff640 1 -- 172.21.15.120:0/1963064172 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba44053880 con 0x561df872c200 2024-09-07T03:32:39.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.534+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1963064172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872c200 msgr2=0x561df8731da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.534+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/1963064172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872c200 0x561df8731da0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fba4400a470 tx=0x7fba44045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:39.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.534+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1963064172 shutdown_connections 2024-09-07T03:32:39.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.534+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/1963064172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872c200 0x561df8731da0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.534+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1963064172 >> 172.21.15.120:0/1963064172 conn(0x561df87261c0 msgr2=0x561df8728620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.534+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1963064172 shutdown_connections 2024-09-07T03:32:39.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.534+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1963064172 wait complete. 2024-09-07T03:32:39.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.547+0000 7fba4f9ab800 1 Processor -- start 2024-09-07T03:32:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.547+0000 7fba4f9ab800 1 -- start start 2024-09-07T03:32:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.548+0000 7fba4f9ab800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df881b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.548+0000 7fba4f9ab800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561df85c4dd0 con 0x561df872adf0 2024-09-07T03:32:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.548+0000 7fba4d495640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df881b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.548+0000 7fba4d495640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df881b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52384/0 (socket says 172.21.15.120:52384) 2024-09-07T03:32:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.548+0000 7fba4d495640 1 -- 172.21.15.120:0/3521774819 learned_addr learned my addr 172.21.15.120:0/3521774819 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.548+0000 7fba4d495640 1 -- 172.21.15.120:0/3521774819 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df85dde10 con 0x561df872adf0 2024-09-07T03:32:39.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.548+0000 7fba4d495640 1 --2- 172.21.15.120:0/3521774819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df881b4c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fba40001ea0 tx=0x7fba4000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817fd374d82a0d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.549+0000 7fb93b606640 1 -- 172.21.15.120:0/3521774819 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba40008070 con 0x561df872adf0 2024-09-07T03:32:39.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.549+0000 7fb93b606640 1 -- 172.21.15.120:0/3521774819 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4000d500 con 0x561df872adf0 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.549+0000 7fb93b606640 1 -- 172.21.15.120:0/3521774819 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4000d880 con 0x561df872adf0 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.549+0000 7fba4f9ab800 1 -- 172.21.15.120:0/3521774819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 msgr2=0x561df881b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.549+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/3521774819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df881b4c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fba40001ea0 tx=0x7fba4000b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.549+0000 7fba4f9ab800 1 -- 172.21.15.120:0/3521774819 shutdown_connections 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.549+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/3521774819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df881b4c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.549+0000 7fba4f9ab800 1 -- 172.21.15.120:0/3521774819 >> 172.21.15.120:0/3521774819 conn(0x561df87261c0 msgr2=0x561df8816e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4f9ab800 1 -- 172.21.15.120:0/3521774819 shutdown_connections 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4f9ab800 1 -- 172.21.15.120:0/3521774819 wait complete. 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4f9ab800 1 Processor -- start 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4f9ab800 1 -- start start 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4f9ab800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df8822de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4f9ab800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561df872c8f0 con 0x561df872adf0 2024-09-07T03:32:39.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4d495640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df8822de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4d495640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df8822de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52388/0 (socket says 172.21.15.120:52388) 2024-09-07T03:32:39.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4d495640 1 -- 172.21.15.120:0/507247589 learned_addr learned my addr 172.21.15.120:0/507247589 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.550+0000 7fba4d495640 1 -- 172.21.15.120:0/507247589 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df8823340 con 0x561df872adf0 2024-09-07T03:32:39.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.551+0000 7fba4d495640 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df8822de0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fba40000f60 tx=0x7fba40000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.551+0000 7fb939e03640 1 -- 172.21.15.120:0/507247589 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4000f8d0 con 0x561df872adf0 2024-09-07T03:32:39.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.551+0000 7fb939e03640 1 -- 172.21.15.120:0/507247589 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4000fa70 con 0x561df872adf0 2024-09-07T03:32:39.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.551+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561df88235d0 con 0x561df872adf0 2024-09-07T03:32:39.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.551+0000 7fb939e03640 1 -- 172.21.15.120:0/507247589 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4000fd50 con 0x561df872adf0 2024-09-07T03:32:39.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.551+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df8823fd0 con 0x561df872adf0 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.552+0000 7fb939e03640 1 -- 172.21.15.120:0/507247589 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fba40017040 con 0x561df872adf0 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.552+0000 7fb939e03640 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb93403c780 0x7fb93403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.552+0000 7fb939e03640 1 -- 172.21.15.120:0/507247589 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fba40015020 con 0x561df872adf0 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.552+0000 7fba4cc94640 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb93403c780 0x7fb93403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.552+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df872c200 0x561df882a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.552+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df882a970 con 0x561df872c200 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.553+0000 7fba4dc96640 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df872c200 0x561df882a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.553+0000 7fba4cc94640 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb93403c780 0x7fb93403ec40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fba44057000 tx=0x7fba44052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.553+0000 7fba4dc96640 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df872c200 0x561df882a430 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.553+0000 7fba4dc96640 1 -- 172.21.15.120:0/507247589 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba4800a4d0 con 0x561df872c200 2024-09-07T03:32:39.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.553+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df882b220 0x561df882d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.553+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df882de20 con 0x561df882b220 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.553+0000 7fba4d495640 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df882b220 0x561df882d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.554+0000 7fba4d495640 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df882b220 0x561df882d6b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.554+0000 7fba4d495640 1 -- 172.21.15.120:0/507247589 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba4002d070 con 0x561df882b220 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.554+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df882f6d0 con 0x561df882b220 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.554+0000 7fba4d495640 1 -- 172.21.15.120:0/507247589 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fba4002d070 con 0x561df882b220 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.554+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df882e840 con 0x561df882b220 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.554+0000 7fba4d495640 1 -- 172.21.15.120:0/507247589 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba4002d070 con 0x561df882b220 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.554+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df882eca0 con 0x561df872c200 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.555+0000 7fba4dc96640 1 -- 172.21.15.120:0/507247589 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fba4800a4d0 con 0x561df872c200 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.555+0000 7fba4f9ab800 1 Processor -- start 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.555+0000 7fba4f9ab800 1 -- start start 2024-09-07T03:32:39.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.555+0000 7fba4f9ab800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df883dbc0 0x561df883dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.555+0000 7fba4f9ab800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561df8622a00 con 0x561df883dbc0 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.555+0000 7fba4dc96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df883dbc0 0x561df883dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.555+0000 7fba4dc96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df883dbc0 0x561df883dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52394/0 (socket says 172.21.15.120:52394) 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.555+0000 7fba4dc96640 1 -- 172.21.15.120:0/1964958949 learned_addr learned my addr 172.21.15.120:0/1964958949 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.556+0000 7fba4dc96640 1 -- 172.21.15.120:0/1964958949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df883e620 con 0x561df883dbc0 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.556+0000 7fba4dc96640 1 --2- 172.21.15.120:0/1964958949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df883dbc0 0x561df883dfe0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba48016d20 tx=0x7fba4800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.556+0000 7fb932ffd640 1 -- 172.21.15.120:0/1964958949 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48017660 con 0x561df883dbc0 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.556+0000 7fb932ffd640 1 -- 172.21.15.120:0/1964958949 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4801b030 con 0x561df883dbc0 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.556+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1964958949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561df883ee50 con 0x561df883dbc0 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.556+0000 7fb932ffd640 1 -- 172.21.15.120:0/1964958949 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48017950 con 0x561df883dbc0 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.556+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1964958949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df883f3f0 con 0x561df883dbc0 2024-09-07T03:32:39.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.557+0000 7fb932ffd640 1 -- 172.21.15.120:0/1964958949 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fba48017b40 con 0x561df883dbc0 2024-09-07T03:32:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.557+0000 7fb932ffd640 1 --2- 172.21.15.120:0/1964958949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb92403c7f0 0x7fb92403ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.557+0000 7fb932ffd640 1 -- 172.21.15.120:0/1964958949 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fba4800e040 con 0x561df883dbc0 2024-09-07T03:32:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.557+0000 7fba4d495640 1 --2- 172.21.15.120:0/1964958949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb92403c7f0 0x7fb92403ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.557+0000 7fba4f9ab800 1 Processor -- start 2024-09-07T03:32:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.557+0000 7fba4d495640 1 --2- 172.21.15.120:0/1964958949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb92403c7f0 0x7fb92403ecb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x561df88244f0 tx=0x7fba4001b440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.557+0000 7fba4f9ab800 1 -- start start 2024-09-07T03:32:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fba4f9ab800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df884aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fba4f9ab800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561df881bd10 con 0x561df884a680 2024-09-07T03:32:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fba4dc96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df884aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fba4dc96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df884aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52404/0 (socket says 172.21.15.120:52404) 2024-09-07T03:32:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fba4dc96640 1 -- 172.21.15.120:0/1764190116 learned_addr learned my addr 172.21.15.120:0/1764190116 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fba4dc96640 1 -- 172.21.15.120:0/1764190116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df884b070 con 0x561df884a680 2024-09-07T03:32:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fba4dc96640 1 --2- 172.21.15.120:0/1764190116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df884aa80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba48013450 tx=0x7fba48053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f68e573c1cf468 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fb930ff9640 1 -- 172.21.15.120:0/1764190116 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48014a00 con 0x561df884a680 2024-09-07T03:32:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fb930ff9640 1 -- 172.21.15.120:0/1764190116 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48051070 con 0x561df884a680 2024-09-07T03:32:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.558+0000 7fb930ff9640 1 -- 172.21.15.120:0/1764190116 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48028350 con 0x561df884a680 2024-09-07T03:32:39.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1764190116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 msgr2=0x561df884aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/1764190116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df884aa80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba48013450 tx=0x7fba48053f40 comp rx=0 tx=0).stop 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1764190116 shutdown_connections 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/1764190116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df884aa80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1764190116 >> 172.21.15.120:0/1764190116 conn(0x561df8846a80 msgr2=0x561df8844cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1764190116 shutdown_connections 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1764190116 wait complete. 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 Processor -- start 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 -- start start 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df8734c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.559+0000 7fba4f9ab800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561df884b690 con 0x561df884a680 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fba4dc96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df8734c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fba4dc96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df8734c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52410/0 (socket says 172.21.15.120:52410) 2024-09-07T03:32:39.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 learned_addr learned my addr 172.21.15.120:0/457468016 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df8735180 con 0x561df884a680 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fba4dc96640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df8734c20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fba48053f80 tx=0x7fba48053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fb922ffd640 1 -- 172.21.15.120:0/457468016 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48005030 con 0x561df884a680 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fb922ffd640 1 -- 172.21.15.120:0/457468016 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba480051d0 con 0x561df884a680 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561df8733530 con 0x561df884a680 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fb922ffd640 1 -- 172.21.15.120:0/457468016 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48005510 con 0x561df884a680 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.560+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df8733a70 con 0x561df884a680 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.561+0000 7fb922ffd640 1 -- 172.21.15.120:0/457468016 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fba48055240 con 0x561df884a680 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.561+0000 7fb922ffd640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb91803c730 0x7fb91803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.561+0000 7fb922ffd640 1 -- 172.21.15.120:0/457468016 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7fba48055040 con 0x561df884a680 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.561+0000 7fba4d495640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb91803c730 0x7fb91803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.561+0000 7fba4d495640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb91803c730 0x7fb91803ebf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba4000ffd0 tx=0x7fba40042000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df885f940 0x561df8861e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df8862550 con 0x561df885f940 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4cc94640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df885f940 0x561df8861e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4cc94640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df885f940 0x561df8861e00 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4f9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4f9ab800 20 realm 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.562+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df8862980 con 0x561df885f940 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4f9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4f9ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df8863250 con 0x561df885f940 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4f9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df8863c70 0x561df88660a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df8866810 con 0x561df8863c70 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4dc96640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df8863c70 0x561df88660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.563+0000 7fba4dc96640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df8863c70 0x561df88660a0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4f9ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df8867060 con 0x561df8863c70 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4f9ab800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4f9ab800 20 searching for the correct realm 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561df8868dd0 0x561df886b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8868dd0 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4d495640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561df8868dd0 0x561df886b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4d495640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561df8868dd0 0x561df886b200 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.564+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8863c70 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.565+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.565+0000 7fba4dc96640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fba48055bb0 0x7fba4803e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.565+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x7fba48055bb0 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.565+0000 7fba4cc94640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fba48055bb0 0x7fba4803e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.565+0000 7fba4cc94640 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fba48055bb0 0x7fba4803e800 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8868dd0 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.566+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8863c70 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.567+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.567+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8863c70 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.567+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.567+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.567+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.567+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x7fba48055bb0 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.567+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.567+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.568+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.568+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x7fba48055bb0 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.568+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.568+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8863c70 2024-09-07T03:32:39.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.568+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.568+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8868dd0 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.568+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.568+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.569+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.569+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8863c70 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.569+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.569+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8868dd0 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8868dd0 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.570+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x7fba48055bb0 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df885f940 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x7fba48055bb0 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8868dd0 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x7fba48055bb0 2024-09-07T03:32:39.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.571+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8863c70 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.572+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.572+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8863c70 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.572+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.572+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8868dd0 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.572+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.572+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8863c70 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561df886b8d0 con 0x561df8863c70 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:39.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df88679b0 con 0x561df885f940 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df8867590 con 0x561df8863c70 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.573+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df8868320 con 0x561df885f940 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 zone default found 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 4 Realm: () 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 zonegroup default 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df886c200 con 0x7fba48055bb0 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df886e440 con 0x561df8868dd0 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df886e7e0 con 0x561df8868dd0 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 started sync module instance, tier type = 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.574+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df886d880 con 0x561df8863c70 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.576+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.576+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94686723628144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df886e090 con 0x561df8863c70 2024-09-07T03:32:39.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.576+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df886f540 con 0x561df885f940 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.577+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.577+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94686723628144] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.577+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94686723635504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8870200 con 0x561df885f940 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.577+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df886eb80 con 0x561df8863c70 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.578+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94686723635504] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.578+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.578+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94686723636560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8870170 con 0x561df8863c70 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.578+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8871210 con 0x7fba48055bb0 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.579+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94686723636560] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.579+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.579+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94686723639104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8871210 con 0x7fba48055bb0 2024-09-07T03:32:39.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.579+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8871bd0 con 0x561df8863c70 2024-09-07T03:32:39.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.580+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94686723639104] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.580+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.580+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94686723643648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8871210 con 0x561df8863c70 2024-09-07T03:32:39.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.580+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88725e0 con 0x561df8868dd0 2024-09-07T03:32:39.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.581+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94686723643648] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.581+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.581+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94686723640672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8871180 con 0x561df8868dd0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.581+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88734a0 con 0x561df8868dd0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.583+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.583+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94686723650000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8873c80 con 0x561df8868dd0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.583+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8874770 con 0x7fba48055bb0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.583+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94686723640672] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94686723650000] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94686723654208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8874730 con 0x7fba48055bb0 2024-09-07T03:32:39.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4f9ab800 20 add_watcher() i=0 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4f9ab800 20 add_watcher() i=1 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4f9ab800 20 add_watcher() i=2 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4f9ab800 20 add_watcher() i=3 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4f9ab800 20 add_watcher() i=4 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4f9ab800 20 add_watcher() i=5 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.584+0000 7fba4f9ab800 20 add_watcher() i=6 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.585+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94686723654208] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.585+0000 7fba4f9ab800 20 add_watcher() i=7 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.585+0000 7fba4f9ab800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.585+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df88729d0 con 0x561df885f940 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.585+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.585+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94686723651344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df8874fc0 con 0x561df885f940 2024-09-07T03:32:39.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94686723651344] v34'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fb903fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fba4f9ab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fba4f9ab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fba4f9ab800 5 note: GC not initialized 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fb902fe5640 20 reqs_thread_entry: start 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fba4f9ab800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fba4f9ab800 20 Filter name: none 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fb900fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fba4f9ab800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.587+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df88aa7b0 con 0x561df885f940 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df88ad0e0 con 0x7fba48055bb0 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 20 disabling bucket name=myfoo 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df88ab0c0 con 0x7fba48055bb0 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:39.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 : miss 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.588+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df88ad9b0 con 0x561df885f940 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.589+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.589+0000 7fba4f9ab800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.589+0000 7fba4f9ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.589+0000 7fba4f9ab800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.589+0000 7fba4f9ab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.589+0000 7fba4f9ab800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.589+0000 7fba4f9ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.589+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88b51f0 con 0x561df885f940 2024-09-07T03:32:39.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(66 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v34'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fba4f9ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fba4f9ab800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fba4f9ab800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fba4f9ab800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1, ofs0, ns] 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94686723891248 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df88b3ef0 con 0x7fba48055bb0 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== watch-notify(notify (1) cookie 94686723639104 notify 146028888079 ret 0) ==== 802+0+0 (crc 0 0 0) 0x561df88adda0 con 0x7fba48055bb0 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fb930ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94686723639104 notifier 4589 bl.length()=760 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fb930ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fb930ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fb930ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(67 notify.3 [notify cookie 94686723891248 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.590+0000 7fb930ff9640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb910003ea0 con 0x7fba48055bb0 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.591+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.591+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== watch-notify(notify_complete (2) cookie 94686723891248 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561df88acec0 con 0x7fba48055bb0 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.591+0000 7fba4f9ab800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_sources= new_sources= 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.591+0000 7fba4f9ab800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential sources added=[] removed=[] 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.591+0000 7fba4f9ab800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_dests= new_dests= 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.591+0000 7fba4f9ab800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential dests added=[] removed=[] 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.591+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88b0050 con 0x561df885f940 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fba4f9ab800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fba4f9ab800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fba4f9ab800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94686723870256 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561df88a9250 con 0x561df8863c70 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94686723643648 notify 146028888090 ret 0) ==== 609+0+0 (crc 0 0 0) 0x561df8733a70 con 0x561df8863c70 2024-09-07T03:32:39.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fb930ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94686723643648 notifier 4589 bl.length()=567 2024-09-07T03:32:39.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fb930ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:39.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fb930ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:39.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(70 notify.4 [notify cookie 94686723870256 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.592+0000 7fb930ff9640 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb910003ea0 con 0x561df8863c70 2024-09-07T03:32:39.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.593+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== watch-notify(notify_complete (2) cookie 94686723870256 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561df8733530 con 0x561df8863c70 2024-09-07T03:32:39.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.593+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.611 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:39.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.593+0000 7fb903fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.594+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94686723651344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88a8650 con 0x561df885f940 2024-09-07T03:32:39.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.594+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94686723651344] v34'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.594+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94686723628144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88a8650 con 0x561df8863c70 2024-09-07T03:32:39.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.596+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94686723628144] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.596+0000 7fba4f9ab800 20 remove_watcher() i=0 2024-09-07T03:32:39.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.596+0000 7fba4f9ab800 2 removed watcher, disabling cache 2024-09-07T03:32:39.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.596+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94686723635504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88a8650 con 0x561df885f940 2024-09-07T03:32:39.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.597+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94686723635504] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x561df885f940 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.597+0000 7fba4f9ab800 20 remove_watcher() i=1 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.597+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94686723636560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88a8650 con 0x561df8863c70 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.598+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94686723636560] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.598+0000 7fba4f9ab800 20 remove_watcher() i=2 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.598+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94686723639104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88a8650 con 0x7fba48055bb0 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.599+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94686723639104] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.599+0000 7fba4f9ab800 20 remove_watcher() i=3 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.599+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94686723643648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88a8650 con 0x561df8863c70 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.600+0000 7fba4dc96640 1 -- 172.21.15.120:0/457468016 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94686723643648] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4803b070 con 0x561df8863c70 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.600+0000 7fba4f9ab800 20 remove_watcher() i=4 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.600+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94686723640672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88a8650 con 0x561df8868dd0 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.601+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94686723640672] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.601+0000 7fba4f9ab800 20 remove_watcher() i=5 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.601+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94686723650000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88a8650 con 0x561df8868dd0 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.602+0000 7fba4d495640 1 -- 172.21.15.120:0/457468016 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94686723650000] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4002d070 con 0x561df8868dd0 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.602+0000 7fba4f9ab800 20 remove_watcher() i=6 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.602+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94686723654208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561df88a8650 con 0x7fba48055bb0 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94686723654208] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba44051070 con 0x7fba48055bb0 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 20 remove_watcher() i=7 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df8863c70 msgr2=0x561df88660a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df8863c70 0x561df88660a0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df885f940 msgr2=0x561df8861e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df885f940 0x561df8861e00 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fba48055bb0 msgr2=0x7fba4803e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fba48055bb0 0x7fba4803e800 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561df8868dd0 msgr2=0x561df886b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561df8868dd0 0x561df886b200 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb91803c730 msgr2=0x7fb91803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb91803c730 0x7fb91803ebf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba4000ffd0 tx=0x7fba40042000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 msgr2=0x561df8734c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4cc94640 1 -- 172.21.15.120:0/457468016 reap_dead start 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df8734c20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fba48053f80 tx=0x7fba48053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 shutdown_connections 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/457468016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df884a680 0x561df8734c20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 >> 172.21.15.120:0/457468016 conn(0x561df8846a80 msgr2=0x561df8844c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 shutdown_connections 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.603+0000 7fba4f9ab800 1 -- 172.21.15.120:0/457468016 wait complete. 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1964958949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb92403c7f0 msgr2=0x7fb92403ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/1964958949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb92403c7f0 0x7fb92403ecb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x561df88244f0 tx=0x7fba4001b440 comp rx=0 tx=0).stop 2024-09-07T03:32:39.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1964958949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df883dbc0 msgr2=0x561df883dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/1964958949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df883dbc0 0x561df883dfe0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba48016d20 tx=0x7fba4800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1964958949 shutdown_connections 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/1964958949 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb92403c7f0 0x7fb92403ecb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/1964958949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df883dbc0 0x561df883dfe0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1964958949 >> 172.21.15.120:0/1964958949 conn(0x561df8831f70 msgr2=0x561df8832350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1964958949 shutdown_connections 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/1964958949 wait complete. 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df882b220 msgr2=0x561df882d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df882b220 0x561df882d6b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df872c200 msgr2=0x561df882a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df872c200 0x561df882a430 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb93403c780 msgr2=0x7fb93403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb93403c780 0x7fb93403ec40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fba44057000 tx=0x7fba44052000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 msgr2=0x561df8822de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df8822de0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fba40000f60 tx=0x7fba40000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 shutdown_connections 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561df882b220 0x561df882d6b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561df872c200 0x561df882a430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb93403c780 0x7fb93403ec40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 --2- 172.21.15.120:0/507247589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561df872adf0 0x561df8822de0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 >> 172.21.15.120:0/507247589 conn(0x561df87261c0 msgr2=0x561df881c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 shutdown_connections 2024-09-07T03:32:39.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.604+0000 7fba4f9ab800 1 -- 172.21.15.120:0/507247589 wait complete. 2024-09-07T03:32:39.623 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:39.625 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-07T03:32:39.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-07T03:32:39.625 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-07T03:32:39.669 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:39.670 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:39.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.668+0000 7f3947b2c800 1 Processor -- start 2024-09-07T03:32:39.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.668+0000 7f3947b2c800 1 -- start start 2024-09-07T03:32:39.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.668+0000 7f3947b2c800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5607f366b690 0x5607f366da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.668+0000 7f3947b2c800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5607f3514e40 con 0x5607f366e020 2024-09-07T03:32:39.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.668+0000 7f3947b2c800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5607f34df680 con 0x5607f366b690 2024-09-07T03:32:39.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.668+0000 7f394373e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5607f366b690 0x5607f366da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.668+0000 7f3942f3d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5607f366e020 0x5607f36704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42310/0 (socket says 172.21.15.120:42310) 2024-09-07T03:32:39.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.668+0000 7f3942f3d640 1 -- 172.21.15.120:0/2927788413 learned_addr learned my addr 172.21.15.120:0/2927788413 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:39.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.669+0000 7f394273c640 1 -- 172.21.15.120:0/2927788413 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172670419 0 0) 0x5607f3514e40 con 0x5607f366e020 2024-09-07T03:32:39.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.669+0000 7f394273c640 1 -- 172.21.15.120:0/2927788413 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f392c001e10 con 0x5607f366e020 2024-09-07T03:32:39.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.669+0000 7f394373e640 1 -- 172.21.15.120:0/2927788413 >> v1:172.21.15.104:6789/0 conn(0x5607f366e020 legacy=0x5607f36704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.669+0000 7f394373e640 1 -- 172.21.15.120:0/2927788413 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f34fb6b0 con 0x5607f366b690 2024-09-07T03:32:39.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f394373e640 1 --2- 172.21.15.120:0/2927788413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f366da80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f393400a470 tx=0x7f3934045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbeb5004fbfb2284 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f394273c640 1 -- 172.21.15.120:0/2927788413 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934059070 con 0x5607f366b690 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f394273c640 1 -- 172.21.15.120:0/2927788413 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934054570 con 0x5607f366b690 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f394273c640 1 -- 172.21.15.120:0/2927788413 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934054870 con 0x5607f366b690 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f3947b2c800 1 -- 172.21.15.120:0/2927788413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 msgr2=0x5607f366da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f3947b2c800 1 --2- 172.21.15.120:0/2927788413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f366da80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f393400a470 tx=0x7f3934045920 comp rx=0 tx=0).stop 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f3947b2c800 1 -- 172.21.15.120:0/2927788413 shutdown_connections 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f3947b2c800 1 --2- 172.21.15.120:0/2927788413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f366da80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f3947b2c800 1 -- 172.21.15.120:0/2927788413 >> 172.21.15.120:0/2927788413 conn(0x5607f36651f0 msgr2=0x5607f3667630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f3947b2c800 1 -- 172.21.15.120:0/2927788413 shutdown_connections 2024-09-07T03:32:39.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.671+0000 7f3947b2c800 1 -- 172.21.15.120:0/2927788413 wait complete. 2024-09-07T03:32:39.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.686+0000 7f3947b2c800 1 Processor -- start 2024-09-07T03:32:39.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.686+0000 7f3947b2c800 1 -- start start 2024-09-07T03:32:39.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.686+0000 7f3947b2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f375a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.686+0000 7f3947b2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5607f3503dd0 con 0x5607f366b690 2024-09-07T03:32:39.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.686+0000 7f394373e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f375a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.686+0000 7f394373e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f375a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52432/0 (socket says 172.21.15.120:52432) 2024-09-07T03:32:39.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.686+0000 7f394373e640 1 -- 172.21.15.120:0/3843287444 learned_addr learned my addr 172.21.15.120:0/3843287444 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.686+0000 7f394373e640 1 -- 172.21.15.120:0/3843287444 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f351ce10 con 0x5607f366b690 2024-09-07T03:32:39.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f394373e640 1 --2- 172.21.15.120:0/3843287444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f375a4b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f393400a470 tx=0x7f393404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38761d5cc35e144 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f383160a640 1 -- 172.21.15.120:0/3843287444 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934065070 con 0x5607f366b690 2024-09-07T03:32:39.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f383160a640 1 -- 172.21.15.120:0/3843287444 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393405a040 con 0x5607f366b690 2024-09-07T03:32:39.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f383160a640 1 -- 172.21.15.120:0/3843287444 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934059070 con 0x5607f366b690 2024-09-07T03:32:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f3947b2c800 1 -- 172.21.15.120:0/3843287444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 msgr2=0x5607f375a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3843287444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f375a4b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f393400a470 tx=0x7f393404e000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f3947b2c800 1 -- 172.21.15.120:0/3843287444 shutdown_connections 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3843287444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f375a4b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f3947b2c800 1 -- 172.21.15.120:0/3843287444 >> 172.21.15.120:0/3843287444 conn(0x5607f36651f0 msgr2=0x5607f3755e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f3947b2c800 1 -- 172.21.15.120:0/3843287444 shutdown_connections 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.687+0000 7f3947b2c800 1 -- 172.21.15.120:0/3843287444 wait complete. 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.688+0000 7f3947b2c800 1 Processor -- start 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.688+0000 7f3947b2c800 1 -- start start 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.688+0000 7f3947b2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f366adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.688+0000 7f3947b2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5607f3672040 con 0x5607f366b690 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.688+0000 7f394373e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f366adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.688+0000 7f394373e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f366adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52434/0 (socket says 172.21.15.120:52434) 2024-09-07T03:32:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.688+0000 7f394373e640 1 -- 172.21.15.120:0/787918506 learned_addr learned my addr 172.21.15.120:0/787918506 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.688+0000 7f394373e640 1 -- 172.21.15.120:0/787918506 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f366b310 con 0x5607f366b690 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.689+0000 7f394373e640 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f366adb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3934025b20 tx=0x7f3934002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.689+0000 7f382fe07640 1 -- 172.21.15.120:0/787918506 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934071070 con 0x5607f366b690 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.689+0000 7f382fe07640 1 -- 172.21.15.120:0/787918506 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934066040 con 0x5607f366b690 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.689+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607f36696c0 con 0x5607f366b690 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.689+0000 7f382fe07640 1 -- 172.21.15.120:0/787918506 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934065050 con 0x5607f366b690 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.689+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f3669c80 con 0x5607f366b690 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.690+0000 7f382fe07640 1 -- 172.21.15.120:0/787918506 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3934074070 con 0x5607f366b690 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.690+0000 7f382fe07640 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382803c730 0x7f382803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.690+0000 7f382fe07640 1 -- 172.21.15.120:0/787918506 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f39340966e0 con 0x5607f366b690 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.690+0000 7f3942f3d640 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382803c730 0x7f382803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.690+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f366e020 0x5607f376b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.690+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f376b7d0 con 0x5607f366e020 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.690+0000 7f3943f3f640 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f366e020 0x5607f376b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.690+0000 7f3942f3d640 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382803c730 0x7f382803ebf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3938001db0 tx=0x7f3938001310 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.690+0000 7f3943f3f640 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f366e020 0x5607f376b290 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.691+0000 7f3943f3f640 1 -- 172.21.15.120:0/787918506 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f393c00a4d0 con 0x5607f366e020 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.691+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f376c5c0 0x5607f376e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.691+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f376eff0 con 0x5607f376c5c0 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.691+0000 7f394373e640 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f376c5c0 0x5607f376e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.691+0000 7f394373e640 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f376c5c0 0x5607f376e9b0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.691+0000 7f394373e640 1 -- 172.21.15.120:0/787918506 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3934073030 con 0x5607f376c5c0 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.691+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37708a0 con 0x5607f376c5c0 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.692+0000 7f394373e640 1 -- 172.21.15.120:0/787918506 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3934073030 con 0x5607f376c5c0 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.692+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f376f9e0 con 0x5607f376c5c0 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.692+0000 7f394373e640 1 -- 172.21.15.120:0/787918506 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3934073030 con 0x5607f376c5c0 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.692+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f376fe40 con 0x5607f366e020 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.692+0000 7f3943f3f640 1 -- 172.21.15.120:0/787918506 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f393c00a4d0 con 0x5607f366e020 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.693+0000 7f3947b2c800 1 Processor -- start 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.693+0000 7f3947b2c800 1 -- start start 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.693+0000 7f3947b2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f377edd0 0x5607f377f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.693+0000 7f3947b2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5607f3561a00 con 0x5607f377edd0 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.693+0000 7f3943f3f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f377edd0 0x5607f377f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.693+0000 7f3943f3f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f377edd0 0x5607f377f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52438/0 (socket says 172.21.15.120:52438) 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.693+0000 7f3943f3f640 1 -- 172.21.15.120:0/3890236668 learned_addr learned my addr 172.21.15.120:0/3890236668 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.693+0000 7f3943f3f640 1 -- 172.21.15.120:0/3890236668 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f377f830 con 0x5607f377edd0 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.694+0000 7f3943f3f640 1 --2- 172.21.15.120:0/3890236668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f377edd0 0x5607f377f1f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f393c016d20 tx=0x7f393c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.694+0000 7f382d602640 1 -- 172.21.15.120:0/3890236668 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c017660 con 0x5607f377edd0 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.694+0000 7f382d602640 1 -- 172.21.15.120:0/3890236668 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c01b030 con 0x5607f377edd0 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.694+0000 7f3947b2c800 1 -- 172.21.15.120:0/3890236668 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607f3780060 con 0x5607f377edd0 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.694+0000 7f382d602640 1 -- 172.21.15.120:0/3890236668 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c017950 con 0x5607f377edd0 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.694+0000 7f3947b2c800 1 -- 172.21.15.120:0/3890236668 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f3780600 con 0x5607f377edd0 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f382d602640 1 -- 172.21.15.120:0/3890236668 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f393c017af0 con 0x5607f377edd0 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f382d602640 1 --2- 172.21.15.120:0/3890236668 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f381c03c780 0x7f381c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f382d602640 1 -- 172.21.15.120:0/3890236668 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f393c00e040 con 0x5607f377edd0 2024-09-07T03:32:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f394373e640 1 --2- 172.21.15.120:0/3890236668 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f381c03c780 0x7f381c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f3947b2c800 1 Processor -- start 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f3947b2c800 1 -- start start 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f394373e640 1 --2- 172.21.15.120:0/3890236668 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f381c03c780 0x7f381c03ec40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5607f376bd80 tx=0x7f3934096040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f3947b2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f378bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f3947b2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5607f375ac40 con 0x5607f378b8f0 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f3943f3f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f378bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f3943f3f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f378bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52444/0 (socket says 172.21.15.120:52444) 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.695+0000 7f3943f3f640 1 -- 172.21.15.120:0/1872194811 learned_addr learned my addr 172.21.15.120:0/1872194811 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3943f3f640 1 -- 172.21.15.120:0/1872194811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f378c2c0 con 0x5607f378b8f0 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3943f3f640 1 --2- 172.21.15.120:0/1872194811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f378bcd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f393c005cf0 tx=0x7f393c017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a5c36468e9b21e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3826ffd640 1 -- 172.21.15.120:0/1872194811 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c01fd90 con 0x5607f378b8f0 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3826ffd640 1 -- 172.21.15.120:0/1872194811 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c014960 con 0x5607f378b8f0 2024-09-07T03:32:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3826ffd640 1 -- 172.21.15.120:0/1872194811 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c028350 con 0x5607f378b8f0 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3947b2c800 1 -- 172.21.15.120:0/1872194811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 msgr2=0x5607f378bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3947b2c800 1 --2- 172.21.15.120:0/1872194811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f378bcd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f393c005cf0 tx=0x7f393c017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3947b2c800 1 -- 172.21.15.120:0/1872194811 shutdown_connections 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3947b2c800 1 --2- 172.21.15.120:0/1872194811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f378bcd0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3947b2c800 1 -- 172.21.15.120:0/1872194811 >> 172.21.15.120:0/1872194811 conn(0x5607f3787cf0 msgr2=0x5607f3785f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3947b2c800 1 -- 172.21.15.120:0/1872194811 shutdown_connections 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.696+0000 7f3947b2c800 1 -- 172.21.15.120:0/1872194811 wait complete. 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.697+0000 7f3947b2c800 1 Processor -- start 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.697+0000 7f3947b2c800 1 -- start start 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.697+0000 7f3947b2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f3792e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.697+0000 7f3947b2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5607f378c8d0 con 0x5607f378b8f0 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.697+0000 7f3943f3f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f3792e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.697+0000 7f3943f3f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f3792e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:52456/0 (socket says 172.21.15.120:52456) 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.697+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 learned_addr learned my addr 172.21.15.120:0/3911579450 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.697+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f3793380 con 0x5607f378b8f0 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.697+0000 7f3943f3f640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f3792e20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f393c053cd0 tx=0x7f393c053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.698+0000 7f38257fa640 1 -- 172.21.15.120:0/3911579450 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c02e070 con 0x5607f378b8f0 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.698+0000 7f38257fa640 1 -- 172.21.15.120:0/3911579450 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c0551b0 con 0x5607f378b8f0 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.698+0000 7f38257fa640 1 -- 172.21.15.120:0/3911579450 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c055490 con 0x5607f378b8f0 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.698+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607f3793610 con 0x5607f378b8f0 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.698+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f37941a0 con 0x5607f378b8f0 2024-09-07T03:32:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.698+0000 7f38257fa640 1 -- 172.21.15.120:0/3911579450 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f393c055630 con 0x5607f378b8f0 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.699+0000 7f38257fa640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f380c03c780 0x7f380c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.699+0000 7f38257fa640 1 -- 172.21.15.120:0/3911579450 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6133+0+0 (secure 0 0 0) 0x7f393c04b040 con 0x5607f378b8f0 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.699+0000 7f394373e640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f380c03c780 0x7f380c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.699+0000 7f394373e640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f380c03c780 0x7f380c03ec40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f393406afd0 tx=0x7f3934084000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.699+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.699+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f379e950 0x5607f37a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.699+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37a1560 con 0x5607f379e950 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.699+0000 7f3942f3d640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f379e950 0x5607f37a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3942f3d640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f379e950 0x5607f37a0e10 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3938009050 con 0x5607f379e950 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 20 realm 2024-09-07T03:32:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f379dca0 con 0x5607f379e950 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3938009050 con 0x5607f379e950 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37a2050 con 0x5607f379e950 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3938009050 con 0x5607f379e950 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f37a2e30 0x5607f37a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.700+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37a58f0 con 0x5607f37a2e30 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3943f3f640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f37a2e30 0x5607f37a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3943f3f640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f37a2e30 0x5607f37a5220 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3947b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37a6140 con 0x5607f37a2e30 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3947b2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3947b2c800 20 searching for the correct realm 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5607f37a7eb0 0x5607f37aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a7eb0 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.701+0000 7f394373e640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5607f37a7eb0 0x5607f37aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.702+0000 7f394373e640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5607f37a7eb0 0x5607f37aa2e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.702+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.702+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.702+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.702+0000 7f3943f3f640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f393c02a450 0x7f393c03c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.702+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x7f393c02a450 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.702+0000 7f3942f3d640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f393c02a450 0x7f393c03c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.703+0000 7f3942f3d640 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f393c02a450 0x7f393c03c3f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.703+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938009050 con 0x7f393c02a450 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.703+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.703+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938009050 con 0x5607f379e950 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.703+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.703+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.703+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a7eb0 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.704+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.704+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.704+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.704+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.704+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.704+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.704+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.704+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.704+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.705+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x7f393c02a450 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.705+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.705+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.705+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.705+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x7f393c02a450 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.705+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.705+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.706+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.706+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a7eb0 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.706+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.706+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.706+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.706+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.706+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.706+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a7eb0 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a7eb0 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.707+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x7f393c02a450 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.708+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.708+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f379e950 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.708+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.708+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x7f393c02a450 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.708+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.708+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a7eb0 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.708+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.708+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x7f393c02a450 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.709+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.709+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.709+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.709+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.709+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.709+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a7eb0 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.709+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.709+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5607f37aa9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:39.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:39.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:39.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:39.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:39.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:39.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37a6ac0 con 0x5607f379e950 2024-09-07T03:32:39.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37a6700 con 0x5607f37a2e30 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.710+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37a6f00 con 0x5607f379e950 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 zone default found 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 4 Realm: () 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 zonegroup default 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ab2e0 con 0x7f393c02a450 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ad520 con 0x5607f37a7eb0 2024-09-07T03:32:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ad8c0 con 0x5607f37a7eb0 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 started sync module instance, tier type = 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.711+0000 7f3947b2c800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.712+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ac9b0 con 0x5607f37a2e30 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.713+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.713+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94592149671328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ac610 con 0x5607f37a2e30 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.713+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ae780 con 0x5607f379e950 2024-09-07T03:32:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.714+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94592149671328] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.714+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(46 notify.1 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.714+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94592149675184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ae780 con 0x5607f379e950 2024-09-07T03:32:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.714+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37af210 con 0x5607f37a2e30 2024-09-07T03:32:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.715+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94592149675184] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.715+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.715+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94592149679328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ae780 con 0x5607f37a2e30 2024-09-07T03:32:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.715+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37afc60 con 0x7f393c02a450 2024-09-07T03:32:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.716+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94592149679328] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.716+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(50 notify.3 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.716+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94592149682032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ae780 con 0x7f393c02a450 2024-09-07T03:32:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.716+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b06b0 con 0x5607f37a2e30 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.717+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.717+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94592149684672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b05e0 con 0x5607f37a2e30 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.717+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b15e0 con 0x5607f37a7eb0 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.718+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94592149682032] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.718+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94592149684672] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.720+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.720+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94592149686944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b10f0 con 0x5607f37a7eb0 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.720+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b1fa0 con 0x5607f37a7eb0 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.721+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94592149686944] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.721+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.721+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94592149676752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b1fa0 con 0x5607f37a7eb0 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.721+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b2960 con 0x7f393c02a450 2024-09-07T03:32:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(58 notify.7 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94592149676752] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94592149693616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b28d0 con 0x7f393c02a450 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f3947b2c800 20 add_watcher() i=0 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f3947b2c800 20 add_watcher() i=1 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f3947b2c800 20 add_watcher() i=2 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f3947b2c800 20 add_watcher() i=3 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f3947b2c800 20 add_watcher() i=4 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f3947b2c800 20 add_watcher() i=5 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.722+0000 7f3947b2c800 20 add_watcher() i=6 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.723+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94592149693616] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.723+0000 7f3947b2c800 20 add_watcher() i=7 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.723+0000 7f3947b2c800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.723+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b28d0 con 0x5607f379e950 2024-09-07T03:32:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.724+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.724+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94592149695648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37b3570 con 0x5607f379e950 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.725+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94592149695648] v34'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.725+0000 7f37fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.725+0000 7f3947b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.725+0000 7f3947b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.725+0000 7f3947b2c800 5 note: GC not initialized 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f37f97e2640 20 reqs_thread_entry: start 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 20 Filter name: none 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f37f27fc640 20 reqs_thread_entry: start 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e8ee0 con 0x5607f379e950 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.726+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37eb810 con 0x7f393c02a450 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 20 enabling bucket name=myfoo 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e97f0 con 0x7f393c02a450 2024-09-07T03:32:39.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 : miss 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 20 rados->read ofs=0 len=0 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.727+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ec0b0 con 0x5607f379e950 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.728+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.728+0000 7f3947b2c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.728+0000 7f3947b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.728+0000 7f3947b2c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.728+0000 7f3947b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.728+0000 7f3947b2c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:39.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.728+0000 7f3947b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.728+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 8.a 8:51622d95:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37f3900 con 0x5607f379e950 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(66 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v34'9 uv9 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3947b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3947b2c800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3947b2c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3947b2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1, ofs0, ns] 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94592149931856 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37f26e0 con 0x7f393c02a450 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== watch-notify(notify (1) cookie 94592149682032 notify 146028888080 ret 0) ==== 802+0+0 (crc 0 0 0) 0x5607f37ec4a0 con 0x7f393c02a450 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3826ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 94592149682032 notifier 4596 bl.length()=760 2024-09-07T03:32:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(67 notify.3 [notify cookie 94592149931856 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3826ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 info.flags=0x17 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3826ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1 to cache LRU end 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3826ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.729+0000 7f3826ffd640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3808003ea0 con 0x7f393c02a450 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.730+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== watch-notify(notify_complete (2) cookie 94592149931856 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5607f37eb5f0 con 0x7f393c02a450 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.730+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.730+0000 7f3947b2c800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_sources= new_sources= 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.730+0000 7f3947b2c800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential sources added=[] removed=[] 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.730+0000 7f3947b2c800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): orig_dests= new_dests= 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.730+0000 7f3947b2c800 20 handle_bi_update(): bucket=:myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1]): potential dests added=[] removed=[] 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.730+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37ec730 con 0x5607f379e950 2024-09-07T03:32:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3947b2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3947b2c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3947b2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94592149931824 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5607f37f26e0 con 0x5607f37a2e30 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94592149684672 notify 146028888091 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5607f37941a0 con 0x5607f37a2e30 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3826ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94592149684672 notifier 4596 bl.length()=567 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3826ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3826ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3826ffd640 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3808003ea0 con 0x5607f37a2e30 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(70 notify.4 [notify cookie 94592149931824 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.731+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.732+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94592149931824 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5607f3793610 con 0x5607f37a2e30 2024-09-07T03:32:39.754 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:39.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.732+0000 7f37fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:39.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.733+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94592149695648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e6d40 con 0x5607f379e950 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.734+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94592149695648] v34'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.734+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94592149671328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e6d40 con 0x5607f37a2e30 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.735+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94592149671328] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.735+0000 7f3947b2c800 20 remove_watcher() i=0 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.735+0000 7f3947b2c800 2 removed watcher, disabling cache 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.735+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94592149675184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e6d40 con 0x5607f379e950 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.735+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94592149675184] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x5607f379e950 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.735+0000 7f3947b2c800 20 remove_watcher() i=1 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.735+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94592149679328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e6d40 con 0x5607f37a2e30 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.737+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94592149679328] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.737+0000 7f3947b2c800 20 remove_watcher() i=2 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.737+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94592149682032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e6d40 con 0x7f393c02a450 2024-09-07T03:32:39.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.737+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94592149682032] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.737+0000 7f3947b2c800 20 remove_watcher() i=3 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.737+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94592149684672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e6d40 con 0x5607f37a2e30 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.739+0000 7f3943f3f640 1 -- 172.21.15.120:0/3911579450 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94592149684672] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f393c027070 con 0x5607f37a2e30 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.739+0000 7f3947b2c800 20 remove_watcher() i=4 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.739+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94592149686944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e6d40 con 0x5607f37a7eb0 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.740+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94592149686944] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.740+0000 7f3947b2c800 20 remove_watcher() i=5 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.740+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94592149676752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e6d40 con 0x5607f37a7eb0 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.741+0000 7f394373e640 1 -- 172.21.15.120:0/3911579450 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94592149676752] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3934073030 con 0x5607f37a7eb0 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.741+0000 7f3947b2c800 20 remove_watcher() i=6 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.741+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94592149693616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5607f37e6d40 con 0x7f393c02a450 2024-09-07T03:32:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.741+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94592149693616] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3938028040 con 0x7f393c02a450 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 20 remove_watcher() i=7 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f37a2e30 msgr2=0x5607f37a5220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f37a2e30 0x5607f37a5220 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f379e950 msgr2=0x5607f37a0e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f379e950 0x5607f37a0e10 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f393c02a450 msgr2=0x7f393c03c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f393c02a450 0x7f393c03c3f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5607f37a7eb0 msgr2=0x5607f37aa2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5607f37a7eb0 0x5607f37aa2e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f380c03c780 msgr2=0x7f380c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f380c03c780 0x7f380c03ec40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f393406afd0 tx=0x7f3934084000 comp rx=0 tx=0).stop 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 msgr2=0x5607f3792e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3911579450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f378b8f0 0x5607f3792e20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f393c053cd0 tx=0x7f393c053d00 comp rx=0 tx=0).stop 2024-09-07T03:32:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 reap_dead start 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3942f3d640 1 -- 172.21.15.120:0/3911579450 reap_dead start 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 shutdown_connections 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 >> 172.21.15.120:0/3911579450 conn(0x5607f3787cf0 msgr2=0x5607f3785f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 shutdown_connections 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3911579450 wait complete. 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3890236668 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f381c03c780 msgr2=0x7f381c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3890236668 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f381c03c780 0x7f381c03ec40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5607f376bd80 tx=0x7f3934096040 comp rx=0 tx=0).stop 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3890236668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f377edd0 msgr2=0x5607f377f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3890236668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f377edd0 0x5607f377f1f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f393c016d20 tx=0x7f393c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3890236668 shutdown_connections 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3890236668 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f381c03c780 0x7f381c03ec40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 --2- 172.21.15.120:0/3890236668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f377edd0 0x5607f377f1f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3890236668 >> 172.21.15.120:0/3890236668 conn(0x5607f3773180 msgr2=0x5607f3773560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3890236668 shutdown_connections 2024-09-07T03:32:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.742+0000 7f3947b2c800 1 -- 172.21.15.120:0/3890236668 wait complete. 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f376c5c0 msgr2=0x5607f376e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f376c5c0 0x5607f376e9b0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f366e020 msgr2=0x5607f376b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f366e020 0x5607f376b290 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382803c730 msgr2=0x7f382803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382803c730 0x7f382803ebf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3938001db0 tx=0x7f3938001310 comp rx=0 tx=0).stop 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 msgr2=0x5607f366adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f366adb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3934025b20 tx=0x7f3934002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 shutdown_connections 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5607f376c5c0 0x5607f376e9b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5607f366e020 0x5607f376b290 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382803c730 0x7f382803ebf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 --2- 172.21.15.120:0/787918506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5607f366b690 0x5607f366adb0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 >> 172.21.15.120:0/787918506 conn(0x5607f36651f0 msgr2=0x5607f375b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:39.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 shutdown_connections 2024-09-07T03:32:39.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:39.743+0000 7f3947b2c800 1 -- 172.21.15.120:0/787918506 wait complete. 2024-09-07T03:32:39.765 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:39.797 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-07T03:32:40.059 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-07T03:32:40.065 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:55.066 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-07T03:32:55.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-07T03:32:55.066 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-07T03:32:55.117 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:55.117 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:55.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.117+0000 7f4828615800 1 Processor -- start 2024-09-07T03:32:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.117+0000 7f4828615800 1 -- start start 2024-09-07T03:32:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.117+0000 7f4828615800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562701a9a200 0x562701a9fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.117+0000 7f4828615800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562701943e40 con 0x562701a98df0 2024-09-07T03:32:55.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.117+0000 7f4828615800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56270190e680 con 0x562701a9a200 2024-09-07T03:32:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.118+0000 7f4823591640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562701a9a200 0x562701a9fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.118+0000 7f4823d92640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x562701a98df0 0x562701a99af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41456/0 (socket says 172.21.15.120:41456) 2024-09-07T03:32:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.118+0000 7f4823d92640 1 -- 172.21.15.120:0/1234327154 learned_addr learned my addr 172.21.15.120:0/1234327154 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.118+0000 7f4823591640 1 -- 172.21.15.120:0/1234327154 >> v1:172.21.15.104:6789/0 conn(0x562701a98df0 legacy=0x562701a99af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.118+0000 7f4823591640 1 -- 172.21.15.120:0/1234327154 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56270192a6b0 con 0x562701a9a200 2024-09-07T03:32:55.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.118+0000 7f4822d90640 1 -- 172.21.15.120:0/1234327154 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1100192 0 0) 0x562701943e40 con 0x562701a98df0 2024-09-07T03:32:55.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.120+0000 7f4823591640 1 --2- 172.21.15.120:0/1234327154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a9a200 0x562701a9fda0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f480c00a470 tx=0x7f480c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e1d1922f88136c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.120+0000 7f4822d90640 1 -- 172.21.15.120:0/1234327154 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f480c053570 con 0x562701a9a200 2024-09-07T03:32:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.120+0000 7f4822d90640 1 -- 172.21.15.120:0/1234327154 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480c058070 con 0x562701a9a200 2024-09-07T03:32:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.121+0000 7f4822d90640 1 -- 172.21.15.120:0/1234327154 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f480c053880 con 0x562701a9a200 2024-09-07T03:32:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.121+0000 7f4828615800 1 -- 172.21.15.120:0/1234327154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a9a200 msgr2=0x562701a9fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.121+0000 7f4828615800 1 --2- 172.21.15.120:0/1234327154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a9a200 0x562701a9fda0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f480c00a470 tx=0x7f480c045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.121+0000 7f4828615800 1 -- 172.21.15.120:0/1234327154 shutdown_connections 2024-09-07T03:32:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.121+0000 7f4828615800 1 --2- 172.21.15.120:0/1234327154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a9a200 0x562701a9fda0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.121+0000 7f4828615800 1 -- 172.21.15.120:0/1234327154 >> 172.21.15.120:0/1234327154 conn(0x562701a941c0 msgr2=0x562701a96620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.121+0000 7f4828615800 1 -- 172.21.15.120:0/1234327154 shutdown_connections 2024-09-07T03:32:55.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.121+0000 7f4828615800 1 -- 172.21.15.120:0/1234327154 wait complete. 2024-09-07T03:32:55.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.137+0000 7f4828615800 1 Processor -- start 2024-09-07T03:32:55.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.137+0000 7f4828615800 1 -- start start 2024-09-07T03:32:55.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.137+0000 7f4828615800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701a0cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.137+0000 7f4828615800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562701932dd0 con 0x562701a98df0 2024-09-07T03:32:55.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.138+0000 7f4823d92640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701a0cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.138+0000 7f4823d92640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701a0cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58450/0 (socket says 172.21.15.120:58450) 2024-09-07T03:32:55.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.138+0000 7f4823d92640 1 -- 172.21.15.120:0/2869457301 learned_addr learned my addr 172.21.15.120:0/2869457301 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.138+0000 7f4823d92640 1 -- 172.21.15.120:0/2869457301 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56270194be10 con 0x562701a98df0 2024-09-07T03:32:55.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.138+0000 7f4823d92640 1 --2- 172.21.15.120:0/2869457301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701a0cdf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4814001ea0 tx=0x7f481400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e23ac3877731f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.138+0000 7f4711e0b640 1 -- 172.21.15.120:0/2869457301 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4814008070 con 0x562701a98df0 2024-09-07T03:32:55.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.138+0000 7f4711e0b640 1 -- 172.21.15.120:0/2869457301 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481400d500 con 0x562701a98df0 2024-09-07T03:32:55.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.138+0000 7f4711e0b640 1 -- 172.21.15.120:0/2869457301 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481400d880 con 0x562701a98df0 2024-09-07T03:32:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.139+0000 7f4828615800 1 -- 172.21.15.120:0/2869457301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 msgr2=0x562701a0cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.139+0000 7f4828615800 1 --2- 172.21.15.120:0/2869457301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701a0cdf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4814001ea0 tx=0x7f481400b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.139+0000 7f4828615800 1 -- 172.21.15.120:0/2869457301 shutdown_connections 2024-09-07T03:32:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.139+0000 7f4828615800 1 --2- 172.21.15.120:0/2869457301 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701a0cdf0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.139+0000 7f4828615800 1 -- 172.21.15.120:0/2869457301 >> 172.21.15.120:0/2869457301 conn(0x562701a941c0 msgr2=0x562701b83d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.139+0000 7f4828615800 1 -- 172.21.15.120:0/2869457301 shutdown_connections 2024-09-07T03:32:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.139+0000 7f4828615800 1 -- 172.21.15.120:0/2869457301 wait complete. 2024-09-07T03:32:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.139+0000 7f4828615800 1 Processor -- start 2024-09-07T03:32:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.139+0000 7f4828615800 1 -- start start 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.140+0000 7f4828615800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701b89740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.140+0000 7f4828615800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562701a9a8f0 con 0x562701a98df0 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.140+0000 7f4823d92640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701b89740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.140+0000 7f4823d92640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701b89740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58456/0 (socket says 172.21.15.120:58456) 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.140+0000 7f4823d92640 1 -- 172.21.15.120:0/242484424 learned_addr learned my addr 172.21.15.120:0/242484424 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.140+0000 7f4823d92640 1 -- 172.21.15.120:0/242484424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562701b89ca0 con 0x562701a98df0 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.141+0000 7f4823d92640 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701b89740 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f48140012f0 tx=0x7f4814000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.141+0000 7f470bfff640 1 -- 172.21.15.120:0/242484424 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481400f9d0 con 0x562701a98df0 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.141+0000 7f470bfff640 1 -- 172.21.15.120:0/242484424 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481400fb70 con 0x562701a98df0 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.141+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562701b88050 con 0x562701a98df0 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.141+0000 7f470bfff640 1 -- 172.21.15.120:0/242484424 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481400fe50 con 0x562701a98df0 2024-09-07T03:32:55.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.141+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562701b88610 con 0x562701a98df0 2024-09-07T03:32:55.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.142+0000 7f470bfff640 1 -- 172.21.15.120:0/242484424 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4814017040 con 0x562701a98df0 2024-09-07T03:32:55.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.142+0000 7f470bfff640 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f470c03c920 0x7f470c03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.142+0000 7f470bfff640 1 -- 172.21.15.120:0/242484424 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f4814015020 con 0x562701a98df0 2024-09-07T03:32:55.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.142+0000 7f4823591640 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f470c03c920 0x7f470c03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.142+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701a9a200 0x562701b9a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.142+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701b9a860 con 0x562701a9a200 2024-09-07T03:32:55.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.142+0000 7f4824593640 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701a9a200 0x562701b9a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.143+0000 7f4823591640 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f470c03c920 0x7f470c03ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f480c057000 tx=0x7f480c052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.143+0000 7f4824593640 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701a9a200 0x562701b9a320 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.143+0000 7f4824593640 1 -- 172.21.15.120:0/242484424 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f481c00a4d0 con 0x562701a9a200 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.143+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701b9b650 0x562701b9da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.143+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701b9e080 con 0x562701b9b650 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.143+0000 7f4823d92640 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701b9b650 0x562701b9da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.144+0000 7f4823d92640 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701b9b650 0x562701b9da40 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.144+0000 7f4823d92640 1 -- 172.21.15.120:0/242484424 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f481402d070 con 0x562701b9b650 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.144+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701b9f930 con 0x562701b9b650 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.145+0000 7f4823d92640 1 -- 172.21.15.120:0/242484424 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f481402d070 con 0x562701b9b650 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.145+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701b9ea70 con 0x562701b9b650 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.145+0000 7f4823d92640 1 -- 172.21.15.120:0/242484424 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f481402d070 con 0x562701b9b650 2024-09-07T03:32:55.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.145+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701b9eed0 con 0x562701a9a200 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.145+0000 7f4824593640 1 -- 172.21.15.120:0/242484424 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f481c00a4d0 con 0x562701a9a200 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.146+0000 7f4828615800 1 Processor -- start 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.146+0000 7f4828615800 1 -- start start 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.146+0000 7f4828615800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bade60 0x562701bae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.146+0000 7f4828615800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562701990a00 con 0x562701bade60 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.146+0000 7f4824593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bade60 0x562701bae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.146+0000 7f4824593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bade60 0x562701bae280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58472/0 (socket says 172.21.15.120:58472) 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.146+0000 7f4824593640 1 -- 172.21.15.120:0/1172033095 learned_addr learned my addr 172.21.15.120:0/1172033095 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.147+0000 7f4824593640 1 -- 172.21.15.120:0/1172033095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562701bae8c0 con 0x562701bade60 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.147+0000 7f4824593640 1 --2- 172.21.15.120:0/1172033095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bade60 0x562701bae280 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f481c016d20 tx=0x7f481c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.147+0000 7f47097fa640 1 -- 172.21.15.120:0/1172033095 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481c017660 con 0x562701bade60 2024-09-07T03:32:55.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.147+0000 7f47097fa640 1 -- 172.21.15.120:0/1172033095 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481c01b030 con 0x562701bade60 2024-09-07T03:32:55.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.147+0000 7f4828615800 1 -- 172.21.15.120:0/1172033095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562701baf0f0 con 0x562701bade60 2024-09-07T03:32:55.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.147+0000 7f47097fa640 1 -- 172.21.15.120:0/1172033095 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481c017950 con 0x562701bade60 2024-09-07T03:32:55.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.147+0000 7f4828615800 1 -- 172.21.15.120:0/1172033095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562701baf690 con 0x562701bade60 2024-09-07T03:32:55.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.148+0000 7f47097fa640 1 -- 172.21.15.120:0/1172033095 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f481c017af0 con 0x562701bade60 2024-09-07T03:32:55.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.148+0000 7f47097fa640 1 --2- 172.21.15.120:0/1172033095 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46fc03c780 0x7f46fc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.148+0000 7f47097fa640 1 -- 172.21.15.120:0/1172033095 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f481c00e040 con 0x562701bade60 2024-09-07T03:32:55.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.148+0000 7f4823d92640 1 --2- 172.21.15.120:0/1172033095 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46fc03c780 0x7f46fc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4828615800 1 Processor -- start 2024-09-07T03:32:55.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4828615800 1 -- start start 2024-09-07T03:32:55.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4823d92640 1 --2- 172.21.15.120:0/1172033095 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46fc03c780 0x7f46fc03ec40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x562701b9ae10 tx=0x7f481404e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4828615800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bbad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4828615800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562701b8c1d0 con 0x562701bba940 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4824593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bbad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4824593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bbad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58478/0 (socket says 172.21.15.120:58478) 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4824593640 1 -- 172.21.15.120:0/965108832 learned_addr learned my addr 172.21.15.120:0/965108832 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4824593640 1 -- 172.21.15.120:0/965108832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562701bbb330 con 0x562701bba940 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.149+0000 7f4824593640 1 --2- 172.21.15.120:0/965108832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bbad40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f481c005cf0 tx=0x7f481c017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2767dd9f0a6f18ae server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4702ffd640 1 -- 172.21.15.120:0/965108832 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481c014960 con 0x562701bba940 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4702ffd640 1 -- 172.21.15.120:0/965108832 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481c055040 con 0x562701bba940 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4702ffd640 1 -- 172.21.15.120:0/965108832 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481c028350 con 0x562701bba940 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4828615800 1 -- 172.21.15.120:0/965108832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 msgr2=0x562701bbad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4828615800 1 --2- 172.21.15.120:0/965108832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bbad40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f481c005cf0 tx=0x7f481c017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4828615800 1 -- 172.21.15.120:0/965108832 shutdown_connections 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4828615800 1 --2- 172.21.15.120:0/965108832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bbad40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4828615800 1 -- 172.21.15.120:0/965108832 >> 172.21.15.120:0/965108832 conn(0x562701bb6d40 msgr2=0x562701bb4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4828615800 1 -- 172.21.15.120:0/965108832 shutdown_connections 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4828615800 1 -- 172.21.15.120:0/965108832 wait complete. 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.150+0000 7f4828615800 1 Processor -- start 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.151+0000 7f4828615800 1 -- start start 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.151+0000 7f4828615800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bc1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.151+0000 7f4828615800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562701bbb920 con 0x562701bba940 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.151+0000 7f4824593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bc1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.151+0000 7f4824593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bc1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58488/0 (socket says 172.21.15.120:58488) 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.151+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 learned_addr learned my addr 172.21.15.120:0/3104019152 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.151+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562701bc24c0 con 0x562701bba940 2024-09-07T03:32:55.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.151+0000 7f4824593640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bc1f60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f481c053cd0 tx=0x7f481c053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.151+0000 7f47017fa640 1 -- 172.21.15.120:0/3104019152 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481c02e070 con 0x562701bba940 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.152+0000 7f47017fa640 1 -- 172.21.15.120:0/3104019152 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481c014440 con 0x562701bba940 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.152+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562701bc2750 con 0x562701bba940 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.152+0000 7f47017fa640 1 -- 172.21.15.120:0/3104019152 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481c0127a0 con 0x562701bba940 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.152+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562701bc32e0 con 0x562701bba940 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.152+0000 7f47017fa640 1 -- 172.21.15.120:0/3104019152 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f481c012940 con 0x562701bba940 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.153+0000 7f47017fa640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46ec03c780 0x7f46ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.153+0000 7f47017fa640 1 -- 172.21.15.120:0/3104019152 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f481c04b040 con 0x562701bba940 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.153+0000 7f4823d92640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46ec03c780 0x7f46ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.153+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.153+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701bcd980 0x562701bcfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.153+0000 7f4823d92640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46ec03c780 0x7f46ec03ec40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f481400bbf0 tx=0x7f4814046000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.153+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bd0590 con 0x562701bcd980 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.153+0000 7f4823591640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701bcd980 0x562701bcfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4823591640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701bcd980 0x562701bcfe40 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 20 realm 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bd09c0 con 0x562701bcd980 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bd1290 con 0x562701bcd980 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701bd1cb0 0x562701bd40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.154+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bd4810 con 0x562701bd1cb0 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.155+0000 7f4824593640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701bd1cb0 0x562701bd40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.155+0000 7f4824593640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701bd1cb0 0x562701bd40a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.155+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.155+0000 7f4828615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.155+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.155+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bd50b0 con 0x562701bd1cb0 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.156+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.156+0000 7f4828615800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.156+0000 7f4828615800 20 searching for the correct realm 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.156+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562701bd6e20 0x562701bd9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.156+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd6e20 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.156+0000 7f4823d92640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562701bd6e20 0x562701bd9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.156+0000 7f4823d92640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562701bd6e20 0x562701bd9230 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.156+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.156+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd1cb0 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.157+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.157+0000 7f4824593640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f481c033460 0x7f481c0549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.157+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x7f481c033460 2024-09-07T03:32:55.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.157+0000 7f4823591640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f481c033460 0x7f481c0549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.157+0000 7f4823591640 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f481c033460 0x7f481c0549d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.157+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.157+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bcd980 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.158+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.158+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bcd980 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.158+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.158+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd6e20 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.158+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.158+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bcd980 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.158+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.158+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd1cb0 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.159+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.159+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd1cb0 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.159+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.159+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bcd980 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.159+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.159+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x7f481c033460 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.159+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.160+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bcd980 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.160+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.160+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x7f481c033460 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.160+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.160+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd1cb0 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.160+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.160+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd6e20 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.161+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.161+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bcd980 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.161+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.161+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd1cb0 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.161+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.161+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd6e20 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.161+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.162+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bcd980 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.162+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.162+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bcd980 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.162+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.162+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bcd980 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.162+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.162+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd6e20 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.162+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.162+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x7f481c033460 2024-09-07T03:32:55.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.163+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.163+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x7f481c033460 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.163+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.163+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x7f481c033460 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.163+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.163+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd6e20 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.163+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.163+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x7f481c033460 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.164+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.164+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd1cb0 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.164+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.164+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd1cb0 2024-09-07T03:32:55.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.164+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.164+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd6e20 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.164+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.164+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd1cb0 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9900 con 0x562701bd1cb0 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:55.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bd5a30 con 0x562701bcd980 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.165+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bd5e20 con 0x562701bd1cb0 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bd6280 con 0x562701bcd980 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 20 zone default found 2024-09-07T03:32:55.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 4 Realm: () 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 20 zonegroup default 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bd9dd0 con 0x7f481c033460 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bdc090 con 0x562701bd6e20 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.166+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.167+0000 7f4828615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.167+0000 7f4828615800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.167+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bdc430 con 0x562701bd6e20 2024-09-07T03:32:55.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.167+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.167+0000 7f4828615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.167+0000 7f4828615800 20 started sync module instance, tier type = 2024-09-07T03:32:55.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.167+0000 7f4828615800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:55.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.167+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdb520 con 0x562701bd1cb0 2024-09-07T03:32:55.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.168+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.168+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725532924224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdcd20 con 0x562701bd1cb0 2024-09-07T03:32:55.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.168+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdd570 con 0x562701bcd980 2024-09-07T03:32:55.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.169+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725532924224] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.170+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.170+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725532928384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdd910 con 0x562701bcd980 2024-09-07T03:32:55.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.170+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bde1a0 con 0x562701bd1cb0 2024-09-07T03:32:55.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.171+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725532928384] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.171+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.171+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725532929440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdddc0 con 0x562701bd1cb0 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.171+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdec30 con 0x7f481c033460 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.172+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.172+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725532936032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdec30 con 0x7f481c033460 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.172+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdfbf0 con 0x562701bd1cb0 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.172+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725532929440] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.173+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725532936032] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.173+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.173+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725532938272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdfbb0 con 0x562701bd1cb0 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.173+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701be0490 con 0x562701bd6e20 2024-09-07T03:32:55.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.175+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.175+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725532938272] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.175+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725532942304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdfbb0 con 0x562701bd6e20 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.175+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdf6c0 con 0x562701bd6e20 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.176+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725532942304] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.176+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.176+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725532944432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdf6c0 con 0x562701bd6e20 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.176+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701be1980 con 0x7f481c033460 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725532947664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701be1de0 con 0x7f481c033460 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4828615800 20 add_watcher() i=0 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4828615800 20 add_watcher() i=1 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4828615800 20 add_watcher() i=2 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4828615800 20 add_watcher() i=3 2024-09-07T03:32:55.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4828615800 20 add_watcher() i=4 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4828615800 20 add_watcher() i=5 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725532944432] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.179+0000 7f4828615800 20 add_watcher() i=6 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.180+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725532947664] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.180+0000 7f4828615800 20 add_watcher() i=7 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.180+0000 7f4828615800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.180+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701be0eb0 con 0x562701bcd980 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.180+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.180+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725532948720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701be0eb0 con 0x562701bcd980 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.182+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725532948720] v36'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.182+0000 7f46d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:55.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.182+0000 7f4828615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.182+0000 7f4828615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.182+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701be72c0 con 0x562701bd1cb0 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.183+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'49 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.183+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701be72c0 con 0x7f481c033460 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.184+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'24 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.184+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bed9b0 con 0x562701bd6e20 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.186+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.186+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bedf20 con 0x562701bcd980 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.187+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'159 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.187+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bee3d0 con 0x562701bd1cb0 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.188+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'50 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.188+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bee3d0 con 0x562701bd6e20 2024-09-07T03:32:55.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.189+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'41 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.189+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701becde0 con 0x562701bd1cb0 2024-09-07T03:32:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.190+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.190+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701becde0 con 0x562701bcd980 2024-09-07T03:32:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.192+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.192+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701becde0 con 0x562701bd1cb0 2024-09-07T03:32:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.193+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.193+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701becde0 con 0x562701bd1cb0 2024-09-07T03:32:55.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.194+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.194+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701becde0 con 0x562701bd1cb0 2024-09-07T03:32:55.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.196+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'51 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.196+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701becde0 con 0x562701bd6e20 2024-09-07T03:32:55.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.197+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.197+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701becde0 con 0x562701bd1cb0 2024-09-07T03:32:55.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.198+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.198+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701becde0 con 0x562701bcd980 2024-09-07T03:32:55.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.199+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'47 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.199+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701beced0 con 0x562701bcd980 2024-09-07T03:32:55.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.200+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.200+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef140 con 0x562701bd1cb0 2024-09-07T03:32:55.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.201+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'45 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.202+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef140 con 0x562701bd1cb0 2024-09-07T03:32:55.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.202+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'52 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.203+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef140 con 0x562701bd6e20 2024-09-07T03:32:55.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.204+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.204+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef140 con 0x562701bd1cb0 2024-09-07T03:32:55.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.205+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.205+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef140 con 0x562701bcd980 2024-09-07T03:32:55.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.206+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'161 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.206+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef120 con 0x562701bd1cb0 2024-09-07T03:32:55.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.208+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'46 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.208+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef120 con 0x562701bd1cb0 2024-09-07T03:32:55.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.209+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.209+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef120 con 0x562701bd6e20 2024-09-07T03:32:55.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.210+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.210+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef100 con 0x562701bd1cb0 2024-09-07T03:32:55.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.211+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.211+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef100 con 0x562701bd6e20 2024-09-07T03:32:55.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.212+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.212+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef100 con 0x562701bd6e20 2024-09-07T03:32:55.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.213+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'42 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.213+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef100 con 0x562701bd6e20 2024-09-07T03:32:55.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.215+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.215+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701beef50 con 0x562701bd1cb0 2024-09-07T03:32:55.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.216+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.216+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef120 con 0x562701bcd980 2024-09-07T03:32:55.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.217+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.217+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef120 con 0x562701bd1cb0 2024-09-07T03:32:55.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.219+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'47 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.219+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef120 con 0x562701bcd980 2024-09-07T03:32:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.220+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'48 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.220+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bef120 con 0x7f481c033460 2024-09-07T03:32:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.221+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.221+0000 7f46d8fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:55.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.221+0000 7f4828615800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:55.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.221+0000 7f4828615800 20 Filter name: none 2024-09-07T03:32:55.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.221+0000 7f46527fc640 20 reqs_thread_entry: start 2024-09-07T03:32:55.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.221+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.222+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.222+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.222+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.222+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.223+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.223+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x7f481c033460 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.223+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.223+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x7f481c033460 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.223+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.223+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x7f481c033460 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.223+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.223+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd6e20 2024-09-07T03:32:55.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.224+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.224+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd6e20 2024-09-07T03:32:55.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.224+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.224+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd6e20 2024-09-07T03:32:55.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.224+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.224+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.224+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.224+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.225+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.225+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.225+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.225+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.225+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv19 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.225+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.226+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv19 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.226+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.226+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv19 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.226+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd6e20 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.226+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.226+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd6e20 2024-09-07T03:32:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.226+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.227+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd6e20 2024-09-07T03:32:55.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.227+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.227+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.227+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.227+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.227+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.227+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.228+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.228+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.228+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.228+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.228+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.228+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.228+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.228+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.229+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.229+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.229+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.229+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.229+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 45 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.229+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.230+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 46 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.230+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.230+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 47 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.230+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.230+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 48 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.230+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.231+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 49 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.231+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.231+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 50 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.231+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.231+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 51 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.231+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd6e20 2024-09-07T03:32:55.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.232+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.232+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd6e20 2024-09-07T03:32:55.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.232+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.232+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd6e20 2024-09-07T03:32:55.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.232+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.232+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.233+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 52 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.233+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.233+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 53 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.233+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.233+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 54 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.233+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.233+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.234+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.234+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.234+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.234+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.234+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.234+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.234+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.234+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.234+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.235+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.235+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.235+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 55 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.235+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.235+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 56 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.235+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701bec660 con 0x562701bd1cb0 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.236+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 57 ==== osd_op_reply(141 gc.15 [call out=1701b] v0'0 uv44 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.236+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b0c0 con 0x562701bd1cb0 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.236+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 58 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.236+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd1cb0 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.236+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 59 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.236+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd1cb0 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.237+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 60 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.237+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd6e20 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.237+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.237+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd6e20 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.237+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.237+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd6e20 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.237+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 33 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.237+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd1cb0 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.238+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 61 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.238+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd1cb0 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.238+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 62 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.238+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.238+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 63 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.238+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bcd980 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.239+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.239+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bcd980 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.239+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.239+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bcd980 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.239+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.239+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.239+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 64 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.239+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd1cb0 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.240+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 65 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.240+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.240+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 66 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.240+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.240+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 67 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.240+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd1cb0 2024-09-07T03:32:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.241+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 68 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.241+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.241+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 69 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.242+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd6e20 2024-09-07T03:32:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.242+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 34 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.242+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd6e20 2024-09-07T03:32:55.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.242+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 35 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.242+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd6e20 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.242+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 36 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.242+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.243+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 70 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.243+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd1cb0 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.243+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 71 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.243+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.243+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 72 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.243+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd6e20 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 37 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd6e20 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 38 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 39 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 40 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 41 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv18 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.244+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.245+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 42 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.245+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.245+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 43 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.245+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.245+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 44 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.245+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd6e20 2024-09-07T03:32:55.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.245+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 45 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.245+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.246+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 73 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.246+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd1cb0 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.246+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 74 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.246+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.246+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 75 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.246+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bcd980 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.247+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.247+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bcd980 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.247+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.247+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bcd980 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.247+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 43 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.247+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.248+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 76 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.248+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bd1cb0 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.248+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 77 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.248+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bd1cb0 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.248+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 78 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.248+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bcd980 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.249+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.249+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x562701bcd980 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.249+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.249+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x562701bcd980 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.249+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.249+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x7f481c033460 2024-09-07T03:32:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.249+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.249+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1a070 con 0x7f481c033460 2024-09-07T03:32:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.250+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.250+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562701c1b080 con 0x7f481c033460 2024-09-07T03:32:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.250+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.251+0000 7f46d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.251+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725532948720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701c199e0 con 0x562701bcd980 2024-09-07T03:32:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.252+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94725532948720] v36'162 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.252+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725532924224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701be18f0 con 0x562701bd1cb0 2024-09-07T03:32:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.253+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 79 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94725532924224] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.253+0000 7f4828615800 20 remove_watcher() i=0 2024-09-07T03:32:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.253+0000 7f4828615800 2 removed watcher, disabling cache 2024-09-07T03:32:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.253+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725532928384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701be18f0 con 0x562701bcd980 2024-09-07T03:32:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.254+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.1 v2:172.21.15.120:6808/3372043485 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94725532928384] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f480c051070 con 0x562701bcd980 2024-09-07T03:32:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.254+0000 7f4828615800 20 remove_watcher() i=1 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.254+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725532929440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdc980 con 0x562701bd1cb0 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.255+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 80 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94725532929440] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.255+0000 7f4828615800 20 remove_watcher() i=2 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.255+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725532936032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdb940 con 0x7f481c033460 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.256+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94725532936032] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.256+0000 7f4828615800 20 remove_watcher() i=3 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.256+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725532938272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdb940 con 0x562701bd1cb0 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.257+0000 7f4824593640 1 -- 172.21.15.120:0/3104019152 <== osd.0 v2:172.21.15.104:6800/182397107 81 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94725532938272] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481c027070 con 0x562701bd1cb0 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.257+0000 7f4828615800 20 remove_watcher() i=4 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.257+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725532942304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdb940 con 0x562701bd6e20 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.258+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94725532942304] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.258+0000 7f4828615800 20 remove_watcher() i=5 2024-09-07T03:32:55.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.258+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725532944432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdffe0 con 0x562701bd6e20 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.259+0000 7f4823d92640 1 -- 172.21.15.120:0/3104019152 <== osd.3 v2:172.21.15.120:6800/1193158925 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94725532944432] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f481402d070 con 0x562701bd6e20 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.259+0000 7f4828615800 20 remove_watcher() i=6 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.259+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725532947664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562701bdb940 con 0x7f481c033460 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 <== osd.2 v2:172.21.15.120:6809/3781833098 22 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94725532947664] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f480c051070 con 0x7f481c033460 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4828615800 20 remove_watcher() i=7 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701bd1cb0 msgr2=0x562701bd40a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701bd1cb0 0x562701bd40a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701bcd980 msgr2=0x562701bcfe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701bcd980 0x562701bcfe40 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f481c033460 msgr2=0x7f481c0549d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f481c033460 0x7f481c0549d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562701bd6e20 msgr2=0x562701bd9230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.260+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562701bd6e20 0x562701bd9230 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46ec03c780 msgr2=0x7f46ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46ec03c780 0x7f46ec03ec40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f481400bbf0 tx=0x7f4814046000 comp rx=0 tx=0).stop 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4823591640 1 -- 172.21.15.120:0/3104019152 reap_dead start 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 msgr2=0x562701bc1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bc1f60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f481c053cd0 tx=0x7f481c053d00 comp rx=0 tx=0).stop 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 shutdown_connections 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 --2- 172.21.15.120:0/3104019152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bba940 0x562701bc1f60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 >> 172.21.15.120:0/3104019152 conn(0x562701bb6d40 msgr2=0x562701bb4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 shutdown_connections 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/3104019152 wait complete. 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/1172033095 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46fc03c780 msgr2=0x7f46fc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 --2- 172.21.15.120:0/1172033095 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46fc03c780 0x7f46fc03ec40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x562701b9ae10 tx=0x7f481404e040 comp rx=0 tx=0).stop 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/1172033095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bade60 msgr2=0x562701bae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 --2- 172.21.15.120:0/1172033095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bade60 0x562701bae280 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f481c016d20 tx=0x7f481c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/1172033095 shutdown_connections 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 --2- 172.21.15.120:0/1172033095 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f46fc03c780 0x7f46fc03ec40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 --2- 172.21.15.120:0/1172033095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701bade60 0x562701bae280 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/1172033095 >> 172.21.15.120:0/1172033095 conn(0x562701ba2210 msgr2=0x562701ba25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/1172033095 shutdown_connections 2024-09-07T03:32:55.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/1172033095 wait complete. 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701b9b650 msgr2=0x562701b9da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701b9b650 0x562701b9da40 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701a9a200 msgr2=0x562701b9a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.261+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701a9a200 0x562701b9a320 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f470c03c920 msgr2=0x7f470c03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f470c03c920 0x7f470c03ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f480c057000 tx=0x7f480c052000 comp rx=0 tx=0).stop 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 msgr2=0x562701b89740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701b89740 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f48140012f0 tx=0x7f4814000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 shutdown_connections 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562701b9b650 0x562701b9da40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562701a9a200 0x562701b9a320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f470c03c920 0x7f470c03ede0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 --2- 172.21.15.120:0/242484424 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562701a98df0 0x562701b89740 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 >> 172.21.15.120:0/242484424 conn(0x562701a941c0 msgr2=0x562701b82520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 shutdown_connections 2024-09-07T03:32:55.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.262+0000 7f4828615800 1 -- 172.21.15.120:0/242484424 wait complete. 2024-09-07T03:32:55.271 INFO:teuthology.orchestra.run.smithi120.stdout:[{"tag":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.6734177508069502749\u0000","time":"2024-09-07T03:32:55.064125+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_7","key":"","instance":""}]}] 2024-09-07T03:32:55.271 DEBUG:tasks.util.rgw: json result: [{'tag': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.6734177508069502749\x00', 'time': '2024-09-07T03:32:55.064125+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_7', 'key': '', 'instance': ''}]}] 2024-09-07T03:32:55.271 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-07T03:32:55.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-07T03:32:55.272 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-07T03:32:55.314 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:55.314 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:55.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.313+0000 7f37e9539800 1 Processor -- start 2024-09-07T03:32:55.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37e9539800 1 -- start start 2024-09-07T03:32:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37e9539800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b0960326c0 0x55b096034ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37e9539800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b095edbe40 con 0x55b096034ff0 2024-09-07T03:32:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37e9539800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b095ea6680 con 0x55b0960326c0 2024-09-07T03:32:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37e51c7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b0960326c0 0x55b096034ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37dc9c6640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b096034ff0 0x55b0960374b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41462/0 (socket says 172.21.15.120:41462) 2024-09-07T03:32:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37dc9c6640 1 -- 172.21.15.120:0/1115533969 learned_addr learned my addr 172.21.15.120:0/1115533969 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37e51c7640 1 -- 172.21.15.120:0/1115533969 >> v1:172.21.15.104:6789/0 conn(0x55b096034ff0 legacy=0x55b0960374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37e49c6640 1 -- 172.21.15.120:0/1115533969 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491457094 0 0) 0x55b095edbe40 con 0x55b096034ff0 2024-09-07T03:32:55.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.314+0000 7f37e51c7640 1 -- 172.21.15.120:0/1115533969 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b095ec26b0 con 0x55b0960326c0 2024-09-07T03:32:55.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.316+0000 7f37e51c7640 1 --2- 172.21.15.120:0/1115533969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b096034ab0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f37d800a470 tx=0x7f37d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41270675cdeba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.316+0000 7f37e49c6640 1 -- 172.21.15.120:0/1115533969 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8053570 con 0x55b0960326c0 2024-09-07T03:32:55.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.316+0000 7f37e49c6640 1 -- 172.21.15.120:0/1115533969 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8058070 con 0x55b0960326c0 2024-09-07T03:32:55.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.316+0000 7f37e49c6640 1 -- 172.21.15.120:0/1115533969 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8053880 con 0x55b0960326c0 2024-09-07T03:32:55.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.317+0000 7f37e9539800 1 -- 172.21.15.120:0/1115533969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 msgr2=0x55b096034ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.317+0000 7f37e9539800 1 --2- 172.21.15.120:0/1115533969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b096034ab0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f37d800a470 tx=0x7f37d8045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:55.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.317+0000 7f37e9539800 1 -- 172.21.15.120:0/1115533969 shutdown_connections 2024-09-07T03:32:55.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.317+0000 7f37e9539800 1 --2- 172.21.15.120:0/1115533969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b096034ab0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.317+0000 7f37e9539800 1 -- 172.21.15.120:0/1115533969 >> 172.21.15.120:0/1115533969 conn(0x55b09602c1a0 msgr2=0x55b09602e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.317+0000 7f37e9539800 1 -- 172.21.15.120:0/1115533969 shutdown_connections 2024-09-07T03:32:55.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.317+0000 7f37e9539800 1 -- 172.21.15.120:0/1115533969 wait complete. 2024-09-07T03:32:55.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.330+0000 7f37e9539800 1 Processor -- start 2024-09-07T03:32:55.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.331+0000 7f37e9539800 1 -- start start 2024-09-07T03:32:55.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.331+0000 7f37e9539800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b0961214d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.331+0000 7f37e9539800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b095ecadd0 con 0x55b0960326c0 2024-09-07T03:32:55.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.331+0000 7f37e51c7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b0961214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.331+0000 7f37e51c7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b0961214d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58518/0 (socket says 172.21.15.120:58518) 2024-09-07T03:32:55.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.331+0000 7f37e51c7640 1 -- 172.21.15.120:0/3242047453 learned_addr learned my addr 172.21.15.120:0/3242047453 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.331+0000 7f37e51c7640 1 -- 172.21.15.120:0/3242047453 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b095ee3e10 con 0x55b0960326c0 2024-09-07T03:32:55.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.332+0000 7f37e51c7640 1 --2- 172.21.15.120:0/3242047453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b0961214d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f37d8025c20 tx=0x7f37d8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf43fd3d145b6ac server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.332+0000 7f36d3606640 1 -- 172.21.15.120:0/3242047453 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8053a20 con 0x55b0960326c0 2024-09-07T03:32:55.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.332+0000 7f36d3606640 1 -- 172.21.15.120:0/3242047453 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8063070 con 0x55b0960326c0 2024-09-07T03:32:55.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.332+0000 7f36d3606640 1 -- 172.21.15.120:0/3242047453 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8053d30 con 0x55b0960326c0 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 -- 172.21.15.120:0/3242047453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 msgr2=0x55b0961214d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 --2- 172.21.15.120:0/3242047453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b0961214d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f37d8025c20 tx=0x7f37d8051000 comp rx=0 tx=0).stop 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 -- 172.21.15.120:0/3242047453 shutdown_connections 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 --2- 172.21.15.120:0/3242047453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b0961214d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 -- 172.21.15.120:0/3242047453 >> 172.21.15.120:0/3242047453 conn(0x55b09602c1a0 msgr2=0x55b09611ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 -- 172.21.15.120:0/3242047453 shutdown_connections 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 -- 172.21.15.120:0/3242047453 wait complete. 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 Processor -- start 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 -- start start 2024-09-07T03:32:55.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b096128db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e9539800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b096039010 con 0x55b0960326c0 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.333+0000 7f37e51c7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b096128db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.334+0000 7f37e51c7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b096128db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58524/0 (socket says 172.21.15.120:58524) 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.334+0000 7f37e51c7640 1 -- 172.21.15.120:0/2113109522 learned_addr learned my addr 172.21.15.120:0/2113109522 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.334+0000 7f37e51c7640 1 -- 172.21.15.120:0/2113109522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b096129310 con 0x55b0960326c0 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.334+0000 7f37e51c7640 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b096128db0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f37d8025c20 tx=0x7f37d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.334+0000 7f36d1e03640 1 -- 172.21.15.120:0/2113109522 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8078070 con 0x55b0960326c0 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.334+0000 7f36d1e03640 1 -- 172.21.15.120:0/2113109522 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8073470 con 0x55b0960326c0 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.334+0000 7f36d1e03640 1 -- 172.21.15.120:0/2113109522 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8073750 con 0x55b0960326c0 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.334+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0961295a0 con 0x55b0960326c0 2024-09-07T03:32:55.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.334+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09612a1b0 con 0x55b0960326c0 2024-09-07T03:32:55.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.335+0000 7f36d1e03640 1 -- 172.21.15.120:0/2113109522 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f37d807b070 con 0x55b0960326c0 2024-09-07T03:32:55.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.335+0000 7f36d1e03640 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36cc03c780 0x7f36cc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.335+0000 7f36d1e03640 1 -- 172.21.15.120:0/2113109522 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f37d8097c40 con 0x55b0960326c0 2024-09-07T03:32:55.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.335+0000 7f37dc9c6640 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36cc03c780 0x7f36cc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.336+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096034ff0 0x55b096130400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.336+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b09612ab70 con 0x55b096034ff0 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.336+0000 7f37e59c8640 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096034ff0 0x55b096130400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.336+0000 7f37dc9c6640 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36cc03c780 0x7f36cc03ec40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37d0000c00 tx=0x7f37d00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.336+0000 7f37e59c8640 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096034ff0 0x55b096130400 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.336+0000 7f37e59c8640 1 -- 172.21.15.120:0/2113109522 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37e000a4d0 con 0x55b096034ff0 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.336+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096131330 0x55b096133720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.336+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096133d50 con 0x55b096131330 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.337+0000 7f37e51c7640 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096131330 0x55b096133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.337+0000 7f37e51c7640 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096131330 0x55b096133720 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.337+0000 7f37e51c7640 1 -- 172.21.15.120:0/2113109522 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37d807a030 con 0x55b096131330 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.337+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096135600 con 0x55b096131330 2024-09-07T03:32:55.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.338+0000 7f37e51c7640 1 -- 172.21.15.120:0/2113109522 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37d807a030 con 0x55b096131330 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.338+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096134740 con 0x55b096131330 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.338+0000 7f37e51c7640 1 -- 172.21.15.120:0/2113109522 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37d807a030 con 0x55b096131330 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.338+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096134ba0 con 0x55b096034ff0 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.338+0000 7f37e59c8640 1 -- 172.21.15.120:0/2113109522 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37e000a4d0 con 0x55b096034ff0 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.338+0000 7f37e9539800 1 Processor -- start 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.339+0000 7f37e9539800 1 -- start start 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.339+0000 7f37e9539800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b096143af0 0x55b096143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.339+0000 7f37e9539800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b095f28a00 con 0x55b096143af0 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.339+0000 7f37e59c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b096143af0 0x55b096143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.339+0000 7f37e59c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b096143af0 0x55b096143f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58540/0 (socket says 172.21.15.120:58540) 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.339+0000 7f37e59c8640 1 -- 172.21.15.120:0/4160506244 learned_addr learned my addr 172.21.15.120:0/4160506244 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.339+0000 7f37e59c8640 1 -- 172.21.15.120:0/4160506244 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b096144550 con 0x55b096143af0 2024-09-07T03:32:55.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.340+0000 7f37e59c8640 1 --2- 172.21.15.120:0/4160506244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b096143af0 0x55b096143f10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f37e0016d20 tx=0x7f37e000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.340+0000 7f36caffd640 1 -- 172.21.15.120:0/4160506244 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e0017660 con 0x55b096143af0 2024-09-07T03:32:55.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.340+0000 7f36caffd640 1 -- 172.21.15.120:0/4160506244 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e001b030 con 0x55b096143af0 2024-09-07T03:32:55.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.340+0000 7f37e9539800 1 -- 172.21.15.120:0/4160506244 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b096144d80 con 0x55b096143af0 2024-09-07T03:32:55.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.340+0000 7f36caffd640 1 -- 172.21.15.120:0/4160506244 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e0017950 con 0x55b096143af0 2024-09-07T03:32:55.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.340+0000 7f37e9539800 1 -- 172.21.15.120:0/4160506244 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b096145320 con 0x55b096143af0 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.341+0000 7f36caffd640 1 -- 172.21.15.120:0/4160506244 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f37e0017b40 con 0x55b096143af0 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.341+0000 7f36caffd640 1 --2- 172.21.15.120:0/4160506244 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36c003c730 0x7f36c003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.341+0000 7f36caffd640 1 -- 172.21.15.120:0/4160506244 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f37e000e040 con 0x55b096143af0 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.341+0000 7f37e51c7640 1 --2- 172.21.15.120:0/4160506244 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36c003c730 0x7f36c003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.341+0000 7f37e9539800 1 Processor -- start 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.341+0000 7f37e9539800 1 -- start start 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.341+0000 7f37e51c7640 1 --2- 172.21.15.120:0/4160506244 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36c003c730 0x7f36c003ebf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55b096130af0 tx=0x7f37d808b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.341+0000 7f37e9539800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096030aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.341+0000 7f37e9539800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b096121cc0 con 0x55b0960306c0 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.342+0000 7f37e59c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096030aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.342+0000 7f37e59c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096030aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58544/0 (socket says 172.21.15.120:58544) 2024-09-07T03:32:55.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.342+0000 7f37e59c8640 1 -- 172.21.15.120:0/1937851399 learned_addr learned my addr 172.21.15.120:0/1937851399 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.342+0000 7f37e59c8640 1 -- 172.21.15.120:0/1937851399 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b096031090 con 0x55b0960306c0 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.342+0000 7f37e59c8640 1 --2- 172.21.15.120:0/1937851399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096030aa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f37e0013450 tx=0x7f37e0053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d58697e398ca702 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.342+0000 7f36c8ff9640 1 -- 172.21.15.120:0/1937851399 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e0014a00 con 0x55b0960306c0 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.342+0000 7f36c8ff9640 1 -- 172.21.15.120:0/1937851399 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e0051070 con 0x55b0960306c0 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.342+0000 7f36c8ff9640 1 -- 172.21.15.120:0/1937851399 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e0028350 con 0x55b0960306c0 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 -- 172.21.15.120:0/1937851399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 msgr2=0x55b096030aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 --2- 172.21.15.120:0/1937851399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096030aa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f37e0013450 tx=0x7f37e0053f40 comp rx=0 tx=0).stop 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 -- 172.21.15.120:0/1937851399 shutdown_connections 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 --2- 172.21.15.120:0/1937851399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096030aa0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 -- 172.21.15.120:0/1937851399 >> 172.21.15.120:0/1937851399 conn(0x55b09614c9b0 msgr2=0x55b09614abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 -- 172.21.15.120:0/1937851399 shutdown_connections 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 -- 172.21.15.120:0/1937851399 wait complete. 2024-09-07T03:32:55.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 Processor -- start 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 -- start start 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e9539800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b096031720 con 0x55b0960306c0 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e59c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e59c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58558/0 (socket says 172.21.15.120:58558) 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 learned_addr learned my addr 172.21.15.120:0/3221435181 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.343+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09615a310 con 0x55b0960306c0 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.344+0000 7f37e59c8640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096159db0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f37e0013450 tx=0x7f37e0053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.344+0000 7f36b6ffd640 1 -- 172.21.15.120:0/3221435181 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e0005030 con 0x55b0960306c0 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.344+0000 7f36b6ffd640 1 -- 172.21.15.120:0/3221435181 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e00051d0 con 0x55b0960306c0 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.344+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b09615a5a0 con 0x55b0960306c0 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.344+0000 7f36b6ffd640 1 -- 172.21.15.120:0/3221435181 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37e00054b0 con 0x55b0960306c0 2024-09-07T03:32:55.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.344+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09615af20 con 0x55b0960306c0 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.345+0000 7f36b6ffd640 1 -- 172.21.15.120:0/3221435181 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f37e00127a0 con 0x55b0960306c0 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.345+0000 7f36b6ffd640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36b003c780 0x7f36b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.345+0000 7f36b6ffd640 1 -- 172.21.15.120:0/3221435181 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f37e0030030 con 0x55b0960306c0 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.345+0000 7f37e51c7640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36b003c780 0x7f36b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.345+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.345+0000 7f37e51c7640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36b003c780 0x7f36b003ec40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f37d80893f0 tx=0x7f37d808d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.345+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096165830 0x55b096167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.345+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096168440 con 0x55b096165830 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.345+0000 7f37dc9c6640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096165830 0x55b096167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37dc9c6640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096165830 0x55b096167cf0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 20 realm 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096164b80 con 0x55b096165830 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096168f30 con 0x55b096165830 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096169d10 0x55b09616c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.346+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b09616c7d0 con 0x55b096169d10 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.347+0000 7f37e59c8640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096169d10 0x55b09616c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.347+0000 7f37e59c8640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096169d10 0x55b09616c100 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.347+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.347+0000 7f37e9539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.347+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.347+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b09616d020 con 0x55b096169d10 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.348+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.348+0000 7f37e9539800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.348+0000 7f37e9539800 20 searching for the correct realm 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.348+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09616ed90 0x55b096171200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.348+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b09616ed90 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.348+0000 7f37e51c7640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09616ed90 0x55b096171200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.348+0000 7f37e51c7640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09616ed90 0x55b096171200 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.348+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.348+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096169d10 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.349+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.349+0000 7f37e59c8640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f37e0004b30 0x7f37e0020a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.349+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x7f37e0004b30 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.349+0000 7f37dc9c6640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f37e0004b30 0x7f37e0020a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.349+0000 7f37dc9c6640 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f37e0004b30 0x7f37e0020a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.349+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x7f37e0004b30 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.349+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096165830 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.350+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.350+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096165830 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.350+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.350+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b09616ed90 2024-09-07T03:32:55.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.350+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.350+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096165830 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.350+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.350+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096169d10 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.351+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.351+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096169d10 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.351+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.351+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096165830 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.351+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.351+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x7f37e0004b30 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.351+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x7f37e0004b30 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.351+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096165830 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.351+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.352+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x7f37e0004b30 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.352+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37d000f5f0 con 0x7f37e0004b30 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.352+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096169d10 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.352+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.352+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b09616ed90 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.352+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.352+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096165830 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.353+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.353+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096169d10 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.353+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.353+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b09616ed90 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.353+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.353+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096165830 2024-09-07T03:32:55.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.353+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.353+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096165830 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.354+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.354+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096165830 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.354+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x55b096165830 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.354+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b09616ed90 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.354+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.354+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x7f37e0004b30 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.354+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x7f37e0004b30 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.354+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x7f37e0004b30 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.355+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x7f37e0004b30 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.355+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x7f37e0004b30 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.355+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x7f37e0004b30 2024-09-07T03:32:55.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.355+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b09616ed90 2024-09-07T03:32:55.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.355+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.355+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x7f37e0004b30 2024-09-07T03:32:55.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.355+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d000f5f0 con 0x7f37e0004b30 2024-09-07T03:32:55.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.355+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096169d10 2024-09-07T03:32:55.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.356+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.356+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096169d10 2024-09-07T03:32:55.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.356+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.356+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b09616ed90 2024-09-07T03:32:55.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.356+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.356+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096169d10 2024-09-07T03:32:55.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.356+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.356+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b0961718d0 con 0x55b096169d10 2024-09-07T03:32:55.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:55.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b09616d970 con 0x55b096165830 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b09616d580 con 0x55b096169d10 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:55.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.357+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b09616e2a0 con 0x55b096165830 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 zone default found 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 4 Realm: () 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 zonegroup default 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096172200 con 0x7f37e0004b30 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096174440 con 0x55b09616ed90 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961747e0 con 0x55b09616ed90 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 started sync module instance, tier type = 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.358+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096173880 con 0x55b096169d10 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.360+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.360+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94216920710560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096173880 con 0x55b096169d10 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.360+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096174e00 con 0x55b096165830 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.361+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94216920710560] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.361+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.361+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94216920708048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961737f0 con 0x55b096165830 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.361+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096175c70 con 0x55b096169d10 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.362+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94216920708048] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.362+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.362+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94216920715680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096175c70 con 0x55b096169d10 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.362+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096176670 con 0x7f37e0004b30 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.363+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94216920715680] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.363+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.363+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94216920719744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096175c70 con 0x7f37e0004b30 2024-09-07T03:32:55.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.363+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096175c70 con 0x55b096169d10 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.364+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.364+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94216920722384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096177500 con 0x55b096169d10 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.364+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096178000 con 0x55b09616ed90 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.365+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94216920719744] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.365+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94216920722384] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.365+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.365+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94216920723440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961757c0 con 0x55b09616ed90 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.365+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961785e0 con 0x55b09616ed90 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.366+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94216920723440] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.367+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.367+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94216920726256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961785e0 con 0x55b09616ed90 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.367+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096178fa0 con 0x7f37e0004b30 2024-09-07T03:32:55.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94216920730352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096179440 con 0x7f37e0004b30 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37e9539800 20 add_watcher() i=0 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37e9539800 20 add_watcher() i=1 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37e9539800 20 add_watcher() i=2 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37e9539800 20 add_watcher() i=3 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37e9539800 20 add_watcher() i=4 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37e9539800 20 add_watcher() i=5 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94216920726256] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.368+0000 7f37e9539800 20 add_watcher() i=6 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.369+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94216920730352] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.369+0000 7f37e9539800 20 add_watcher() i=7 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.369+0000 7f37e9539800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:55.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.369+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b096178130 con 0x55b096165830 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.369+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.369+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94216920731408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096178130 con 0x55b096165830 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.370+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94216920731408] v36'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.370+0000 7f369bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.370+0000 7f37e9539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.370+0000 7f37e9539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.371+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096184e10 con 0x55b096169d10 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.372+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'50 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.372+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096184e10 con 0x7f37e0004b30 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.373+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'25 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.373+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096184e10 con 0x55b09616ed90 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.374+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.374+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185850 con 0x55b096165830 2024-09-07T03:32:55.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.375+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'164 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.375+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185dc0 con 0x55b096169d10 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.376+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'53 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.376+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185dc0 con 0x55b09616ed90 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.377+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'43 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.377+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185dc0 con 0x55b096169d10 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.378+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.378+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096186350 con 0x55b096165830 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.379+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.379+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096186160 con 0x55b096169d10 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.380+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.380+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096186160 con 0x55b096169d10 2024-09-07T03:32:55.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.381+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.381+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961861a0 con 0x55b096169d10 2024-09-07T03:32:55.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.382+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'54 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.382+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961861a0 con 0x55b09616ed90 2024-09-07T03:32:55.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.383+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.383+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096186270 con 0x55b096169d10 2024-09-07T03:32:55.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.384+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.384+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096186670 con 0x55b096165830 2024-09-07T03:32:55.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.385+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'49 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.385+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096186570 con 0x55b096165830 2024-09-07T03:32:55.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.387+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'165 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.387+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096186570 con 0x55b096169d10 2024-09-07T03:32:55.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.388+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'48 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.388+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096186570 con 0x55b096169d10 2024-09-07T03:32:55.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.389+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'55 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.389+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961853a0 con 0x55b09616ed90 2024-09-07T03:32:55.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.390+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.390+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961853a0 con 0x55b096169d10 2024-09-07T03:32:55.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.391+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.391+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b096165830 2024-09-07T03:32:55.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.392+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'166 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.392+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b096169d10 2024-09-07T03:32:55.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.393+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'49 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.393+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b096169d10 2024-09-07T03:32:55.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.394+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.394+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b09616ed90 2024-09-07T03:32:55.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.395+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.395+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b096169d10 2024-09-07T03:32:55.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.396+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.396+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b09616ed90 2024-09-07T03:32:55.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.397+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.398+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b09616ed90 2024-09-07T03:32:55.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.398+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'44 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.398+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b09616ed90 2024-09-07T03:32:55.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.400+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.400+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b096169d10 2024-09-07T03:32:55.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.401+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'31 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.401+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185480 con 0x55b096165830 2024-09-07T03:32:55.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.402+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.402+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185460 con 0x55b096169d10 2024-09-07T03:32:55.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.403+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'50 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.403+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185430 con 0x55b096165830 2024-09-07T03:32:55.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.404+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'50 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.404+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096185430 con 0x7f37e0004b30 2024-09-07T03:32:55.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.405+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.405+0000 7f369afe5640 20 reqs_thread_entry: start 2024-09-07T03:32:55.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.405+0000 7f37e9539800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:55.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.405+0000 7f37e9539800 20 Filter name: none 2024-09-07T03:32:55.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.405+0000 7f3698fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:55.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.405+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-07T03:32:55.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.405+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:94 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.407+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(94 gc.10 [call] v36'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.407+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.407+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(95 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.407+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.407+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:96 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b1550 con 0x55b096169d10 2024-09-07T03:32:55.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.408+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(96 gc.10 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.408+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.408+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(97 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.408+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.408+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:98 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.408+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(98 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.408+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.408+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.410+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(99 gc.10 [call] v36'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.410+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-07T03:32:55.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.410+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b09616ed90 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(100 gc.11 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b09616ed90 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(101 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b1550 con 0x55b09616ed90 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(102 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:103 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b09616ed90 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(103 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.411+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:104 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b09616ed90 2024-09-07T03:32:55.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.412+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(104 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.412+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.412+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:105 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b09616ed90 2024-09-07T03:32:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.412+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(105 gc.11 [call] v36'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.412+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-07T03:32:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.412+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.414+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(106 gc.12 [call] v36'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.414+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:107 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.414+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== osd_op_reply(107 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.414+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.414+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b1550 con 0x55b096169d10 2024-09-07T03:32:55.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.414+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(108 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.414+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:109 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b1550 con 0x55b096169d10 2024-09-07T03:32:55.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.414+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(109 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.414+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.415+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:110 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b1550 con 0x55b096169d10 2024-09-07T03:32:55.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.415+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(110 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.415+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.415+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:111 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.416+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 45 ==== osd_op_reply(111 gc.12 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.416+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.416+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:112 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(112 gc.13 [call] v36'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:113 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(113 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:114 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b1550 con 0x55b096165830 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(114 gc.13 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:115 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(115 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:116 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(116 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.417+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.418+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:117 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.418+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(117 gc.13 [call] v36'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.418+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.418+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:118 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 32 ==== osd_op_reply(118 gc.14 [call] v36'167 uv167 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:119 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 33 ==== osd_op_reply(119 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:120 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b1550 con 0x55b096165830 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 34 ==== osd_op_reply(120 gc.14 [call out=24b] v0'0 uv167 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:121 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 35 ==== osd_op_reply(121 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.420+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:122 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.421+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 36 ==== osd_op_reply(122 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.421+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.421+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:123 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096165830 2024-09-07T03:32:55.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.422+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 37 ==== osd_op_reply(123 gc.14 [call] v36'168 uv168 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.422+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-07T03:32:55.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.422+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:124 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 46 ==== osd_op_reply(124 gc.15 [call] v36'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:125 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 47 ==== osd_op_reply(125 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:126 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b1550 con 0x55b096169d10 2024-09-07T03:32:55.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 48 ==== osd_op_reply(126 gc.15 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:127 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 49 ==== osd_op_reply(127 gc.15 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.423+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:128 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b2560 con 0x55b096169d10 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 50 ==== osd_op_reply(128 gc.15 [call out=1701b] v0'0 uv51 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 20 garbage collection: RGWGC::process iterating over entry tag='cf0fab6f-a978-4ce5-bacd-166891c31743.4225.6734177508069502749', time=2024-09-07T03:32:55.064125+0000, chain.objs.size()=7 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_1 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:129 3.21s0 3:84c676c3:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b0310 con 0x7f37e0004b30 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_2 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:130 3.24s0 3:25e00a9d:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b59c0 con 0x55b09616ed90 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_3 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:131 3.12s0 3:48b1f725:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b8430 con 0x7f37e0004b30 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_4 2024-09-07T03:32:55.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:132 3.9s0 3:91a77b94:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b59c0 con 0x55b09616ed90 2024-09-07T03:32:55.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_5 2024-09-07T03:32:55.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:133 3.14s0 3:2974b468:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bd210 con 0x55b096169d10 2024-09-07T03:32:55.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_6 2024-09-07T03:32:55.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:134 3.2s0 3:40219a35:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfc00 con 0x55b09616ed90 2024-09-07T03:32:55.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_7 2024-09-07T03:32:55.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.424+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:135 3.29s0 3:9475128f:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961c2580 con 0x55b09616ed90 2024-09-07T03:32:55.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.428+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== osd_op_reply(130 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_2 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.431+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(131 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_3 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.431+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 51 ==== osd_op_reply(133 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_5 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.431+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(132 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_4 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.431+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== osd_op_reply(134 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_6 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.431+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== osd_op_reply(135 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_7 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.432+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(129 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.1__shadow_.SkwyQGK-i132Min9AJpn9U0JIskVBg0_1 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.432+0000 7f37e9539800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-07T03:32:55.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.432+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:136 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b096169d10 2024-09-07T03:32:55.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.434+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 52 ==== osd_op_reply(136 gc.15 [call] v36'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.434+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:137 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b096169d10 2024-09-07T03:32:55.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.436+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 53 ==== osd_op_reply(137 gc.15 [call] v36'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.436+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-07T03:32:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.436+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:138 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b096169d10 2024-09-07T03:32:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 54 ==== osd_op_reply(138 gc.16 [call] v36'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:139 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b096169d10 2024-09-07T03:32:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 55 ==== osd_op_reply(139 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:140 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b096169d10 2024-09-07T03:32:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 56 ==== osd_op_reply(140 gc.16 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:141 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b096169d10 2024-09-07T03:32:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 57 ==== osd_op_reply(141 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.438+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b096169d10 2024-09-07T03:32:55.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.439+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 58 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.439+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.439+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b096169d10 2024-09-07T03:32:55.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.440+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 59 ==== osd_op_reply(143 gc.16 [call] v36'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.440+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-07T03:32:55.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.440+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:144 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b09616ed90 2024-09-07T03:32:55.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== osd_op_reply(144 gc.17 [call] v36'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b09616ed90 2024-09-07T03:32:55.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 33 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b09616ed90 2024-09-07T03:32:55.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 34 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b09616ed90 2024-09-07T03:32:55.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 35 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.441+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:148 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961bfb60 con 0x55b09616ed90 2024-09-07T03:32:55.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.442+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 36 ==== osd_op_reply(148 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.442+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.442+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:149 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b0840 con 0x55b09616ed90 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.442+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 37 ==== osd_op_reply(149 gc.17 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.442+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.442+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b0840 con 0x55b096169d10 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.443+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 60 ==== osd_op_reply(150 gc.18 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.443+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:151 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b0840 con 0x55b096169d10 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.444+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 61 ==== osd_op_reply(151 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.444+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.444+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:152 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096169d10 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.444+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 62 ==== osd_op_reply(152 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.444+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:153 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.444+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 63 ==== osd_op_reply(153 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.444+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.444+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:154 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.445+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 64 ==== osd_op_reply(154 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.445+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.445+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:155 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.446+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 65 ==== osd_op_reply(155 gc.18 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.446+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.446+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:156 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.446+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 38 ==== osd_op_reply(156 gc.19 [call] v36'169 uv169 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.446+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:157 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 39 ==== osd_op_reply(157 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:158 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 40 ==== osd_op_reply(158 gc.19 [call out=24b] v0'0 uv169 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:159 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 41 ==== osd_op_reply(159 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:160 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 42 ==== osd_op_reply(160 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.447+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:161 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.448+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 43 ==== osd_op_reply(161 gc.19 [call] v36'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.448+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.448+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:162 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.449+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 66 ==== osd_op_reply(162 gc.20 [call] v36'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.449+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:163 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 67 ==== osd_op_reply(163 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:164 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 68 ==== osd_op_reply(164 gc.20 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:165 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 69 ==== osd_op_reply(165 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:166 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 70 ==== osd_op_reply(166 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.450+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:167 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.451+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 71 ==== osd_op_reply(167 gc.20 [call] v36'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.451+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-07T03:32:55.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.451+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:168 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.453+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 72 ==== osd_op_reply(168 gc.21 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.453+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:169 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.453+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 73 ==== osd_op_reply(169 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.453+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.453+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:170 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.453+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 74 ==== osd_op_reply(170 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.453+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:171 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.454+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 75 ==== osd_op_reply(171 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.454+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.454+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:172 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.454+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 76 ==== osd_op_reply(172 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.454+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.454+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:173 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.455+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 77 ==== osd_op_reply(173 gc.21 [call] v36'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.455+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-07T03:32:55.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.455+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:174 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.456+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 38 ==== osd_op_reply(174 gc.22 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.456+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:175 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.456+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 39 ==== osd_op_reply(175 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.456+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.456+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:176 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.457+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 40 ==== osd_op_reply(176 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.457+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:177 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.457+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 41 ==== osd_op_reply(177 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.457+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.457+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:178 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.457+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 42 ==== osd_op_reply(178 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.457+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.457+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:179 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.458+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 43 ==== osd_op_reply(179 gc.22 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.458+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-07T03:32:55.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.458+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:180 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.459+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 78 ==== osd_op_reply(180 gc.23 [call] v36'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.459+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:181 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 79 ==== osd_op_reply(181 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:182 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 80 ==== osd_op_reply(182 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:183 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 81 ==== osd_op_reply(183 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:184 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 82 ==== osd_op_reply(184 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.460+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:185 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.461+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 83 ==== osd_op_reply(185 gc.23 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.461+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.461+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:186 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.462+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 44 ==== osd_op_reply(186 gc.24 [call] v36'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.462+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:187 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.462+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 45 ==== osd_op_reply(187 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.462+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.462+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:188 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.463+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 46 ==== osd_op_reply(188 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.463+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:189 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.463+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 47 ==== osd_op_reply(189 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.463+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.463+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:190 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.463+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 48 ==== osd_op_reply(190 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.463+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.463+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:191 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.464+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 49 ==== osd_op_reply(191 gc.24 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.464+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.464+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:192 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.465+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 50 ==== osd_op_reply(192 gc.25 [call] v36'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.465+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:193 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.465+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 51 ==== osd_op_reply(193 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.465+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.465+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:194 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.466+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 52 ==== osd_op_reply(194 gc.25 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.466+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:195 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.466+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 53 ==== osd_op_reply(195 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.466+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.466+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:196 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.466+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 54 ==== osd_op_reply(196 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.466+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.466+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:197 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.467+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 55 ==== osd_op_reply(197 gc.25 [call] v36'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.467+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-07T03:32:55.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.467+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:198 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.468+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 56 ==== osd_op_reply(198 gc.26 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.468+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:199 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.468+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 57 ==== osd_op_reply(199 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.468+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.468+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:200 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.469+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 58 ==== osd_op_reply(200 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.469+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:201 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.469+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 59 ==== osd_op_reply(201 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.469+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.469+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:202 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.469+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 60 ==== osd_op_reply(202 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.469+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.469+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:203 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.470+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 61 ==== osd_op_reply(203 gc.26 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.470+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-07T03:32:55.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.470+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:204 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.471+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 84 ==== osd_op_reply(204 gc.27 [call] v36'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.471+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:205 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.471+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 85 ==== osd_op_reply(205 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.471+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.471+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:206 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.472+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 86 ==== osd_op_reply(206 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.472+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:207 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.472+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 87 ==== osd_op_reply(207 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.472+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.472+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:208 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.472+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 88 ==== osd_op_reply(208 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.472+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.472+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:209 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.473+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 89 ==== osd_op_reply(209 gc.27 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.473+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.473+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:210 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.474+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 44 ==== osd_op_reply(210 gc.28 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.474+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:211 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.474+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 45 ==== osd_op_reply(211 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.474+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.474+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:212 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.475+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 46 ==== osd_op_reply(212 gc.28 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.475+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:213 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.475+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 47 ==== osd_op_reply(213 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.475+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.475+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:214 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.475+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 48 ==== osd_op_reply(214 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.475+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.475+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:215 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.476+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 49 ==== osd_op_reply(215 gc.28 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.476+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-07T03:32:55.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.476+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:216 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.477+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 90 ==== osd_op_reply(216 gc.29 [call] v36'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.477+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:217 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.477+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 91 ==== osd_op_reply(217 gc.29 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.477+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.477+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:218 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.477+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 92 ==== osd_op_reply(218 gc.29 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.478+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:219 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.478+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 93 ==== osd_op_reply(219 gc.29 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.478+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.478+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:220 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.478+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 94 ==== osd_op_reply(220 gc.29 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.478+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.478+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:221 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.479+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 95 ==== osd_op_reply(221 gc.29 [call] v36'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.479+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-07T03:32:55.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.479+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:222 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.480+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 50 ==== osd_op_reply(222 gc.30 [call] v36'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.480+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:223 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.480+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 51 ==== osd_op_reply(223 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.480+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.480+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:224 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.481+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 52 ==== osd_op_reply(224 gc.30 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.481+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:225 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.481+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 53 ==== osd_op_reply(225 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.481+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.481+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:226 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.481+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 54 ==== osd_op_reply(226 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.481+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.481+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:227 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.482+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 55 ==== osd_op_reply(227 gc.30 [call] v36'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.482+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-07T03:32:55.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.482+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:228 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x7f37e0004b30 2024-09-07T03:32:55.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.483+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(228 gc.31 [call] v36'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.483+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:229 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x7f37e0004b30 2024-09-07T03:32:55.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.483+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(229 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.483+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.483+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:230 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x7f37e0004b30 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.484+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(230 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.484+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:231 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x7f37e0004b30 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.484+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(231 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.484+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.484+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:232 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x7f37e0004b30 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.484+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(232 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.484+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.484+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:233 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x7f37e0004b30 2024-09-07T03:32:55.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.485+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 22 ==== osd_op_reply(233 gc.31 [call] v36'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.485+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-07T03:32:55.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.485+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:234 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.486+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 96 ==== osd_op_reply(234 gc.0 [call] v36'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.486+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:235 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.486+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 97 ==== osd_op_reply(235 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.486+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.486+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:236 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.486+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 98 ==== osd_op_reply(236 gc.0 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.486+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.487+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 99 ==== osd_op_reply(237 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.487+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.487+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:238 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.487+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 100 ==== osd_op_reply(238 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.487+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.487+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:239 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.488+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 101 ==== osd_op_reply(239 gc.0 [call] v36'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.488+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-07T03:32:55.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.488+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:240 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x7f37e0004b30 2024-09-07T03:32:55.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.489+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 23 ==== osd_op_reply(240 gc.1 [call] v36'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.489+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:241 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x7f37e0004b30 2024-09-07T03:32:55.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.489+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 24 ==== osd_op_reply(241 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.489+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.489+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:242 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x7f37e0004b30 2024-09-07T03:32:55.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.489+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 25 ==== osd_op_reply(242 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.489+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:243 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x7f37e0004b30 2024-09-07T03:32:55.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.490+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 26 ==== osd_op_reply(243 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.490+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.490+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:244 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x7f37e0004b30 2024-09-07T03:32:55.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.490+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 27 ==== osd_op_reply(244 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.490+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.490+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:245 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x7f37e0004b30 2024-09-07T03:32:55.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.491+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 28 ==== osd_op_reply(245 gc.1 [call] v36'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.491+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-07T03:32:55.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.491+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:246 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 62 ==== osd_op_reply(246 gc.2 [call] v36'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:247 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 63 ==== osd_op_reply(247 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:248 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 64 ==== osd_op_reply(248 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:249 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 65 ==== osd_op_reply(249 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.492+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:250 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.493+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 66 ==== osd_op_reply(250 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.493+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.493+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:251 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.494+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 67 ==== osd_op_reply(251 gc.2 [call] v36'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.494+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-07T03:32:55.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.494+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:252 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 56 ==== osd_op_reply(252 gc.3 [call] v36'171 uv171 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:253 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 57 ==== osd_op_reply(253 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:254 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 58 ==== osd_op_reply(254 gc.3 [call out=24b] v0'0 uv171 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:255 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 59 ==== osd_op_reply(255 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.495+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:256 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.496+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 60 ==== osd_op_reply(256 gc.3 [call out=15b] v0'0 uv171 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.496+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.496+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:257 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.497+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 61 ==== osd_op_reply(257 gc.3 [call] v36'172 uv172 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.497+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-07T03:32:55.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.497+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:258 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.498+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 102 ==== osd_op_reply(258 gc.4 [call] v36'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.498+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:259 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.498+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 103 ==== osd_op_reply(259 gc.4 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.498+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.498+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:260 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.498+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 104 ==== osd_op_reply(260 gc.4 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.498+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:261 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.498+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 105 ==== osd_op_reply(261 gc.4 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.499+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.499+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:262 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.499+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 106 ==== osd_op_reply(262 gc.4 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.499+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.499+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:263 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.500+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 107 ==== osd_op_reply(263 gc.4 [call] v36'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.500+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-07T03:32:55.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.500+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:264 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 68 ==== osd_op_reply(264 gc.5 [call] v36'47 uv47 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:265 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 69 ==== osd_op_reply(265 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:266 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 70 ==== osd_op_reply(266 gc.5 [call out=24b] v0'0 uv47 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:267 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 71 ==== osd_op_reply(267 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:268 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 72 ==== osd_op_reply(268 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.501+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:269 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b09616ed90 2024-09-07T03:32:55.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.502+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 73 ==== osd_op_reply(269 gc.5 [call] v36'48 uv48 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.502+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-07T03:32:55.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.502+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:270 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.503+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 108 ==== osd_op_reply(270 gc.6 [call] v36'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.503+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:271 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 109 ==== osd_op_reply(271 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:272 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 110 ==== osd_op_reply(272 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:273 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 111 ==== osd_op_reply(273 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:274 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 112 ==== osd_op_reply(274 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.504+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:275 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.505+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 113 ==== osd_op_reply(275 gc.6 [call] v36'30 uv30 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.505+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-07T03:32:55.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.505+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:276 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.506+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 62 ==== osd_op_reply(276 gc.7 [call] v36'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.506+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:277 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 63 ==== osd_op_reply(277 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:278 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 64 ==== osd_op_reply(278 gc.7 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:279 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 65 ==== osd_op_reply(279 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:280 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961be510 con 0x55b096165830 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 66 ==== osd_op_reply(280 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.507+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:281 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.509+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 67 ==== osd_op_reply(281 gc.7 [call] v36'42 uv42 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.509+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-07T03:32:55.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.509+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:282 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 114 ==== osd_op_reply(282 gc.8 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:283 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 115 ==== osd_op_reply(283 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:284 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 116 ==== osd_op_reply(284 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:285 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 117 ==== osd_op_reply(285 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.510+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:286 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.511+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 118 ==== osd_op_reply(286 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.511+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.511+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:287 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.512+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 119 ==== osd_op_reply(287 gc.8 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.512+0000 7f37e9539800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-07T03:32:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.512+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:288 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 120 ==== osd_op_reply(288 gc.9 [call] v36'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:289 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 121 ==== osd_op_reply(289 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:290 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 122 ==== osd_op_reply(290 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:291 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 123 ==== osd_op_reply(291 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.513+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:292 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.514+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 124 ==== osd_op_reply(292 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.514+0000 7f37e9539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:32:55.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.514+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:293 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.515+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 125 ==== osd_op_reply(293 gc.9 [call] v36'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.515+0000 7f369bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:55.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.515+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94216920731408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.516+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94216920731408] v36'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.516+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94216920710560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096169d10 2024-09-07T03:32:55.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.517+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 126 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94216920710560] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.517+0000 7f37e9539800 20 remove_watcher() i=0 2024-09-07T03:32:55.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.517+0000 7f37e9539800 2 removed watcher, disabling cache 2024-09-07T03:32:55.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.517+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94216920708048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961b07d0 con 0x55b096165830 2024-09-07T03:32:55.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.518+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.1 v2:172.21.15.120:6808/3372043485 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94216920708048] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x55b096165830 2024-09-07T03:32:55.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.518+0000 7f37e9539800 20 remove_watcher() i=1 2024-09-07T03:32:55.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.518+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94216920715680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096173da0 con 0x55b096169d10 2024-09-07T03:32:55.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.519+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 127 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94216920715680] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.519+0000 7f37e9539800 20 remove_watcher() i=2 2024-09-07T03:32:55.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.519+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94216920719744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b0961733d0 con 0x7f37e0004b30 2024-09-07T03:32:55.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.520+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 29 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94216920719744] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.520+0000 7f37e9539800 20 remove_watcher() i=3 2024-09-07T03:32:55.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.520+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94216920722384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096173da0 con 0x55b096169d10 2024-09-07T03:32:55.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.521+0000 7f37e59c8640 1 -- 172.21.15.120:0/3221435181 <== osd.0 v2:172.21.15.104:6800/182397107 128 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94216920722384] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37e0027070 con 0x55b096169d10 2024-09-07T03:32:55.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.521+0000 7f37e9539800 20 remove_watcher() i=4 2024-09-07T03:32:55.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.521+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94216920723440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096176180 con 0x55b09616ed90 2024-09-07T03:32:55.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.522+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 74 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94216920723440] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.522+0000 7f37e9539800 20 remove_watcher() i=5 2024-09-07T03:32:55.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.522+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94216920726256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096176180 con 0x55b09616ed90 2024-09-07T03:32:55.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.524+0000 7f37e51c7640 1 -- 172.21.15.120:0/3221435181 <== osd.3 v2:172.21.15.120:6800/1193158925 75 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94216920726256] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80a0070 con 0x55b09616ed90 2024-09-07T03:32:55.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.524+0000 7f37e9539800 20 remove_watcher() i=6 2024-09-07T03:32:55.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.524+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94216920730352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b096176180 con 0x7f37e0004b30 2024-09-07T03:32:55.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 <== osd.2 v2:172.21.15.120:6809/3781833098 30 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94216920730352] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d003c040 con 0x7f37e0004b30 2024-09-07T03:32:55.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 20 remove_watcher() i=7 2024-09-07T03:32:55.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096169d10 msgr2=0x55b09616c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096169d10 0x55b09616c100 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096165830 msgr2=0x55b096167cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096165830 0x55b096167cf0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f37e0004b30 msgr2=0x7f37e0020a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f37e0004b30 0x7f37e0020a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09616ed90 msgr2=0x55b096171200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b09616ed90 0x55b096171200 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36b003c780 msgr2=0x7f36b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36b003c780 0x7f36b003ec40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f37d80893f0 tx=0x7f37d808d000 comp rx=0 tx=0).stop 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 msgr2=0x55b096159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096159db0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f37e0013450 tx=0x7f37e0053d90 comp rx=0 tx=0).stop 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37dc9c6640 1 -- 172.21.15.120:0/3221435181 reap_dead start 2024-09-07T03:32:55.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 shutdown_connections 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/3221435181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960306c0 0x55b096159db0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 >> 172.21.15.120:0/3221435181 conn(0x55b09614c9b0 msgr2=0x55b09614abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 shutdown_connections 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/3221435181 wait complete. 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/4160506244 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36c003c730 msgr2=0x7f36c003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/4160506244 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36c003c730 0x7f36c003ebf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55b096130af0 tx=0x7f37d808b040 comp rx=0 tx=0).stop 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/4160506244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b096143af0 msgr2=0x55b096143f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/4160506244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b096143af0 0x55b096143f10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f37e0016d20 tx=0x7f37e000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/4160506244 shutdown_connections 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/4160506244 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36c003c730 0x7f36c003ebf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 --2- 172.21.15.120:0/4160506244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b096143af0 0x55b096143f10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/4160506244 >> 172.21.15.120:0/4160506244 conn(0x55b096137ea0 msgr2=0x55b096138280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.525+0000 7f37e9539800 1 -- 172.21.15.120:0/4160506244 shutdown_connections 2024-09-07T03:32:55.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 -- 172.21.15.120:0/4160506244 wait complete. 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096131330 msgr2=0x55b096133720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096131330 0x55b096133720 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096034ff0 msgr2=0x55b096130400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096034ff0 0x55b096130400 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36cc03c780 msgr2=0x7f36cc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36cc03c780 0x7f36cc03ec40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37d0000c00 tx=0x7f37d00013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 msgr2=0x55b096128db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b096128db0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f37d8025c20 tx=0x7f37d8002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 shutdown_connections 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b096131330 0x55b096133720 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b096034ff0 0x55b096130400 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f36cc03c780 0x7f36cc03ec40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 --2- 172.21.15.120:0/2113109522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b0960326c0 0x55b096128db0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 >> 172.21.15.120:0/2113109522 conn(0x55b09602c1a0 msgr2=0x55b096122720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 shutdown_connections 2024-09-07T03:32:55.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.526+0000 7f37e9539800 1 -- 172.21.15.120:0/2113109522 wait complete. 2024-09-07T03:32:55.536 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-07T03:32:55.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-07T03:32:55.536 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-07T03:32:55.621 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:55.621 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe466526800 1 Processor -- start 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe466526800 1 -- start start 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe466526800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55ff32a80600 0x55ff32a829f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe466526800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff32929e40 con 0x55ff32a83020 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe466526800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55ff328f4680 con 0x55ff32a80600 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe4621d9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55ff32a80600 0x55ff32a829f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe4619d8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55ff32a83020 0x55ff32a854e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41478/0 (socket says 172.21.15.120:41478) 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe4619d8640 1 -- 172.21.15.120:0/1519635128 learned_addr learned my addr 172.21.15.120:0/1519635128 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe4621d9640 1 -- 172.21.15.120:0/1519635128 >> v1:172.21.15.104:6789/0 conn(0x55ff32a83020 legacy=0x55ff32a854e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.621+0000 7fe4621d9640 1 -- 172.21.15.120:0/1519635128 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff329106b0 con 0x55ff32a80600 2024-09-07T03:32:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.623+0000 7fe4621d9640 1 --2- 172.21.15.120:0/1519635128 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32a829f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a470 tx=0x7fe454045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17f8ea5d4e1955e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.623+0000 7fe4611d7640 1 -- 172.21.15.120:0/1519635128 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454053570 con 0x55ff32a80600 2024-09-07T03:32:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.623+0000 7fe4611d7640 1 -- 172.21.15.120:0/1519635128 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe454058070 con 0x55ff32a80600 2024-09-07T03:32:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.623+0000 7fe4611d7640 1 -- 172.21.15.120:0/1519635128 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454053880 con 0x55ff32a80600 2024-09-07T03:32:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.624+0000 7fe466526800 1 -- 172.21.15.120:0/1519635128 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 msgr2=0x55ff32a829f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.624+0000 7fe466526800 1 --2- 172.21.15.120:0/1519635128 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32a829f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a470 tx=0x7fe454045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.624+0000 7fe466526800 1 -- 172.21.15.120:0/1519635128 shutdown_connections 2024-09-07T03:32:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.624+0000 7fe466526800 1 --2- 172.21.15.120:0/1519635128 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32a829f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.624+0000 7fe466526800 1 -- 172.21.15.120:0/1519635128 >> 172.21.15.120:0/1519635128 conn(0x55ff32a7a1c0 msgr2=0x55ff32a7c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.624+0000 7fe466526800 1 -- 172.21.15.120:0/1519635128 shutdown_connections 2024-09-07T03:32:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.624+0000 7fe466526800 1 -- 172.21.15.120:0/1519635128 wait complete. 2024-09-07T03:32:55.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.638+0000 7fe466526800 1 Processor -- start 2024-09-07T03:32:55.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.638+0000 7fe466526800 1 -- start start 2024-09-07T03:32:55.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.638+0000 7fe466526800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32a7fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.638+0000 7fe466526800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ff32918dd0 con 0x55ff32a80600 2024-09-07T03:32:55.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.638+0000 7fe4621d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32a7fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.638+0000 7fe4621d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32a7fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58570/0 (socket says 172.21.15.120:58570) 2024-09-07T03:32:55.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.638+0000 7fe4621d9640 1 -- 172.21.15.120:0/2051442475 learned_addr learned my addr 172.21.15.120:0/2051442475 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.638+0000 7fe4621d9640 1 -- 172.21.15.120:0/2051442475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff32931e10 con 0x55ff32a80600 2024-09-07T03:32:55.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.639+0000 7fe4621d9640 1 --2- 172.21.15.120:0/2051442475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32a7fd90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe454025c20 tx=0x7fe454051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c32310795c5df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.639+0000 7fe350608640 1 -- 172.21.15.120:0/2051442475 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454053a20 con 0x55ff32a80600 2024-09-07T03:32:55.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.639+0000 7fe350608640 1 -- 172.21.15.120:0/2051442475 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe454063070 con 0x55ff32a80600 2024-09-07T03:32:55.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.639+0000 7fe350608640 1 -- 172.21.15.120:0/2051442475 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454053cf0 con 0x55ff32a80600 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.639+0000 7fe466526800 1 -- 172.21.15.120:0/2051442475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 msgr2=0x55ff32a7fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.639+0000 7fe466526800 1 --2- 172.21.15.120:0/2051442475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32a7fd90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe454025c20 tx=0x7fe454051000 comp rx=0 tx=0).stop 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe466526800 1 -- 172.21.15.120:0/2051442475 shutdown_connections 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe466526800 1 --2- 172.21.15.120:0/2051442475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32a7fd90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe466526800 1 -- 172.21.15.120:0/2051442475 >> 172.21.15.120:0/2051442475 conn(0x55ff32a7a1c0 msgr2=0x55ff32b6b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe466526800 1 -- 172.21.15.120:0/2051442475 shutdown_connections 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe466526800 1 -- 172.21.15.120:0/2051442475 wait complete. 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe466526800 1 Processor -- start 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe466526800 1 -- start start 2024-09-07T03:32:55.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe466526800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32b79160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe466526800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ff32a87040 con 0x55ff32a80600 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe4621d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32b79160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe4621d9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32b79160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58574/0 (socket says 172.21.15.120:58574) 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.640+0000 7fe4621d9640 1 -- 172.21.15.120:0/2046276103 learned_addr learned my addr 172.21.15.120:0/2046276103 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.641+0000 7fe4621d9640 1 -- 172.21.15.120:0/2046276103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff32b796c0 con 0x55ff32a80600 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.641+0000 7fe4621d9640 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32b79160 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe454025c20 tx=0x7fe454002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.641+0000 7fe34ee05640 1 -- 172.21.15.120:0/2046276103 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454068660 con 0x55ff32a80600 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.641+0000 7fe34ee05640 1 -- 172.21.15.120:0/2046276103 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe454068800 con 0x55ff32a80600 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.641+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff32b79950 con 0x55ff32a80600 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.641+0000 7fe34ee05640 1 -- 172.21.15.120:0/2046276103 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454068ae0 con 0x55ff32a80600 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.641+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff32b7a560 con 0x55ff32a80600 2024-09-07T03:32:55.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.642+0000 7fe34ee05640 1 -- 172.21.15.120:0/2046276103 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe454068c80 con 0x55ff32a80600 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.642+0000 7fe34ee05640 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe34803c780 0x7fe34803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.642+0000 7fe34ee05640 1 -- 172.21.15.120:0/2046276103 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe454098310 con 0x55ff32a80600 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.642+0000 7fe4619d8640 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe34803c780 0x7fe34803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.642+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32a83020 0x55ff32b807b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.642+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32b7af20 con 0x55ff32a83020 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.642+0000 7fe4629da640 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32a83020 0x55ff32b807b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.642+0000 7fe4619d8640 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe34803c780 0x7fe34803ec40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe458001d70 tx=0x7fe4580012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.643+0000 7fe4629da640 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32a83020 0x55ff32b807b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.643+0000 7fe4629da640 1 -- 172.21.15.120:0/2046276103 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe45c00a4d0 con 0x55ff32a83020 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.643+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32b81720 0x55ff32b83b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.643+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32b84170 con 0x55ff32b81720 2024-09-07T03:32:55.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.643+0000 7fe4621d9640 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32b81720 0x55ff32b83b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.644+0000 7fe4621d9640 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32b81720 0x55ff32b83b10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.644+0000 7fe4621d9640 1 -- 172.21.15.120:0/2046276103 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe454051070 con 0x55ff32b81720 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.644+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32b85a20 con 0x55ff32b81720 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.644+0000 7fe4621d9640 1 -- 172.21.15.120:0/2046276103 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe454051070 con 0x55ff32b81720 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.644+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32b84b60 con 0x55ff32b81720 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.644+0000 7fe4621d9640 1 -- 172.21.15.120:0/2046276103 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe454051070 con 0x55ff32b81720 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.644+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32b84fc0 con 0x55ff32a83020 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.645+0000 7fe4629da640 1 -- 172.21.15.120:0/2046276103 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe45c00a4d0 con 0x55ff32a83020 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.645+0000 7fe466526800 1 Processor -- start 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.645+0000 7fe466526800 1 -- start start 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.645+0000 7fe466526800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32b93f50 0x55ff32b94370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.645+0000 7fe466526800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ff32976a00 con 0x55ff32b93f50 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.645+0000 7fe4629da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32b93f50 0x55ff32b94370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.645+0000 7fe4629da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32b93f50 0x55ff32b94370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58590/0 (socket says 172.21.15.120:58590) 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.645+0000 7fe4629da640 1 -- 172.21.15.120:0/3952435145 learned_addr learned my addr 172.21.15.120:0/3952435145 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.646+0000 7fe4629da640 1 -- 172.21.15.120:0/3952435145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff32b949b0 con 0x55ff32b93f50 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.646+0000 7fe4629da640 1 --2- 172.21.15.120:0/3952435145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32b93f50 0x55ff32b94370 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe45c016d20 tx=0x7fe45c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.646+0000 7fe347fff640 1 -- 172.21.15.120:0/3952435145 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c017660 con 0x55ff32b93f50 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.646+0000 7fe347fff640 1 -- 172.21.15.120:0/3952435145 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45c01b030 con 0x55ff32b93f50 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.646+0000 7fe466526800 1 -- 172.21.15.120:0/3952435145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff32b951e0 con 0x55ff32b93f50 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.646+0000 7fe347fff640 1 -- 172.21.15.120:0/3952435145 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c017950 con 0x55ff32b93f50 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.646+0000 7fe466526800 1 -- 172.21.15.120:0/3952435145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff32b95780 con 0x55ff32b93f50 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.647+0000 7fe347fff640 1 -- 172.21.15.120:0/3952435145 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe45c017af0 con 0x55ff32b93f50 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.647+0000 7fe347fff640 1 --2- 172.21.15.120:0/3952435145 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe33c03c780 0x7fe33c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.647+0000 7fe347fff640 1 -- 172.21.15.120:0/3952435145 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe45c00e040 con 0x55ff32b93f50 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.647+0000 7fe4621d9640 1 --2- 172.21.15.120:0/3952435145 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe33c03c780 0x7fe33c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.647+0000 7fe466526800 1 Processor -- start 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.647+0000 7fe4621d9640 1 --2- 172.21.15.120:0/3952435145 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe33c03c780 0x7fe33c03ec40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55ff32b80ee0 tx=0x7fe454083040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.647+0000 7fe466526800 1 -- start start 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe466526800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe466526800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ff32a7e630 con 0x55ff32ba0a50 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe4629da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe4629da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58598/0 (socket says 172.21.15.120:58598) 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe4629da640 1 -- 172.21.15.120:0/1843868198 learned_addr learned my addr 172.21.15.120:0/1843868198 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe4629da640 1 -- 172.21.15.120:0/1843868198 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff32ba1440 con 0x55ff32ba0a50 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe4629da640 1 --2- 172.21.15.120:0/1843868198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba0e50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe45c005cf0 tx=0x7fe45c017ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b97c2fa02b7d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe345ffb640 1 -- 172.21.15.120:0/1843868198 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c04a070 con 0x55ff32ba0a50 2024-09-07T03:32:55.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe345ffb640 1 -- 172.21.15.120:0/1843868198 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45c055040 con 0x55ff32ba0a50 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.648+0000 7fe345ffb640 1 -- 172.21.15.120:0/1843868198 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c052070 con 0x55ff32ba0a50 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 -- 172.21.15.120:0/1843868198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 msgr2=0x55ff32ba0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 --2- 172.21.15.120:0/1843868198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba0e50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe45c005cf0 tx=0x7fe45c017ea0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 -- 172.21.15.120:0/1843868198 shutdown_connections 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 --2- 172.21.15.120:0/1843868198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba0e50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 -- 172.21.15.120:0/1843868198 >> 172.21.15.120:0/1843868198 conn(0x55ff32b9ce50 msgr2=0x55ff32b9b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 -- 172.21.15.120:0/1843868198 shutdown_connections 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 -- 172.21.15.120:0/1843868198 wait complete. 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 Processor -- start 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 -- start start 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe466526800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ff32ba1a60 con 0x55ff32ba0a50 2024-09-07T03:32:55.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe4629da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe4629da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58602/0 (socket says 172.21.15.120:58602) 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.649+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 learned_addr learned my addr 172.21.15.120:0/170424314 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.650+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff32ba8610 con 0x55ff32ba0a50 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.650+0000 7fe4629da640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba80b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe45c005cf0 tx=0x7fe45c053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.650+0000 7fe333fff640 1 -- 172.21.15.120:0/170424314 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c02e070 con 0x55ff32ba0a50 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.650+0000 7fe333fff640 1 -- 172.21.15.120:0/170424314 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45c028480 con 0x55ff32ba0a50 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.650+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff32ba88a0 con 0x55ff32ba0a50 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.650+0000 7fe333fff640 1 -- 172.21.15.120:0/170424314 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c04a040 con 0x55ff32ba0a50 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.650+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff32ba9220 con 0x55ff32ba0a50 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.651+0000 7fe333fff640 1 -- 172.21.15.120:0/170424314 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe45c0127a0 con 0x55ff32ba0a50 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.651+0000 7fe333fff640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe32c03c730 0x7fe32c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.651+0000 7fe333fff640 1 -- 172.21.15.120:0/170424314 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe45c03cd00 con 0x55ff32ba0a50 2024-09-07T03:32:55.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.651+0000 7fe4621d9640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe32c03c730 0x7fe32c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.651+0000 7fe4621d9640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe32c03c730 0x7fe32c03ebf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe454098580 tx=0x7fe45408d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.651+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.651+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32bb3b50 0x55ff32bb6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.651+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bb6760 con 0x55ff32bb3b50 2024-09-07T03:32:55.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.651+0000 7fe4619d8640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32bb3b50 0x55ff32bb6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe4619d8640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32bb3b50 0x55ff32bb6010 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe458009050 con 0x55ff32bb3b50 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe466526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe466526800 20 realm 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bb2ea0 con 0x55ff32bb3b50 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe458009050 con 0x55ff32bb3b50 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe466526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe466526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bb7240 con 0x55ff32bb3b50 2024-09-07T03:32:55.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.652+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe458009050 con 0x55ff32bb3b50 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe466526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32bb8020 0x55ff32bba410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbaae0 con 0x55ff32bb8020 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe4629da640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32bb8020 0x55ff32bba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe4629da640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32bb8020 0x55ff32bba410 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe466526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.653+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbb380 con 0x55ff32bb8020 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe466526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:55.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe466526800 20 searching for the correct realm 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ff32bbd0f0 0x55ff32bbf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe4621d9640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ff32bbd0f0 0x55ff32bbf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe4621d9640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ff32bbd0f0 0x55ff32bbf500 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb8020 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe4629da640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe45c052070 0x7fe45c0524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.654+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x7fe45c052070 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.655+0000 7fe4619d8640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe45c052070 0x7fe45c0524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.655+0000 7fe4619d8640 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe45c052070 0x7fe45c0524c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.655+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458009050 con 0x7fe45c052070 2024-09-07T03:32:55.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.655+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.655+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458009050 con 0x55ff32bb3b50 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.655+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.656+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.656+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.656+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.656+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.656+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.656+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb8020 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.656+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.656+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb8020 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x7fe45c052070 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x7fe45c052070 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.657+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb8020 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.658+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.658+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.658+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.658+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.658+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.658+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb8020 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.658+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.659+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.659+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.659+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.659+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.659+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.659+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.659+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.659+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.659+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x7fe45c052070 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x7fe45c052070 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x7fe45c052070 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.660+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x7fe45c052070 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.661+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.661+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb8020 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.661+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.661+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb8020 2024-09-07T03:32:55.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.661+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.661+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.661+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.661+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb8020 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbfbd0 con 0x55ff32bb8020 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:55.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbbcd0 con 0x55ff32bb3b50 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbc120 con 0x55ff32bb8020 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.662+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bbc580 con 0x55ff32bb3b50 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 zone default found 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 4 Realm: () 2024-09-07T03:32:55.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 zonegroup default 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc00a0 con 0x7fe45c052070 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc2360 con 0x55ff32bbd0f0 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc2760 con 0x55ff32bbd0f0 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 started sync module instance, tier type = 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.663+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc17a0 con 0x55ff32bb8020 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.665+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.665+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94554556207856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc2bc0 con 0x55ff32bb8020 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.665+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc3410 con 0x55ff32bb3b50 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.665+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94554556207856] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.666+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.666+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94554556214208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc3490 con 0x55ff32bb3b50 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.666+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc3d40 con 0x55ff32bb8020 2024-09-07T03:32:55.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.667+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94554556214208] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.667+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.667+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94554556215264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc38b0 con 0x55ff32bb8020 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.667+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc4860 con 0x7fe45c052070 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.668+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.668+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94554556220240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc4820 con 0x7fe45c052070 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.668+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc5810 con 0x55ff32bb8020 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.669+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94554556220240] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.669+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94554556215264] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.669+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.669+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94554556216320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc5810 con 0x55ff32bb8020 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.669+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc60b0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.670+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94554556216320] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.670+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.670+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94554556222544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc5810 con 0x55ff32bbd0f0 2024-09-07T03:32:55.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.670+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc66d0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.671+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94554556222544] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.671+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.671+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94554556226560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc66d0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.671+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc7140 con 0x7fe45c052070 2024-09-07T03:32:55.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94554556230704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc7100 con 0x7fe45c052070 2024-09-07T03:32:55.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 20 add_watcher() i=0 2024-09-07T03:32:55.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 20 add_watcher() i=1 2024-09-07T03:32:55.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 20 add_watcher() i=2 2024-09-07T03:32:55.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 20 add_watcher() i=3 2024-09-07T03:32:55.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 20 add_watcher() i=4 2024-09-07T03:32:55.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 20 add_watcher() i=5 2024-09-07T03:32:55.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94554556226560] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 20 add_watcher() i=6 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94554556230704] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 20 add_watcher() i=7 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.673+0000 7fe466526800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.674+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc6220 con 0x55ff32bb3b50 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.674+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.674+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94554556232928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc6220 con 0x55ff32bb3b50 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.675+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94554556232928] v36'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.675+0000 7fe318fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.675+0000 7fe466526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.675+0000 7fe466526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.675+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bccb00 con 0x55ff32bb8020 2024-09-07T03:32:55.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.677+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'53 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.677+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bccb00 con 0x7fe45c052070 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.678+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.678+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd3210 con 0x55ff32bbd0f0 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.679+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.679+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd3780 con 0x55ff32bb3b50 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.680+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'175 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.680+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd3c30 con 0x55ff32bb8020 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.681+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'62 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.681+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd3c30 con 0x55ff32bbd0f0 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.682+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'49 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.682+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd2730 con 0x55ff32bb8020 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.683+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'31 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.683+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd2730 con 0x55ff32bb3b50 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.684+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.684+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4580 con 0x55ff32bb8020 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.685+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.685+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4580 con 0x55ff32bb8020 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.686+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.686+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4580 con 0x55ff32bb8020 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.687+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'63 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.687+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4580 con 0x55ff32bbd0f0 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.688+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.688+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4580 con 0x55ff32bb8020 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.689+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.689+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4580 con 0x55ff32bb3b50 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.689+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'55 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.689+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4580 con 0x55ff32bb3b50 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.690+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'176 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.691+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4610 con 0x55ff32bb8020 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.691+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.692+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4610 con 0x55ff32bb8020 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.692+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'64 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.692+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4610 con 0x55ff32bbd0f0 2024-09-07T03:32:55.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.693+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.694+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4610 con 0x55ff32bb8020 2024-09-07T03:32:55.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.695+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.695+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4610 con 0x55ff32bb3b50 2024-09-07T03:32:55.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.696+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'177 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.696+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4610 con 0x55ff32bb8020 2024-09-07T03:32:55.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.697+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'59 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.697+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4610 con 0x55ff32bb8020 2024-09-07T03:32:55.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.697+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.698+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4610 con 0x55ff32bbd0f0 2024-09-07T03:32:55.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.698+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.698+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4610 con 0x55ff32bb8020 2024-09-07T03:32:55.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.699+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.699+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd47e0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.700+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.700+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd47e0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.701+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'50 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.701+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd21d0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.703+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.703+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4650 con 0x55ff32bb8020 2024-09-07T03:32:55.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.704+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.704+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4650 con 0x55ff32bb3b50 2024-09-07T03:32:55.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.705+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.705+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4650 con 0x55ff32bb8020 2024-09-07T03:32:55.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.706+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'60 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.706+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4650 con 0x55ff32bb3b50 2024-09-07T03:32:55.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.707+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'56 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.707+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd4690 con 0x7fe45c052070 2024-09-07T03:32:55.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.708+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.708+0000 7fe2937fe640 20 reqs_thread_entry: start 2024-09-07T03:32:55.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.708+0000 7fe466526800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:55.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.708+0000 7fe466526800 20 Filter name: none 2024-09-07T03:32:55.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.708+0000 7fe2917fa640 20 reqs_thread_entry: start 2024-09-07T03:32:55.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.708+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.709+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.709+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.709+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.709+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.709+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.709+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x7fe45c052070 2024-09-07T03:32:55.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.710+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.710+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x7fe45c052070 2024-09-07T03:32:55.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.710+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.710+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x7fe45c052070 2024-09-07T03:32:55.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.710+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.710+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.710+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.710+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.711+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.711+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.711+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.711+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.711+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv172 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.711+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.711+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv172 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.711+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.712+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv172 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.712+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.712+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.712+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.713+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.713+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.713+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.713+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.713+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.713+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.714+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv48 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.714+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.714+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.714+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.714+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv30 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.714+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.715+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv30 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.715+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.715+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv30 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.715+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.715+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.715+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.715+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv42 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.715+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.716+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.716+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.716+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.716+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.716+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.716+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.717+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 45 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.717+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.717+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 46 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.717+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.717+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 47 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.717+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.717+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 48 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.717+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.718+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 49 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.718+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.718+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 50 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.718+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.718+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 51 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.718+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.719+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.719+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.719+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.719+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.719+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.719+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.719+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 52 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.719+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.720+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 53 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.720+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.720+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 54 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.720+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.720+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.720+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.720+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.720+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.721+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.721+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.721+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.721+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.721+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv168 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.721+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.722+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.722+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.722+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 55 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.722+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.722+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 56 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.722+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.722+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 57 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.722+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.723+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 58 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.723+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.723+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 59 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.723+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.723+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 60 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.723+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.724+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.724+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.724+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.724+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.724+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 33 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.724+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.725+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 61 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.725+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.725+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 62 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.725+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.725+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 63 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.725+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.725+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.725+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.726+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.726+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.726+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.726+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.726+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 64 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.726+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.727+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 65 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.727+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.727+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 66 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.727+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.727+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 67 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.727+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.727+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 68 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.727+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.728+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 69 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.728+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.728+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 34 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.728+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.728+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 35 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.728+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.728+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 36 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.728+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.729+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 70 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.729+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.729+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 71 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.729+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.729+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 72 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.729+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.729+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 37 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.729+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.730+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 38 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.730+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.730+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 39 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.730+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.730+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 40 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.730+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.730+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 41 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.730+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.731+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 42 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.731+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.731+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 43 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.731+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.731+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 44 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.731+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bbd0f0 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.731+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 45 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.731+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.732+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 73 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.732+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.732+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 74 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.732+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.732+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 75 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.732+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.732+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.732+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.733+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.733+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.733+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 43 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.733+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.733+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 76 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.733+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.733+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 77 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.733+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb8020 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.734+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 78 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.734+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.734+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.734+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.734+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.734+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x55ff32bb3b50 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.734+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.734+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x7fe45c052070 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.735+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.735+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x7fe45c052070 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.735+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.735+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0bb0 con 0x7fe45c052070 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.735+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.736+0000 7fe318fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.736+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94554556232928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bd0b50 con 0x55ff32bb3b50 2024-09-07T03:32:55.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.737+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94554556232928] v36'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.737+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94554556207856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc74e0 con 0x55ff32bb8020 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.738+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 79 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94554556207856] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.738+0000 7fe466526800 20 remove_watcher() i=0 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.738+0000 7fe466526800 2 removed watcher, disabling cache 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.738+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94554556214208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc12f0 con 0x55ff32bb3b50 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.739+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.1 v2:172.21.15.120:6808/3372043485 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94554556214208] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe458028040 con 0x55ff32bb3b50 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.739+0000 7fe466526800 20 remove_watcher() i=1 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.739+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94554556215264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc2bc0 con 0x55ff32bb8020 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.740+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 80 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94554556215264] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.740+0000 7fe466526800 20 remove_watcher() i=2 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.740+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94554556220240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc12f0 con 0x7fe45c052070 2024-09-07T03:32:55.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.741+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94554556220240] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.741+0000 7fe466526800 20 remove_watcher() i=3 2024-09-07T03:32:55.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.741+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94554556216320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc4350 con 0x55ff32bb8020 2024-09-07T03:32:55.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.742+0000 7fe4629da640 1 -- 172.21.15.120:0/170424314 <== osd.0 v2:172.21.15.104:6800/182397107 81 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94554556216320] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c039070 con 0x55ff32bb8020 2024-09-07T03:32:55.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.742+0000 7fe466526800 20 remove_watcher() i=4 2024-09-07T03:32:55.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.742+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94554556222544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc4350 con 0x55ff32bbd0f0 2024-09-07T03:32:55.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.743+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94554556222544] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.743+0000 7fe466526800 20 remove_watcher() i=5 2024-09-07T03:32:55.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.743+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94554556226560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc4350 con 0x55ff32bbd0f0 2024-09-07T03:32:55.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.744+0000 7fe4621d9640 1 -- 172.21.15.120:0/170424314 <== osd.3 v2:172.21.15.120:6800/1193158925 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94554556226560] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe454051070 con 0x55ff32bbd0f0 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.744+0000 7fe466526800 20 remove_watcher() i=6 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.744+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94554556230704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ff32bc4350 con 0x7fe45c052070 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.745+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 <== osd.2 v2:172.21.15.120:6809/3781833098 22 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94554556230704] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe458028040 con 0x7fe45c052070 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.745+0000 7fe466526800 20 remove_watcher() i=7 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32bb8020 msgr2=0x55ff32bba410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32bb8020 0x55ff32bba410 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32bb3b50 msgr2=0x55ff32bb6010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32bb3b50 0x55ff32bb6010 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe45c052070 msgr2=0x7fe45c0524c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe45c052070 0x7fe45c0524c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ff32bbd0f0 msgr2=0x55ff32bbf500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55ff32bbd0f0 0x55ff32bbf500 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe32c03c730 msgr2=0x7fe32c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe32c03c730 0x7fe32c03ebf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe454098580 tx=0x7fe45408d000 comp rx=0 tx=0).stop 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 msgr2=0x55ff32ba80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe4619d8640 1 -- 172.21.15.120:0/170424314 reap_dead start 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba80b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe45c005cf0 tx=0x7fe45c053d00 comp rx=0 tx=0).stop 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 shutdown_connections 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/170424314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32ba0a50 0x55ff32ba80b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 >> 172.21.15.120:0/170424314 conn(0x55ff32b9ce50 msgr2=0x55ff32b9b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 shutdown_connections 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/170424314 wait complete. 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/3952435145 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe33c03c780 msgr2=0x7fe33c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/3952435145 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe33c03c780 0x7fe33c03ec40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55ff32b80ee0 tx=0x7fe454083040 comp rx=0 tx=0).stop 2024-09-07T03:32:55.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/3952435145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32b93f50 msgr2=0x55ff32b94370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/3952435145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32b93f50 0x55ff32b94370 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe45c016d20 tx=0x7fe45c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/3952435145 shutdown_connections 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/3952435145 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe33c03c780 0x7fe33c03ec40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 --2- 172.21.15.120:0/3952435145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32b93f50 0x55ff32b94370 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/3952435145 >> 172.21.15.120:0/3952435145 conn(0x55ff32b88300 msgr2=0x55ff32b886e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/3952435145 shutdown_connections 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.746+0000 7fe466526800 1 -- 172.21.15.120:0/3952435145 wait complete. 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32b81720 msgr2=0x55ff32b83b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32b81720 0x55ff32b83b10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32a83020 msgr2=0x55ff32b807b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32a83020 0x55ff32b807b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe34803c780 msgr2=0x7fe34803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe34803c780 0x7fe34803ec40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe458001d70 tx=0x7fe4580012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 msgr2=0x55ff32b79160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32b79160 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe454025c20 tx=0x7fe454002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 shutdown_connections 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ff32b81720 0x55ff32b83b10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55ff32a83020 0x55ff32b807b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe34803c780 0x7fe34803ec40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 --2- 172.21.15.120:0/2046276103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ff32a80600 0x55ff32b79160 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 >> 172.21.15.120:0/2046276103 conn(0x55ff32a7a1c0 msgr2=0x55ff32b6ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 shutdown_connections 2024-09-07T03:32:55.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.747+0000 7fe466526800 1 -- 172.21.15.120:0/2046276103 wait complete. 2024-09-07T03:32:55.756 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-07T03:32:55.757 DEBUG:tasks.util.rgw: json result: [] 2024-09-07T03:32:55.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-07T03:32:55.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-07T03:32:55.757 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-07T03:32:55.801 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:55.802 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:55.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.801+0000 7ffad8125800 1 Processor -- start 2024-09-07T03:32:55.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.801+0000 7ffad8125800 1 -- start start 2024-09-07T03:32:55.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.801+0000 7ffad8125800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556aa53c7600 0x556aa53c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.801+0000 7ffad8125800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556aa5270e40 con 0x556aa53ca020 2024-09-07T03:32:55.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.801+0000 7ffad8125800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x556aa523b680 con 0x556aa53c7600 2024-09-07T03:32:55.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.801+0000 7ffad3dae640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556aa53c7600 0x556aa53c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.801+0000 7ffacbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x556aa53ca020 0x556aa53cc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41494/0 (socket says 172.21.15.120:41494) 2024-09-07T03:32:55.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.801+0000 7ffacbfff640 1 -- 172.21.15.120:0/3757069994 learned_addr learned my addr 172.21.15.120:0/3757069994 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:55.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.802+0000 7ffad3dae640 1 -- 172.21.15.120:0/3757069994 >> v1:172.21.15.104:6789/0 conn(0x556aa53ca020 legacy=0x556aa53cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.802+0000 7ffad35ad640 1 -- 172.21.15.120:0/3757069994 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151396213 0 0) 0x556aa5270e40 con 0x556aa53ca020 2024-09-07T03:32:55.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.802+0000 7ffad3dae640 1 -- 172.21.15.120:0/3757069994 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aa52576b0 con 0x556aa53c7600 2024-09-07T03:32:55.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.803+0000 7ffad3dae640 1 --2- 172.21.15.120:0/3757069994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa53c99f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ffac400a470 tx=0x7ffac4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebd6ea7d26462ef server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad35ad640 1 -- 172.21.15.120:0/3757069994 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4053570 con 0x556aa53c7600 2024-09-07T03:32:55.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad35ad640 1 -- 172.21.15.120:0/3757069994 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac4058070 con 0x556aa53c7600 2024-09-07T03:32:55.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad35ad640 1 -- 172.21.15.120:0/3757069994 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4053880 con 0x556aa53c7600 2024-09-07T03:32:55.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad8125800 1 -- 172.21.15.120:0/3757069994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 msgr2=0x556aa53c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad8125800 1 --2- 172.21.15.120:0/3757069994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa53c99f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ffac400a470 tx=0x7ffac4045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:55.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad8125800 1 -- 172.21.15.120:0/3757069994 shutdown_connections 2024-09-07T03:32:55.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad8125800 1 --2- 172.21.15.120:0/3757069994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa53c99f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad8125800 1 -- 172.21.15.120:0/3757069994 >> 172.21.15.120:0/3757069994 conn(0x556aa53c11c0 msgr2=0x556aa53c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad8125800 1 -- 172.21.15.120:0/3757069994 shutdown_connections 2024-09-07T03:32:55.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.804+0000 7ffad8125800 1 -- 172.21.15.120:0/3757069994 wait complete. 2024-09-07T03:32:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.818+0000 7ffad8125800 1 Processor -- start 2024-09-07T03:32:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.818+0000 7ffad8125800 1 -- start start 2024-09-07T03:32:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.818+0000 7ffad8125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa53c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.818+0000 7ffad8125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556aa525fdd0 con 0x556aa53c7600 2024-09-07T03:32:55.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.818+0000 7ffad3dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa53c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.818+0000 7ffad3dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa53c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58606/0 (socket says 172.21.15.120:58606) 2024-09-07T03:32:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.818+0000 7ffad3dae640 1 -- 172.21.15.120:0/2702388461 learned_addr learned my addr 172.21.15.120:0/2702388461 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.819+0000 7ffad3dae640 1 -- 172.21.15.120:0/2702388461 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aa5278e10 con 0x556aa53c7600 2024-09-07T03:32:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.819+0000 7ffad3dae640 1 --2- 172.21.15.120:0/2702388461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa53c6d70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ffac400a470 tx=0x7ffac4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510371632e05c950 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.819+0000 7ff9c1e0b640 1 -- 172.21.15.120:0/2702388461 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4053570 con 0x556aa53c7600 2024-09-07T03:32:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.819+0000 7ff9c1e0b640 1 -- 172.21.15.120:0/2702388461 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac4063030 con 0x556aa53c7600 2024-09-07T03:32:55.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.819+0000 7ff9c1e0b640 1 -- 172.21.15.120:0/2702388461 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4053840 con 0x556aa53c7600 2024-09-07T03:32:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 -- 172.21.15.120:0/2702388461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 msgr2=0x556aa53c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 --2- 172.21.15.120:0/2702388461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa53c6d70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ffac400a470 tx=0x7ffac4051000 comp rx=0 tx=0).stop 2024-09-07T03:32:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 -- 172.21.15.120:0/2702388461 shutdown_connections 2024-09-07T03:32:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 --2- 172.21.15.120:0/2702388461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa53c6d70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 -- 172.21.15.120:0/2702388461 >> 172.21.15.120:0/2702388461 conn(0x556aa53c11c0 msgr2=0x556aa54b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 -- 172.21.15.120:0/2702388461 shutdown_connections 2024-09-07T03:32:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 -- 172.21.15.120:0/2702388461 wait complete. 2024-09-07T03:32:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 Processor -- start 2024-09-07T03:32:55.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 -- start start 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa54bff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad8125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556aa53ce040 con 0x556aa53c7600 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.820+0000 7ffad3dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa54bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.821+0000 7ffad3dae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa54bff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58618/0 (socket says 172.21.15.120:58618) 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.821+0000 7ffad3dae640 1 -- 172.21.15.120:0/2655176823 learned_addr learned my addr 172.21.15.120:0/2655176823 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.821+0000 7ffad3dae640 1 -- 172.21.15.120:0/2655176823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aa54c04a0 con 0x556aa53c7600 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.821+0000 7ffad3dae640 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa54bff40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffac400a470 tx=0x7ffac4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.821+0000 7ff9bbfff640 1 -- 172.21.15.120:0/2655176823 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4078070 con 0x556aa53c7600 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.821+0000 7ff9bbfff640 1 -- 172.21.15.120:0/2655176823 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac4068420 con 0x556aa53c7600 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.821+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556aa54c0730 con 0x556aa53c7600 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.821+0000 7ff9bbfff640 1 -- 172.21.15.120:0/2655176823 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac4068700 con 0x556aa53c7600 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.821+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aa54c1340 con 0x556aa53c7600 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.822+0000 7ff9bbfff640 1 -- 172.21.15.120:0/2655176823 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ffac407b070 con 0x556aa53c7600 2024-09-07T03:32:55.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.822+0000 7ff9bbfff640 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9bc03c780 0x7ff9bc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.822+0000 7ff9bbfff640 1 -- 172.21.15.120:0/2655176823 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ffac4097990 con 0x556aa53c7600 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.822+0000 7ffacbfff640 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9bc03c780 0x7ff9bc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.823+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa53ca020 0x556aa54c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.823+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa54c7ad0 con 0x556aa53ca020 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.823+0000 7ffad45af640 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa53ca020 0x556aa54c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.823+0000 7ffacbfff640 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9bc03c780 0x7ff9bc03ec40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffabc000c00 tx=0x7ffabc0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.823+0000 7ffad45af640 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa53ca020 0x556aa54c7590 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.823+0000 7ffad45af640 1 -- 172.21.15.120:0/2655176823 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffacc00a4d0 con 0x556aa53ca020 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.823+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54c8380 0x556aa54ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.823+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa54caf60 con 0x556aa54c8380 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.823+0000 7ffad3dae640 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54c8380 0x556aa54ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.824+0000 7ffad3dae640 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54c8380 0x556aa54ca7f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.824+0000 7ffad3dae640 1 -- 172.21.15.120:0/2655176823 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffac407a030 con 0x556aa54c8380 2024-09-07T03:32:55.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.824+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa54cc810 con 0x556aa54c8380 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.824+0000 7ffad3dae640 1 -- 172.21.15.120:0/2655176823 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffac407a030 con 0x556aa54c8380 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.824+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa54cb860 con 0x556aa54c8380 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.824+0000 7ffad3dae640 1 -- 172.21.15.120:0/2655176823 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffac407a030 con 0x556aa54c8380 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.824+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa54cbc80 con 0x556aa53ca020 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.825+0000 7ffad45af640 1 -- 172.21.15.120:0/2655176823 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffacc00a4d0 con 0x556aa53ca020 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.825+0000 7ffad8125800 1 Processor -- start 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.825+0000 7ffad8125800 1 -- start start 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.825+0000 7ffad8125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54dac20 0x556aa54db040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.825+0000 7ffad8125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556aa52bda00 con 0x556aa54dac20 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.825+0000 7ffad45af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54dac20 0x556aa54db040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.825+0000 7ffad45af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54dac20 0x556aa54db040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58632/0 (socket says 172.21.15.120:58632) 2024-09-07T03:32:55.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.825+0000 7ffad45af640 1 -- 172.21.15.120:0/535207044 learned_addr learned my addr 172.21.15.120:0/535207044 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.826+0000 7ffad45af640 1 -- 172.21.15.120:0/535207044 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aa54db680 con 0x556aa54dac20 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.826+0000 7ffad45af640 1 --2- 172.21.15.120:0/535207044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54dac20 0x556aa54db040 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffacc016d20 tx=0x7ffacc00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.826+0000 7ff9b97fa640 1 -- 172.21.15.120:0/535207044 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffacc017660 con 0x556aa54dac20 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.826+0000 7ff9b97fa640 1 -- 172.21.15.120:0/535207044 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffacc01b030 con 0x556aa54dac20 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.826+0000 7ffad8125800 1 -- 172.21.15.120:0/535207044 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556aa54dbeb0 con 0x556aa54dac20 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.826+0000 7ff9b97fa640 1 -- 172.21.15.120:0/535207044 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffacc017950 con 0x556aa54dac20 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.826+0000 7ffad8125800 1 -- 172.21.15.120:0/535207044 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aa54dc450 con 0x556aa54dac20 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.827+0000 7ff9b97fa640 1 -- 172.21.15.120:0/535207044 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ffacc017af0 con 0x556aa54dac20 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.827+0000 7ff9b97fa640 1 --2- 172.21.15.120:0/535207044 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9ac03c780 0x7ff9ac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.827+0000 7ff9b97fa640 1 -- 172.21.15.120:0/535207044 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ffacc00e040 con 0x556aa54dac20 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.827+0000 7ffad3dae640 1 --2- 172.21.15.120:0/535207044 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9ac03c780 0x7ff9ac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.827+0000 7ffad8125800 1 Processor -- start 2024-09-07T03:32:55.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.827+0000 7ffad3dae640 1 --2- 172.21.15.120:0/535207044 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9ac03c780 0x7ff9ac03ec40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x556aa54cb380 tx=0x7ffac408b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.827+0000 7ffad8125800 1 -- start start 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ffad8125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ffad8125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556aa53c5610 con 0x556aa54e76c0 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ffad45af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ffad45af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54e7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58638/0 (socket says 172.21.15.120:58638) 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ffad45af640 1 -- 172.21.15.120:0/1802030283 learned_addr learned my addr 172.21.15.120:0/1802030283 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ffad45af640 1 -- 172.21.15.120:0/1802030283 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aa54e80b0 con 0x556aa54e76c0 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ffad45af640 1 --2- 172.21.15.120:0/1802030283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54e7ac0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffacc054030 tx=0x7ffacc054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b3cf375706b31c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ff9b2ffd640 1 -- 172.21.15.120:0/1802030283 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffacc014e70 con 0x556aa54e76c0 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ff9b2ffd640 1 -- 172.21.15.120:0/1802030283 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffacc0149b0 con 0x556aa54e76c0 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.828+0000 7ff9b2ffd640 1 -- 172.21.15.120:0/1802030283 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffacc028350 con 0x556aa54e76c0 2024-09-07T03:32:55.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 -- 172.21.15.120:0/1802030283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 msgr2=0x556aa54e7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 --2- 172.21.15.120:0/1802030283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54e7ac0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffacc054030 tx=0x7ffacc054060 comp rx=0 tx=0).stop 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 -- 172.21.15.120:0/1802030283 shutdown_connections 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 --2- 172.21.15.120:0/1802030283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54e7ac0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 -- 172.21.15.120:0/1802030283 >> 172.21.15.120:0/1802030283 conn(0x556aa54e3ac0 msgr2=0x556aa54e1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 -- 172.21.15.120:0/1802030283 shutdown_connections 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 -- 172.21.15.120:0/1802030283 wait complete. 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 Processor -- start 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 -- start start 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad8125800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556aa54e86a0 con 0x556aa54e76c0 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad45af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad45af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54eecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58650/0 (socket says 172.21.15.120:58650) 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.829+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 learned_addr learned my addr 172.21.15.120:0/2319736038 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.830+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aa54ef210 con 0x556aa54e76c0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.830+0000 7ffad45af640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54eecb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffacc013550 tx=0x7ffacc053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.830+0000 7ff9b17fa640 1 -- 172.21.15.120:0/2319736038 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffacc012570 con 0x556aa54e76c0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.830+0000 7ff9b17fa640 1 -- 172.21.15.120:0/2319736038 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffacc005500 con 0x556aa54e76c0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.830+0000 7ff9b17fa640 1 -- 172.21.15.120:0/2319736038 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffacc012ae0 con 0x556aa54e76c0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.830+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556aa54ef4a0 con 0x556aa54e76c0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.830+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aa54f0030 con 0x556aa54e76c0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.831+0000 7ff9b17fa640 1 -- 172.21.15.120:0/2319736038 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ffacc012c80 con 0x556aa54e76c0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.831+0000 7ff9b17fa640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff99c03c780 0x7ff99c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.831+0000 7ff9b17fa640 1 -- 172.21.15.120:0/2319736038 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ffacc0489e0 con 0x556aa54e76c0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.831+0000 7ffad3dae640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff99c03c780 0x7ff99c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.831+0000 7ffad3dae640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff99c03c780 0x7ff99c03ec40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffac4053da0 tx=0x7ffac4094000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa54fa7b0 0x556aa54fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa54fd3c0 con 0x556aa54fa7b0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffacbfff640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa54fa7b0 0x556aa54fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffacbfff640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa54fa7b0 0x556aa54fcc70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffad8125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffad8125800 20 realm 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa54f9b00 con 0x556aa54fa7b0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffad8125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.832+0000 7ffad8125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.833+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.833+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa54fdeb0 con 0x556aa54fa7b0 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.833+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.833+0000 7ffad8125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.833+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.833+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54fec90 0x556aa5501080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.833+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5501750 con 0x556aa54fec90 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.833+0000 7ffad45af640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54fec90 0x556aa5501080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.833+0000 7ffad45af640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54fec90 0x556aa5501080 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad8125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5501fa0 con 0x556aa54fec90 2024-09-07T03:32:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad8125800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad8125800 20 searching for the correct realm 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556aa5503d10 0x556aa5506140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa5503d10 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad3dae640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556aa5503d10 0x556aa5506140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad3dae640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556aa5503d10 0x556aa5506140 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.834+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fec90 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.835+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.835+0000 7ffad45af640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffacc014440 0x7ffacc0439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.835+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x7ffacc014440 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.835+0000 7ffacbfff640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffacc014440 0x7ffacc0439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:55.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.835+0000 7ffacbfff640 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffacc014440 0x7ffacc0439d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.835+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x7ffacc014440 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.835+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fa7b0 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.836+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.836+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fa7b0 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.836+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.836+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa5503d10 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.836+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.836+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fa7b0 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.836+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.836+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fec90 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fec90 2024-09-07T03:32:55.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fa7b0 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x7ffacc014440 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x7ffacc014440 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fa7b0 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.837+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x7ffacc014440 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.838+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffabc00f5f0 con 0x7ffacc014440 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.838+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fec90 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.838+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.838+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa5503d10 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.838+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.838+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fa7b0 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.839+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.839+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fec90 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.839+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.839+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa5503d10 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.839+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.839+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fa7b0 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.839+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.839+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fa7b0 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fa7b0 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x556aa54fa7b0 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa5503d10 2024-09-07T03:32:55.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x7ffacc014440 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x7ffacc014440 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x7ffacc014440 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x7ffacc014440 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.840+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x7ffacc014440 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.841+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x7ffacc014440 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.841+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa5503d10 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.841+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.841+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x7ffacc014440 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.841+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffabc00f5f0 con 0x7ffacc014440 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.841+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fec90 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.841+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.841+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fec90 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa5503d10 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fec90 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556aa5506810 con 0x556aa54fec90 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad8125800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad8125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad8125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad8125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad8125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:55.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad8125800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5502920 con 0x556aa54fa7b0 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.842+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5502560 con 0x556aa54fec90 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5502d60 con 0x556aa54fa7b0 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 zone default found 2024-09-07T03:32:55.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 4 Realm: () 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 zonegroup default 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5507140 con 0x7ffacc014440 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.843+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5509380 con 0x556aa5503d10 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.844+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.844+0000 7ffad8125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.844+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.844+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5509720 con 0x556aa5503d10 2024-09-07T03:32:55.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.844+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.844+0000 7ffad8125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:55.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.844+0000 7ffad8125800 20 started sync module instance, tier type = 2024-09-07T03:32:55.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.844+0000 7ffad8125800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:55.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.844+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5508810 con 0x556aa54fec90 2024-09-07T03:32:55.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.845+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.845+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93916528413968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5508810 con 0x556aa54fec90 2024-09-07T03:32:55.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.845+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550a180 con 0x556aa54fa7b0 2024-09-07T03:32:55.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.846+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93916528413968] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.846+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.846+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93916528411488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5508780 con 0x556aa54fa7b0 2024-09-07T03:32:55.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.846+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550b040 con 0x556aa54fec90 2024-09-07T03:32:55.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.847+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93916528411488] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.847+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.847+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93916528420208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550b040 con 0x556aa54fec90 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.847+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550bae0 con 0x7ffacc014440 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.848+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93916528420208] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.848+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.848+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93916528424400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550b040 con 0x7ffacc014440 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.848+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550c530 con 0x556aa54fec90 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.849+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93916528424400] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.850+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.850+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93916528427072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550b040 con 0x556aa54fec90 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.850+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550cf70 con 0x556aa5503d10 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.851+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.851+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93916528429760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550d390 con 0x556aa5503d10 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.851+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550de90 con 0x556aa5503d10 2024-09-07T03:32:55.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.851+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93916528427072] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.852+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93916528429760] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.852+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.852+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93916528433536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550cee0 con 0x556aa5503d10 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.852+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550e730 con 0x7ffacc014440 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93916528435840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550eb50 con 0x7ffacc014440 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffad8125800 20 add_watcher() i=0 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffad8125800 20 add_watcher() i=1 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffad8125800 20 add_watcher() i=2 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffad8125800 20 add_watcher() i=3 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffad8125800 20 add_watcher() i=4 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffad8125800 20 add_watcher() i=5 2024-09-07T03:32:55.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93916528433536] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.853+0000 7ffad8125800 20 add_watcher() i=6 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.854+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93916528435840] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.854+0000 7ffad8125800 20 add_watcher() i=7 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.854+0000 7ffad8125800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.854+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5511b80 con 0x556aa54fa7b0 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.854+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.854+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93916528436896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550ef70 con 0x556aa54fa7b0 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.856+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93916528436896] v36'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.856+0000 7ff989fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.856+0000 7ffad8125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.856+0000 7ffad8125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.856+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551a210 con 0x556aa54fec90 2024-09-07T03:32:55.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.857+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'54 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.857+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551a210 con 0x7ffacc014440 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.858+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.858+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551a210 con 0x556aa5503d10 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.859+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.859+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551ac70 con 0x556aa54fa7b0 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.860+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'180 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.860+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5518870 con 0x556aa54fec90 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.861+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'65 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.861+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5518870 con 0x556aa5503d10 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.862+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'51 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.862+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5518870 con 0x556aa54fec90 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.863+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'32 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.863+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa55187d0 con 0x556aa54fa7b0 2024-09-07T03:32:55.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.864+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.864+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fec90 2024-09-07T03:32:55.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.865+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.865+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fec90 2024-09-07T03:32:55.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.866+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.866+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fec90 2024-09-07T03:32:55.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.867+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'66 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.867+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa5503d10 2024-09-07T03:32:55.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.868+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.868+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fec90 2024-09-07T03:32:55.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.869+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.869+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fa7b0 2024-09-07T03:32:55.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.870+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.870+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fa7b0 2024-09-07T03:32:55.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.871+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'181 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.871+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fec90 2024-09-07T03:32:55.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.872+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.872+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fec90 2024-09-07T03:32:55.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.873+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'67 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.873+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa5503d10 2024-09-07T03:32:55.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.874+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.874+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fec90 2024-09-07T03:32:55.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.875+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.875+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fa7b0 2024-09-07T03:32:55.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.876+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'182 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.876+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fec90 2024-09-07T03:32:55.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.877+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'62 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.877+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa54fec90 2024-09-07T03:32:55.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.878+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.878+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b790 con 0x556aa5503d10 2024-09-07T03:32:55.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.879+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.879+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551bd40 con 0x556aa54fec90 2024-09-07T03:32:55.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.880+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'41 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.880+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551bc80 con 0x556aa5503d10 2024-09-07T03:32:55.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.881+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.881+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551bc40 con 0x556aa5503d10 2024-09-07T03:32:55.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.882+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'52 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.882+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551bc40 con 0x556aa5503d10 2024-09-07T03:32:55.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.883+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.883+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551bc40 con 0x556aa54fec90 2024-09-07T03:32:55.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.884+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.884+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5518890 con 0x556aa54fa7b0 2024-09-07T03:32:55.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.885+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.885+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5518890 con 0x556aa54fec90 2024-09-07T03:32:55.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.886+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'63 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.886+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5518860 con 0x556aa54fa7b0 2024-09-07T03:32:55.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.887+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.887+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa551b830 con 0x7ffacc014440 2024-09-07T03:32:55.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.888+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ff988fe1640 20 reqs_thread_entry: start 2024-09-07T03:32:55.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:55.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 20 Filter name: none 2024-09-07T03:32:55.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ff9027fc640 20 reqs_thread_entry: start 2024-09-07T03:32:55.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 20 rados->read ofs=0 len=0 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5546760 con 0x556aa54fa7b0 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.889+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556aa5546760 con 0x7ffacc014440 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.890+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-07T03:32:55.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.890+0000 7ff989fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:55.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.891+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93916528436896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5546760 con 0x556aa54fa7b0 2024-09-07T03:32:55.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.892+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93916528436896] v36'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.892+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93916528413968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5519740 con 0x556aa54fec90 2024-09-07T03:32:55.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.893+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93916528413968] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.893+0000 7ffad8125800 20 remove_watcher() i=0 2024-09-07T03:32:55.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.893+0000 7ffad8125800 2 removed watcher, disabling cache 2024-09-07T03:32:55.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.893+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93916528411488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5508d10 con 0x556aa54fa7b0 2024-09-07T03:32:55.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.894+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93916528411488] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x556aa54fa7b0 2024-09-07T03:32:55.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.894+0000 7ffad8125800 20 remove_watcher() i=1 2024-09-07T03:32:55.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.894+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93916528420208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5508d10 con 0x556aa54fec90 2024-09-07T03:32:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.895+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93916528420208] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.895+0000 7ffad8125800 20 remove_watcher() i=2 2024-09-07T03:32:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.896+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93916528424400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550a570 con 0x7ffacc014440 2024-09-07T03:32:55.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.896+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93916528424400] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.896+0000 7ffad8125800 20 remove_watcher() i=3 2024-09-07T03:32:55.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.896+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93916528427072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5508d10 con 0x556aa54fec90 2024-09-07T03:32:55.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.897+0000 7ffad45af640 1 -- 172.21.15.120:0/2319736038 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93916528427072] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffacc027070 con 0x556aa54fec90 2024-09-07T03:32:55.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.898+0000 7ffad8125800 20 remove_watcher() i=4 2024-09-07T03:32:55.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.898+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93916528429760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550a570 con 0x556aa5503d10 2024-09-07T03:32:55.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.898+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93916528429760] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.898+0000 7ffad8125800 20 remove_watcher() i=5 2024-09-07T03:32:55.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.898+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93916528433536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa550c040 con 0x556aa5503d10 2024-09-07T03:32:55.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.899+0000 7ffad3dae640 1 -- 172.21.15.120:0/2319736038 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93916528433536] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffac40a0030 con 0x556aa5503d10 2024-09-07T03:32:55.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.899+0000 7ffad8125800 20 remove_watcher() i=6 2024-09-07T03:32:55.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.899+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93916528435840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556aa5508d10 con 0x7ffacc014440 2024-09-07T03:32:55.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93916528435840] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffabc03c040 con 0x7ffacc014440 2024-09-07T03:32:55.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffad8125800 20 remove_watcher() i=7 2024-09-07T03:32:55.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54fec90 msgr2=0x556aa5501080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54fec90 0x556aa5501080 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa54fa7b0 msgr2=0x556aa54fcc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa54fa7b0 0x556aa54fcc70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffacc014440 msgr2=0x7ffacc0439d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ffacc014440 0x7ffacc0439d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556aa5503d10 msgr2=0x556aa5506140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.900+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556aa5503d10 0x556aa5506140 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff99c03c780 msgr2=0x7ff99c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff99c03c780 0x7ff99c03ec40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffac4053da0 tx=0x7ffac4094000 comp rx=0 tx=0).stop 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 msgr2=0x556aa54eecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffacbfff640 1 -- 172.21.15.120:0/2319736038 reap_dead start 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54eecb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffacc013550 tx=0x7ffacc053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 shutdown_connections 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 --2- 172.21.15.120:0/2319736038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54e76c0 0x556aa54eecb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 >> 172.21.15.120:0/2319736038 conn(0x556aa54e3ac0 msgr2=0x556aa54e1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 shutdown_connections 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/2319736038 wait complete. 2024-09-07T03:32:55.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/535207044 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9ac03c780 msgr2=0x7ff9ac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 --2- 172.21.15.120:0/535207044 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9ac03c780 0x7ff9ac03ec40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x556aa54cb380 tx=0x7ffac408b040 comp rx=0 tx=0).stop 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/535207044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54dac20 msgr2=0x556aa54db040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 --2- 172.21.15.120:0/535207044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54dac20 0x556aa54db040 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffacc016d20 tx=0x7ffacc00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/535207044 shutdown_connections 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 --2- 172.21.15.120:0/535207044 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9ac03c780 0x7ff9ac03ec40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 --2- 172.21.15.120:0/535207044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa54dac20 0x556aa54db040 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/535207044 >> 172.21.15.120:0/535207044 conn(0x556aa54cefd0 msgr2=0x556aa54cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/535207044 shutdown_connections 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.901+0000 7ffad8125800 1 -- 172.21.15.120:0/535207044 wait complete. 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54c8380 msgr2=0x556aa54ca7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54c8380 0x556aa54ca7f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa53ca020 msgr2=0x556aa54c7590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa53ca020 0x556aa54c7590 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9bc03c780 msgr2=0x7ff9bc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9bc03c780 0x7ff9bc03ec40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffabc000c00 tx=0x7ffabc0013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 msgr2=0x556aa54bff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa54bff40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffac400a470 tx=0x7ffac4002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 shutdown_connections 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556aa54c8380 0x556aa54ca7f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556aa53ca020 0x556aa54c7590 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff9bc03c780 0x7ff9bc03ec40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 --2- 172.21.15.120:0/2655176823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556aa53c7600 0x556aa54bff40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 >> 172.21.15.120:0/2655176823 conn(0x556aa53c11c0 msgr2=0x556aa54b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 shutdown_connections 2024-09-07T03:32:55.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:55.902+0000 7ffad8125800 1 -- 172.21.15.120:0/2655176823 wait complete. 2024-09-07T03:32:55.911 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-07T03:32:55.920 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-07T03:32:55.925 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:55.953 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:55.965 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:56.009 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-07T03:32:56.014 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:56.014 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-07T03:32:56.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-07T03:32:56.015 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-07T03:32:56.060 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:56.060 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:56.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc578b33800 1 Processor -- start 2024-09-07T03:32:56.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc578b33800 1 -- start start 2024-09-07T03:32:56.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc578b33800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556c210812d0 0x556c21086e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc578b33800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556c20f29e40 con 0x556c21080000 2024-09-07T03:32:56.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc578b33800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x556c20ef4680 con 0x556c210812d0 2024-09-07T03:32:56.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc56ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556c210812d0 0x556c21086e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc57481a640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x556c21080000 0x556c21080bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41506/0 (socket says 172.21.15.120:41506) 2024-09-07T03:32:56.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc57481a640 1 -- 172.21.15.120:0/2006110000 learned_addr learned my addr 172.21.15.120:0/2006110000 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:56.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc56ffff640 1 -- 172.21.15.120:0/2006110000 >> v1:172.21.15.104:6789/0 conn(0x556c21080000 legacy=0x556c21080bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.060+0000 7fc56ffff640 1 -- 172.21.15.120:0/2006110000 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c20f106b0 con 0x556c210812d0 2024-09-07T03:32:56.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.062+0000 7fc56ffff640 1 --2- 172.21.15.120:0/2006110000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c210812d0 0x556c21086e70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc56000a470 tx=0x7fc560045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de95cdae7f9134bf server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.062+0000 7fc56f7fe640 1 -- 172.21.15.120:0/2006110000 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc560053570 con 0x556c210812d0 2024-09-07T03:32:56.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.062+0000 7fc56f7fe640 1 -- 172.21.15.120:0/2006110000 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560058070 con 0x556c210812d0 2024-09-07T03:32:56.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.062+0000 7fc56f7fe640 1 -- 172.21.15.120:0/2006110000 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc560053880 con 0x556c210812d0 2024-09-07T03:32:56.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.063+0000 7fc578b33800 1 -- 172.21.15.120:0/2006110000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c210812d0 msgr2=0x556c21086e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.063+0000 7fc578b33800 1 --2- 172.21.15.120:0/2006110000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c210812d0 0x556c21086e70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc56000a470 tx=0x7fc560045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:56.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.063+0000 7fc578b33800 1 -- 172.21.15.120:0/2006110000 shutdown_connections 2024-09-07T03:32:56.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.063+0000 7fc578b33800 1 --2- 172.21.15.120:0/2006110000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c210812d0 0x556c21086e70 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.063+0000 7fc578b33800 1 -- 172.21.15.120:0/2006110000 >> 172.21.15.120:0/2006110000 conn(0x556c2107b3d0 msgr2=0x556c2107d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.063+0000 7fc578b33800 1 -- 172.21.15.120:0/2006110000 shutdown_connections 2024-09-07T03:32:56.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.063+0000 7fc578b33800 1 -- 172.21.15.120:0/2006110000 wait complete. 2024-09-07T03:32:56.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.077+0000 7fc578b33800 1 Processor -- start 2024-09-07T03:32:56.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.077+0000 7fc578b33800 1 -- start start 2024-09-07T03:32:56.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.077+0000 7fc578b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c2116f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.077+0000 7fc578b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556c20f18dd0 con 0x556c21080000 2024-09-07T03:32:56.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.077+0000 7fc57481a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c2116f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.077+0000 7fc57481a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c2116f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58676/0 (socket says 172.21.15.120:58676) 2024-09-07T03:32:56.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.077+0000 7fc57481a640 1 -- 172.21.15.120:0/805405536 learned_addr learned my addr 172.21.15.120:0/805405536 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.077+0000 7fc57481a640 1 -- 172.21.15.120:0/805405536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c20f31e10 con 0x556c21080000 2024-09-07T03:32:56.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc57481a640 1 --2- 172.21.15.120:0/805405536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c2116f650 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc568001df0 tx=0x7fc56800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0ffa39c9ac6e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc462e05640 1 -- 172.21.15.120:0/805405536 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc568012020 con 0x556c21080000 2024-09-07T03:32:56.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc462e05640 1 -- 172.21.15.120:0/805405536 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56800e470 con 0x556c21080000 2024-09-07T03:32:56.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc462e05640 1 -- 172.21.15.120:0/805405536 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56800e7f0 con 0x556c21080000 2024-09-07T03:32:56.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc578b33800 1 -- 172.21.15.120:0/805405536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 msgr2=0x556c2116f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc578b33800 1 --2- 172.21.15.120:0/805405536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c2116f650 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc568001df0 tx=0x7fc56800b6c0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc578b33800 1 -- 172.21.15.120:0/805405536 shutdown_connections 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc578b33800 1 --2- 172.21.15.120:0/805405536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c2116f650 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc578b33800 1 -- 172.21.15.120:0/805405536 >> 172.21.15.120:0/805405536 conn(0x556c2107b3d0 msgr2=0x556c2116afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.078+0000 7fc578b33800 1 -- 172.21.15.120:0/805405536 shutdown_connections 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.079+0000 7fc578b33800 1 -- 172.21.15.120:0/805405536 wait complete. 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.079+0000 7fc578b33800 1 Processor -- start 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.079+0000 7fc578b33800 1 -- start start 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.079+0000 7fc578b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c20ff5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.079+0000 7fc578b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556c210819c0 con 0x556c21080000 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.079+0000 7fc57481a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c20ff5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.079+0000 7fc57481a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c20ff5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58692/0 (socket says 172.21.15.120:58692) 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.079+0000 7fc57481a640 1 -- 172.21.15.120:0/2084970858 learned_addr learned my addr 172.21.15.120:0/2084970858 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.079+0000 7fc57481a640 1 -- 172.21.15.120:0/2084970858 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c20ff5bd0 con 0x556c21080000 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.080+0000 7fc57481a640 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c20ff5670 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x556c211705e0 tx=0x7fc568000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.080+0000 7fc461602640 1 -- 172.21.15.120:0/2084970858 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc568012030 con 0x556c21080000 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.080+0000 7fc461602640 1 -- 172.21.15.120:0/2084970858 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc568001450 con 0x556c21080000 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.080+0000 7fc461602640 1 -- 172.21.15.120:0/2084970858 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56801a7a0 con 0x556c21080000 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.080+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c20ff3f80 con 0x556c21080000 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.080+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c20ff4540 con 0x556c21080000 2024-09-07T03:32:56.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.081+0000 7fc461602640 1 -- 172.21.15.120:0/2084970858 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc568015020 con 0x556c21080000 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.081+0000 7fc461602640 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc45c03c730 0x7fc45c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.081+0000 7fc461602640 1 -- 172.21.15.120:0/2084970858 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc568020030 con 0x556c21080000 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.081+0000 7fc56ffff640 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc45c03c730 0x7fc45c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.081+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c210812d0 0x556c21180500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.081+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c21180a80 con 0x556c210812d0 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.081+0000 7fc57501b640 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c210812d0 0x556c21180500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.081+0000 7fc56ffff640 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc45c03c730 0x7fc45c03ebf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc560057000 tx=0x7fc560052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.082+0000 7fc57501b640 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c210812d0 0x556c21180500 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.082+0000 7fc57501b640 1 -- 172.21.15.120:0/2084970858 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x556c210812d0 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.082+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c21181870 0x556c21183c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.082+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211842a0 con 0x556c21181870 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.082+0000 7fc57481a640 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c21181870 0x556c21183c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.082+0000 7fc57481a640 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c21181870 0x556c21183c60 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.083+0000 7fc57481a640 1 -- 172.21.15.120:0/2084970858 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc56801ab20 con 0x556c21181870 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.083+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c21185b50 con 0x556c21181870 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.083+0000 7fc57481a640 1 -- 172.21.15.120:0/2084970858 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc56801ab20 con 0x556c21181870 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.083+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c21184c90 con 0x556c21181870 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.083+0000 7fc57481a640 1 -- 172.21.15.120:0/2084970858 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc56801ab20 con 0x556c21181870 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.083+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211850b0 con 0x556c210812d0 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.084+0000 7fc57501b640 1 -- 172.21.15.120:0/2084970858 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc57000a4d0 con 0x556c210812d0 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.084+0000 7fc578b33800 1 Processor -- start 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.084+0000 7fc578b33800 1 -- start start 2024-09-07T03:32:56.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.084+0000 7fc578b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21194050 0x556c21194470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.084+0000 7fc578b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556c20f76a00 con 0x556c21194050 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.084+0000 7fc57501b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21194050 0x556c21194470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.084+0000 7fc57501b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21194050 0x556c21194470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58708/0 (socket says 172.21.15.120:58708) 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.084+0000 7fc57501b640 1 -- 172.21.15.120:0/1368178200 learned_addr learned my addr 172.21.15.120:0/1368178200 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.085+0000 7fc57501b640 1 -- 172.21.15.120:0/1368178200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c21194ab0 con 0x556c21194050 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.085+0000 7fc57501b640 1 --2- 172.21.15.120:0/1368178200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21194050 0x556c21194470 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc570016d60 tx=0x7fc57000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.085+0000 7fc45affd640 1 -- 172.21.15.120:0/1368178200 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc570017660 con 0x556c21194050 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.085+0000 7fc45affd640 1 -- 172.21.15.120:0/1368178200 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57001b030 con 0x556c21194050 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.085+0000 7fc578b33800 1 -- 172.21.15.120:0/1368178200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c211952e0 con 0x556c21194050 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.085+0000 7fc45affd640 1 -- 172.21.15.120:0/1368178200 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc570017950 con 0x556c21194050 2024-09-07T03:32:56.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.085+0000 7fc578b33800 1 -- 172.21.15.120:0/1368178200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c21195880 con 0x556c21194050 2024-09-07T03:32:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.086+0000 7fc45affd640 1 -- 172.21.15.120:0/1368178200 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc570017af0 con 0x556c21194050 2024-09-07T03:32:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.086+0000 7fc45affd640 1 --2- 172.21.15.120:0/1368178200 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc44c03c780 0x7fc44c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.086+0000 7fc45affd640 1 -- 172.21.15.120:0/1368178200 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc57000e040 con 0x556c21194050 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.086+0000 7fc57481a640 1 --2- 172.21.15.120:0/1368178200 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc44c03c780 0x7fc44c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.086+0000 7fc578b33800 1 Processor -- start 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.086+0000 7fc578b33800 1 -- start start 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.086+0000 7fc57481a640 1 --2- 172.21.15.120:0/1368178200 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc44c03c780 0x7fc44c03ec40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x556c211847b0 tx=0x7fc568043050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc578b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc578b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556c2116fea0 con 0x556c211a0ab0 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc57501b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc57501b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58724/0 (socket says 172.21.15.120:58724) 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc57501b640 1 -- 172.21.15.120:0/113271390 learned_addr learned my addr 172.21.15.120:0/113271390 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc57501b640 1 -- 172.21.15.120:0/113271390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c211a1480 con 0x556c211a0ab0 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc57501b640 1 --2- 172.21.15.120:0/113271390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a0e90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc570053df0 tx=0x7fc570054040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acd5bfa556f29a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc458ff9640 1 -- 172.21.15.120:0/113271390 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc570025070 con 0x556c211a0ab0 2024-09-07T03:32:56.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc458ff9640 1 -- 172.21.15.120:0/113271390 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57001fde0 con 0x556c211a0ab0 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.087+0000 7fc458ff9640 1 -- 172.21.15.120:0/113271390 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc570028dc0 con 0x556c211a0ab0 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 -- 172.21.15.120:0/113271390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 msgr2=0x556c211a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 --2- 172.21.15.120:0/113271390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a0e90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc570053df0 tx=0x7fc570054040 comp rx=0 tx=0).stop 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 -- 172.21.15.120:0/113271390 shutdown_connections 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 --2- 172.21.15.120:0/113271390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a0e90 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 -- 172.21.15.120:0/113271390 >> 172.21.15.120:0/113271390 conn(0x556c2119ceb0 msgr2=0x556c2119b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 -- 172.21.15.120:0/113271390 shutdown_connections 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 -- 172.21.15.120:0/113271390 wait complete. 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 Processor -- start 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 -- start start 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc578b33800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556c211a1ac0 con 0x556c211a0ab0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc57501b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc57501b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58730/0 (socket says 172.21.15.120:58730) 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 learned_addr learned my addr 172.21.15.120:0/1794025666 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.088+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c211a8600 con 0x556c211a0ab0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.089+0000 7fc57501b640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a80a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc570013550 tx=0x7fc570053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.089+0000 7fc4527fc640 1 -- 172.21.15.120:0/1794025666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc570028350 con 0x556c211a0ab0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.089+0000 7fc4527fc640 1 -- 172.21.15.120:0/1794025666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570055240 con 0x556c211a0ab0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.089+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c211a8890 con 0x556c211a0ab0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.089+0000 7fc4527fc640 1 -- 172.21.15.120:0/1794025666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700284f0 con 0x556c211a0ab0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.089+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c211a9210 con 0x556c211a0ab0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.089+0000 7fc4527fc640 1 -- 172.21.15.120:0/1794025666 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc570055430 con 0x556c211a0ab0 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.090+0000 7fc4527fc640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc43c03c780 0x7fc43c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.090+0000 7fc4527fc640 1 -- 172.21.15.120:0/1794025666 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc570055040 con 0x556c211a0ab0 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.090+0000 7fc57481a640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc43c03c780 0x7fc43c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.090+0000 7fc57481a640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc43c03c780 0x7fc43c03ec40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc56801a6a0 tx=0x7fc568049000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.090+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.090+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c211b3a20 0x556c211b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.090+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211b6630 con 0x556c211b3a20 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.090+0000 7fc56ffff640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c211b3a20 0x556c211b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc56ffff640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c211b3a20 0x556c211b5ee0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 20 realm 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211b6a60 con 0x556c211b3a20 2024-09-07T03:32:56.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211b7330 con 0x556c211b3a20 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c211b7d50 0x556c211ba180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.091+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211ba8f0 con 0x556c211b7d50 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc57501b640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c211b7d50 0x556c211ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc57501b640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c211b7d50 0x556c211ba180 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc578b33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211bb140 con 0x556c211b7d50 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc578b33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc578b33800 20 searching for the correct realm 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556c211bceb0 0x556c211bf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.092+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211bceb0 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.093+0000 7fc57481a640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556c211bceb0 0x556c211bf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.093+0000 7fc57481a640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556c211bceb0 0x556c211bf2e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.093+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.093+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b7d50 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.093+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.093+0000 7fc57501b640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc570055720 0x7fc57002a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.093+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x7fc570055720 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.094+0000 7fc56ffff640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc570055720 0x7fc57002a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.094+0000 7fc56ffff640 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc570055720 0x7fc57002a990 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.094+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.094+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b3a20 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.094+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.094+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b3a20 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.094+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.094+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211bceb0 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.095+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.095+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b3a20 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.095+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.095+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b7d50 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.095+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.095+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b7d50 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.095+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.095+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b3a20 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.096+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.096+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x7fc570055720 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.096+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.096+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b3a20 2024-09-07T03:32:56.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.096+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.096+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x7fc570055720 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.096+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.096+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b7d50 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.097+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.097+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211bceb0 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.097+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.097+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b3a20 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.097+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.097+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b7d50 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.097+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.097+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211bceb0 2024-09-07T03:32:56.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.098+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.098+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b3a20 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.098+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.098+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b3a20 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.098+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.098+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b3a20 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.098+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.098+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211bceb0 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x7fc570055720 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x7fc570055720 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x7fc570055720 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211bceb0 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.099+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x7fc570055720 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.100+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.100+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b7d50 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.100+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.100+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b7d50 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.100+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.100+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211bceb0 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.100+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.100+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b7d50 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556c211bf9b0 con 0x556c211b7d50 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:56.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211bbac0 con 0x556c211b3a20 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211bb6a0 con 0x556c211b7d50 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.101+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211bc430 con 0x556c211b3a20 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 zone default found 2024-09-07T03:32:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 4 Realm: () 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 zonegroup default 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211c02e0 con 0x7fc570055720 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211c2520 con 0x556c211bceb0 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211c28c0 con 0x556c211bceb0 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 started sync module instance, tier type = 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.102+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c1960 con 0x556c211b7d50 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.104+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.104+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93922900319872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c1960 con 0x556c211b7d50 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.104+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c3280 con 0x556c211b3a20 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.105+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93922900319872] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.105+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.105+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93922900317360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c18d0 con 0x556c211b3a20 2024-09-07T03:32:56.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.105+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c4140 con 0x556c211b7d50 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.106+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.106+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93922900317360] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.106+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93922900326000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c4140 con 0x556c211b7d50 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.106+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c4b40 con 0x7fc570055720 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.107+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93922900326000] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.107+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.107+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93922900330064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c4140 con 0x7fc570055720 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.107+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c5590 con 0x556c211b7d50 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.108+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93922900330064] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.108+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.108+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93922900332704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c4140 con 0x556c211b7d50 2024-09-07T03:32:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.108+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c5fd0 con 0x556c211bceb0 2024-09-07T03:32:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.109+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.109+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93922900332704] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.109+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93922900327568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c40b0 con 0x556c211bceb0 2024-09-07T03:32:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.109+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c6e40 con 0x556c211bceb0 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.110+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93922900327568] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.110+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.110+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93922900339088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c6db0 con 0x556c211bceb0 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.110+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c7d00 con 0x7fc570055720 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93922900339088] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93922900341296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c7d00 con 0x7fc570055720 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc578b33800 20 add_watcher() i=0 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc578b33800 20 add_watcher() i=1 2024-09-07T03:32:56.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc578b33800 20 add_watcher() i=2 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc578b33800 20 add_watcher() i=3 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc578b33800 20 add_watcher() i=4 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc578b33800 20 add_watcher() i=5 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.111+0000 7fc578b33800 20 add_watcher() i=6 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.112+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93922900341296] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.112+0000 7fc578b33800 20 add_watcher() i=7 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.112+0000 7fc578b33800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.112+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211cb1b0 con 0x556c211b3a20 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.113+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.113+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93922900343328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c211c8700 con 0x556c211b3a20 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.114+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93922900343328] v36'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.114+0000 7fc42b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.114+0000 7fc578b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:56.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.114+0000 7fc578b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.114+0000 7fc578b33800 5 note: GC not initialized 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.114+0000 7fc42a7dc640 20 reqs_thread_entry: start 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.114+0000 7fc578b33800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.114+0000 7fc578b33800 20 Filter name: none 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.114+0000 7fc39bfff640 20 reqs_thread_entry: start 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc578b33800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c211fe870 con 0x7fc570055720 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc578b33800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc578b33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc578b33800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:56.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc578b33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 : miss 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc578b33800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.115+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:63 8.10 8:0f1ebb75:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c212002d0 con 0x556c211b7d50 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(63 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 info.flags=0x17 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 to cache LRU end 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 20 get_obj_state: octx=0x7fc560053530 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x556c21202488 s->prefetch_data=0 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 3.5s0 3:a0a014a4:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x556c211b7d50 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 10 manifest: total_size = 5 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.116+0000 7fc578b33800 20 get_obj_state: setting s->obj_tag to _cOlG70luWAOJGTTDxMbr7fyUanOM2jW 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.117+0000 7fc42b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.117+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93922900343328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x556c211b3a20 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.118+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93922900343328] v36'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.118+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93922900319872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x556c211b7d50 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.119+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93922900319872] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.119+0000 7fc578b33800 20 remove_watcher() i=0 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.119+0000 7fc578b33800 2 removed watcher, disabling cache 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.119+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93922900317360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x556c211b3a20 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.120+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93922900317360] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc560051070 con 0x556c211b3a20 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.120+0000 7fc578b33800 20 remove_watcher() i=1 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.120+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93922900326000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x556c211b7d50 2024-09-07T03:32:56.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.121+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93922900326000] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.121+0000 7fc578b33800 20 remove_watcher() i=2 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.121+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93922900330064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x7fc570055720 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.122+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93922900330064] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.122+0000 7fc578b33800 20 remove_watcher() i=3 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.122+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93922900332704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x556c211b7d50 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.123+0000 7fc57501b640 1 -- 172.21.15.120:0/1794025666 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93922900332704] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57003a070 con 0x556c211b7d50 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.123+0000 7fc578b33800 20 remove_watcher() i=4 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.123+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93922900327568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x556c211bceb0 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.124+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93922900327568] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.124+0000 7fc578b33800 20 remove_watcher() i=5 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.124+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93922900339088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x556c211bceb0 2024-09-07T03:32:56.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.125+0000 7fc57481a640 1 -- 172.21.15.120:0/1794025666 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93922900339088] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568047070 con 0x556c211bceb0 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.125+0000 7fc578b33800 20 remove_watcher() i=6 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.125+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93922900341296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556c212035a0 con 0x7fc570055720 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93922900341296] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc560051070 con 0x7fc570055720 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 20 remove_watcher() i=7 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c211b7d50 msgr2=0x556c211ba180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c211b7d50 0x556c211ba180 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c211b3a20 msgr2=0x556c211b5ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c211b3a20 0x556c211b5ee0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc570055720 msgr2=0x7fc57002a990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc570055720 0x7fc57002a990 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556c211bceb0 msgr2=0x556c211bf2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556c211bceb0 0x556c211bf2e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc43c03c780 msgr2=0x7fc43c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc43c03c780 0x7fc43c03ec40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc56801a6a0 tx=0x7fc568049000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc56ffff640 1 -- 172.21.15.120:0/1794025666 reap_dead start 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 msgr2=0x556c211a80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.126+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a80a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc570013550 tx=0x7fc570053d50 comp rx=0 tx=0).stop 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 shutdown_connections 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 --2- 172.21.15.120:0/1794025666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c211a0ab0 0x556c211a80a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 >> 172.21.15.120:0/1794025666 conn(0x556c2119ceb0 msgr2=0x556c2119b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 shutdown_connections 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1794025666 wait complete. 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1368178200 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc44c03c780 msgr2=0x7fc44c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 --2- 172.21.15.120:0/1368178200 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc44c03c780 0x7fc44c03ec40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x556c211847b0 tx=0x7fc568043050 comp rx=0 tx=0).stop 2024-09-07T03:32:56.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1368178200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21194050 msgr2=0x556c21194470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 --2- 172.21.15.120:0/1368178200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21194050 0x556c21194470 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc570016d60 tx=0x7fc57000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1368178200 shutdown_connections 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 --2- 172.21.15.120:0/1368178200 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc44c03c780 0x7fc44c03ec40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 --2- 172.21.15.120:0/1368178200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21194050 0x556c21194470 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1368178200 >> 172.21.15.120:0/1368178200 conn(0x556c21188400 msgr2=0x556c211887e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1368178200 shutdown_connections 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.127+0000 7fc578b33800 1 -- 172.21.15.120:0/1368178200 wait complete. 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c21181870 msgr2=0x556c21183c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c21181870 0x556c21183c60 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c210812d0 msgr2=0x556c21180500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c210812d0 0x556c21180500 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc45c03c730 msgr2=0x7fc45c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc45c03c730 0x7fc45c03ebf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc560057000 tx=0x7fc560052000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 msgr2=0x556c20ff5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c20ff5670 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x556c211705e0 tx=0x7fc568000bc0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 shutdown_connections 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556c21181870 0x556c21183c60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556c210812d0 0x556c21180500 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc45c03c730 0x7fc45c03ebf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 --2- 172.21.15.120:0/2084970858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556c21080000 0x556c20ff5670 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 >> 172.21.15.120:0/2084970858 conn(0x556c2107b3d0 msgr2=0x556c21170930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 shutdown_connections 2024-09-07T03:32:56.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.128+0000 7fc578b33800 1 -- 172.21.15.120:0/2084970858 wait complete. 2024-09-07T03:32:56.146 INFO:teuthology.orchestra.run.smithi120.stdout:fooFoofooFooFULL_CONTROL 2024-09-07T03:32:56.147 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-07T03:32:56.149 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-07T03:32:56.154 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:56.154 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-07T03:32:56.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-07T03:32:56.154 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-07T03:32:56.200 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:56.200 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:56.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.199+0000 7f96e9519800 1 Processor -- start 2024-09-07T03:32:56.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.199+0000 7f96e9519800 1 -- start start 2024-09-07T03:32:56.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.199+0000 7f96e9519800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56014f12fe00 0x56014f130b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.199+0000 7f96e9519800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56014efdae40 con 0x56014f131040 2024-09-07T03:32:56.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.200+0000 7f96e9519800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56014efa5680 con 0x56014f12fe00 2024-09-07T03:32:56.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.200+0000 7f96e700a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56014f12fe00 0x56014f130b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.200+0000 7f96de809640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x56014f131040 0x56014f135da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41508/0 (socket says 172.21.15.120:41508) 2024-09-07T03:32:56.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.200+0000 7f96de809640 1 -- 172.21.15.120:0/3103338886 learned_addr learned my addr 172.21.15.120:0/3103338886 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:56.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.200+0000 7f96e700a640 1 -- 172.21.15.120:0/3103338886 >> v1:172.21.15.104:6789/0 conn(0x56014f131040 legacy=0x56014f135da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.200+0000 7f96e700a640 1 -- 172.21.15.120:0/3103338886 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014efc16b0 con 0x56014f12fe00 2024-09-07T03:32:56.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.202+0000 7f96e700a640 1 --2- 172.21.15.120:0/3103338886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f130b00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f96d800a600 tx=0x7f96d8047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fb714e23abb089 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.202+0000 7f96e6809640 1 -- 172.21.15.120:0/3103338886 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d8056070 con 0x56014f12fe00 2024-09-07T03:32:56.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.202+0000 7f96e6809640 1 -- 172.21.15.120:0/3103338886 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d800a200 con 0x56014f12fe00 2024-09-07T03:32:56.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.202+0000 7f96e6809640 1 -- 172.21.15.120:0/3103338886 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d8008590 con 0x56014f12fe00 2024-09-07T03:32:56.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.202+0000 7f96e9519800 1 -- 172.21.15.120:0/3103338886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 msgr2=0x56014f130b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.202+0000 7f96e9519800 1 --2- 172.21.15.120:0/3103338886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f130b00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f96d800a600 tx=0x7f96d8047cb0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.203+0000 7f96e9519800 1 -- 172.21.15.120:0/3103338886 shutdown_connections 2024-09-07T03:32:56.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.203+0000 7f96e9519800 1 --2- 172.21.15.120:0/3103338886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f130b00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.203+0000 7f96e9519800 1 -- 172.21.15.120:0/3103338886 >> 172.21.15.120:0/3103338886 conn(0x56014f12b1d0 msgr2=0x56014f12d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.203+0000 7f96e9519800 1 -- 172.21.15.120:0/3103338886 shutdown_connections 2024-09-07T03:32:56.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.203+0000 7f96e9519800 1 -- 172.21.15.120:0/3103338886 wait complete. 2024-09-07T03:32:56.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.216+0000 7f96e9519800 1 Processor -- start 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.216+0000 7f96e9519800 1 -- start start 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.216+0000 7f96e9519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f21e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.216+0000 7f96e9519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56014efc9dd0 con 0x56014f12fe00 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.217+0000 7f96e700a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f21e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.217+0000 7f96e700a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f21e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58750/0 (socket says 172.21.15.120:58750) 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.217+0000 7f96e700a640 1 -- 172.21.15.120:0/4257266674 learned_addr learned my addr 172.21.15.120:0/4257266674 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.217+0000 7f96e700a640 1 -- 172.21.15.120:0/4257266674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014efe2e10 con 0x56014f12fe00 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.217+0000 7f96e700a640 1 --2- 172.21.15.120:0/4257266674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f21e4d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f96d8027ae0 tx=0x7f96d8053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60cb2c53f29d795 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.217+0000 7f95d560a640 1 -- 172.21.15.120:0/4257266674 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d8009810 con 0x56014f12fe00 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.217+0000 7f95d560a640 1 -- 172.21.15.120:0/4257266674 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d80099b0 con 0x56014f12fe00 2024-09-07T03:32:56.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.217+0000 7f95d560a640 1 -- 172.21.15.120:0/4257266674 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d8009cb0 con 0x56014f12fe00 2024-09-07T03:32:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.218+0000 7f96e9519800 1 -- 172.21.15.120:0/4257266674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 msgr2=0x56014f21e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.218+0000 7f96e9519800 1 --2- 172.21.15.120:0/4257266674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f21e4d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f96d8027ae0 tx=0x7f96d8053000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.218+0000 7f96e9519800 1 -- 172.21.15.120:0/4257266674 shutdown_connections 2024-09-07T03:32:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.218+0000 7f96e9519800 1 --2- 172.21.15.120:0/4257266674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f21e4d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.218+0000 7f96e9519800 1 -- 172.21.15.120:0/4257266674 >> 172.21.15.120:0/4257266674 conn(0x56014f12b1d0 msgr2=0x56014f219e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.218+0000 7f96e9519800 1 -- 172.21.15.120:0/4257266674 shutdown_connections 2024-09-07T03:32:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.218+0000 7f96e9519800 1 -- 172.21.15.120:0/4257266674 wait complete. 2024-09-07T03:32:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.218+0000 7f96e9519800 1 Processor -- start 2024-09-07T03:32:56.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.218+0000 7f96e9519800 1 -- start start 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.219+0000 7f96e9519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f22a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.219+0000 7f96e9519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56014f131730 con 0x56014f12fe00 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.219+0000 7f96e700a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f22a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.219+0000 7f96e700a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f22a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58754/0 (socket says 172.21.15.120:58754) 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.219+0000 7f96e700a640 1 -- 172.21.15.120:0/1789079182 learned_addr learned my addr 172.21.15.120:0/1789079182 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.219+0000 7f96e700a640 1 -- 172.21.15.120:0/1789079182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014f22a6e0 con 0x56014f12fe00 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.219+0000 7f96e700a640 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f22a180 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f96d800a1d0 tx=0x7f96d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.220+0000 7f95d3e07640 1 -- 172.21.15.120:0/1789079182 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d8009240 con 0x56014f12fe00 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.220+0000 7f95d3e07640 1 -- 172.21.15.120:0/1789079182 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d80093e0 con 0x56014f12fe00 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.220+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56014f22a970 con 0x56014f12fe00 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.220+0000 7f95d3e07640 1 -- 172.21.15.120:0/1789079182 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96d8052670 con 0x56014f12fe00 2024-09-07T03:32:56.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.220+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56014f22b580 con 0x56014f12fe00 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.220+0000 7f95d3e07640 1 -- 172.21.15.120:0/1789079182 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f96d8059070 con 0x56014f12fe00 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.221+0000 7f95d3e07640 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95cc03c780 0x7f95cc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.221+0000 7f95d3e07640 1 -- 172.21.15.120:0/1789079182 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f96d8062070 con 0x56014f12fe00 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.221+0000 7f96de809640 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95cc03c780 0x7f95cc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.221+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f131040 0x56014f2317d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.221+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f231d10 con 0x56014f131040 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.221+0000 7f96e780b640 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f131040 0x56014f2317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.221+0000 7f96de809640 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95cc03c780 0x7f95cc03ec40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96d0001d70 tx=0x7f96d00012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.221+0000 7f96e780b640 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f131040 0x56014f2317d0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.222+0000 7f96e780b640 1 -- 172.21.15.120:0/1789079182 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96e000a4d0 con 0x56014f131040 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.222+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f2325c0 0x56014f234a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.222+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f2351c0 con 0x56014f2325c0 2024-09-07T03:32:56.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.222+0000 7f96e700a640 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f2325c0 0x56014f234a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.222+0000 7f96e700a640 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f2325c0 0x56014f234a50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.222+0000 7f96e700a640 1 -- 172.21.15.120:0/1789079182 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f96d806b070 con 0x56014f2325c0 2024-09-07T03:32:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.222+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f236a70 con 0x56014f2325c0 2024-09-07T03:32:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.223+0000 7f96e700a640 1 -- 172.21.15.120:0/1789079182 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f96d806b070 con 0x56014f2325c0 2024-09-07T03:32:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.223+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f235af0 con 0x56014f2325c0 2024-09-07T03:32:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.223+0000 7f96e700a640 1 -- 172.21.15.120:0/1789079182 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f96d806b070 con 0x56014f2325c0 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.223+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f235f50 con 0x56014f131040 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.223+0000 7f96e780b640 1 -- 172.21.15.120:0/1789079182 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f96e000a4d0 con 0x56014f131040 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.224+0000 7f96e9519800 1 Processor -- start 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.224+0000 7f96e9519800 1 -- start start 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.224+0000 7f96e9519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f244f50 0x56014f245370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.224+0000 7f96e9519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56014f027a00 con 0x56014f244f50 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.224+0000 7f96e780b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f244f50 0x56014f245370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.224+0000 7f96e780b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f244f50 0x56014f245370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58762/0 (socket says 172.21.15.120:58762) 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.224+0000 7f96e780b640 1 -- 172.21.15.120:0/2510541498 learned_addr learned my addr 172.21.15.120:0/2510541498 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.224+0000 7f96e780b640 1 -- 172.21.15.120:0/2510541498 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014f2459b0 con 0x56014f244f50 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.225+0000 7f96e780b640 1 --2- 172.21.15.120:0/2510541498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f244f50 0x56014f245370 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f96e0016d20 tx=0x7f96e000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.225+0000 7f95d1602640 1 -- 172.21.15.120:0/2510541498 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0017660 con 0x56014f244f50 2024-09-07T03:32:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.225+0000 7f95d1602640 1 -- 172.21.15.120:0/2510541498 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e001b030 con 0x56014f244f50 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.225+0000 7f95d1602640 1 -- 172.21.15.120:0/2510541498 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0017950 con 0x56014f244f50 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.225+0000 7f96e9519800 1 -- 172.21.15.120:0/2510541498 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56014f2461e0 con 0x56014f244f50 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.225+0000 7f96e9519800 1 -- 172.21.15.120:0/2510541498 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56014f246780 con 0x56014f244f50 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.225+0000 7f95d1602640 1 -- 172.21.15.120:0/2510541498 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f96e0017af0 con 0x56014f244f50 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f95d1602640 1 --2- 172.21.15.120:0/2510541498 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95c003c780 0x7f95c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f95d1602640 1 -- 172.21.15.120:0/2510541498 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f96e000e040 con 0x56014f244f50 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f96e700a640 1 --2- 172.21.15.120:0/2510541498 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95c003c780 0x7f95c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f96e9519800 1 Processor -- start 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f96e700a640 1 --2- 172.21.15.120:0/2510541498 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95c003c780 0x7f95c003ec40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x56014f22b980 tx=0x7f96d8084040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f96e9519800 1 -- start start 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f96e9519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f251dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f96e9519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56014f21ec60 con 0x56014f2519d0 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f96e780b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f251dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f96e780b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f251dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58776/0 (socket says 172.21.15.120:58776) 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.226+0000 7f96e780b640 1 -- 172.21.15.120:0/3949926024 learned_addr learned my addr 172.21.15.120:0/3949926024 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f96e780b640 1 -- 172.21.15.120:0/3949926024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014f2523c0 con 0x56014f2519d0 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f96e780b640 1 --2- 172.21.15.120:0/3949926024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f251dd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f96e0054030 tx=0x7f96e0054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c75a1cbabccea49 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f95caffd640 1 -- 172.21.15.120:0/3949926024 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0014e70 con 0x56014f2519d0 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f95caffd640 1 -- 172.21.15.120:0/3949926024 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e0055040 con 0x56014f2519d0 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f95caffd640 1 -- 172.21.15.120:0/3949926024 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0014b00 con 0x56014f2519d0 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f96e9519800 1 -- 172.21.15.120:0/3949926024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 msgr2=0x56014f251dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f96e9519800 1 --2- 172.21.15.120:0/3949926024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f251dd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f96e0054030 tx=0x7f96e0054060 comp rx=0 tx=0).stop 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f96e9519800 1 -- 172.21.15.120:0/3949926024 shutdown_connections 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f96e9519800 1 --2- 172.21.15.120:0/3949926024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f251dd0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f96e9519800 1 -- 172.21.15.120:0/3949926024 >> 172.21.15.120:0/3949926024 conn(0x56014f24ddd0 msgr2=0x56014f24c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f96e9519800 1 -- 172.21.15.120:0/3949926024 shutdown_connections 2024-09-07T03:32:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.227+0000 7f96e9519800 1 -- 172.21.15.120:0/3949926024 wait complete. 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e9519800 1 Processor -- start 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e9519800 1 -- start start 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e9519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f258f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e9519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56014f2529b0 con 0x56014f2519d0 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e780b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f258f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e780b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f258f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58790/0 (socket says 172.21.15.120:58790) 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 learned_addr learned my addr 172.21.15.120:0/1550116606 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014f259480 con 0x56014f2519d0 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e780b640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f258f20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f96e0053d10 tx=0x7f96e0053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f95c97fa640 1 -- 172.21.15.120:0/1550116606 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0012570 con 0x56014f2519d0 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f95c97fa640 1 -- 172.21.15.120:0/1550116606 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e00127a0 con 0x56014f2519d0 2024-09-07T03:32:56.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56014f259710 con 0x56014f2519d0 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.228+0000 7f95c97fa640 1 -- 172.21.15.120:0/1550116606 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e0012b20 con 0x56014f2519d0 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.229+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56014f25a2a0 con 0x56014f2519d0 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.229+0000 7f95c97fa640 1 -- 172.21.15.120:0/1550116606 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f96e0012cc0 con 0x56014f2519d0 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.229+0000 7f95c97fa640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95b003c780 0x7f95b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.230+0000 7f95c97fa640 1 -- 172.21.15.120:0/1550116606 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f96e0048940 con 0x56014f2519d0 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.230+0000 7f96e700a640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95b003c780 0x7f95b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.230+0000 7f96e700a640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95b003c780 0x7f95b003ec40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96d80823f0 tx=0x7f96d808e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.230+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.230+0000 7f96e9519800 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f264a80 0x56014f266f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.230+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f267690 con 0x56014f264a80 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.230+0000 7f96de809640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f264a80 0x56014f266f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96de809640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f264a80 0x56014f266f40 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96d0009050 con 0x56014f264a80 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 20 realm 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f263dd0 con 0x56014f264a80 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96d0009050 con 0x56014f264a80 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f268180 con 0x56014f264a80 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96d0009050 con 0x56014f264a80 2024-09-07T03:32:56.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f268f60 0x56014f26b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.231+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f26ba20 con 0x56014f268f60 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e780b640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f268f60 0x56014f26b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e780b640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f268f60 0x56014f26b350 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e9519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f26c270 con 0x56014f268f60 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e9519800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:56.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e9519800 20 searching for the correct realm 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e9519800 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56014f26dfe0 0x56014f270410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f26dfe0 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.232+0000 7f96e700a640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56014f26dfe0 0x56014f270410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.233+0000 7f96e700a640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56014f26dfe0 0x56014f270410 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.233+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.233+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f268f60 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.234+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.234+0000 7f96e780b640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f96e0014440 0x7f96e0042a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.234+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x7f96e0014440 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.234+0000 7f96de809640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f96e0014440 0x7f96e0042a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.234+0000 7f96de809640 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f96e0014440 0x7f96e0042a30 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.234+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0009050 con 0x7f96e0014440 2024-09-07T03:32:56.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.234+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f264a80 2024-09-07T03:32:56.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.234+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0009050 con 0x56014f264a80 2024-09-07T03:32:56.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.234+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f264a80 2024-09-07T03:32:56.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.235+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.235+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f26dfe0 2024-09-07T03:32:56.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.235+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.235+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f264a80 2024-09-07T03:32:56.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.235+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.235+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f268f60 2024-09-07T03:32:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.235+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.235+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f268f60 2024-09-07T03:32:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.236+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.236+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f264a80 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.236+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.236+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x7f96e0014440 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.236+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.236+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f264a80 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.236+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.236+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x7f96e0014440 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.237+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.237+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f268f60 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.237+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.237+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f26dfe0 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.237+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.237+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f264a80 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.237+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.237+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f268f60 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.238+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.238+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f26dfe0 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.238+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.238+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f264a80 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.238+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.238+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f264a80 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.238+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.238+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f264a80 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f26dfe0 2024-09-07T03:32:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x7f96e0014440 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x7f96e0014440 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x7f96e0014440 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.239+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f26dfe0 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.240+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.240+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x7f96e0014440 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.240+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.240+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f268f60 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.240+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.240+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f268f60 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.241+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.241+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f26dfe0 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.241+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.241+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f268f60 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.241+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56014f270ae0 con 0x56014f268f60 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:56.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f26cbf0 con 0x56014f264a80 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f26c830 con 0x56014f268f60 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f26d030 con 0x56014f264a80 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:56.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 20 zone default found 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.242+0000 7f96e9519800 4 Realm: () 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 20 zonegroup default 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f271410 con 0x7f96e0014440 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f273650 con 0x56014f26dfe0 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f2739f0 con 0x56014f26dfe0 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 20 started sync module instance, tier type = 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.243+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f272ae0 con 0x56014f268f60 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.245+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.245+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94563622924304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f272ae0 con 0x56014f268f60 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.245+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f274440 con 0x56014f264a80 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.246+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94563622924304] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.246+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.246+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94563622928176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f272ae0 con 0x56014f264a80 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.246+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f274f00 con 0x56014f268f60 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.247+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94563622928176] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.247+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.247+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94563622930896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f272ae0 con 0x56014f268f60 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.247+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f275990 con 0x7f96e0014440 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.248+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94563622930896] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.248+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.248+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94563622933600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f272ae0 con 0x7f96e0014440 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.248+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2763e0 con 0x56014f268f60 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.249+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94563622933600] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.250+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.250+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94563622936304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f272ae0 con 0x56014f268f60 2024-09-07T03:32:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.250+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f276e30 con 0x56014f26dfe0 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.251+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.251+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94563622938944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2776d0 con 0x56014f26dfe0 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.251+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f278140 con 0x56014f26dfe0 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.251+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94563622936304] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.252+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94563622938944] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.252+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.252+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94563622941216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f272630 con 0x56014f26dfe0 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.252+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f278a20 con 0x7f96e0014440 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94563622941216] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94563622943760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2789e0 con 0x7f96e0014440 2024-09-07T03:32:56.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96e9519800 20 add_watcher() i=0 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96e9519800 20 add_watcher() i=1 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96e9519800 20 add_watcher() i=2 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96e9519800 20 add_watcher() i=3 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96e9519800 20 add_watcher() i=4 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96e9519800 20 add_watcher() i=5 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.253+0000 7f96e9519800 20 add_watcher() i=6 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.254+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94563622943760] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.254+0000 7f96e9519800 20 add_watcher() i=7 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.254+0000 7f96e9519800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.254+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f27bed0 con 0x56014f264a80 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.254+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.254+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94563622946560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f279420 con 0x56014f264a80 2024-09-07T03:32:56.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.255+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94563622946560] v36'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f959dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96e9519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96e9519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96e9519800 5 note: GC not initialized 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f959cfe1640 20 reqs_thread_entry: start 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96e9519800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96e9519800 20 Filter name: none 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f95167fc640 20 reqs_thread_entry: start 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96e9519800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f2af560 con 0x7f96e0014440 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.256+0000 7f96e9519800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:56.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 : miss 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:63 8.10 8:0f1ebb75:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b0fc0 con 0x56014f268f60 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(63 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 info.flags=0x17 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 to cache LRU end 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 20 get_obj_state: octx=0x56014f251dd0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56014f2b3178 s->prefetch_data=0 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 3.5s0 3:a0a014a4:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x56014f268f60 2024-09-07T03:32:56.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 10 manifest: total_size = 5 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.257+0000 7f96e9519800 20 get_obj_state: setting s->obj_tag to _VBMAlrsm1rPeXuv1v8bnPy4MZ4Ol4Ic 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.258+0000 7f959dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.258+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94563622946560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x56014f264a80 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.259+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94563622946560] v36'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.259+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94563622924304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x56014f268f60 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.260+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94563622924304] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.260+0000 7f96e9519800 20 remove_watcher() i=0 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.260+0000 7f96e9519800 2 removed watcher, disabling cache 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.260+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94563622928176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x56014f264a80 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.261+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94563622928176] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x56014f264a80 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.261+0000 7f96e9519800 20 remove_watcher() i=1 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.261+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94563622930896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x56014f268f60 2024-09-07T03:32:56.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.262+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94563622930896] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.262+0000 7f96e9519800 20 remove_watcher() i=2 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.262+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94563622933600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x7f96e0014440 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.263+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94563622933600] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.263+0000 7f96e9519800 20 remove_watcher() i=3 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.263+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94563622936304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x56014f268f60 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.264+0000 7f96e780b640 1 -- 172.21.15.120:0/1550116606 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94563622936304] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e0027070 con 0x56014f268f60 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.264+0000 7f96e9519800 20 remove_watcher() i=4 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.264+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94563622938944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x56014f26dfe0 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.265+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94563622938944] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.265+0000 7f96e9519800 20 remove_watcher() i=5 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.265+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94563622941216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x56014f26dfe0 2024-09-07T03:32:56.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.266+0000 7f96e700a640 1 -- 172.21.15.120:0/1550116606 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94563622941216] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d806b070 con 0x56014f26dfe0 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.266+0000 7f96e9519800 20 remove_watcher() i=6 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.266+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94563622943760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56014f2b42a0 con 0x7f96e0014440 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94563622943760] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96d0028040 con 0x7f96e0014440 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 20 remove_watcher() i=7 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f268f60 msgr2=0x56014f26b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f268f60 0x56014f26b350 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f264a80 msgr2=0x56014f266f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f264a80 0x56014f266f40 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f96e0014440 msgr2=0x7f96e0042a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f96e0014440 0x7f96e0042a30 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56014f26dfe0 msgr2=0x56014f270410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x56014f26dfe0 0x56014f270410 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95b003c780 msgr2=0x7f95b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95b003c780 0x7f95b003ec40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96d80823f0 tx=0x7f96d808e000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 msgr2=0x56014f258f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 --2- 172.21.15.120:0/1550116606 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f2519d0 0x56014f258f20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f96e0053d10 tx=0x7f96e0053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 reap_dead start 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96de809640 1 -- 172.21.15.120:0/1550116606 reap_dead start 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 shutdown_connections 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 >> 172.21.15.120:0/1550116606 conn(0x56014f24ddd0 msgr2=0x56014f24bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.267+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 shutdown_connections 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/1550116606 wait complete. 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/2510541498 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95c003c780 msgr2=0x7f95c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/2510541498 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95c003c780 0x7f95c003ec40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x56014f22b980 tx=0x7f96d8084040 comp rx=0 tx=0).stop 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/2510541498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f244f50 msgr2=0x56014f245370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/2510541498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f244f50 0x56014f245370 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f96e0016d20 tx=0x7f96e000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/2510541498 shutdown_connections 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/2510541498 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95c003c780 0x7f95c003ec40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/2510541498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f244f50 0x56014f245370 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/2510541498 >> 172.21.15.120:0/2510541498 conn(0x56014f239300 msgr2=0x56014f2396e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/2510541498 shutdown_connections 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/2510541498 wait complete. 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f2325c0 msgr2=0x56014f234a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f2325c0 0x56014f234a50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f131040 msgr2=0x56014f2317d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f131040 0x56014f2317d0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95cc03c780 msgr2=0x7f95cc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95cc03c780 0x7f95cc03ec40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96d0001d70 tx=0x7f96d00012d0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 msgr2=0x56014f22a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f22a180 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f96d800a1d0 tx=0x7f96d8002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 shutdown_connections 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56014f2325c0 0x56014f234a50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56014f131040 0x56014f2317d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f95cc03c780 0x7f95cc03ec40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 --2- 172.21.15.120:0/1789079182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56014f12fe00 0x56014f22a180 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.268+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 >> 172.21.15.120:0/1789079182 conn(0x56014f12b1d0 msgr2=0x56014f21f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.269+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 shutdown_connections 2024-09-07T03:32:56.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.269+0000 7f96e9519800 1 -- 172.21.15.120:0/1789079182 wait complete. 2024-09-07T03:32:56.283 INFO:teuthology.orchestra.run.smithi120.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-07T03:32:56.283 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-07T03:32:56.286 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-07T03:32:56.303 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:56.401 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-07T03:32:56.402 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-07T03:32:56.402 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-07T03:32:56.402 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-07T03:32:56.402 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-07T03:32:56.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-07T03:32:56.403 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-07T03:32:56.448 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.448+0000 7ff290b15800 1 Processor -- start 2024-09-07T03:32:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.448+0000 7ff290b15800 1 -- start start 2024-09-07T03:32:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.448+0000 7ff290b15800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a6de086210 0x55a6de0886d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.448+0000 7ff290b15800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a6ddf2be40 con 0x55a6de0826a0 2024-09-07T03:32:56.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.448+0000 7ff290b15800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a6ddef6680 con 0x55a6de086210 2024-09-07T03:32:56.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.448+0000 7ff287fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a6de086210 0x55a6de0886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.448+0000 7ff28e5ff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55a6de0826a0 0x55a6de084a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41512/0 (socket says 172.21.15.120:41512) 2024-09-07T03:32:56.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.448+0000 7ff28e5ff640 1 -- 172.21.15.120:0/1034937614 learned_addr learned my addr 172.21.15.120:0/1034937614 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:56.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.449+0000 7ff287fff640 1 -- 172.21.15.120:0/1034937614 >> v1:172.21.15.104:6789/0 conn(0x55a6de0826a0 legacy=0x55a6de084a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.449+0000 7ff28ddfe640 1 -- 172.21.15.120:0/1034937614 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135702078 0 0) 0x55a6ddf2be40 con 0x55a6de0826a0 2024-09-07T03:32:56.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.449+0000 7ff287fff640 1 -- 172.21.15.120:0/1034937614 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ddf126b0 con 0x55a6de086210 2024-09-07T03:32:56.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff287fff640 1 --2- 172.21.15.120:0/1034937614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de086210 0x55a6de0886d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff27800a470 tx=0x7ff278045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92e3b524fbb7a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff28ddfe640 1 -- 172.21.15.120:0/1034937614 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff278053570 con 0x55a6de086210 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff28ddfe640 1 -- 172.21.15.120:0/1034937614 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff278058070 con 0x55a6de086210 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff28ddfe640 1 -- 172.21.15.120:0/1034937614 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff278053880 con 0x55a6de086210 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff290b15800 1 -- 172.21.15.120:0/1034937614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de086210 msgr2=0x55a6de0886d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff290b15800 1 --2- 172.21.15.120:0/1034937614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de086210 0x55a6de0886d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff27800a470 tx=0x7ff278045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff290b15800 1 -- 172.21.15.120:0/1034937614 shutdown_connections 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff290b15800 1 --2- 172.21.15.120:0/1034937614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de086210 0x55a6de0886d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff290b15800 1 -- 172.21.15.120:0/1034937614 >> 172.21.15.120:0/1034937614 conn(0x55a6de07c200 msgr2=0x55a6de07e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff290b15800 1 -- 172.21.15.120:0/1034937614 shutdown_connections 2024-09-07T03:32:56.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.451+0000 7ff290b15800 1 -- 172.21.15.120:0/1034937614 wait complete. 2024-09-07T03:32:56.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.465+0000 7ff290b15800 1 Processor -- start 2024-09-07T03:32:56.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.465+0000 7ff290b15800 1 -- start start 2024-09-07T03:32:56.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.465+0000 7ff290b15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de171450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.465+0000 7ff290b15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a6ddf1add0 con 0x55a6de0826a0 2024-09-07T03:32:56.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.465+0000 7ff28e5ff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de171450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.465+0000 7ff28e5ff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de171450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58806/0 (socket says 172.21.15.120:58806) 2024-09-07T03:32:56.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.466+0000 7ff28e5ff640 1 -- 172.21.15.120:0/3125361259 learned_addr learned my addr 172.21.15.120:0/3125361259 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.466+0000 7ff28e5ff640 1 -- 172.21.15.120:0/3125361259 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ddf33e10 con 0x55a6de0826a0 2024-09-07T03:32:56.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.466+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/3125361259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de171450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff280001ea0 tx=0x7ff28000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e397cb427974ed server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.466+0000 7ff17c608640 1 -- 172.21.15.120:0/3125361259 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff280008070 con 0x55a6de0826a0 2024-09-07T03:32:56.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.466+0000 7ff17c608640 1 -- 172.21.15.120:0/3125361259 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28000d500 con 0x55a6de0826a0 2024-09-07T03:32:56.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.466+0000 7ff17c608640 1 -- 172.21.15.120:0/3125361259 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28000d880 con 0x55a6de0826a0 2024-09-07T03:32:56.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 -- 172.21.15.120:0/3125361259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 msgr2=0x55a6de171450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 --2- 172.21.15.120:0/3125361259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de171450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff280001ea0 tx=0x7ff28000b6a0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 -- 172.21.15.120:0/3125361259 shutdown_connections 2024-09-07T03:32:56.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 --2- 172.21.15.120:0/3125361259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de171450 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 -- 172.21.15.120:0/3125361259 >> 172.21.15.120:0/3125361259 conn(0x55a6de07c200 msgr2=0x55a6de16cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 -- 172.21.15.120:0/3125361259 shutdown_connections 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 -- 172.21.15.120:0/3125361259 wait complete. 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 Processor -- start 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 -- start start 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de081dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.467+0000 7ff290b15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a6de089050 con 0x55a6de0826a0 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff28e5ff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de081dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff28e5ff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de081dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58816/0 (socket says 172.21.15.120:58816) 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff28e5ff640 1 -- 172.21.15.120:0/2180352665 learned_addr learned my addr 172.21.15.120:0/2180352665 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff28e5ff640 1 -- 172.21.15.120:0/2180352665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6de082320 con 0x55a6de0826a0 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de081dc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff2800012f0 tx=0x7ff280000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff17ae05640 1 -- 172.21.15.120:0/2180352665 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28000f9d0 con 0x55a6de0826a0 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff17ae05640 1 -- 172.21.15.120:0/2180352665 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28000fb70 con 0x55a6de0826a0 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff17ae05640 1 -- 172.21.15.120:0/2180352665 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28000fe50 con 0x55a6de0826a0 2024-09-07T03:32:56.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6de0806d0 con 0x55a6de0826a0 2024-09-07T03:32:56.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.468+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6de080c90 con 0x55a6de0826a0 2024-09-07T03:32:56.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.469+0000 7ff17ae05640 1 -- 172.21.15.120:0/2180352665 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff280017040 con 0x55a6de0826a0 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.469+0000 7ff17ae05640 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff17403c920 0x7ff17403ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff17ae05640 1 -- 172.21.15.120:0/2180352665 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff280015020 con 0x55a6de0826a0 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff287fff640 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff17403c920 0x7ff17403ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de086210 0x55a6de182360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1828a0 con 0x55a6de086210 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff28ee00640 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de086210 0x55a6de182360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff287fff640 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff17403c920 0x7ff17403ede0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff278057000 tx=0x7ff278052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff28ee00640 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de086210 0x55a6de182360 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff28ee00640 1 -- 172.21.15.120:0/2180352665 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff28800a4d0 con 0x55a6de086210 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de183690 0x55a6de185a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.470+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1860c0 con 0x55a6de183690 2024-09-07T03:32:56.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.471+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de183690 0x55a6de185a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.471+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de183690 0x55a6de185a80 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.471+0000 7ff28e5ff640 1 -- 172.21.15.120:0/2180352665 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de183690 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.471+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de187970 con 0x55a6de183690 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.472+0000 7ff28e5ff640 1 -- 172.21.15.120:0/2180352665 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de183690 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.472+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de186ae0 con 0x55a6de183690 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.472+0000 7ff28e5ff640 1 -- 172.21.15.120:0/2180352665 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de183690 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.472+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de186f00 con 0x55a6de086210 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.472+0000 7ff28ee00640 1 -- 172.21.15.120:0/2180352665 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff28800a4d0 con 0x55a6de086210 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.472+0000 7ff290b15800 1 Processor -- start 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff290b15800 1 -- start start 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff290b15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de195df0 0x55a6de196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff290b15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a6ddf78a00 con 0x55a6de195df0 2024-09-07T03:32:56.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff28ee00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de195df0 0x55a6de196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff28ee00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de195df0 0x55a6de196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58832/0 (socket says 172.21.15.120:58832) 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff28ee00640 1 -- 172.21.15.120:0/3488513762 learned_addr learned my addr 172.21.15.120:0/3488513762 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff28ee00640 1 -- 172.21.15.120:0/3488513762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6de196850 con 0x55a6de195df0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff28ee00640 1 --2- 172.21.15.120:0/3488513762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de195df0 0x55a6de196210 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff288016d20 tx=0x7ff28800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff173fff640 1 -- 172.21.15.120:0/3488513762 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff288017660 con 0x55a6de195df0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff173fff640 1 -- 172.21.15.120:0/3488513762 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28801b030 con 0x55a6de195df0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff290b15800 1 -- 172.21.15.120:0/3488513762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6de197080 con 0x55a6de195df0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.473+0000 7ff173fff640 1 -- 172.21.15.120:0/3488513762 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff288017950 con 0x55a6de195df0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.474+0000 7ff290b15800 1 -- 172.21.15.120:0/3488513762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6de197620 con 0x55a6de195df0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.474+0000 7ff173fff640 1 -- 172.21.15.120:0/3488513762 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff288017af0 con 0x55a6de195df0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.474+0000 7ff173fff640 1 --2- 172.21.15.120:0/3488513762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff16803c780 0x7ff16803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff173fff640 1 -- 172.21.15.120:0/3488513762 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff28800e040 con 0x55a6de195df0 2024-09-07T03:32:56.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/3488513762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff16803c780 0x7ff16803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff290b15800 1 Processor -- start 2024-09-07T03:32:56.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/3488513762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff16803c780 0x7ff16803ec40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55a6de186600 tx=0x7ff280001460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff290b15800 1 -- start start 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff290b15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff290b15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a6de171ca0 con 0x55a6de1a28f0 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff28ee00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff28ee00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58836/0 (socket says 172.21.15.120:58836) 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff28ee00640 1 -- 172.21.15.120:0/2207897316 learned_addr learned my addr 172.21.15.120:0/2207897316 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.475+0000 7ff28ee00640 1 -- 172.21.15.120:0/2207897316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6de1a32e0 con 0x55a6de1a28f0 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff28ee00640 1 --2- 172.21.15.120:0/2207897316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a2cf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff288005cf0 tx=0x7ff288017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6c2b186554cf19 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff171ffb640 1 -- 172.21.15.120:0/2207897316 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff288014960 con 0x55a6de1a28f0 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff171ffb640 1 -- 172.21.15.120:0/2207897316 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288055040 con 0x55a6de1a28f0 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff171ffb640 1 -- 172.21.15.120:0/2207897316 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff288028350 con 0x55a6de1a28f0 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff290b15800 1 -- 172.21.15.120:0/2207897316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 msgr2=0x55a6de1a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff290b15800 1 --2- 172.21.15.120:0/2207897316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a2cf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff288005cf0 tx=0x7ff288017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff290b15800 1 -- 172.21.15.120:0/2207897316 shutdown_connections 2024-09-07T03:32:56.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff290b15800 1 --2- 172.21.15.120:0/2207897316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a2cf0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff290b15800 1 -- 172.21.15.120:0/2207897316 >> 172.21.15.120:0/2207897316 conn(0x55a6de19ed10 msgr2=0x55a6de19cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff290b15800 1 -- 172.21.15.120:0/2207897316 shutdown_connections 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.476+0000 7ff290b15800 1 -- 172.21.15.120:0/2207897316 wait complete. 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff290b15800 1 Processor -- start 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff290b15800 1 -- start start 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff290b15800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff290b15800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a6de1a38d0 con 0x55a6de1a28f0 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff28ee00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff28ee00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58848/0 (socket says 172.21.15.120:58848) 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 learned_addr learned my addr 172.21.15.120:0/684013169 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6de1aa510 con 0x55a6de1a28f0 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff28ee00640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a9fb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff288053cd0 tx=0x7ff288053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff15ffff640 1 -- 172.21.15.120:0/684013169 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28802e070 con 0x55a6de1a28f0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff15ffff640 1 -- 172.21.15.120:0/684013169 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288014440 con 0x55a6de1a28f0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.477+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6de1aa7a0 con 0x55a6de1a28f0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.478+0000 7ff15ffff640 1 -- 172.21.15.120:0/684013169 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2880127a0 con 0x55a6de1a28f0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.478+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6de1ab330 con 0x55a6de1a28f0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.478+0000 7ff15ffff640 1 -- 172.21.15.120:0/684013169 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff288012940 con 0x55a6de1a28f0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.478+0000 7ff15ffff640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff15803c780 0x7ff15803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.478+0000 7ff15ffff640 1 -- 172.21.15.120:0/684013169 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff28804b040 con 0x55a6de1a28f0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.479+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff15803c780 0x7ff15803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.479+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff15803c780 0x7ff15803ec40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff280054010 tx=0x7ff280043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.479+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.479+0000 7ff290b15800 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de1b59d0 0x55a6de1b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.479+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1b85e0 con 0x55a6de1b59d0 2024-09-07T03:32:56.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.479+0000 7ff287fff640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de1b59d0 0x55a6de1b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff287fff640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de1b59d0 0x55a6de1b7e90 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 20 realm 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1b8a10 con 0x55a6de1b59d0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1b92e0 con 0x55a6de1b59d0 2024-09-07T03:32:56.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de1b9d00 0x55a6de1bc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1bc8a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.480+0000 7ff28ee00640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de1b9d00 0x55a6de1bc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff28ee00640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de1b9d00 0x55a6de1bc130 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff290b15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1bd0f0 con 0x55a6de1b9d00 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff290b15800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:56.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff290b15800 20 searching for the correct realm 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff290b15800 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a6de1bee60 0x55a6de1c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1bee60 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.481+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a6de1bee60 0x55a6de1c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.482+0000 7ff28e5ff640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a6de1bee60 0x55a6de1c12d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.482+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.482+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.482+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.482+0000 7ff28ee00640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff288033460 0x7ff2880549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.482+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x7ff288033460 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.483+0000 7ff287fff640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff288033460 0x7ff2880549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.483+0000 7ff287fff640 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff288033460 0x7ff2880549d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.483+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.483+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b59d0 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.483+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.483+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b59d0 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.483+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.483+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1bee60 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.484+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.484+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b59d0 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.484+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.484+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.484+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.484+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.484+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.484+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b59d0 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.485+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.485+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x7ff288033460 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.485+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.485+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b59d0 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.485+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.485+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x7ff288033460 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.485+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.485+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.486+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.486+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1bee60 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.486+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.486+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b59d0 2024-09-07T03:32:56.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.486+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.486+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.486+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.486+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1bee60 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b59d0 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b59d0 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b59d0 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1bee60 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.487+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x7ff288033460 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.488+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.488+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x7ff288033460 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.488+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.488+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x7ff288033460 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.488+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.488+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1bee60 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.488+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.488+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x7ff288033460 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.489+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.489+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.489+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.489+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.489+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.489+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1bee60 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.489+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.489+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c19a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:56.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1bda40 con 0x55a6de1b59d0 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1bd620 con 0x55a6de1b9d00 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.490+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1be3b0 con 0x55a6de1b59d0 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 zone default found 2024-09-07T03:32:56.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 4 Realm: () 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 zonegroup default 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c22d0 con 0x7ff288033460 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c4510 con 0x55a6de1bee60 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c48b0 con 0x55a6de1bee60 2024-09-07T03:32:56.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 started sync module instance, tier type = 2024-09-07T03:32:56.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:56.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.491+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c3950 con 0x55a6de1b9d00 2024-09-07T03:32:56.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.493+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.493+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94175179324784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c5100 con 0x55a6de1b9d00 2024-09-07T03:32:56.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.493+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c5950 con 0x55a6de1b59d0 2024-09-07T03:32:56.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.494+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94175179324784] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.494+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.494+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94175179328592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c5520 con 0x55a6de1b59d0 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.494+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c6440 con 0x55a6de1b9d00 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.495+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94175179328592] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.495+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.495+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94175179333392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c5520 con 0x55a6de1b9d00 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.495+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c6f60 con 0x7ff288033460 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.496+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94175179333392] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.497+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.497+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94175179336272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c6f20 con 0x7ff288033460 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.497+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c79a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.497+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94175179336272] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.498+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.498+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94175179338896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c7960 con 0x55a6de1b9d00 2024-09-07T03:32:56.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.498+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c83e0 con 0x55a6de1bee60 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.499+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94175179338896] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.499+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.499+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94175179341616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c87d0 con 0x55a6de1bee60 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.499+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c9190 con 0x55a6de1bee60 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.500+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94175179341616] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.500+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.500+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94175179345120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c9100 con 0x55a6de1bee60 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.500+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c9f50 con 0x7ff288033460 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.501+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94175179345120] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.502+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.502+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94175179347328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1c9f50 con 0x7ff288033460 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.502+0000 7ff290b15800 20 add_watcher() i=0 2024-09-07T03:32:56.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.502+0000 7ff290b15800 20 add_watcher() i=1 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.502+0000 7ff290b15800 20 add_watcher() i=2 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.502+0000 7ff290b15800 20 add_watcher() i=3 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.502+0000 7ff290b15800 20 add_watcher() i=4 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.502+0000 7ff290b15800 20 add_watcher() i=5 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.502+0000 7ff290b15800 20 add_watcher() i=6 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.503+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94175179347328] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.503+0000 7ff290b15800 20 add_watcher() i=7 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.503+0000 7ff290b15800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.503+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1cd3d0 con 0x55a6de1b59d0 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.504+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.504+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94175179348384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1ca8f0 con 0x55a6de1b59d0 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.505+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94175179348384] v36'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.505+0000 7ff144fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.505+0000 7ff290b15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.505+0000 7ff290b15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.505+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d5c50 con 0x55a6de1b9d00 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.506+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'55 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.506+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d5cb0 con 0x7ff288033460 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.507+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.507+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d6380 con 0x55a6de1bee60 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.508+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.508+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d68f0 con 0x55a6de1b59d0 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.509+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'189 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.509+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d6da0 con 0x55a6de1b9d00 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.510+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'68 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.510+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d6da0 con 0x55a6de1bee60 2024-09-07T03:32:56.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.511+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'53 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.511+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.513+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'33 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.513+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b59d0 2024-09-07T03:32:56.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.513+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.514+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.514+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.515+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.516+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.516+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.517+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'69 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.517+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d48d0 con 0x55a6de1bee60 2024-09-07T03:32:56.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.518+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.518+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d48d0 con 0x55a6de1b9d00 2024-09-07T03:32:56.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.519+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.519+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d48d0 con 0x55a6de1b59d0 2024-09-07T03:32:56.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.520+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'59 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.520+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b59d0 2024-09-07T03:32:56.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.521+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'190 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.521+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.522+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.522+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.523+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'70 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.523+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1bee60 2024-09-07T03:32:56.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.524+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.524+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.525+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.525+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b59d0 2024-09-07T03:32:56.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.526+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'191 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.526+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.527+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'65 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.527+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.528+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.528+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1bee60 2024-09-07T03:32:56.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.529+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.529+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.530+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'42 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.530+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1bee60 2024-09-07T03:32:56.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.531+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.532+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1bee60 2024-09-07T03:32:56.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.532+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'54 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.532+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1bee60 2024-09-07T03:32:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.534+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.534+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.535+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.535+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b59d0 2024-09-07T03:32:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.536+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.536+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b9d00 2024-09-07T03:32:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.537+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'66 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.537+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x55a6de1b59d0 2024-09-07T03:32:56.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.538+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'60 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.538+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de1d4aa0 con 0x7ff288033460 2024-09-07T03:32:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.539+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.539+0000 7ff0bf7fe640 20 reqs_thread_entry: start 2024-09-07T03:32:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.539+0000 7ff290b15800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 20 Filter name: none 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff0bd7fa640 20 reqs_thread_entry: start 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de202830 con 0x7ff288033460 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff278051070 con 0x7ff288033460 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 : miss 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.540+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 8.10 8:0f1ebb75:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2042a0 con 0x55a6de1b9d00 2024-09-07T03:32:56.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(95 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff290b15800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff290b15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 info.flags=0x17 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff290b15800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 to cache LRU end 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff290b15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff290b15800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff290b15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:96 4.21 4:86a1e421:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281790 con 0x55a6de1bee60 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(96 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.541+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 4.30 4:0fc77c28:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2817d0 con 0x55a6de1b9d00 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.542+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(97 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.1 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.542+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:98 4.2c 4:3592c44b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281810 con 0x55a6de1b59d0 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.542+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(98 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.542+0000 7ff290b15800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-07T03:32:56.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.542+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:99 4.1d 4:ba064837:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281810 con 0x55a6de1bee60 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.542+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(99 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.542+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:100 4.3d 4:bdabf87d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281810 con 0x55a6de1b9d00 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.543+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(100 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.543+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:101 4.22 4:44c14859:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281810 con 0x55a6de1b59d0 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.543+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(101 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff278051070 con 0x55a6de1b59d0 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.543+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:102 4.39 4:9e033bb8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281810 con 0x7ff288033460 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.543+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(102 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6 [call out=429b] v0'0 uv5 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7ff278086040 con 0x7ff288033460 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.543+0000 7ff290b15800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.543+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:103 4.7 4:e1b8a894:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281810 con 0x55a6de1b59d0 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.544+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(103 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.544+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:104 4.2a 4:5685855d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281810 con 0x55a6de1b59d0 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.544+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(104 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8 [call out=430b] v0'0 uv7 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.544+0000 7ff290b15800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-07T03:32:56.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.544+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:105 4.1 4:83c2a3f1:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281810 con 0x7ff288033460 2024-09-07T03:32:56.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.544+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(105 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff278086040 con 0x7ff288033460 2024-09-07T03:32:56.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.544+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 4.1a 4:5846bfde:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de281810 con 0x55a6de1b9d00 2024-09-07T03:32:56.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.545+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(106 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 [call out=702b] v0'0 uv11 ondisk = 0) ==== 195+0+702 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.545+0000 7ff290b15800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.545+0000 7ff290b15800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.545+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.545+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:107 3.5s0 3:a32ab73f:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de27f160 con 0x55a6de1b9d00 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.546+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(107 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.546+0000 7ff290b15800 10 manifest: total_size = 6 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.546+0000 7ff290b15800 20 get_obj_state: setting s->obj_tag to cf0fab6f-a978-4ce5-bacd-166891c31743.4225.15648418808921534873 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.546+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.546+0000 7ff290b15800 20 prepare_atomic_modification: state is not atomic. state=0x55a6de280c68 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.546+0000 7ff290b15800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.546+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:108 4.2c 4:3592c44b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de209350 con 0x55a6de1b59d0 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.547+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(108 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2 [stat,call,call] v36'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.547+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:109 3.5s0 3:a32ab73f:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2093b0 con 0x55a6de1b9d00 2024-09-07T03:32:56.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.548+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(109 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_9c8454ddf7aa50116496bac348d7550d [call] v36'5 uv5 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.548+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:110 4.2c 4:3592c44b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de209c80 con 0x55a6de1b59d0 2024-09-07T03:32:56.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.548+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.548+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:111 3.36s0 3:6f864a97:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de209c80 con 0x7ff288033460 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.549+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(111 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7ff278086040 con 0x7ff288033460 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.549+0000 7ff290b15800 10 manifest: total_size = 3 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.549+0000 7ff290b15800 20 get_obj_state: setting s->obj_tag to cf0fab6f-a978-4ce5-bacd-166891c31743.4225.3851331861052048470 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.549+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.549+0000 7ff290b15800 20 prepare_atomic_modification: state is not atomic. state=0x55a6de280c68 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.549+0000 7ff290b15800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.549+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:112 4.39 4:9e033bb8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20e930 con 0x7ff288033460 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.549+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(110 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2 [stat,call,call] v36'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.550+0000 7ff171ffb640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-07T03:32:56.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.550+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(112 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6 [stat,call,call] v36'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff278086040 con 0x7ff288033460 2024-09-07T03:32:56.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.550+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:113 3.36s0 3:6f864a97:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de204be0 con 0x7ff288033460 2024-09-07T03:32:56.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.551+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(113 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_b1b9a972ccd8c962a473909b97007eb4 [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff278086040 con 0x7ff288033460 2024-09-07T03:32:56.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.551+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:114 4.39 4:9e033bb8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20a8f0 con 0x7ff288033460 2024-09-07T03:32:56.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.551+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.551+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:115 3.38s0 3:1eb725ce:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20a8f0 con 0x55a6de1bee60 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.552+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(115 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.552+0000 7ff290b15800 10 manifest: total_size = 4 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.552+0000 7ff290b15800 20 get_obj_state: setting s->obj_tag to cf0fab6f-a978-4ce5-bacd-166891c31743.4225.14346848114839711089 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.552+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.552+0000 7ff290b15800 20 prepare_atomic_modification: state is not atomic. state=0x55a6de280c68 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.552+0000 7ff290b15800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.552+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:116 4.2a 4:5685855d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20a8f0 con 0x55a6de1b59d0 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.552+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(114 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff278086040 con 0x7ff288033460 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.552+0000 7ff1717fa640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.553+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 32 ==== osd_op_reply(116 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8 [stat,call,call] v36'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.553+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:117 3.38s0 3:1eb725ce:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20a8f0 con 0x55a6de1bee60 2024-09-07T03:32:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.554+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(117 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.554+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:118 4.2a 4:5685855d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20a840 con 0x55a6de1b59d0 2024-09-07T03:32:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.554+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.554+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:119 3.3as0 3:5e8b76d1:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20b9d0 con 0x55a6de1b9d00 2024-09-07T03:32:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.555+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(119 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.555+0000 7ff290b15800 10 manifest: total_size = 5 2024-09-07T03:32:56.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.555+0000 7ff290b15800 20 get_obj_state: setting s->obj_tag to cf0fab6f-a978-4ce5-bacd-166891c31743.4225.15176772260952148899 2024-09-07T03:32:56.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.555+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.555+0000 7ff290b15800 20 prepare_atomic_modification: state is not atomic. state=0x55a6de280c68 2024-09-07T03:32:56.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.555+0000 7ff290b15800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 2024-09-07T03:32:56.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.555+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:120 4.1a 4:5846bfde:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20fa10 con 0x55a6de1b9d00 2024-09-07T03:32:56.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.555+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 33 ==== osd_op_reply(118 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8 [stat,call,call] v36'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.555+0000 7ff171ffb640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-07T03:32:56.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.556+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== osd_op_reply(120 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 [stat,call,call] v36'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.556+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:121 3.3as0 3:5e8b76d1:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de205090 con 0x55a6de1b9d00 2024-09-07T03:32:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(121 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_24d27c169c2c881eb09a065116f2aa5c [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:122 4.1a 4:5846bfde:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20b870 con 0x55a6de1b9d00 2024-09-07T03:32:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:123 3.5s0 3:a0a014a4:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20b870 con 0x55a6de1b9d00 2024-09-07T03:32:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(123 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff290b15800 10 manifest: total_size = 5 2024-09-07T03:32:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff290b15800 20 get_obj_state: setting s->obj_tag to _VBMAlrsm1rPeXuv1v8bnPy4MZ4Ol4Ic 2024-09-07T03:32:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff290b15800 20 get_obj_state: octx=0x7ff278053600 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55a6de280c68 s->prefetch_data=0 2024-09-07T03:32:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff290b15800 20 prepare_atomic_modification: state is not atomic. state=0x55a6de280c68 2024-09-07T03:32:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff290b15800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 2024-09-07T03:32:56.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.558+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:124 4.1a 4:5846bfde:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20f440 con 0x55a6de1b9d00 2024-09-07T03:32:56.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.559+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(122 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 [stat,call,call] v36'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.559+0000 7ff1717fa640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-07T03:32:56.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.559+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 45 ==== osd_op_reply(124 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 [stat,call,call] v36'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.559+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:125 3.5s0 3:a0a014a4:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20fa00 con 0x55a6de1b9d00 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.560+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 46 ==== osd_op_reply(125 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5_bb3aec0fdcdbc2974890f805c585d432 [call] v36'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.560+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:126 4.1a 4:5846bfde:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20fa00 con 0x55a6de1b9d00 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.560+0000 7ff290b15800 20 list_objects_ordered: starting attempt 1 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.560+0000 7ff290b15800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.560+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:127 4.21 4:86a1e421:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280a80 con 0x55a6de1bee60 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.560+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:128 4.30 4:0fc77c28:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280eb0 con 0x55a6de1b9d00 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:129 4.2c 4:3592c44b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280a80 con 0x55a6de1b59d0 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:130 4.1d 4:ba064837:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de215900 con 0x55a6de1bee60 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:131 4.3d 4:bdabf87d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2181f0 con 0x55a6de1b9d00 2024-09-07T03:32:56.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:132 4.22 4:44c14859:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de21ae80 con 0x55a6de1b59d0 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:133 4.39 4:9e033bb8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de21d950 con 0x7ff288033460 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:134 4.7 4:e1b8a894:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de220240 con 0x55a6de1b59d0 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:135 4.2a 4:5685855d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de222b70 con 0x55a6de1b59d0 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:136 4.1 4:83c2a3f1:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2259f0 con 0x7ff288033460 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:137 4.1a 4:5846bfde:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de228820 con 0x55a6de1b9d00 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(127 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 34 ==== osd_op_reply(129 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(130 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 47 ==== osd_op_reply(131 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 48 ==== osd_op_reply(128 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.1 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.561+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 35 ==== osd_op_reply(132 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 36 ==== osd_op_reply(134 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 37 ==== osd_op_reply(135 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff278086040 con 0x55a6de1b59d0 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 49 ==== osd_op_reply(126 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 [stat,call,call] v36'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 22 ==== osd_op_reply(133 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff278086040 con 0x7ff288033460 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff1717fa640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 23 ==== osd_op_reply(136 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff278086040 con 0x7ff288033460 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 50 ==== osd_op_reply(137 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 [call out=128b] v0'0 uv15 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5])"; uploads.size()=0; is_truncated=0 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:138 4.21 4:86a1e421:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de228820 con 0x55a6de1bee60 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:139 4.30 4:0fc77c28:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2259f0 con 0x55a6de1b9d00 2024-09-07T03:32:56.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:140 4.2c 4:3592c44b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de228010 con 0x55a6de1b59d0 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:141 4.1d 4:ba064837:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de228430 con 0x55a6de1bee60 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:142 4.3d 4:bdabf87d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de215d00 con 0x55a6de1b9d00 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:143 4.22 4:44c14859:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2259f0 con 0x55a6de1b59d0 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:144 4.39 4:9e033bb8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de228010 con 0x7ff288033460 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:145 4.7 4:e1b8a894:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2259f0 con 0x55a6de1b59d0 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:146 4.2a 4:5685855d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de215d00 con 0x55a6de1b59d0 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:147 4.1 4:83c2a3f1:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de228010 con 0x7ff288033460 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:148 4.1a 4:5846bfde:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de228820 con 0x55a6de1b9d00 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 51 ==== osd_op_reply(142 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 52 ==== osd_op_reply(139 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.1 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== osd_op_reply(138 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 53 ==== osd_op_reply(148 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 [call out=128b] v0'0 uv15 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(141 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.562+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 24 ==== osd_op_reply(144 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.563+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 38 ==== osd_op_reply(140 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.563+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 39 ==== osd_op_reply(143 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.563+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 25 ==== osd_op_reply(147 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.563+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 40 ==== osd_op_reply(145 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.563+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 41 ==== osd_op_reply(146 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.563+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2259f0 con 0x7ff288033460 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.564+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 26 ==== osd_op_reply(149 foo.buckets [call] v36'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.564+0000 7ff290b15800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.564+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2259f0 con 0x7ff288033460 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 27 ==== osd_op_reply(150 myfoo [call,call,delete] v36'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff290b15800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff290b15800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-07T03:32:56.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94175179725296 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280eb0 con 0x55a6de1bee60 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== watch-notify(notify (1) cookie 94175179345120 notify 154618822674 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55a6de1d7900 con 0x55a6de1bee60 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff171ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822674 cookie 94175179345120 notifier 4645 bl.length()=149 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff171ffb640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7ff154003d60 con 0x55a6de1bee60 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== osd_op_reply(151 notify.6 [notify cookie 94175179725296 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 33 ==== watch-notify(notify_complete (2) cookie 94175179725296 notify 154618822674 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a6de1d6720 con 0x55a6de1bee60 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.565+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:153 8.10 8:0f1ebb75:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280eb0 con 0x55a6de1b9d00 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.567+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 54 ==== osd_op_reply(153 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 [call,call,delete] v36'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.567+0000 7ff290b15800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 from cache 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.567+0000 7ff290b15800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5, ofs0, ns] 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.567+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify cookie 94175179615120 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280eb0 con 0x7ff288033460 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.567+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 28 ==== watch-notify(notify (1) cookie 94175179336272 notify 154618822677 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55a6de1d50d0 con 0x7ff288033460 2024-09-07T03:32:56.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.567+0000 7ff1717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822677 cookie 94175179336272 notifier 4645 bl.length()=206 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.567+0000 7ff1717fa640 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:155 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7ff0c40032c0 con 0x7ff288033460 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.567+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 29 ==== osd_op_reply(154 notify.3 [notify cookie 94175179615120 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 30 ==== osd_op_reply(155 notify.3 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 31 ==== watch-notify(notify_complete (2) cookie 94175179615120 notify 154618822677 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a6de1d5530 con 0x7ff288033460 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:156 4.21 4:86a1e421:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280e90 con 0x55a6de1bee60 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:157 4.30 4:0fc77c28:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1b9d00 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:158 4.2c 4:3592c44b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2259f0 con 0x55a6de1b59d0 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:159 4.1d 4:ba064837:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280e90 con 0x55a6de1bee60 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:160 4.3d 4:bdabf87d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1b9d00 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:161 4.22 4:44c14859:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de2259f0 con 0x55a6de1b59d0 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:162 4.39 4:9e033bb8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280e90 con 0x7ff288033460 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:163 4.7 4:e1b8a894:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1b59d0 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:164 4.2a 4:5685855d:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de202c40 con 0x55a6de1b59d0 2024-09-07T03:32:56.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:165 4.1 4:83c2a3f1:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de203640 con 0x7ff288033460 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.568+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:166 4.1a 4:5846bfde:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de223540 con 0x55a6de1b9d00 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.569+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 55 ==== osd_op_reply(166 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.10 [delete] v36'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 56 ==== osd_op_reply(157 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.1 [delete] v36'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 34 ==== osd_op_reply(156 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.0 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 35 ==== osd_op_reply(159 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.3 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 42 ==== osd_op_reply(158 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.2 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 57 ==== osd_op_reply(160 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.4 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 43 ==== osd_op_reply(161 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.5 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 44 ==== osd_op_reply(163 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.7 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 45 ==== osd_op_reply(164 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.8 [delete] v36'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 32 ==== osd_op_reply(165 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.9 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 33 ==== osd_op_reply(162 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5.6 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff290b15800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 : miss 2024-09-07T03:32:56.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff290b15800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:167 6.11 6:896ba0de:::pubsub..bucket.myfoo%2fcf0fab6f-a978-4ce5-bacd-166891c31743.4225.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1bee60 2024-09-07T03:32:56.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 36 ==== osd_op_reply(167 pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff290b15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff290b15800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 info.flags=0x0 2024-09-07T03:32:56.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff290b15800 10 adding default.rgw.log++pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 to cache LRU end 2024-09-07T03:32:56.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.570+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:168 6.11 6:896ba0de:::pubsub..bucket.myfoo%2fcf0fab6f-a978-4ce5-bacd-166891c31743.4225.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280e90 con 0x55a6de1bee60 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.572+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 37 ==== osd_op_reply(168 pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.5 [delete] v36'33 uv29 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.572+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x7ff288033460 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.573+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 34 ==== osd_op_reply(169 foo.buckets [call] v36'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.574+0000 7ff144fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.574+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94175179348384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de280e90 con 0x55a6de1b59d0 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.575+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 46 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94175179348384] v36'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.575+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94175179324784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1b9d00 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.576+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 58 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94175179324784] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.576+0000 7ff290b15800 20 remove_watcher() i=0 2024-09-07T03:32:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.576+0000 7ff290b15800 2 removed watcher, disabling cache 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.576+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94175179328592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1b59d0 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.577+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.1 v2:172.21.15.120:6808/3372043485 47 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94175179328592] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278093040 con 0x55a6de1b59d0 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.577+0000 7ff290b15800 20 remove_watcher() i=1 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.577+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94175179333392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1b9d00 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.578+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 59 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94175179333392] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.578+0000 7ff290b15800 20 remove_watcher() i=2 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.578+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94175179336272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x7ff288033460 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.579+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 35 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94175179336272] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.579+0000 7ff290b15800 20 remove_watcher() i=3 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.579+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94175179338896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1b9d00 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.580+0000 7ff28ee00640 1 -- 172.21.15.120:0/684013169 <== osd.0 v2:172.21.15.104:6800/182397107 60 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94175179338896] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff288027070 con 0x55a6de1b9d00 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.580+0000 7ff290b15800 20 remove_watcher() i=4 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.580+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94175179341616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1bee60 2024-09-07T03:32:56.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.581+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 38 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94175179341616] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.581+0000 7ff290b15800 20 remove_watcher() i=5 2024-09-07T03:32:56.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.581+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94175179345120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x55a6de1bee60 2024-09-07T03:32:56.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.582+0000 7ff28e5ff640 1 -- 172.21.15.120:0/684013169 <== osd.3 v2:172.21.15.120:6800/1193158925 39 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94175179345120] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28002d070 con 0x55a6de1bee60 2024-09-07T03:32:56.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.582+0000 7ff290b15800 20 remove_watcher() i=6 2024-09-07T03:32:56.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.582+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94175179347328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a6de20ab90 con 0x7ff288033460 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 <== osd.2 v2:172.21.15.120:6809/3781833098 36 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94175179347328] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff278093040 con 0x7ff288033460 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff290b15800 20 remove_watcher() i=7 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de1b9d00 msgr2=0x55a6de1bc130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff290b15800 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de1b9d00 0x55a6de1bc130 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de1b59d0 msgr2=0x55a6de1b7e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff290b15800 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de1b59d0 0x55a6de1b7e90 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff288033460 msgr2=0x7ff2880549d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff290b15800 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff288033460 0x7ff2880549d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a6de1bee60 msgr2=0x55a6de1c12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.583+0000 7ff290b15800 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a6de1bee60 0x55a6de1c12d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff15803c780 msgr2=0x7ff15803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff15803c780 0x7ff15803ec40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff280054010 tx=0x7ff280043000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 msgr2=0x55a6de1a9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 --2- 172.21.15.120:0/684013169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de1a28f0 0x55a6de1a9fb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff288053cd0 tx=0x7ff288053d00 comp rx=0 tx=0).stop 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff287fff640 1 -- 172.21.15.120:0/684013169 reap_dead start 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 shutdown_connections 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 >> 172.21.15.120:0/684013169 conn(0x55a6de19ed10 msgr2=0x55a6de19cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 shutdown_connections 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/684013169 wait complete. 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/3488513762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff16803c780 msgr2=0x7ff16803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 --2- 172.21.15.120:0/3488513762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff16803c780 0x7ff16803ec40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55a6de186600 tx=0x7ff280001460 comp rx=0 tx=0).stop 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/3488513762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de195df0 msgr2=0x55a6de196210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 --2- 172.21.15.120:0/3488513762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de195df0 0x55a6de196210 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff288016d20 tx=0x7ff28800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/3488513762 shutdown_connections 2024-09-07T03:32:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 --2- 172.21.15.120:0/3488513762 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff16803c780 0x7ff16803ec40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 --2- 172.21.15.120:0/3488513762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de195df0 0x55a6de196210 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/3488513762 >> 172.21.15.120:0/3488513762 conn(0x55a6de18a1a0 msgr2=0x55a6de18a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/3488513762 shutdown_connections 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/3488513762 wait complete. 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de183690 msgr2=0x55a6de185a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de183690 0x55a6de185a80 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de086210 msgr2=0x55a6de182360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.584+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de086210 0x55a6de182360 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff17403c920 msgr2=0x7ff17403ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff17403c920 0x7ff17403ede0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff278057000 tx=0x7ff278052000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 msgr2=0x55a6de081dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de081dc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff2800012f0 tx=0x7ff280000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 shutdown_connections 2024-09-07T03:32:56.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a6de183690 0x55a6de185a80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a6de086210 0x55a6de182360 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff17403c920 0x7ff17403ede0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 --2- 172.21.15.120:0/2180352665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a6de0826a0 0x55a6de081dc0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 >> 172.21.15.120:0/2180352665 conn(0x55a6de07c200 msgr2=0x55a6de172730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 shutdown_connections 2024-09-07T03:32:56.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.585+0000 7ff290b15800 1 -- 172.21.15.120:0/2180352665 wait complete. 2024-09-07T03:32:56.594 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-07T03:32:56.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-07T03:32:56.594 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-07T03:32:56.640 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:56.641 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:56.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.640+0000 7f5025d3d800 1 Processor -- start 2024-09-07T03:32:56.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.640+0000 7f5025d3d800 1 -- start start 2024-09-07T03:32:56.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.640+0000 7f5025d3d800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556102c19e00 0x556102c1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.640+0000 7f5025d3d800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556102ac4e40 con 0x556102c1b040 2024-09-07T03:32:56.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.640+0000 7f5025d3d800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x556102a8f680 con 0x556102c19e00 2024-09-07T03:32:56.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.641+0000 7f5021a2a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x556102c19e00 0x556102c1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.641+0000 7f5021229640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x556102c1b040 0x556102c1fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41516/0 (socket says 172.21.15.120:41516) 2024-09-07T03:32:56.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.641+0000 7f5021229640 1 -- 172.21.15.120:0/749310596 learned_addr learned my addr 172.21.15.120:0/749310596 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:56.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.641+0000 7f5021a2a640 1 -- 172.21.15.120:0/749310596 >> v1:172.21.15.104:6789/0 conn(0x556102c1b040 legacy=0x556102c1fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.641+0000 7f5021a2a640 1 -- 172.21.15.120:0/749310596 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556102aab6b0 con 0x556102c19e00 2024-09-07T03:32:56.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.641+0000 7f5020a28640 1 -- 172.21.15.120:0/749310596 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302111215 0 0) 0x556102ac4e40 con 0x556102c1b040 2024-09-07T03:32:56.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.643+0000 7f5021a2a640 1 --2- 172.21.15.120:0/749310596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102c1ab00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f501400a470 tx=0x7f5014045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11133bf2473cbec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.643+0000 7f5020a28640 1 -- 172.21.15.120:0/749310596 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5014053570 con 0x556102c19e00 2024-09-07T03:32:56.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.643+0000 7f5020a28640 1 -- 172.21.15.120:0/749310596 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5014058070 con 0x556102c19e00 2024-09-07T03:32:56.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.643+0000 7f5020a28640 1 -- 172.21.15.120:0/749310596 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5014053880 con 0x556102c19e00 2024-09-07T03:32:56.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.644+0000 7f5025d3d800 1 -- 172.21.15.120:0/749310596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 msgr2=0x556102c1ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.644+0000 7f5025d3d800 1 --2- 172.21.15.120:0/749310596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102c1ab00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f501400a470 tx=0x7f5014045a20 comp rx=0 tx=0).stop 2024-09-07T03:32:56.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.644+0000 7f5025d3d800 1 -- 172.21.15.120:0/749310596 shutdown_connections 2024-09-07T03:32:56.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.644+0000 7f5025d3d800 1 --2- 172.21.15.120:0/749310596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102c1ab00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.644+0000 7f5025d3d800 1 -- 172.21.15.120:0/749310596 >> 172.21.15.120:0/749310596 conn(0x556102c151d0 msgr2=0x556102c17630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.644+0000 7f5025d3d800 1 -- 172.21.15.120:0/749310596 shutdown_connections 2024-09-07T03:32:56.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.644+0000 7f5025d3d800 1 -- 172.21.15.120:0/749310596 wait complete. 2024-09-07T03:32:56.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.657+0000 7f5025d3d800 1 Processor -- start 2024-09-07T03:32:56.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.657+0000 7f5025d3d800 1 -- start start 2024-09-07T03:32:56.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.658+0000 7f5025d3d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102b8ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.658+0000 7f5025d3d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556102ab3dd0 con 0x556102c19e00 2024-09-07T03:32:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.658+0000 7f5021a2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102b8ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.658+0000 7f5021a2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102b8ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58858/0 (socket says 172.21.15.120:58858) 2024-09-07T03:32:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.658+0000 7f5021a2a640 1 -- 172.21.15.120:0/4253418958 learned_addr learned my addr 172.21.15.120:0/4253418958 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.658+0000 7f5021a2a640 1 -- 172.21.15.120:0/4253418958 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556102acce10 con 0x556102c19e00 2024-09-07T03:32:56.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.658+0000 7f5021a2a640 1 --2- 172.21.15.120:0/4253418958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102b8ddc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5014025c20 tx=0x7f5014051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec27801879fb54f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.658+0000 7f4f0fe07640 1 -- 172.21.15.120:0/4253418958 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5014053a20 con 0x556102c19e00 2024-09-07T03:32:56.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.659+0000 7f4f0fe07640 1 -- 172.21.15.120:0/4253418958 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5014063070 con 0x556102c19e00 2024-09-07T03:32:56.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.659+0000 7f4f0fe07640 1 -- 172.21.15.120:0/4253418958 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5014053d30 con 0x556102c19e00 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.659+0000 7f5025d3d800 1 -- 172.21.15.120:0/4253418958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 msgr2=0x556102b8ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.659+0000 7f5025d3d800 1 --2- 172.21.15.120:0/4253418958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102b8ddc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5014025c20 tx=0x7f5014051000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.659+0000 7f5025d3d800 1 -- 172.21.15.120:0/4253418958 shutdown_connections 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.659+0000 7f5025d3d800 1 --2- 172.21.15.120:0/4253418958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102b8ddc0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.659+0000 7f5025d3d800 1 -- 172.21.15.120:0/4253418958 >> 172.21.15.120:0/4253418958 conn(0x556102c151d0 msgr2=0x556102d04d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.659+0000 7f5025d3d800 1 -- 172.21.15.120:0/4253418958 shutdown_connections 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.659+0000 7f5025d3d800 1 -- 172.21.15.120:0/4253418958 wait complete. 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.660+0000 7f5025d3d800 1 Processor -- start 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.660+0000 7f5025d3d800 1 -- start start 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.660+0000 7f5025d3d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102d0a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.660+0000 7f5025d3d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556102c1b730 con 0x556102c19e00 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.660+0000 7f5021a2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102d0a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.660+0000 7f5021a2a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102d0a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58874/0 (socket says 172.21.15.120:58874) 2024-09-07T03:32:56.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.660+0000 7f5021a2a640 1 -- 172.21.15.120:0/2411170236 learned_addr learned my addr 172.21.15.120:0/2411170236 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.660+0000 7f5021a2a640 1 -- 172.21.15.120:0/2411170236 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556102d0acb0 con 0x556102c19e00 2024-09-07T03:32:56.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.660+0000 7f5021a2a640 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102d0a750 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5014025c20 tx=0x7f5014002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.661+0000 7f4f0e604640 1 -- 172.21.15.120:0/2411170236 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5014078070 con 0x556102c19e00 2024-09-07T03:32:56.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.661+0000 7f4f0e604640 1 -- 172.21.15.120:0/2411170236 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5014073470 con 0x556102c19e00 2024-09-07T03:32:56.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.661+0000 7f4f0e604640 1 -- 172.21.15.120:0/2411170236 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5014073750 con 0x556102c19e00 2024-09-07T03:32:56.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.661+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556102d09060 con 0x556102c19e00 2024-09-07T03:32:56.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.661+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556102d09680 con 0x556102c19e00 2024-09-07T03:32:56.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.662+0000 7f4f0e604640 1 -- 172.21.15.120:0/2411170236 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f501407b070 con 0x556102c19e00 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.662+0000 7f4f0e604640 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4f0803c780 0x7f4f0803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.662+0000 7f4f0e604640 1 -- 172.21.15.120:0/2411170236 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f5014097c40 con 0x556102c19e00 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.662+0000 7f5021229640 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4f0803c780 0x7f4f0803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.662+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102c1b040 0x556102d1b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.662+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d1b7a0 con 0x556102c1b040 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.662+0000 7f502222b640 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102c1b040 0x556102d1b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.662+0000 7f5021229640 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4f0803c780 0x7f4f0803ec40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5018000c00 tx=0x7f50180013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.662+0000 7f502222b640 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102c1b040 0x556102d1b1f0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.663+0000 7f502222b640 1 -- 172.21.15.120:0/2411170236 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f501c00a4d0 con 0x556102c1b040 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.663+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d1c590 0x556102d1e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.663+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d1efb0 con 0x556102d1c590 2024-09-07T03:32:56.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.663+0000 7f5021a2a640 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d1c590 0x556102d1e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.663+0000 7f5021a2a640 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d1c590 0x556102d1e980 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.664+0000 7f5021a2a640 1 -- 172.21.15.120:0/2411170236 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f501407a030 con 0x556102d1c590 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.664+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d20860 con 0x556102d1c590 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.664+0000 7f5021a2a640 1 -- 172.21.15.120:0/2411170236 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f501407a030 con 0x556102d1c590 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.664+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d1f9a0 con 0x556102d1c590 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.664+0000 7f5021a2a640 1 -- 172.21.15.120:0/2411170236 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f501407a030 con 0x556102d1c590 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.664+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d1fe00 con 0x556102c1b040 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.665+0000 7f502222b640 1 -- 172.21.15.120:0/2411170236 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f501c00a4d0 con 0x556102c1b040 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.665+0000 7f5025d3d800 1 Processor -- start 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.665+0000 7f5025d3d800 1 -- start start 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.665+0000 7f5025d3d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d2ece0 0x556102d2f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.665+0000 7f5025d3d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556102b11a00 con 0x556102d2ece0 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.665+0000 7f502222b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d2ece0 0x556102d2f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.665+0000 7f502222b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d2ece0 0x556102d2f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58890/0 (socket says 172.21.15.120:58890) 2024-09-07T03:32:56.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.665+0000 7f502222b640 1 -- 172.21.15.120:0/3282737265 learned_addr learned my addr 172.21.15.120:0/3282737265 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.666+0000 7f502222b640 1 -- 172.21.15.120:0/3282737265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556102d2f740 con 0x556102d2ece0 2024-09-07T03:32:56.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.666+0000 7f502222b640 1 --2- 172.21.15.120:0/3282737265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d2ece0 0x556102d2f100 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f501c016d20 tx=0x7f501c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.666+0000 7f4f077fe640 1 -- 172.21.15.120:0/3282737265 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f501c017660 con 0x556102d2ece0 2024-09-07T03:32:56.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.666+0000 7f4f077fe640 1 -- 172.21.15.120:0/3282737265 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501c01b030 con 0x556102d2ece0 2024-09-07T03:32:56.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.666+0000 7f5025d3d800 1 -- 172.21.15.120:0/3282737265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556102d2ff70 con 0x556102d2ece0 2024-09-07T03:32:56.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.666+0000 7f4f077fe640 1 -- 172.21.15.120:0/3282737265 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f501c017950 con 0x556102d2ece0 2024-09-07T03:32:56.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.666+0000 7f5025d3d800 1 -- 172.21.15.120:0/3282737265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556102d30510 con 0x556102d2ece0 2024-09-07T03:32:56.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.667+0000 7f4f077fe640 1 -- 172.21.15.120:0/3282737265 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f501c017af0 con 0x556102d2ece0 2024-09-07T03:32:56.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.667+0000 7f4f077fe640 1 --2- 172.21.15.120:0/3282737265 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4efc03c780 0x7f4efc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.667+0000 7f4f077fe640 1 -- 172.21.15.120:0/3282737265 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f501c00e040 con 0x556102d2ece0 2024-09-07T03:32:56.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.667+0000 7f5021a2a640 1 --2- 172.21.15.120:0/3282737265 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4efc03c780 0x7f4efc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.667+0000 7f5025d3d800 1 Processor -- start 2024-09-07T03:32:56.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.667+0000 7f5025d3d800 1 -- start start 2024-09-07T03:32:56.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f5021a2a640 1 --2- 172.21.15.120:0/3282737265 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4efc03c780 0x7f4efc03ec40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x556102d1bd50 tx=0x7f501408b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f5025d3d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d3bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f5025d3d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556102d0d130 con 0x556102d3b7a0 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f502222b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d3bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f502222b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d3bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58894/0 (socket says 172.21.15.120:58894) 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f502222b640 1 -- 172.21.15.120:0/1149228466 learned_addr learned my addr 172.21.15.120:0/1149228466 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f502222b640 1 -- 172.21.15.120:0/1149228466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556102d3c170 con 0x556102d3b7a0 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f502222b640 1 --2- 172.21.15.120:0/1149228466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d3bb80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f501c017f20 tx=0x7f501c028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167d44a09a54509d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f4f057fa640 1 -- 172.21.15.120:0/1149228466 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f501c0149b0 con 0x556102d3b7a0 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f4f057fa640 1 -- 172.21.15.120:0/1149228466 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501c028350 con 0x556102d3b7a0 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.668+0000 7f4f057fa640 1 -- 172.21.15.120:0/1149228466 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f501c014b50 con 0x556102d3b7a0 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 -- 172.21.15.120:0/1149228466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 msgr2=0x556102d3bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 --2- 172.21.15.120:0/1149228466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d3bb80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f501c017f20 tx=0x7f501c028e80 comp rx=0 tx=0).stop 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 -- 172.21.15.120:0/1149228466 shutdown_connections 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 --2- 172.21.15.120:0/1149228466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d3bb80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 -- 172.21.15.120:0/1149228466 >> 172.21.15.120:0/1149228466 conn(0x556102d37ba0 msgr2=0x556102d35de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 -- 172.21.15.120:0/1149228466 shutdown_connections 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 -- 172.21.15.120:0/1149228466 wait complete. 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 Processor -- start 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 -- start start 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d42dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f5025d3d800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x556102d3c7b0 con 0x556102d3b7a0 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f502222b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d42dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f502222b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d42dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58896/0 (socket says 172.21.15.120:58896) 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.669+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 learned_addr learned my addr 172.21.15.120:0/3900739006 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.670+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556102d43320 con 0x556102d3b7a0 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.670+0000 7f502222b640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d42dc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f501c017f20 tx=0x7f501c053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.670+0000 7f4ef37fe640 1 -- 172.21.15.120:0/3900739006 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f501c04c070 con 0x556102d3b7a0 2024-09-07T03:32:56.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.670+0000 7f4ef37fe640 1 -- 172.21.15.120:0/3900739006 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501c0129b0 con 0x556102d3b7a0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.670+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556102d435b0 con 0x556102d3b7a0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.670+0000 7f4ef37fe640 1 -- 172.21.15.120:0/3900739006 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f501c012c90 con 0x556102d3b7a0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.670+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556102d43f30 con 0x556102d3b7a0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.671+0000 7f4ef37fe640 1 -- 172.21.15.120:0/3900739006 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f501c0135c0 con 0x556102d3b7a0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.671+0000 7f4ef37fe640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4eec03c730 0x7f4eec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.671+0000 7f4ef37fe640 1 -- 172.21.15.120:0/3900739006 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f501c03bc00 con 0x556102d3b7a0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.671+0000 7f5021a2a640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4eec03c730 0x7f4eec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.671+0000 7f5021a2a640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4eec03c730 0x7f4eec03ebf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f50140893f0 tx=0x7f501408d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.671+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102d4e8b0 0x556102d50d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d514c0 con 0x556102d4e8b0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5021229640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102d4e8b0 0x556102d50d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5021229640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102d4e8b0 0x556102d50d70 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 20 realm 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d4dc00 con 0x556102d4e8b0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.672+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d51fb0 con 0x556102d4e8b0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f5025d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d52d90 0x556102d55180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d55850 con 0x556102d52d90 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f502222b640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d52d90 0x556102d55180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f502222b640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d52d90 0x556102d55180 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f5025d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.673+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d560f0 con 0x556102d52d90 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.674+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.674+0000 7f5025d3d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.674+0000 7f5025d3d800 20 searching for the correct realm 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.674+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556102d57e60 0x556102d5a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.674+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d57e60 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.674+0000 7f5021a2a640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556102d57e60 0x556102d5a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.674+0000 7f5021a2a640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556102d57e60 0x556102d5a250 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.674+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.674+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d52d90 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.675+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.675+0000 7f502222b640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f501c014440 0x7f501c04e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.675+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x7f501c014440 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.675+0000 7f5021229640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f501c014440 0x7f501c04e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.675+0000 7f5021229640 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f501c014440 0x7f501c04e480 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.675+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x7f501c014440 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.675+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d4e8b0 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.676+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.676+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d4e8b0 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.676+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.676+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d57e60 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.676+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.676+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d4e8b0 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.676+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.676+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d52d90 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.676+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.677+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d52d90 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.677+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.677+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d4e8b0 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.677+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.677+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x7f501c014440 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.677+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x7f501c014440 2024-09-07T03:32:56.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.677+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d4e8b0 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.677+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.677+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x7f501c014440 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.678+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f501800f5f0 con 0x7f501c014440 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.678+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d52d90 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.678+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.678+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d57e60 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.678+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.678+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d4e8b0 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.678+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.678+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d52d90 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.679+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.679+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d57e60 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.679+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.679+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d4e8b0 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.679+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.679+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d4e8b0 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.679+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.679+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d4e8b0 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x556102d4e8b0 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d57e60 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x7f501c014440 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x7f501c014440 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x7f501c014440 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x7f501c014440 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x7f501c014440 2024-09-07T03:32:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x7f501c014440 2024-09-07T03:32:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.680+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d57e60 2024-09-07T03:32:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.681+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.681+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x7f501c014440 2024-09-07T03:32:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.681+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501800f5f0 con 0x7f501c014440 2024-09-07T03:32:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.681+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d52d90 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.681+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.681+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d52d90 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d57e60 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d52d90 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556102d5a920 con 0x556102d52d90 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5025d3d800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:56.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5025d3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5025d3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5025d3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5025d3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5025d3d800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.682+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d56a40 con 0x556102d4e8b0 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d56680 con 0x556102d52d90 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d56e80 con 0x556102d4e8b0 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 20 zone default found 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 4 Realm: () 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 20 zonegroup default 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.683+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d5b250 con 0x7f501c014440 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f501803c040 con 0x7f501c014440 2024-09-07T03:32:56.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d5d490 con 0x556102d57e60 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d5d830 con 0x556102d57e60 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 20 started sync module instance, tier type = 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.684+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d5c920 con 0x556102d52d90 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.685+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.685+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93875147755120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d5c920 con 0x556102d52d90 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.686+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d5ded0 con 0x556102d4e8b0 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.686+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93875147755120] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.687+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.687+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93875147752560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d5c890 con 0x556102d4e8b0 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.687+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d5ed90 con 0x556102d52d90 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.688+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93875147752560] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.688+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.688+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93875147760320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d5ed90 con 0x556102d52d90 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.688+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d5f790 con 0x7f501c014440 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.689+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93875147760320] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.689+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501803c040 con 0x7f501c014440 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.689+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93875147764384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d5ed90 con 0x7f501c014440 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.689+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d601e0 con 0x556102d52d90 2024-09-07T03:32:56.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.690+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.690+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93875147767024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d60150 con 0x556102d52d90 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.690+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d611b0 con 0x556102d57e60 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.690+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93875147764384] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501803c040 con 0x7f501c014440 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.691+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93875147767024] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.691+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.691+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93875147769296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d61170 con 0x556102d57e60 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.691+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d61a50 con 0x556102d57e60 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.692+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93875147769296] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.692+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.692+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93875147771040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d61170 con 0x556102d57e60 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.692+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d620e0 con 0x7f501c014440 2024-09-07T03:32:56.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93875147771040] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501803c040 con 0x7f501c014440 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93875147774992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d620e0 con 0x7f501c014440 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5025d3d800 20 add_watcher() i=0 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5025d3d800 20 add_watcher() i=1 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5025d3d800 20 add_watcher() i=2 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5025d3d800 20 add_watcher() i=3 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5025d3d800 20 add_watcher() i=4 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5025d3d800 20 add_watcher() i=5 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.694+0000 7f5025d3d800 20 add_watcher() i=6 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.696+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93875147774992] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501803c040 con 0x7f501c014440 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.696+0000 7f5025d3d800 20 add_watcher() i=7 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.696+0000 7f5025d3d800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.696+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d65620 con 0x556102d4e8b0 2024-09-07T03:32:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.696+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.696+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93875147773344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d62b10 con 0x556102d4e8b0 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.697+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93875147773344] v36'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.697+0000 7f4ed37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.697+0000 7f5025d3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.697+0000 7f5025d3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.697+0000 7f5025d3d800 5 note: GC not initialized 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f4ed27fc640 20 reqs_thread_entry: start 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 20 Filter name: none 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f4e43fff640 20 reqs_thread_entry: start 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d986a0 con 0x556102d4e8b0 2024-09-07T03:32:56.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:56.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:56.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:56.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:56.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.698+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d9e6a0 con 0x556102d4e8b0 2024-09-07T03:32:56.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.699+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v36'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f5025d3d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:56.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f5025d3d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f5025d3d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93875148021920 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556102d99fc0 con 0x556102d52d90 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 93875147767024 notify 154618822684 ret 0) ==== 621+0+0 (crc 0 0 0) 0x556102d43f30 con 0x556102d52d90 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f4f057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 93875147767024 notifier 4652 bl.length()=579 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f4f057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f4f057fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 93875148021920 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f4f057fa640 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f4ee4003ea0 con 0x556102d52d90 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.700+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 93875148021920 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f501c06b020 con 0x556102d52d90 2024-09-07T03:32:56.711 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.701+0000 7f4ed37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.701+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93875147773344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d96540 con 0x556102d4e8b0 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.702+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93875147773344] v36'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.702+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93875147755120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d96540 con 0x556102d52d90 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.703+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93875147755120] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.703+0000 7f5025d3d800 20 remove_watcher() i=0 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.703+0000 7f5025d3d800 2 removed watcher, disabling cache 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.703+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93875147752560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d96540 con 0x556102d4e8b0 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.704+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93875147752560] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501803c040 con 0x556102d4e8b0 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.704+0000 7f5025d3d800 20 remove_watcher() i=1 2024-09-07T03:32:56.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.704+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93875147760320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d96540 con 0x556102d52d90 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.705+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93875147760320] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.705+0000 7f5025d3d800 20 remove_watcher() i=2 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.705+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93875147764384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d96540 con 0x7f501c014440 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.706+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93875147764384] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501803c040 con 0x7f501c014440 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.706+0000 7f5025d3d800 20 remove_watcher() i=3 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.706+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93875147767024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d96540 con 0x556102d52d90 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.707+0000 7f502222b640 1 -- 172.21.15.120:0/3900739006 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93875147767024] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501c027070 con 0x556102d52d90 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.707+0000 7f5025d3d800 20 remove_watcher() i=4 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.707+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93875147769296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d96540 con 0x556102d57e60 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.708+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93875147769296] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.708+0000 7f5025d3d800 20 remove_watcher() i=5 2024-09-07T03:32:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.708+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93875147771040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d96540 con 0x556102d57e60 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.709+0000 7f5021a2a640 1 -- 172.21.15.120:0/3900739006 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93875147771040] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50140a0070 con 0x556102d57e60 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.709+0000 7f5025d3d800 20 remove_watcher() i=6 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.709+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93875147774992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556102d96540 con 0x7f501c014440 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93875147774992] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f501803c040 con 0x7f501c014440 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 20 remove_watcher() i=7 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d52d90 msgr2=0x556102d55180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d52d90 0x556102d55180 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102d4e8b0 msgr2=0x556102d50d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102d4e8b0 0x556102d50d70 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f501c014440 msgr2=0x7f501c04e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f501c014440 0x7f501c04e480 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556102d57e60 msgr2=0x556102d5a250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x556102d57e60 0x556102d5a250 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4eec03c730 msgr2=0x7f4eec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4eec03c730 0x7f4eec03ebf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f50140893f0 tx=0x7f501408d000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 msgr2=0x556102d42dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5021229640 1 -- 172.21.15.120:0/3900739006 reap_dead start 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d42dc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f501c017f20 tx=0x7f501c053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 shutdown_connections 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3900739006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d3b7a0 0x556102d42dc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.710+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 >> 172.21.15.120:0/3900739006 conn(0x556102d37ba0 msgr2=0x556102d35db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 shutdown_connections 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/3900739006 wait complete. 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/3282737265 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4efc03c780 msgr2=0x7f4efc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3282737265 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4efc03c780 0x7f4efc03ec40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x556102d1bd50 tx=0x7f501408b040 comp rx=0 tx=0).stop 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/3282737265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d2ece0 msgr2=0x556102d2f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3282737265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d2ece0 0x556102d2f100 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f501c016d20 tx=0x7f501c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/3282737265 shutdown_connections 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3282737265 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4efc03c780 0x7f4efc03ec40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/3282737265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102d2ece0 0x556102d2f100 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/3282737265 >> 172.21.15.120:0/3282737265 conn(0x556102d23090 msgr2=0x556102d23470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/3282737265 shutdown_connections 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/3282737265 wait complete. 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d1c590 msgr2=0x556102d1e980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d1c590 0x556102d1e980 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102c1b040 msgr2=0x556102d1b1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102c1b040 0x556102d1b1f0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4f0803c780 msgr2=0x7f4f0803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4f0803c780 0x7f4f0803ec40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5018000c00 tx=0x7f50180013b0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 msgr2=0x556102d0a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102d0a750 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5014025c20 tx=0x7f5014002fb0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 shutdown_connections 2024-09-07T03:32:56.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x556102d1c590 0x556102d1e980 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x556102c1b040 0x556102d1b1f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f4f0803c780 0x7f4f0803ec40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 --2- 172.21.15.120:0/2411170236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556102c19e00 0x556102d0a750 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.711+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 >> 172.21.15.120:0/2411170236 conn(0x556102c151d0 msgr2=0x556102d03530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.712+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 shutdown_connections 2024-09-07T03:32:56.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.712+0000 7f5025d3d800 1 -- 172.21.15.120:0/2411170236 wait complete. 2024-09-07T03:32:56.722 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:56.722 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-07T03:32:56.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-07T03:32:56.722 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-07T03:32:56.768 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:56.769 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:56.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.768+0000 7f3e6282f800 1 Processor -- start 2024-09-07T03:32:56.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.768+0000 7f3e6282f800 1 -- start start 2024-09-07T03:32:56.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.768+0000 7f3e6282f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56173793b210 0x561737940db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.768+0000 7f3e6282f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617377e4e40 con 0x561737939e00 2024-09-07T03:32:56.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.768+0000 7f3e6282f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5617377af680 con 0x56173793b210 2024-09-07T03:32:56.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.768+0000 7f3e57fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56173793b210 0x561737940db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.768+0000 7f3e57fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56173793b210 0x561737940db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58904/0 (socket says 172.21.15.120:58904) 2024-09-07T03:32:56.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.768+0000 7f3e60320640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x561737939e00 0x56173793ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41530/0 (socket says 172.21.15.120:41530) 2024-09-07T03:32:56.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.768+0000 7f3e57fff640 1 -- 172.21.15.120:0/2481386276 learned_addr learned my addr 172.21.15.120:0/2481386276 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.769+0000 7f3e57fff640 1 -- 172.21.15.120:0/2481386276 >> v1:172.21.15.104:6789/0 conn(0x561737939e00 legacy=0x56173793ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.769+0000 7f3e5fb1f640 1 -- 172.21.15.120:0/2481386276 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923198814 0 0) 0x5617377e4e40 con 0x561737939e00 2024-09-07T03:32:56.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.769+0000 7f3e57fff640 1 -- 172.21.15.120:0/2481386276 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617377cb6b0 con 0x56173793b210 2024-09-07T03:32:56.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.770+0000 7f3e57fff640 1 --2- 172.21.15.120:0/2481386276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56173793b210 0x561737940db0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800a520 tx=0x7f3e48045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e361c846c7a7b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e5fb1f640 1 -- 172.21.15.120:0/2481386276 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e48055070 con 0x56173793b210 2024-09-07T03:32:56.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e5fb1f640 1 -- 172.21.15.120:0/2481386276 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e480515b0 con 0x56173793b210 2024-09-07T03:32:56.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e5fb1f640 1 -- 172.21.15.120:0/2481386276 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e480518d0 con 0x56173793b210 2024-09-07T03:32:56.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e6282f800 1 -- 172.21.15.120:0/2481386276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56173793b210 msgr2=0x561737940db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e6282f800 1 --2- 172.21.15.120:0/2481386276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56173793b210 0x561737940db0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800a520 tx=0x7f3e48045ba0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e6282f800 1 -- 172.21.15.120:0/2481386276 shutdown_connections 2024-09-07T03:32:56.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e6282f800 1 --2- 172.21.15.120:0/2481386276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56173793b210 0x561737940db0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e6282f800 1 -- 172.21.15.120:0/2481386276 >> 172.21.15.120:0/2481386276 conn(0x5617379351d0 msgr2=0x561737937630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e6282f800 1 -- 172.21.15.120:0/2481386276 shutdown_connections 2024-09-07T03:32:56.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.771+0000 7f3e6282f800 1 -- 172.21.15.120:0/2481386276 wait complete. 2024-09-07T03:32:56.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.785+0000 7f3e6282f800 1 Processor -- start 2024-09-07T03:32:56.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.785+0000 7f3e6282f800 1 -- start start 2024-09-07T03:32:56.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.785+0000 7f3e6282f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.785+0000 7f3e6282f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5617377d3dd0 con 0x561737939e00 2024-09-07T03:32:56.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.785+0000 7f3e60320640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.785+0000 7f3e60320640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a293c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58920/0 (socket says 172.21.15.120:58920) 2024-09-07T03:32:56.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.785+0000 7f3e60320640 1 -- 172.21.15.120:0/4270999522 learned_addr learned my addr 172.21.15.120:0/4270999522 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.786+0000 7f3e60320640 1 -- 172.21.15.120:0/4270999522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617377ece10 con 0x561737939e00 2024-09-07T03:32:56.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.786+0000 7f3e60320640 1 --2- 172.21.15.120:0/4270999522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a293c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3e50001ea0 tx=0x7f3e5000d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f637332eeb29a747 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.786+0000 7f3d4e60c640 1 -- 172.21.15.120:0/4270999522 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e5000a420 con 0x561737939e00 2024-09-07T03:32:56.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.786+0000 7f3d4e60c640 1 -- 172.21.15.120:0/4270999522 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5000a5e0 con 0x561737939e00 2024-09-07T03:32:56.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.786+0000 7f3d4e60c640 1 -- 172.21.15.120:0/4270999522 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e5000a940 con 0x561737939e00 2024-09-07T03:32:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 -- 172.21.15.120:0/4270999522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 msgr2=0x561737a293c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4270999522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a293c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3e50001ea0 tx=0x7f3e5000d4e0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 -- 172.21.15.120:0/4270999522 shutdown_connections 2024-09-07T03:32:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4270999522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a293c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 -- 172.21.15.120:0/4270999522 >> 172.21.15.120:0/4270999522 conn(0x5617379351d0 msgr2=0x561737a24d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 -- 172.21.15.120:0/4270999522 shutdown_connections 2024-09-07T03:32:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 -- 172.21.15.120:0/4270999522 wait complete. 2024-09-07T03:32:56.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 Processor -- start 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 -- start start 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a2fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.787+0000 7f3e6282f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56173793b900 con 0x561737939e00 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3e60320640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a2fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3e60320640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a2fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58930/0 (socket says 172.21.15.120:58930) 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3e60320640 1 -- 172.21.15.120:0/4065662471 learned_addr learned my addr 172.21.15.120:0/4065662471 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3e60320640 1 -- 172.21.15.120:0/4065662471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561737a30150 con 0x561737939e00 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3e60320640 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a2fbf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d520 tx=0x7f3e50000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3d4ce09640 1 -- 172.21.15.120:0/4065662471 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e50027070 con 0x561737939e00 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3d4ce09640 1 -- 172.21.15.120:0/4065662471 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e50017610 con 0x561737939e00 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561737a303e0 con 0x561737939e00 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3d4ce09640 1 -- 172.21.15.120:0/4065662471 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e500178f0 con 0x561737939e00 2024-09-07T03:32:56.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.788+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561737a30de0 con 0x561737939e00 2024-09-07T03:32:56.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.789+0000 7f3d4ce09640 1 -- 172.21.15.120:0/4065662471 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3e5002a070 con 0x561737939e00 2024-09-07T03:32:56.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.789+0000 7f3d4ce09640 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d4803c780 0x7f3d4803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.789+0000 7f3d4ce09640 1 -- 172.21.15.120:0/4065662471 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3e50054b90 con 0x561737939e00 2024-09-07T03:32:56.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.790+0000 7f3e57fff640 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d4803c780 0x7f3d4803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.790+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56173793b210 0x561737a37240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.790+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a37780 con 0x56173793b210 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.790+0000 7f3e60b21640 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56173793b210 0x561737a37240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.790+0000 7f3e57fff640 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d4803c780 0x7f3d4803ec40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e48057000 tx=0x7f3e48052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.790+0000 7f3e60b21640 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56173793b210 0x561737a37240 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.790+0000 7f3e60b21640 1 -- 172.21.15.120:0/4065662471 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e5800a4d0 con 0x56173793b210 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.790+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a38030 0x561737a3a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.790+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a3ac10 con 0x561737a38030 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.791+0000 7f3e60320640 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a38030 0x561737a3a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.791+0000 7f3e60320640 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a38030 0x561737a3a4a0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.791+0000 7f3e60320640 1 -- 172.21.15.120:0/4065662471 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e50029030 con 0x561737a38030 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.791+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a3c4c0 con 0x561737a38030 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.792+0000 7f3e60320640 1 -- 172.21.15.120:0/4065662471 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e50029030 con 0x561737a38030 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.792+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a3b600 con 0x561737a38030 2024-09-07T03:32:56.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.792+0000 7f3e60320640 1 -- 172.21.15.120:0/4065662471 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e50029030 con 0x561737a38030 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.792+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a3ba60 con 0x56173793b210 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.792+0000 7f3e60b21640 1 -- 172.21.15.120:0/4065662471 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3e5800a4d0 con 0x56173793b210 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.792+0000 7f3e6282f800 1 Processor -- start 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.792+0000 7f3e6282f800 1 -- start start 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3e6282f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a4a9c0 0x561737a4ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3e6282f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561737831a00 con 0x561737a4a9c0 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3e60b21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a4a9c0 0x561737a4ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3e60b21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a4a9c0 0x561737a4ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58934/0 (socket says 172.21.15.120:58934) 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3e60b21640 1 -- 172.21.15.120:0/577557292 learned_addr learned my addr 172.21.15.120:0/577557292 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3e60b21640 1 -- 172.21.15.120:0/577557292 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561737a4b420 con 0x561737a4a9c0 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3e60b21640 1 --2- 172.21.15.120:0/577557292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a4a9c0 0x561737a4ade0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3e58016d20 tx=0x7f3e5800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3d45ffb640 1 -- 172.21.15.120:0/577557292 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e58017660 con 0x561737a4a9c0 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3d45ffb640 1 -- 172.21.15.120:0/577557292 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5801b030 con 0x561737a4a9c0 2024-09-07T03:32:56.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3e6282f800 1 -- 172.21.15.120:0/577557292 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561737a4bc50 con 0x561737a4a9c0 2024-09-07T03:32:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3d45ffb640 1 -- 172.21.15.120:0/577557292 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e58017950 con 0x561737a4a9c0 2024-09-07T03:32:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.793+0000 7f3e6282f800 1 -- 172.21.15.120:0/577557292 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561737a4c1f0 con 0x561737a4a9c0 2024-09-07T03:32:56.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.794+0000 7f3d45ffb640 1 -- 172.21.15.120:0/577557292 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3e58017af0 con 0x561737a4a9c0 2024-09-07T03:32:56.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.794+0000 7f3d45ffb640 1 --2- 172.21.15.120:0/577557292 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3803c780 0x7f3d3803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.794+0000 7f3d45ffb640 1 -- 172.21.15.120:0/577557292 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3e5800e040 con 0x561737a4a9c0 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e60320640 1 --2- 172.21.15.120:0/577557292 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3803c780 0x7f3d3803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e6282f800 1 Processor -- start 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e60320640 1 --2- 172.21.15.120:0/577557292 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3803c780 0x7f3d3803ec40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x561737a31300 tx=0x7f3e50009e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e6282f800 1 -- start start 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e6282f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a578c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e6282f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561737a29c10 con 0x561737a574c0 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e60b21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e60b21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58944/0 (socket says 172.21.15.120:58944) 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e60b21640 1 -- 172.21.15.120:0/1948418341 learned_addr learned my addr 172.21.15.120:0/1948418341 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.795+0000 7f3e60b21640 1 -- 172.21.15.120:0/1948418341 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561737a57eb0 con 0x561737a574c0 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e60b21640 1 --2- 172.21.15.120:0/1948418341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a578c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3e58053e00 tx=0x7f3e58017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1df363dc34a7da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3d3f7fe640 1 -- 172.21.15.120:0/1948418341 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e58014d40 con 0x561737a574c0 2024-09-07T03:32:56.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3d3f7fe640 1 -- 172.21.15.120:0/1948418341 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e58051070 con 0x561737a574c0 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3d3f7fe640 1 -- 172.21.15.120:0/1948418341 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e580149b0 con 0x561737a574c0 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e6282f800 1 -- 172.21.15.120:0/1948418341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 msgr2=0x561737a578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1948418341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a578c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3e58053e00 tx=0x7f3e58017de0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e6282f800 1 -- 172.21.15.120:0/1948418341 shutdown_connections 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1948418341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a578c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e6282f800 1 -- 172.21.15.120:0/1948418341 >> 172.21.15.120:0/1948418341 conn(0x561737a538e0 msgr2=0x561737a51b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e6282f800 1 -- 172.21.15.120:0/1948418341 shutdown_connections 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e6282f800 1 -- 172.21.15.120:0/1948418341 wait complete. 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e6282f800 1 Processor -- start 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.796+0000 7f3e6282f800 1 -- start start 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3e6282f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a5eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3e6282f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561737a584d0 con 0x561737a574c0 2024-09-07T03:32:56.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3e60b21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a5eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3e60b21640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a5eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58950/0 (socket says 172.21.15.120:58950) 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 learned_addr learned my addr 172.21.15.120:0/1596745594 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561737a5f020 con 0x561737a574c0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3e60b21640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a5eac0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3e58017fd0 tx=0x7f3e58053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3d3dffb640 1 -- 172.21.15.120:0/1596745594 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e580289b0 con 0x561737a574c0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3d3dffb640 1 -- 172.21.15.120:0/1596745594 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e58012c70 con 0x561737a574c0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561737a5f2b0 con 0x561737a574c0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3d3dffb640 1 -- 172.21.15.120:0/1596745594 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e58055250 con 0x561737a574c0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.797+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561737a5fc30 con 0x561737a574c0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.798+0000 7f3d3dffb640 1 -- 172.21.15.120:0/1596745594 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3e580553f0 con 0x561737a574c0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.798+0000 7f3d3dffb640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3003c920 0x7f3d3003ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.798+0000 7f3d3dffb640 1 -- 172.21.15.120:0/1596745594 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3e58035da0 con 0x561737a574c0 2024-09-07T03:32:56.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.798+0000 7f3e60320640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3003c920 0x7f3d3003ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.799+0000 7f3e60320640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3003c920 0x7f3d3003ede0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e500473f0 tx=0x7f3e50032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.799+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.799+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561737a6a560 0x561737a6ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.799+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a6d170 con 0x561737a6a560 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.799+0000 7f3e57fff640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561737a6a560 0x561737a6ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.799+0000 7f3e57fff640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561737a6a560 0x561737a6ca20 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 20 realm 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a6d5a0 con 0x561737a6a560 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a6de70 con 0x561737a6a560 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a6e890 0x561737a70cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a71430 con 0x561737a6e890 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e60b21640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a6e890 0x561737a70cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.800+0000 7f3e60b21640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a6e890 0x561737a70cc0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e6282f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a71c80 con 0x561737a6e890 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e6282f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e6282f800 20 searching for the correct realm 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561737a739f0 0x561737a75e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a739f0 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e60320640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561737a739f0 0x561737a75e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.801+0000 7f3e60320640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561737a739f0 0x561737a75e60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.802+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.802+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6e890 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.802+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.802+0000 7f3e60b21640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3e58014440 0x7f3e58020420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.802+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x7f3e58014440 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.802+0000 7f3e57fff640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3e58014440 0x7f3e58020420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.802+0000 7f3e57fff640 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3e58014440 0x7f3e58020420 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.803+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.803+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6a560 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.803+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.803+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6a560 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.803+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.803+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a739f0 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.803+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.803+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6a560 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6e890 2024-09-07T03:32:56.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6e890 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6a560 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x7f3e58014440 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.804+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6a560 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.805+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.805+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x7f3e58014440 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.805+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.805+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6e890 2024-09-07T03:32:56.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.805+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.805+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a739f0 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.806+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.806+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6a560 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.806+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.806+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6e890 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.806+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.806+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a739f0 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.806+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.806+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6a560 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.806+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.807+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6a560 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.807+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.807+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6a560 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.807+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.807+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a739f0 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.807+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.807+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x7f3e58014440 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.807+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.807+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x7f3e58014440 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.808+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.808+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x7f3e58014440 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.808+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.808+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a739f0 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.808+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.808+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x7f3e58014440 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.808+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.808+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6e890 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.809+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.809+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6e890 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.809+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.809+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a739f0 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.809+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.809+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6e890 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.809+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.809+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561737a76530 con 0x561737a6e890 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.809+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a72600 con 0x561737a6a560 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a72240 con 0x561737a6e890 2024-09-07T03:32:56.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a72a40 con 0x561737a6a560 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 zone default found 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 4 Realm: () 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 zonegroup default 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.810+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a76e60 con 0x7f3e58014440 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a790a0 con 0x561737a739f0 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a79440 con 0x561737a739f0 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 20 started sync module instance, tier type = 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.811+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a78530 con 0x561737a6e890 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.813+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.813+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94657717963088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a78190 con 0x561737a6e890 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.813+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7a190 con 0x561737a6a560 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.814+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94657717963088] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.814+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.814+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94657717966896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7a530 con 0x561737a6a560 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.814+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7af70 con 0x561737a6e890 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.815+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94657717966896] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.815+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.815+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94657717971520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7af30 con 0x561737a6e890 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.815+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7ba20 con 0x7f3e58014440 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.816+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.816+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94657717974320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7ba20 con 0x7f3e58014440 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.816+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7c9c0 con 0x561737a6e890 2024-09-07T03:32:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.816+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94657717971520] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.817+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94657717974320] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.817+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.817+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94657717976592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7c980 con 0x561737a6e890 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.817+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7ce00 con 0x561737a739f0 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.818+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.818+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94657717967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7d650 con 0x561737a739f0 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.818+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7e150 con 0x561737a739f0 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.818+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94657717976592] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.819+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94657717967952] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.819+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.819+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94657717984320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7d1a0 con 0x561737a739f0 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.819+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7e730 con 0x7f3e58014440 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94657717985920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7eb50 con 0x7f3e58014440 2024-09-07T03:32:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e6282f800 20 add_watcher() i=0 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e6282f800 20 add_watcher() i=1 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e6282f800 20 add_watcher() i=2 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e6282f800 20 add_watcher() i=3 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e6282f800 20 add_watcher() i=4 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e6282f800 20 add_watcher() i=5 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94657717984320] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.820+0000 7f3e6282f800 20 add_watcher() i=6 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.821+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94657717985920] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.821+0000 7f3e6282f800 20 add_watcher() i=7 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.821+0000 7f3e6282f800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.821+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737a7eb50 con 0x561737a6a560 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.822+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.822+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94657717986976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737a7eaf0 con 0x561737a6a560 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.823+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94657717986976] v36'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.823+0000 7f3d167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.823+0000 7f3e6282f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.823+0000 7f3e6282f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.823+0000 7f3e6282f800 5 note: GC not initialized 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3d157e2640 20 reqs_thread_entry: start 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 20 Filter name: none 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3c86ffd640 20 reqs_thread_entry: start 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737ab4bc0 con 0x561737a6a560 2024-09-07T03:32:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 20 rados_obj.operate() r=0 bl.length=403 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.824+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737abac30 con 0x561737a6a560 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v36'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3e6282f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3e6282f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3e6282f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94657718232560 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561737ab64e0 con 0x561737a6e890 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94657717976592 notify 154618822685 ret 0) ==== 609+0+0 (crc 0 0 0) 0x561737a5fc30 con 0x561737a6e890 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3d3f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94657717976592 notifier 4659 bl.length()=567 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94657718232560 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3d3f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-07T03:32:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3d3f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3d3f7fe640 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3d24003ea0 con 0x561737a6e890 2024-09-07T03:32:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.826+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94657718232560 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561737a5f2b0 con 0x561737a6e890 2024-09-07T03:32:56.838 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-07T03:32:32.777054Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:32:32.777044Z","tags":[],"group_ids":[]} 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.827+0000 7f3d167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.827+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94657717986976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737ab2a20 con 0x561737a6a560 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.828+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94657717986976] v36'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.828+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94657717963088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737ab2a20 con 0x561737a6e890 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.829+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94657717963088] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.829+0000 7f3e6282f800 20 remove_watcher() i=0 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.829+0000 7f3e6282f800 2 removed watcher, disabling cache 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.829+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94657717966896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737ab2a20 con 0x561737a6a560 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.830+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94657717966896] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x561737a6a560 2024-09-07T03:32:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.830+0000 7f3e6282f800 20 remove_watcher() i=1 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.830+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94657717971520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737ab2a20 con 0x561737a6e890 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.831+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94657717971520] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.831+0000 7f3e6282f800 20 remove_watcher() i=2 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.831+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94657717974320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737ab2a20 con 0x7f3e58014440 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.832+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94657717974320] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.832+0000 7f3e6282f800 20 remove_watcher() i=3 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.832+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94657717976592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737ab2a20 con 0x561737a6e890 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.833+0000 7f3e60b21640 1 -- 172.21.15.120:0/1596745594 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94657717976592] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58027070 con 0x561737a6e890 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.833+0000 7f3e6282f800 20 remove_watcher() i=4 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.833+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94657717967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737ab2a20 con 0x561737a739f0 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.834+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94657717967952] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.834+0000 7f3e6282f800 20 remove_watcher() i=5 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.834+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94657717984320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737ab2a20 con 0x561737a739f0 2024-09-07T03:32:56.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.835+0000 7f3e60320640 1 -- 172.21.15.120:0/1596745594 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94657717984320] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e50043070 con 0x561737a739f0 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.835+0000 7f3e6282f800 20 remove_watcher() i=6 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.835+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94657717985920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561737ab2a20 con 0x7f3e58014440 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94657717985920] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e48057030 con 0x7f3e58014440 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 20 remove_watcher() i=7 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a6e890 msgr2=0x561737a70cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a6e890 0x561737a70cc0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561737a6a560 msgr2=0x561737a6ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561737a6a560 0x561737a6ca20 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3e58014440 msgr2=0x7f3e58020420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3e58014440 0x7f3e58020420 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561737a739f0 msgr2=0x561737a75e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561737a739f0 0x561737a75e60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3003c920 msgr2=0x7f3d3003ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3003c920 0x7f3d3003ede0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e500473f0 tx=0x7f3e50032000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 msgr2=0x561737a5eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a5eac0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3e58017fd0 tx=0x7f3e58053d60 comp rx=0 tx=0).stop 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e57fff640 1 -- 172.21.15.120:0/1596745594 reap_dead start 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 shutdown_connections 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 --2- 172.21.15.120:0/1596745594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a574c0 0x561737a5eac0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 >> 172.21.15.120:0/1596745594 conn(0x561737a538e0 msgr2=0x561737a51af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 shutdown_connections 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.836+0000 7f3e6282f800 1 -- 172.21.15.120:0/1596745594 wait complete. 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/577557292 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3803c780 msgr2=0x7f3d3803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/577557292 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3803c780 0x7f3d3803ec40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x561737a31300 tx=0x7f3e50009e00 comp rx=0 tx=0).stop 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/577557292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a4a9c0 msgr2=0x561737a4ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/577557292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a4a9c0 0x561737a4ade0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3e58016d20 tx=0x7f3e5800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/577557292 shutdown_connections 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/577557292 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d3803c780 0x7f3d3803ec40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/577557292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737a4a9c0 0x561737a4ade0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/577557292 >> 172.21.15.120:0/577557292 conn(0x561737a3ed70 msgr2=0x561737a3f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/577557292 shutdown_connections 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/577557292 wait complete. 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a38030 msgr2=0x561737a3a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a38030 0x561737a3a4a0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56173793b210 msgr2=0x561737a37240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56173793b210 0x561737a37240 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d4803c780 msgr2=0x7f3d4803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d4803c780 0x7f3d4803ec40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e48057000 tx=0x7f3e48052000 comp rx=0 tx=0).stop 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 msgr2=0x561737a2fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a2fbf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d520 tx=0x7f3e50000ed0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 shutdown_connections 2024-09-07T03:32:56.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561737a38030 0x561737a3a4a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56173793b210 0x561737a37240 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3d4803c780 0x7f3d4803ec40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 --2- 172.21.15.120:0/4065662471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561737939e00 0x561737a2fbf0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 >> 172.21.15.120:0/4065662471 conn(0x5617379351d0 msgr2=0x561737a2a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 shutdown_connections 2024-09-07T03:32:56.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.837+0000 7f3e6282f800 1 -- 172.21.15.120:0/4065662471 wait complete. 2024-09-07T03:32:56.849 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-07T03:32:32.777054Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:32:32.777044Z', 'tags': [], 'group_ids': []} 2024-09-07T03:32:56.858 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:56.859 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-07T03:32:56.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-07T03:32:56.859 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-07T03:32:56.903 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:32:56.903 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:32:56.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.903+0000 7ff958b75800 1 Processor -- start 2024-09-07T03:32:56.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.903+0000 7ff958b75800 1 -- start start 2024-09-07T03:32:56.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.903+0000 7ff958b75800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561422b77200 0x561422b796c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.903+0000 7ff958b75800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561422a1ce40 con 0x561422b73600 2024-09-07T03:32:56.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.903+0000 7ff958b75800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5614229e7680 con 0x561422b77200 2024-09-07T03:32:56.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.903+0000 7ff94de5e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x561422b77200 0x561422b796c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.903+0000 7ff95665f640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x561422b73600 0x561422b759f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:41532/0 (socket says 172.21.15.120:41532) 2024-09-07T03:32:56.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.903+0000 7ff95665f640 1 -- 172.21.15.120:0/3350617790 learned_addr learned my addr 172.21.15.120:0/3350617790 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:32:56.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.904+0000 7ff955e5e640 1 -- 172.21.15.120:0/3350617790 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1012813992 0 0) 0x561422a1ce40 con 0x561422b73600 2024-09-07T03:32:56.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.904+0000 7ff955e5e640 1 -- 172.21.15.120:0/3350617790 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff944001e10 con 0x561422b73600 2024-09-07T03:32:56.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.904+0000 7ff94de5e640 1 -- 172.21.15.120:0/3350617790 >> v1:172.21.15.104:6789/0 conn(0x561422b73600 legacy=0x561422b759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.904+0000 7ff94de5e640 1 -- 172.21.15.120:0/3350617790 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561422a036b0 con 0x561422b77200 2024-09-07T03:32:56.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.905+0000 7ff94de5e640 1 --2- 172.21.15.120:0/3350617790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b77200 0x561422b796c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff94000a470 tx=0x7ff940045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fea68232d0eb457 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.905+0000 7ff955e5e640 1 -- 172.21.15.120:0/3350617790 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff940059070 con 0x561422b77200 2024-09-07T03:32:56.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.906+0000 7ff955e5e640 1 -- 172.21.15.120:0/3350617790 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff940054570 con 0x561422b77200 2024-09-07T03:32:56.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.906+0000 7ff955e5e640 1 -- 172.21.15.120:0/3350617790 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff940054870 con 0x561422b77200 2024-09-07T03:32:56.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.906+0000 7ff958b75800 1 -- 172.21.15.120:0/3350617790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b77200 msgr2=0x561422b796c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.906+0000 7ff958b75800 1 --2- 172.21.15.120:0/3350617790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b77200 0x561422b796c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff94000a470 tx=0x7ff940045920 comp rx=0 tx=0).stop 2024-09-07T03:32:56.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.906+0000 7ff958b75800 1 -- 172.21.15.120:0/3350617790 shutdown_connections 2024-09-07T03:32:56.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.906+0000 7ff958b75800 1 --2- 172.21.15.120:0/3350617790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b77200 0x561422b796c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.906+0000 7ff958b75800 1 -- 172.21.15.120:0/3350617790 >> 172.21.15.120:0/3350617790 conn(0x561422b6d1c0 msgr2=0x561422b6f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.906+0000 7ff958b75800 1 -- 172.21.15.120:0/3350617790 shutdown_connections 2024-09-07T03:32:56.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.906+0000 7ff958b75800 1 -- 172.21.15.120:0/3350617790 wait complete. 2024-09-07T03:32:56.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.920+0000 7ff958b75800 1 Processor -- start 2024-09-07T03:32:56.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.920+0000 7ff958b75800 1 -- start start 2024-09-07T03:32:56.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.920+0000 7ff958b75800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422c624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.920+0000 7ff958b75800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561422a0bdd0 con 0x561422b73600 2024-09-07T03:32:56.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.920+0000 7ff95665f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422c624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.920+0000 7ff95665f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422c624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58974/0 (socket says 172.21.15.120:58974) 2024-09-07T03:32:56.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.920+0000 7ff95665f640 1 -- 172.21.15.120:0/401333934 learned_addr learned my addr 172.21.15.120:0/401333934 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.921+0000 7ff95665f640 1 -- 172.21.15.120:0/401333934 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561422a24e10 con 0x561422b73600 2024-09-07T03:32:56.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.921+0000 7ff95665f640 1 --2- 172.21.15.120:0/401333934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422c624e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff948001e30 tx=0x7ff94800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d17e726a43225c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.921+0000 7ff844608640 1 -- 172.21.15.120:0/401333934 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff948012020 con 0x561422b73600 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.921+0000 7ff844608640 1 -- 172.21.15.120:0/401333934 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94800e470 con 0x561422b73600 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.921+0000 7ff844608640 1 -- 172.21.15.120:0/401333934 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff94800e790 con 0x561422b73600 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 -- 172.21.15.120:0/401333934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 msgr2=0x561422c624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 --2- 172.21.15.120:0/401333934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422c624e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff948001e30 tx=0x7ff94800b780 comp rx=0 tx=0).stop 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 -- 172.21.15.120:0/401333934 shutdown_connections 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 --2- 172.21.15.120:0/401333934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422c624e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 -- 172.21.15.120:0/401333934 >> 172.21.15.120:0/401333934 conn(0x561422b6d1c0 msgr2=0x561422c5de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 -- 172.21.15.120:0/401333934 shutdown_connections 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 -- 172.21.15.120:0/401333934 wait complete. 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 Processor -- start 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 -- start start 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422b72d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff958b75800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561422b7a040 con 0x561422b73600 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff95665f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422b72d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff95665f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422b72d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58984/0 (socket says 172.21.15.120:58984) 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.922+0000 7ff95665f640 1 -- 172.21.15.120:0/1800013353 learned_addr learned my addr 172.21.15.120:0/1800013353 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.923+0000 7ff95665f640 1 -- 172.21.15.120:0/1800013353 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561422b73280 con 0x561422b73600 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.923+0000 7ff95665f640 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422b72d20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x561422c63470 tx=0x7ff9480040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.923+0000 7ff842e05640 1 -- 172.21.15.120:0/1800013353 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff948012030 con 0x561422b73600 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.923+0000 7ff842e05640 1 -- 172.21.15.120:0/1800013353 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94801a7a0 con 0x561422b73600 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.923+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561422b71630 con 0x561422b73600 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.923+0000 7ff842e05640 1 -- 172.21.15.120:0/1800013353 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff94801aaa0 con 0x561422b73600 2024-09-07T03:32:56.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.923+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561422b71bf0 con 0x561422b73600 2024-09-07T03:32:56.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.924+0000 7ff842e05640 1 -- 172.21.15.120:0/1800013353 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff948015020 con 0x561422b73600 2024-09-07T03:32:56.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.924+0000 7ff842e05640 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83c03c780 0x7ff83c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.924+0000 7ff842e05640 1 -- 172.21.15.120:0/1800013353 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff948020070 con 0x561422b73600 2024-09-07T03:32:56.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.924+0000 7ff94de5e640 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83c03c780 0x7ff83c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.924+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422b77200 0x561422c73330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.924+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422c73870 con 0x561422b77200 2024-09-07T03:32:56.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.924+0000 7ff956e60640 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422b77200 0x561422c73330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.924+0000 7ff94de5e640 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83c03c780 0x7ff83c03ec40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x561422ae5540 tx=0x7ff940050000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.925+0000 7ff956e60640 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422b77200 0x561422c73330 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.925+0000 7ff956e60640 1 -- 172.21.15.120:0/1800013353 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff95000a4d0 con 0x561422b77200 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.925+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422c74600 0x561422c769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.925+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422c77020 con 0x561422c74600 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.925+0000 7ff95665f640 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422c74600 0x561422c769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.925+0000 7ff95665f640 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422c74600 0x561422c769f0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.926+0000 7ff95665f640 1 -- 172.21.15.120:0/1800013353 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff948018950 con 0x561422c74600 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.926+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422c788d0 con 0x561422c74600 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.926+0000 7ff95665f640 1 -- 172.21.15.120:0/1800013353 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff948018950 con 0x561422c74600 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.926+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422c77a40 con 0x561422c74600 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.926+0000 7ff95665f640 1 -- 172.21.15.120:0/1800013353 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff948018950 con 0x561422c74600 2024-09-07T03:32:56.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.926+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422c77e60 con 0x561422b77200 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.926+0000 7ff956e60640 1 -- 172.21.15.120:0/1800013353 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff95000a4d0 con 0x561422b77200 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.927+0000 7ff958b75800 1 Processor -- start 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.927+0000 7ff958b75800 1 -- start start 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.927+0000 7ff958b75800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c86d90 0x561422c871b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.927+0000 7ff958b75800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561422a69a00 con 0x561422c86d90 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.927+0000 7ff956e60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c86d90 0x561422c871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.927+0000 7ff956e60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c86d90 0x561422c871b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:58998/0 (socket says 172.21.15.120:58998) 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.927+0000 7ff956e60640 1 -- 172.21.15.120:0/4231514679 learned_addr learned my addr 172.21.15.120:0/4231514679 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.927+0000 7ff956e60640 1 -- 172.21.15.120:0/4231514679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561422c877f0 con 0x561422c86d90 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.927+0000 7ff956e60640 1 --2- 172.21.15.120:0/4231514679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c86d90 0x561422c871b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff950016d20 tx=0x7ff95000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.928+0000 7ff83bfff640 1 -- 172.21.15.120:0/4231514679 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950017660 con 0x561422c86d90 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.928+0000 7ff83bfff640 1 -- 172.21.15.120:0/4231514679 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff95001b030 con 0x561422c86d90 2024-09-07T03:32:56.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.928+0000 7ff958b75800 1 -- 172.21.15.120:0/4231514679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561422c88020 con 0x561422c86d90 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.928+0000 7ff83bfff640 1 -- 172.21.15.120:0/4231514679 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950017950 con 0x561422c86d90 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.928+0000 7ff958b75800 1 -- 172.21.15.120:0/4231514679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561422c885c0 con 0x561422c86d90 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.928+0000 7ff83bfff640 1 -- 172.21.15.120:0/4231514679 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff950017af0 con 0x561422c86d90 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff83bfff640 1 --2- 172.21.15.120:0/4231514679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83003c780 0x7ff83003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff83bfff640 1 -- 172.21.15.120:0/4231514679 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff95000e040 con 0x561422c86d90 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff95665f640 1 --2- 172.21.15.120:0/4231514679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83003c780 0x7ff83003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff958b75800 1 Processor -- start 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff958b75800 1 -- start start 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff95665f640 1 --2- 172.21.15.120:0/4231514679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83003c780 0x7ff83003ec40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x561422c77560 tx=0x7ff948052020 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff958b75800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c93c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff958b75800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561422c62d30 con 0x561422c93830 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff956e60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c93c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff956e60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c93c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:59006/0 (socket says 172.21.15.120:59006) 2024-09-07T03:32:56.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.929+0000 7ff956e60640 1 -- 172.21.15.120:0/2334634825 learned_addr learned my addr 172.21.15.120:0/2334634825 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff956e60640 1 -- 172.21.15.120:0/2334634825 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561422c94220 con 0x561422c93830 2024-09-07T03:32:56.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff956e60640 1 --2- 172.21.15.120:0/2334634825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c93c30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff950054030 tx=0x7ff950054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cce2b10d3a2851d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff839ffb640 1 -- 172.21.15.120:0/2334634825 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950014e70 con 0x561422c93830 2024-09-07T03:32:56.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff839ffb640 1 -- 172.21.15.120:0/2334634825 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9500149b0 con 0x561422c93830 2024-09-07T03:32:56.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff839ffb640 1 -- 172.21.15.120:0/2334634825 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950028350 con 0x561422c93830 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff958b75800 1 -- 172.21.15.120:0/2334634825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 msgr2=0x561422c93c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff958b75800 1 --2- 172.21.15.120:0/2334634825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c93c30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff950054030 tx=0x7ff950054060 comp rx=0 tx=0).stop 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff958b75800 1 -- 172.21.15.120:0/2334634825 shutdown_connections 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff958b75800 1 --2- 172.21.15.120:0/2334634825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c93c30 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff958b75800 1 -- 172.21.15.120:0/2334634825 >> 172.21.15.120:0/2334634825 conn(0x561422c8fc30 msgr2=0x561422c8de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff958b75800 1 -- 172.21.15.120:0/2334634825 shutdown_connections 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.930+0000 7ff958b75800 1 -- 172.21.15.120:0/2334634825 wait complete. 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff958b75800 1 Processor -- start 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff958b75800 1 -- start start 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff958b75800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c9add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff958b75800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561422c94810 con 0x561422c93830 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff956e60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c9add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff956e60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c9add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:59008/0 (socket says 172.21.15.120:59008) 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 learned_addr learned my addr 172.21.15.120:0/3523289169 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561422c9b330 con 0x561422c93830 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff956e60640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c9add0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff950012500 tx=0x7ff950053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff827fff640 1 -- 172.21.15.120:0/3523289169 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950012570 con 0x561422c93830 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff827fff640 1 -- 172.21.15.120:0/3523289169 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff950005500 con 0x561422c93830 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.931+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561422c9b5c0 con 0x561422c93830 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.932+0000 7ff827fff640 1 -- 172.21.15.120:0/3523289169 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950012ae0 con 0x561422c93830 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.932+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561422c9c150 con 0x561422c93830 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.932+0000 7ff827fff640 1 -- 172.21.15.120:0/3523289169 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff950012c80 con 0x561422c93830 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.932+0000 7ff827fff640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff82003c730 0x7ff82003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.932+0000 7ff827fff640 1 -- 172.21.15.120:0/3523289169 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff9500489e0 con 0x561422c93830 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.933+0000 7ff95665f640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff82003c730 0x7ff82003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.933+0000 7ff95665f640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff82003c730 0x7ff82003ebf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff94804b650 tx=0x7ff948045000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.933+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.933+0000 7ff958b75800 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422ca69a0 0x561422ca8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.933+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422ca95b0 con 0x561422ca69a0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.933+0000 7ff94de5e640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422ca69a0 0x561422ca8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff94de5e640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422ca69a0 0x561422ca8e60 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 20 realm 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422ca9980 con 0x561422ca69a0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:32:56.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422caa250 con 0x561422ca69a0 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422caac70 0x561422cad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.934+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cad7f0 con 0x561422caac70 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff956e60640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422caac70 0x561422cad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff956e60640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422caac70 0x561422cad080 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff958b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cae040 con 0x561422caac70 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff958b75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff958b75800 20 searching for the correct realm 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff958b75800 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561422cafdb0 0x561422cb21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422cafdb0 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.935+0000 7ff95665f640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561422cafdb0 0x561422cb21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.936+0000 7ff95665f640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561422cafdb0 0x561422cb21e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.936+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.936+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422caac70 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.936+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.936+0000 7ff956e60640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff950014440 0x7ff95003b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.936+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x7ff950014440 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.936+0000 7ff94de5e640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff950014440 0x7ff95003b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:32:56.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.937+0000 7ff94de5e640 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff950014440 0x7ff95003b3f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.937+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.937+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422ca69a0 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.937+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.937+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422ca69a0 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.937+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.937+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422cafdb0 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.937+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.938+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422ca69a0 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.938+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.938+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422caac70 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.938+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.938+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422caac70 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.938+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.938+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422ca69a0 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.938+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.938+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x7ff950014440 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.939+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.939+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422ca69a0 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.939+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.939+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x7ff950014440 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.939+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.939+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422caac70 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.939+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.939+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422cafdb0 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.940+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.940+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422ca69a0 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.940+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.940+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422caac70 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.940+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.940+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422cafdb0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.940+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.941+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422ca69a0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.941+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.941+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422ca69a0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.941+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.941+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422ca69a0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.941+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.941+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422cafdb0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.941+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.941+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x7ff950014440 2024-09-07T03:32:56.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.942+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.942+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x7ff950014440 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.942+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.942+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x7ff950014440 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.942+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.942+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422cafdb0 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.942+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.942+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x7ff950014440 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.943+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.943+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422caac70 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.943+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.943+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422caac70 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.943+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.943+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422cafdb0 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.943+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.943+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422caac70 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561422cb28b0 con 0x561422caac70 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cae990 con 0x561422ca69a0 2024-09-07T03:32:56.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cae5d0 con 0x561422caac70 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.944+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422caedd0 con 0x561422ca69a0 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 zone default found 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 4 Realm: () 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:32:56.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 zonegroup default 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cb31e0 con 0x7ff950014440 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cb5420 con 0x561422cafdb0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cb57c0 con 0x561422cafdb0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:32:56.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 started sync module instance, tier type = 2024-09-07T03:32:56.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:32:56.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.945+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb48b0 con 0x561422caac70 2024-09-07T03:32:56.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.947+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.947+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94644483083424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb4510 con 0x561422caac70 2024-09-07T03:32:56.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.947+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb6630 con 0x561422ca69a0 2024-09-07T03:32:56.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.948+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94644483083424] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.948+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.948+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94644483088768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb69d0 con 0x561422ca69a0 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.948+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb7390 con 0x561422caac70 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.949+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94644483088768] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.949+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.949+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94644483087200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb7390 con 0x561422caac70 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.949+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb7de0 con 0x7ff950014440 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.950+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94644483087200] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.950+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.950+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94644483094768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb7390 con 0x7ff950014440 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.950+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb8830 con 0x561422caac70 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.951+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94644483094768] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.952+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.952+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94644483097408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb7390 con 0x561422caac70 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.952+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb9240 con 0x561422cafdb0 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.953+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94644483097408] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.953+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.953+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94644483092192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb7300 con 0x561422cafdb0 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.953+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cba100 con 0x561422cafdb0 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.954+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94644483092192] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.954+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.954+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94644483103824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cba520 con 0x561422cafdb0 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.954+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cbaee0 con 0x7ff950014440 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94644483107376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cbb300 con 0x7ff950014440 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff958b75800 20 add_watcher() i=0 2024-09-07T03:32:56.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff958b75800 20 add_watcher() i=1 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff958b75800 20 add_watcher() i=2 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff958b75800 20 add_watcher() i=3 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff958b75800 20 add_watcher() i=4 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff958b75800 20 add_watcher() i=5 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94644483103824] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.955+0000 7ff958b75800 20 add_watcher() i=6 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.956+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94644483107376] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.956+0000 7ff958b75800 20 add_watcher() i=7 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.956+0000 7ff958b75800 2 all 8 watchers are set, enabling cache 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.956+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cba070 con 0x561422ca69a0 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.956+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.956+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94644483108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cba070 con 0x561422ca69a0 2024-09-07T03:32:56.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.957+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94644483108432] v36'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.957+0000 7ff80cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.957+0000 7ff958b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.957+0000 7ff958b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.957+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc6d50 con 0x561422caac70 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.959+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'56 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.959+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc6d50 con 0x7ff950014440 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.960+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.960+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc6d50 con 0x561422cafdb0 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.961+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.961+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7770 con 0x561422ca69a0 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.962+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'198 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.962+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7b70 con 0x561422caac70 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.963+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'71 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.963+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7b60 con 0x561422cafdb0 2024-09-07T03:32:56.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.964+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'55 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.964+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7c90 con 0x561422caac70 2024-09-07T03:32:56.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.965+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'34 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.965+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422ca69a0 2024-09-07T03:32:56.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.966+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.966+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82f0 con 0x561422caac70 2024-09-07T03:32:56.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.967+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.967+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82d0 con 0x561422caac70 2024-09-07T03:32:56.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.968+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.968+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82d0 con 0x561422caac70 2024-09-07T03:32:56.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.969+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'72 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.969+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82d0 con 0x561422cafdb0 2024-09-07T03:32:56.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.970+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.970+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82d0 con 0x561422caac70 2024-09-07T03:32:56.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.971+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.971+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82d0 con 0x561422ca69a0 2024-09-07T03:32:56.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.972+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'61 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.972+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82d0 con 0x561422ca69a0 2024-09-07T03:32:56.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.973+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'199 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.973+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82d0 con 0x561422caac70 2024-09-07T03:32:56.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.974+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.974+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82d0 con 0x561422caac70 2024-09-07T03:32:56.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.976+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'73 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.976+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc82d0 con 0x561422cafdb0 2024-09-07T03:32:56.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.977+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.977+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7c90 con 0x561422caac70 2024-09-07T03:32:56.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.978+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.978+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7c90 con 0x561422ca69a0 2024-09-07T03:32:56.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.978+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'200 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.978+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7c90 con 0x561422caac70 2024-09-07T03:32:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.979+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'68 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.979+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7c90 con 0x561422caac70 2024-09-07T03:32:56.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.981+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.981+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422cafdb0 2024-09-07T03:32:56.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.982+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.982+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422caac70 2024-09-07T03:32:56.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.983+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'43 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.983+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422cafdb0 2024-09-07T03:32:56.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.984+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.984+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422cafdb0 2024-09-07T03:32:56.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.985+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'56 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.985+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422cafdb0 2024-09-07T03:32:56.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.986+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:56.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.986+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422caac70 2024-09-07T03:32:56.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.987+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.987+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422ca69a0 2024-09-07T03:32:56.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.988+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.988+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422caac70 2024-09-07T03:32:56.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.989+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'69 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.989+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x561422ca69a0 2024-09-07T03:32:56.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.990+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.990+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc7d20 con 0x7ff950014440 2024-09-07T03:32:56.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.991+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.991+0000 7ff7877fe640 20 reqs_thread_entry: start 2024-09-07T03:32:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.991+0000 7ff958b75800 20 init_complete bucket index max shards: 11 2024-09-07T03:32:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.991+0000 7ff958b75800 20 Filter name: none 2024-09-07T03:32:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.991+0000 7ff7857fa640 20 reqs_thread_entry: start 2024-09-07T03:32:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff958b75800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:32:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff958b75800 20 rados->read ofs=0 len=0 2024-09-07T03:32:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cf3420 con 0x561422ca69a0 2024-09-07T03:32:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff958b75800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:32:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff958b75800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:32:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff958b75800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:32:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff958b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:32:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561422cf5730 con 0x7ff950014440 2024-09-07T03:32:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.992+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-07T03:32:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.993+0000 7ff80cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:32:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.993+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94644483108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cc63c0 con 0x561422ca69a0 2024-09-07T03:32:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.994+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94644483108432] v36'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.994+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94644483083424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cbae50 con 0x561422caac70 2024-09-07T03:32:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.995+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94644483083424] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.995+0000 7ff958b75800 20 remove_watcher() i=0 2024-09-07T03:32:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.995+0000 7ff958b75800 2 removed watcher, disabling cache 2024-09-07T03:32:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.995+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94644483088768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb4ca0 con 0x561422ca69a0 2024-09-07T03:32:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.996+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94644483088768] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff940061430 con 0x561422ca69a0 2024-09-07T03:32:56.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.996+0000 7ff958b75800 20 remove_watcher() i=1 2024-09-07T03:32:56.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.996+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94644483087200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb4ca0 con 0x561422caac70 2024-09-07T03:32:56.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.997+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94644483087200] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:56.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.997+0000 7ff958b75800 20 remove_watcher() i=2 2024-09-07T03:32:56.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.997+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94644483094768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb4ca0 con 0x7ff950014440 2024-09-07T03:32:56.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.998+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94644483094768] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:56.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.998+0000 7ff958b75800 20 remove_watcher() i=3 2024-09-07T03:32:57.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.998+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94644483097408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb4ca0 con 0x561422caac70 2024-09-07T03:32:57.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.999+0000 7ff956e60640 1 -- 172.21.15.120:0/3523289169 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94644483097408] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950027070 con 0x561422caac70 2024-09-07T03:32:57.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.999+0000 7ff958b75800 20 remove_watcher() i=4 2024-09-07T03:32:57.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:56.999+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94644483092192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb8340 con 0x561422cafdb0 2024-09-07T03:32:57.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.000+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94644483092192] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:57.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.000+0000 7ff958b75800 20 remove_watcher() i=5 2024-09-07T03:32:57.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.000+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94644483103824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb4ca0 con 0x561422cafdb0 2024-09-07T03:32:57.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.001+0000 7ff95665f640 1 -- 172.21.15.120:0/3523289169 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94644483103824] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff948018950 con 0x561422cafdb0 2024-09-07T03:32:57.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.001+0000 7ff958b75800 20 remove_watcher() i=6 2024-09-07T03:32:57.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.001+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94644483107376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561422cb6ee0 con 0x7ff950014440 2024-09-07T03:32:57.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94644483107376] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff940061430 con 0x7ff950014440 2024-09-07T03:32:57.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 20 remove_watcher() i=7 2024-09-07T03:32:57.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422caac70 msgr2=0x561422cad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422caac70 0x561422cad080 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422ca69a0 msgr2=0x561422ca8e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422ca69a0 0x561422ca8e60 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff950014440 msgr2=0x7ff95003b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7ff950014440 0x7ff95003b3f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561422cafdb0 msgr2=0x561422cb21e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x561422cafdb0 0x561422cb21e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff82003c730 msgr2=0x7ff82003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff82003c730 0x7ff82003ebf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff94804b650 tx=0x7ff948045000 comp rx=0 tx=0).stop 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 msgr2=0x561422c9add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 --2- 172.21.15.120:0/3523289169 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c93830 0x561422c9add0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff950012500 tx=0x7ff950053d40 comp rx=0 tx=0).stop 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 reap_dead start 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff94de5e640 1 -- 172.21.15.120:0/3523289169 reap_dead start 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 shutdown_connections 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 >> 172.21.15.120:0/3523289169 conn(0x561422c8fc30 msgr2=0x561422c8de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.002+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 shutdown_connections 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/3523289169 wait complete. 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/4231514679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83003c780 msgr2=0x7ff83003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/4231514679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83003c780 0x7ff83003ec40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x561422c77560 tx=0x7ff948052020 comp rx=0 tx=0).stop 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/4231514679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c86d90 msgr2=0x561422c871b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/4231514679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c86d90 0x561422c871b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff950016d20 tx=0x7ff95000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/4231514679 shutdown_connections 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/4231514679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83003c780 0x7ff83003ec40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/4231514679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422c86d90 0x561422c871b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/4231514679 >> 172.21.15.120:0/4231514679 conn(0x561422c7b140 msgr2=0x561422c7b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/4231514679 shutdown_connections 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/4231514679 wait complete. 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422c74600 msgr2=0x561422c769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422c74600 0x561422c769f0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422b77200 msgr2=0x561422c73330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422b77200 0x561422c73330 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83c03c780 msgr2=0x7ff83c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83c03c780 0x7ff83c03ec40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x561422ae5540 tx=0x7ff940050000 comp rx=0 tx=0).stop 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 msgr2=0x561422b72d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422b72d20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x561422c63470 tx=0x7ff9480040e0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 shutdown_connections 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x561422c74600 0x561422c769f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x561422b77200 0x561422c73330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7ff83c03c780 0x7ff83c03ec40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 --2- 172.21.15.120:0/1800013353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561422b73600 0x561422b72d20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 >> 172.21.15.120:0/1800013353 conn(0x561422b6d1c0 msgr2=0x561422c637c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 shutdown_connections 2024-09-07T03:32:57.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:32:57.003+0000 7ff958b75800 1 -- 172.21.15.120:0/1800013353 wait complete. 2024-09-07T03:32:57.012 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-07T03:32:57.030 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:32:57.035 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-07T03:33:32.036 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-07T03:33:32.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-07T03:33:32.037 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-07T03:33:32.089 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:32.089 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:32.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.089+0000 7f6af1f28800 1 Processor -- start 2024-09-07T03:33:32.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.089+0000 7f6af1f28800 1 -- start start 2024-09-07T03:33:32.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.089+0000 7f6af1f28800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562d36319200 0x562d3631eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.089+0000 7f6af1f28800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d361c2e40 con 0x562d36317df0 2024-09-07T03:33:32.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.089+0000 7f6af1f28800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x562d3618d680 con 0x562d36319200 2024-09-07T03:33:32.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.090+0000 7f6aed35c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x562d36319200 0x562d3631eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.090+0000 7f6aedb5d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x562d36317df0 0x562d36318af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42126/0 (socket says 172.21.15.120:42126) 2024-09-07T03:33:32.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.090+0000 7f6aedb5d640 1 -- 172.21.15.120:0/4210097447 learned_addr learned my addr 172.21.15.120:0/4210097447 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:33:32.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.090+0000 7f6aed35c640 1 -- 172.21.15.120:0/4210097447 >> v1:172.21.15.104:6789/0 conn(0x562d36317df0 legacy=0x562d36318af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.090+0000 7f6aed35c640 1 -- 172.21.15.120:0/4210097447 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d361a96b0 con 0x562d36319200 2024-09-07T03:33:32.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.090+0000 7f6aecb5b640 1 -- 172.21.15.120:0/4210097447 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909418086 0 0) 0x562d361c2e40 con 0x562d36317df0 2024-09-07T03:33:32.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.092+0000 7f6aed35c640 1 --2- 172.21.15.120:0/4210097447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36319200 0x562d3631eda0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400a470 tx=0x7f6ae4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a1afc83bb27f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.092+0000 7f6aecb5b640 1 -- 172.21.15.120:0/4210097447 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae4053570 con 0x562d36319200 2024-09-07T03:33:32.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.092+0000 7f6aecb5b640 1 -- 172.21.15.120:0/4210097447 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae4058070 con 0x562d36319200 2024-09-07T03:33:32.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.092+0000 7f6aecb5b640 1 -- 172.21.15.120:0/4210097447 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae4053880 con 0x562d36319200 2024-09-07T03:33:32.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.093+0000 7f6af1f28800 1 -- 172.21.15.120:0/4210097447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36319200 msgr2=0x562d3631eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.093+0000 7f6af1f28800 1 --2- 172.21.15.120:0/4210097447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36319200 0x562d3631eda0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400a470 tx=0x7f6ae4045a20 comp rx=0 tx=0).stop 2024-09-07T03:33:32.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.093+0000 7f6af1f28800 1 -- 172.21.15.120:0/4210097447 shutdown_connections 2024-09-07T03:33:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.093+0000 7f6af1f28800 1 --2- 172.21.15.120:0/4210097447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36319200 0x562d3631eda0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.093+0000 7f6af1f28800 1 -- 172.21.15.120:0/4210097447 >> 172.21.15.120:0/4210097447 conn(0x562d363131c0 msgr2=0x562d36315620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.093+0000 7f6af1f28800 1 -- 172.21.15.120:0/4210097447 shutdown_connections 2024-09-07T03:33:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.093+0000 7f6af1f28800 1 -- 172.21.15.120:0/4210097447 wait complete. 2024-09-07T03:33:32.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.109+0000 7f6af1f28800 1 Processor -- start 2024-09-07T03:33:32.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.109+0000 7f6af1f28800 1 -- start start 2024-09-07T03:33:32.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.109+0000 7f6af1f28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d364062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.109+0000 7f6af1f28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d361b1dd0 con 0x562d36317df0 2024-09-07T03:33:32.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.109+0000 7f6aedb5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d364062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.109+0000 7f6aedb5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d364062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44024/0 (socket says 172.21.15.120:44024) 2024-09-07T03:33:32.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.109+0000 7f6aedb5d640 1 -- 172.21.15.120:0/4011669652 learned_addr learned my addr 172.21.15.120:0/4011669652 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.110+0000 7f6aedb5d640 1 -- 172.21.15.120:0/4011669652 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d361cae10 con 0x562d36317df0 2024-09-07T03:33:32.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.110+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/4011669652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d364062d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0001ea0 tx=0x7f6ae000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71d8de08e28b402 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.110+0000 7f69dbe07640 1 -- 172.21.15.120:0/4011669652 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae0008070 con 0x562d36317df0 2024-09-07T03:33:32.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.110+0000 7f69dbe07640 1 -- 172.21.15.120:0/4011669652 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae000d500 con 0x562d36317df0 2024-09-07T03:33:32.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.110+0000 7f69dbe07640 1 -- 172.21.15.120:0/4011669652 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae000d880 con 0x562d36317df0 2024-09-07T03:33:32.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.111+0000 7f6af1f28800 1 -- 172.21.15.120:0/4011669652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 msgr2=0x562d364062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.111+0000 7f6af1f28800 1 --2- 172.21.15.120:0/4011669652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d364062d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0001ea0 tx=0x7f6ae000b6a0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.111+0000 7f6af1f28800 1 -- 172.21.15.120:0/4011669652 shutdown_connections 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.111+0000 7f6af1f28800 1 --2- 172.21.15.120:0/4011669652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d364062d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.111+0000 7f6af1f28800 1 -- 172.21.15.120:0/4011669652 >> 172.21.15.120:0/4011669652 conn(0x562d363131c0 msgr2=0x562d36401c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.111+0000 7f6af1f28800 1 -- 172.21.15.120:0/4011669652 shutdown_connections 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.111+0000 7f6af1f28800 1 -- 172.21.15.120:0/4011669652 wait complete. 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.111+0000 7f6af1f28800 1 Processor -- start 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.111+0000 7f6af1f28800 1 -- start start 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.112+0000 7f6af1f28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d3640dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.112+0000 7f6af1f28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d363198f0 con 0x562d36317df0 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.112+0000 7f6aedb5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d3640dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.112+0000 7f6aedb5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d3640dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44030/0 (socket says 172.21.15.120:44030) 2024-09-07T03:33:32.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.112+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3447606744 learned_addr learned my addr 172.21.15.120:0/3447606744 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.112+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3447606744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3640e150 con 0x562d36317df0 2024-09-07T03:33:32.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.112+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d3640dbf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00012f0 tx=0x7f6ae0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.113+0000 7f69da604640 1 -- 172.21.15.120:0/3447606744 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae000f9d0 con 0x562d36317df0 2024-09-07T03:33:32.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.113+0000 7f69da604640 1 -- 172.21.15.120:0/3447606744 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae000fb70 con 0x562d36317df0 2024-09-07T03:33:32.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.113+0000 7f69da604640 1 -- 172.21.15.120:0/3447606744 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae000fe50 con 0x562d36317df0 2024-09-07T03:33:32.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.113+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d3640e3e0 con 0x562d36317df0 2024-09-07T03:33:32.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.113+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3640ede0 con 0x562d36317df0 2024-09-07T03:33:32.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.114+0000 7f69da604640 1 -- 172.21.15.120:0/3447606744 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6ae0017040 con 0x562d36317df0 2024-09-07T03:33:32.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.114+0000 7f69da604640 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69d403c920 0x7f69d403ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.114+0000 7f69da604640 1 -- 172.21.15.120:0/3447606744 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6ae0015020 con 0x562d36317df0 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.114+0000 7f6aed35c640 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69d403c920 0x7f69d403ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.114+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d36319200 0x562d36415240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.114+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36415780 con 0x562d36319200 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.114+0000 7f6aee35e640 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d36319200 0x562d36415240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.114+0000 7f6aed35c640 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69d403c920 0x7f69d403ede0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4057000 tx=0x7f6ae4052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.115+0000 7f6aee35e640 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d36319200 0x562d36415240 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.115+0000 7f6aee35e640 1 -- 172.21.15.120:0/3447606744 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ae800a4d0 con 0x562d36319200 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.115+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36416030 0x562d364184f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.115+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36418c60 con 0x562d36416030 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.115+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36416030 0x562d364184f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.116+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36416030 0x562d364184f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.116+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3447606744 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36416030 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.116+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d3641a510 con 0x562d36416030 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.116+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3447606744 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36416030 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.116+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36419680 con 0x562d36416030 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.117+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3447606744 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36416030 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.117+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36419aa0 con 0x562d36319200 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.117+0000 7f6aee35e640 1 -- 172.21.15.120:0/3447606744 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ae800a4d0 con 0x562d36319200 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.117+0000 7f6af1f28800 1 Processor -- start 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.118+0000 7f6af1f28800 1 -- start start 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.118+0000 7f6af1f28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d3642cdd0 0x562d3642d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.118+0000 7f6af1f28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d3620fa00 con 0x562d3642cdd0 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.118+0000 7f6aee35e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d3642cdd0 0x562d3642d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.118+0000 7f6aee35e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d3642cdd0 0x562d3642d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44044/0 (socket says 172.21.15.120:44044) 2024-09-07T03:33:32.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.118+0000 7f6aee35e640 1 -- 172.21.15.120:0/1148099677 learned_addr learned my addr 172.21.15.120:0/1148099677 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.118+0000 7f6aee35e640 1 -- 172.21.15.120:0/1148099677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3642d830 con 0x562d3642cdd0 2024-09-07T03:33:32.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.118+0000 7f6aee35e640 1 --2- 172.21.15.120:0/1148099677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d3642cdd0 0x562d3642d1f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8016d20 tx=0x7f6ae800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.119+0000 7f69d37fe640 1 -- 172.21.15.120:0/1148099677 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae8017660 con 0x562d3642cdd0 2024-09-07T03:33:32.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.119+0000 7f69d37fe640 1 -- 172.21.15.120:0/1148099677 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae801b030 con 0x562d3642cdd0 2024-09-07T03:33:32.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.119+0000 7f6af1f28800 1 -- 172.21.15.120:0/1148099677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d3642e060 con 0x562d3642cdd0 2024-09-07T03:33:32.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.119+0000 7f69d37fe640 1 -- 172.21.15.120:0/1148099677 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae8017950 con 0x562d3642cdd0 2024-09-07T03:33:32.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.119+0000 7f6af1f28800 1 -- 172.21.15.120:0/1148099677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3642e600 con 0x562d3642cdd0 2024-09-07T03:33:32.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.120+0000 7f69d37fe640 1 -- 172.21.15.120:0/1148099677 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6ae8017af0 con 0x562d3642cdd0 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.120+0000 7f69d37fe640 1 --2- 172.21.15.120:0/1148099677 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69c803c780 0x7f69c803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.120+0000 7f69d37fe640 1 -- 172.21.15.120:0/1148099677 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6ae800e040 con 0x562d3642cdd0 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.120+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/1148099677 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69c803c780 0x7f69c803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.120+0000 7f6af1f28800 1 Processor -- start 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.120+0000 7f6af1f28800 1 -- start start 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.120+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/1148099677 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69c803c780 0x7f69c803ec40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x562d364191a0 tx=0x7f6ae000ef40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.120+0000 7f6af1f28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36439c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.120+0000 7f6af1f28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d36406b20 con 0x562d36439890 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.121+0000 7f6aee35e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36439c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.121+0000 7f6aee35e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36439c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44048/0 (socket says 172.21.15.120:44048) 2024-09-07T03:33:32.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.121+0000 7f6aee35e640 1 -- 172.21.15.120:0/3904053654 learned_addr learned my addr 172.21.15.120:0/3904053654 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.121+0000 7f6aee35e640 1 -- 172.21.15.120:0/3904053654 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3643a280 con 0x562d36439890 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.121+0000 7f6aee35e640 1 --2- 172.21.15.120:0/3904053654 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36439c90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8053de0 tx=0x7f6ae8054030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f0f332921b73e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.121+0000 7f69d17fa640 1 -- 172.21.15.120:0/3904053654 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae804b070 con 0x562d36439890 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.121+0000 7f69d17fa640 1 -- 172.21.15.120:0/3904053654 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae8014d40 con 0x562d36439890 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.121+0000 7f69d17fa640 1 -- 172.21.15.120:0/3904053654 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae8052070 con 0x562d36439890 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.122+0000 7f6af1f28800 1 -- 172.21.15.120:0/3904053654 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 msgr2=0x562d36439c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.122+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3904053654 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36439c90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8053de0 tx=0x7f6ae8054030 comp rx=0 tx=0).stop 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.122+0000 7f6af1f28800 1 -- 172.21.15.120:0/3904053654 shutdown_connections 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.122+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3904053654 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36439c90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.122+0000 7f6af1f28800 1 -- 172.21.15.120:0/3904053654 >> 172.21.15.120:0/3904053654 conn(0x562d36435c90 msgr2=0x562d36433ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.122+0000 7f6af1f28800 1 -- 172.21.15.120:0/3904053654 shutdown_connections 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.122+0000 7f6af1f28800 1 -- 172.21.15.120:0/3904053654 wait complete. 2024-09-07T03:33:32.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.123+0000 7f6af1f28800 1 Processor -- start 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.123+0000 7f6af1f28800 1 -- start start 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.123+0000 7f6af1f28800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36440e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.123+0000 7f6af1f28800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x562d3643a8a0 con 0x562d36439890 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.123+0000 7f6aee35e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36440e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.123+0000 7f6aee35e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36440e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44064/0 (socket says 172.21.15.120:44064) 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.123+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 learned_addr learned my addr 172.21.15.120:0/3834779231 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.123+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d364413f0 con 0x562d36439890 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.123+0000 7f6aee35e640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36440e90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8052c30 tx=0x7f6ae8053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.124+0000 7f69bf7fe640 1 -- 172.21.15.120:0/3834779231 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae804b070 con 0x562d36439890 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.124+0000 7f69bf7fe640 1 -- 172.21.15.120:0/3834779231 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae802e070 con 0x562d36439890 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.124+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d36441680 con 0x562d36439890 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.124+0000 7f69bf7fe640 1 -- 172.21.15.120:0/3834779231 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae8012d80 con 0x562d36439890 2024-09-07T03:33:32.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.124+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d36442210 con 0x562d36439890 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.125+0000 7f69bf7fe640 1 -- 172.21.15.120:0/3834779231 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6ae8055230 con 0x562d36439890 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.125+0000 7f69bf7fe640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69b803c730 0x7f69b803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.125+0000 7f69bf7fe640 1 -- 172.21.15.120:0/3834779231 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6ae8034dd0 con 0x562d36439890 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.126+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69b803c730 0x7f69b803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.126+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.126+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69b803c730 0x7f69b803ebf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000efd0 tx=0x7f6ae003f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.126+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d3644c910 0x562d3644edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.126+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d3644f520 con 0x562d3644c910 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.126+0000 7f6aed35c640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d3644c910 0x562d3644edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.127+0000 7f6aed35c640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d3644c910 0x562d3644edd0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.127+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.127+0000 7f6af1f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.127+0000 7f6af1f28800 20 realm 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.127+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.127+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d3644f950 con 0x562d3644c910 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6af1f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6af1f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36450220 con 0x562d3644c910 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6af1f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36450c40 0x562d36453030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d364537a0 con 0x562d36450c40 2024-09-07T03:33:32.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6aee35e640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36450c40 0x562d36453030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.128+0000 7f6aee35e640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36450c40 0x562d36453030 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6af1f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36454040 con 0x562d36450c40 2024-09-07T03:33:32.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6af1f28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:32.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6af1f28800 20 searching for the correct realm 2024-09-07T03:33:32.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d36455db0 0x562d364581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36455db0 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d36455db0 0x562d364581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.129+0000 7f6aedb5d640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d36455db0 0x562d364581c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.130+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.130+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36450c40 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.130+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.130+0000 7f6aee35e640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6ae8014440 0x7f6ae8029aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.130+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x7f6ae8014440 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.130+0000 7f6aed35c640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6ae8014440 0x7f6ae8029aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.131+0000 7f6aed35c640 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6ae8014440 0x7f6ae8029aa0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.131+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.131+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d3644c910 2024-09-07T03:33:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.131+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.131+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d3644c910 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.131+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.131+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36455db0 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.132+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.132+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d3644c910 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.132+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.132+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36450c40 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.132+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.132+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36450c40 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.133+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.133+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d3644c910 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.133+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.133+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x7f6ae8014440 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.134+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.134+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d3644c910 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.134+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.134+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x7f6ae8014440 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.134+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.134+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36450c40 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.135+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.135+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36455db0 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.135+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.135+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d3644c910 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.135+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.135+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36450c40 2024-09-07T03:33:32.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.136+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.136+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36455db0 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.136+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.136+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d3644c910 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.137+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.137+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d3644c910 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.137+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.137+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d3644c910 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.137+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.137+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36455db0 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.138+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.138+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x7f6ae8014440 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.138+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.138+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x7f6ae8014440 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.139+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.139+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x7f6ae8014440 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.139+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.139+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36455db0 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.140+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.140+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x7f6ae8014440 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.140+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.140+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36450c40 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.141+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.141+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36450c40 2024-09-07T03:33:32.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.141+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.141+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36455db0 2024-09-07T03:33:32.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36450c40 2024-09-07T03:33:32.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d36458890 con 0x562d36450c40 2024-09-07T03:33:32.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6af1f28800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:32.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6af1f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6af1f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6af1f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6af1f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6af1f28800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.142+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36454990 con 0x562d3644c910 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.143+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.143+0000 7f6af1f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.143+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.143+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36454d80 con 0x562d36450c40 2024-09-07T03:33:32.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.143+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.143+0000 7f6af1f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.143+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.143+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d364551e0 con 0x562d3644c910 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 20 zone default found 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 4 Realm: () 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 20 zonegroup default 2024-09-07T03:33:32.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36458d60 con 0x7f6ae8014440 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d3645b020 con 0x562d36455db0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.144+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.145+0000 7f6af1f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.145+0000 7f6af1f28800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.145+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d3645b3c0 con 0x562d36455db0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.145+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.145+0000 7f6af1f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.145+0000 7f6af1f28800 20 started sync module instance, tier type = 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.145+0000 7f6af1f28800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.145+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645a4b0 con 0x562d36450c40 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.146+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.146+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94752184052176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645a4b0 con 0x562d36450c40 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.146+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645bf40 con 0x562d3644c910 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.147+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94752184052176] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.147+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.148+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94752184049664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645a420 con 0x562d3644c910 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.148+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645ce00 con 0x562d36450c40 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.149+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94752184049664] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.149+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.149+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94752184058672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645ce00 con 0x562d36450c40 2024-09-07T03:33:32.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.149+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645d8a0 con 0x7f6ae8014440 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.150+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.150+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94752184062864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645d860 con 0x7f6ae8014440 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.150+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645e860 con 0x562d36450c40 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.150+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94752184058672] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.151+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94752184062864] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.151+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.151+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94752184065168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645e860 con 0x562d36450c40 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.151+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645f100 con 0x562d36455db0 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.152+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94752184065168] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.152+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.152+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94752184069200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645e860 con 0x562d36455db0 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.152+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645fac0 con 0x562d36455db0 2024-09-07T03:33:32.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.153+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94752184069200] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.154+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.154+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94752184071696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d3645fa30 con 0x562d36455db0 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.154+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d36460890 con 0x7f6ae8014440 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94752184075104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d36460890 con 0x7f6ae8014440 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6af1f28800 20 add_watcher() i=0 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6af1f28800 20 add_watcher() i=1 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6af1f28800 20 add_watcher() i=2 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6af1f28800 20 add_watcher() i=3 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6af1f28800 20 add_watcher() i=4 2024-09-07T03:33:32.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6af1f28800 20 add_watcher() i=5 2024-09-07T03:33:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94752184071696] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.155+0000 7f6af1f28800 20 add_watcher() i=6 2024-09-07T03:33:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.156+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94752184075104] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.156+0000 7f6af1f28800 20 add_watcher() i=7 2024-09-07T03:33:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.156+0000 7f6af1f28800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.156+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d3645feb0 con 0x562d3644c910 2024-09-07T03:33:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.156+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.156+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94752184073904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d364612d0 con 0x562d3644c910 2024-09-07T03:33:32.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.157+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94752184073904] v36'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.157+0000 7f69977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f6af1f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f6af1f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f6af1f28800 5 note: GC not initialized 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f69967fc640 20 reqs_thread_entry: start 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f6af1f28800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f6af1f28800 20 Filter name: none 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f6913fff640 20 reqs_thread_entry: start 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497480 con 0x562d36450c40 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.158+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497480 con 0x562d36450c40 2024-09-07T03:33:32.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.159+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.159+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36450c40 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.159+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.159+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36455db0 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.159+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.159+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36450c40 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.160+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.160+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36455db0 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.160+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.160+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d3644c910 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.160+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.160+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d3644c910 2024-09-07T03:33:32.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.160+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.160+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36455db0 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.161+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.161+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36455db0 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.161+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.161+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36455db0 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.161+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.161+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d3644c910 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.161+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.161+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x7f6ae8014440 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.162+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.162+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36455db0 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.162+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.162+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x7f6ae8014440 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.162+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.162+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d3644c910 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.162+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.162+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36455db0 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.163+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.163+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d3644c910 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.163+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.163+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36450c40 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.164+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.164+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36450c40 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.164+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.164+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36455db0 2024-09-07T03:33:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.164+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.164+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36450c40 2024-09-07T03:33:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.164+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.164+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36455db0 2024-09-07T03:33:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.165+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.165+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d3644c910 2024-09-07T03:33:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.165+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.165+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36450c40 2024-09-07T03:33:32.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.165+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.165+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36450c40 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.165+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.165+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36450c40 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d3644c910 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36455db0 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36455db0 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d36450c40 2024-09-07T03:33:32.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.166+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d36496eb0 con 0x562d3644c910 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.167+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.167+0000 7f69977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.168+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94752184073904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d36497ed0 con 0x562d3644c910 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.169+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94752184073904] v36'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.169+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94752184052176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d364948b0 con 0x562d36450c40 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.170+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94752184052176] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.170+0000 7f6af1f28800 20 remove_watcher() i=0 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.170+0000 7f6af1f28800 2 removed watcher, disabling cache 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.170+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94752184049664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d364948b0 con 0x562d3644c910 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.171+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94752184049664] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x562d3644c910 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.171+0000 7f6af1f28800 20 remove_watcher() i=1 2024-09-07T03:33:32.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.171+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94752184058672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36450c40 2024-09-07T03:33:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.172+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94752184058672] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.172+0000 7f6af1f28800 20 remove_watcher() i=2 2024-09-07T03:33:32.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.172+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94752184062864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x7f6ae8014440 2024-09-07T03:33:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.173+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94752184062864] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.173+0000 7f6af1f28800 20 remove_watcher() i=3 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.173+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94752184065168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36450c40 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.175+0000 7f6aee35e640 1 -- 172.21.15.120:0/3834779231 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94752184065168] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae8027070 con 0x562d36450c40 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.175+0000 7f6af1f28800 20 remove_watcher() i=4 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.175+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94752184069200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36455db0 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.176+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94752184069200] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.176+0000 7f6af1f28800 20 remove_watcher() i=5 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.176+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94752184071696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x562d36455db0 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.177+0000 7f6aedb5d640 1 -- 172.21.15.120:0/3834779231 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94752184071696] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae002d070 con 0x562d36455db0 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.177+0000 7f6af1f28800 20 remove_watcher() i=6 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.177+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94752184075104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d36497440 con 0x7f6ae8014440 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94752184075104] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ae4051070 con 0x7f6ae8014440 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 20 remove_watcher() i=7 2024-09-07T03:33:32.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36450c40 msgr2=0x562d36453030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36450c40 0x562d36453030 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d3644c910 msgr2=0x562d3644edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d3644c910 0x562d3644edd0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6ae8014440 msgr2=0x7f6ae8029aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f6ae8014440 0x7f6ae8029aa0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d36455db0 msgr2=0x562d364581c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x562d36455db0 0x562d364581c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69b803c730 msgr2=0x7f69b803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69b803c730 0x7f69b803ebf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000efd0 tx=0x7f6ae003f000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 msgr2=0x562d36440e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6aed35c640 1 -- 172.21.15.120:0/3834779231 reap_dead start 2024-09-07T03:33:32.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36440e90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8052c30 tx=0x7f6ae8053d40 comp rx=0 tx=0).stop 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 shutdown_connections 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3834779231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36439890 0x562d36440e90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 >> 172.21.15.120:0/3834779231 conn(0x562d36435c90 msgr2=0x562d36433ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 shutdown_connections 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/3834779231 wait complete. 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/1148099677 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69c803c780 msgr2=0x7f69c803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/1148099677 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69c803c780 0x7f69c803ec40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x562d364191a0 tx=0x7f6ae000ef40 comp rx=0 tx=0).stop 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/1148099677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d3642cdd0 msgr2=0x562d3642d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/1148099677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d3642cdd0 0x562d3642d1f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8016d20 tx=0x7f6ae800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/1148099677 shutdown_connections 2024-09-07T03:33:32.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/1148099677 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69c803c780 0x7f69c803ec40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 --2- 172.21.15.120:0/1148099677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d3642cdd0 0x562d3642d1f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/1148099677 >> 172.21.15.120:0/1148099677 conn(0x562d3641cd70 msgr2=0x562d3641d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/1148099677 shutdown_connections 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.178+0000 7f6af1f28800 1 -- 172.21.15.120:0/1148099677 wait complete. 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36416030 msgr2=0x562d364184f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36416030 0x562d364184f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d36319200 msgr2=0x562d36415240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d36319200 0x562d36415240 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69d403c920 msgr2=0x7f69d403ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69d403c920 0x7f69d403ede0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4057000 tx=0x7f6ae4052000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 msgr2=0x562d3640dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d3640dbf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00012f0 tx=0x7f6ae0000ed0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 shutdown_connections 2024-09-07T03:33:32.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x562d36416030 0x562d364184f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x562d36319200 0x562d36415240 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f69d403c920 0x7f69d403ede0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 --2- 172.21.15.120:0/3447606744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x562d36317df0 0x562d3640dbf0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 >> 172.21.15.120:0/3447606744 conn(0x562d363131c0 msgr2=0x562d364075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 shutdown_connections 2024-09-07T03:33:32.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.179+0000 7f6af1f28800 1 -- 172.21.15.120:0/3447606744 wait complete. 2024-09-07T03:33:32.190 INFO:teuthology.orchestra.run.smithi120.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-07T03:33:32.190 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:33:32.190 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-07T03:33:32.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-07T03:33:32.191 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-07T03:33:32.233 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:32.233 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:32.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.232+0000 7fddd2b19800 1 Processor -- start 2024-09-07T03:33:32.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.232+0000 7fddd2b19800 1 -- start start 2024-09-07T03:33:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.233+0000 7fddd2b19800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a469a7e1f0 0x55a469a806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.233+0000 7fddd2b19800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a469923e40 con 0x55a469a7a680 2024-09-07T03:33:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.233+0000 7fddd2b19800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a4698ee680 con 0x55a469a7e1f0 2024-09-07T03:33:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.233+0000 7fddcfe09640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a469a7e1f0 0x55a469a806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.233+0000 7fddd060a640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55a469a7a680 0x55a469a7ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42132/0 (socket says 172.21.15.120:42132) 2024-09-07T03:33:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.233+0000 7fddcfe09640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a469a7e1f0 0x55a469a806b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44074/0 (socket says 172.21.15.120:44074) 2024-09-07T03:33:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.233+0000 7fddd060a640 1 -- 172.21.15.120:0/1612243940 learned_addr learned my addr 172.21.15.120:0/1612243940 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:33:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.233+0000 7fddcfe09640 1 -- 172.21.15.120:0/1612243940 >> v1:172.21.15.104:6789/0 conn(0x55a469a7a680 legacy=0x55a469a7ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.233+0000 7fddcfe09640 1 -- 172.21.15.120:0/1612243940 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46990a6b0 con 0x55a469a7e1f0 2024-09-07T03:33:32.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.235+0000 7fddcfe09640 1 --2- 172.21.15.120:0/1612243940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7e1f0 0x55a469a806b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fddb800a470 tx=0x7fddb8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5d05026a768bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.235+0000 7fddcf608640 1 -- 172.21.15.120:0/1612243940 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddb8053570 con 0x55a469a7e1f0 2024-09-07T03:33:32.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.235+0000 7fddcf608640 1 -- 172.21.15.120:0/1612243940 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb8058070 con 0x55a469a7e1f0 2024-09-07T03:33:32.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.235+0000 7fddcf608640 1 -- 172.21.15.120:0/1612243940 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddb8053880 con 0x55a469a7e1f0 2024-09-07T03:33:32.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.236+0000 7fddd2b19800 1 -- 172.21.15.120:0/1612243940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7e1f0 msgr2=0x55a469a806b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.236+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1612243940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7e1f0 0x55a469a806b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fddb800a470 tx=0x7fddb8045a20 comp rx=0 tx=0).stop 2024-09-07T03:33:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.236+0000 7fddd2b19800 1 -- 172.21.15.120:0/1612243940 shutdown_connections 2024-09-07T03:33:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.236+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1612243940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7e1f0 0x55a469a806b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.236+0000 7fddd2b19800 1 -- 172.21.15.120:0/1612243940 >> 172.21.15.120:0/1612243940 conn(0x55a469a741e0 msgr2=0x55a469a76620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.236+0000 7fddd2b19800 1 -- 172.21.15.120:0/1612243940 shutdown_connections 2024-09-07T03:33:32.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.236+0000 7fddd2b19800 1 -- 172.21.15.120:0/1612243940 wait complete. 2024-09-07T03:33:32.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.249+0000 7fddd2b19800 1 Processor -- start 2024-09-07T03:33:32.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.249+0000 7fddd2b19800 1 -- start start 2024-09-07T03:33:32.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.250+0000 7fddd2b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469a79df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.250+0000 7fddd2b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a469912dd0 con 0x55a469a7a680 2024-09-07T03:33:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.250+0000 7fddd060a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469a79df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.250+0000 7fddd060a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469a79df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44080/0 (socket says 172.21.15.120:44080) 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.250+0000 7fddd060a640 1 -- 172.21.15.120:0/969487003 learned_addr learned my addr 172.21.15.120:0/969487003 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.250+0000 7fddd060a640 1 -- 172.21.15.120:0/969487003 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46992be10 con 0x55a469a7a680 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fddd060a640 1 --2- 172.21.15.120:0/969487003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469a79df0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fddc0001800 tx=0x7fddc0001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d72a2e16ca80f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fdcbe60c640 1 -- 172.21.15.120:0/969487003 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc0004520 con 0x55a469a7a680 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fdcbe60c640 1 -- 172.21.15.120:0/969487003 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc00046c0 con 0x55a469a7a680 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fdcbe60c640 1 -- 172.21.15.120:0/969487003 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc00049e0 con 0x55a469a7a680 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fddd2b19800 1 -- 172.21.15.120:0/969487003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 msgr2=0x55a469a79df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fddd2b19800 1 --2- 172.21.15.120:0/969487003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469a79df0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fddc0001800 tx=0x7fddc0001cc0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fddd2b19800 1 -- 172.21.15.120:0/969487003 shutdown_connections 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fddd2b19800 1 --2- 172.21.15.120:0/969487003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469a79df0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fddd2b19800 1 -- 172.21.15.120:0/969487003 >> 172.21.15.120:0/969487003 conn(0x55a469a741e0 msgr2=0x55a469b64fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.251+0000 7fddd2b19800 1 -- 172.21.15.120:0/969487003 shutdown_connections 2024-09-07T03:33:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.252+0000 7fddd2b19800 1 -- 172.21.15.120:0/969487003 wait complete. 2024-09-07T03:33:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.252+0000 7fddd2b19800 1 Processor -- start 2024-09-07T03:33:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.252+0000 7fddd2b19800 1 -- start start 2024-09-07T03:33:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.252+0000 7fddd2b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469b73180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.252+0000 7fddd2b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a469a81030 con 0x55a469a7a680 2024-09-07T03:33:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.252+0000 7fddd060a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469b73180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.252+0000 7fddd060a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469b73180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44092/0 (socket says 172.21.15.120:44092) 2024-09-07T03:33:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.252+0000 7fddd060a640 1 -- 172.21.15.120:0/211978088 learned_addr learned my addr 172.21.15.120:0/211978088 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.252+0000 7fddd060a640 1 -- 172.21.15.120:0/211978088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a469b736e0 con 0x55a469a7a680 2024-09-07T03:33:32.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.253+0000 7fddd060a640 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469b73180 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fddc00066b0 tx=0x7fddc0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.253+0000 7fdcbce09640 1 -- 172.21.15.120:0/211978088 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc0022020 con 0x55a469a7a680 2024-09-07T03:33:32.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.253+0000 7fdcbce09640 1 -- 172.21.15.120:0/211978088 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc00148c0 con 0x55a469a7a680 2024-09-07T03:33:32.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.253+0000 7fdcbce09640 1 -- 172.21.15.120:0/211978088 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc0014be0 con 0x55a469a7a680 2024-09-07T03:33:32.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.253+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a469b73970 con 0x55a469a7a680 2024-09-07T03:33:32.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.253+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a469b74370 con 0x55a469a7a680 2024-09-07T03:33:32.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.254+0000 7fdcbce09640 1 -- 172.21.15.120:0/211978088 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fddc0025020 con 0x55a469a7a680 2024-09-07T03:33:32.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.254+0000 7fdcbce09640 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdcb803c780 0x7fdcb803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.254+0000 7fdcbce09640 1 -- 172.21.15.120:0/211978088 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fddc0018030 con 0x55a469a7a680 2024-09-07T03:33:32.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.254+0000 7fddcfe09640 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdcb803c780 0x7fdcb803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.254+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469a7e1f0 0x55a469b7a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.254+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469b7ad10 con 0x55a469a7e1f0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.254+0000 7fddd0e0b640 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469a7e1f0 0x55a469b7a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.255+0000 7fddcfe09640 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdcb803c780 0x7fdcb803ec40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fddb8057000 tx=0x7fddb8052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.255+0000 7fddd0e0b640 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469a7e1f0 0x55a469b7a7d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.255+0000 7fddd0e0b640 1 -- 172.21.15.120:0/211978088 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469a7e1f0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.255+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469b7b5c0 0x55a469b7da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.255+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469b7e1f0 con 0x55a469b7b5c0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.255+0000 7fddd060a640 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469b7b5c0 0x55a469b7da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.256+0000 7fddd060a640 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469b7b5c0 0x55a469b7da80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.256+0000 7fddd060a640 1 -- 172.21.15.120:0/211978088 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fddc001b070 con 0x55a469b7b5c0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.256+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469b7faa0 con 0x55a469b7b5c0 2024-09-07T03:33:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.256+0000 7fddd060a640 1 -- 172.21.15.120:0/211978088 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fddc001b070 con 0x55a469b7b5c0 2024-09-07T03:33:32.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.256+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469b7ec10 con 0x55a469b7b5c0 2024-09-07T03:33:32.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.256+0000 7fddd060a640 1 -- 172.21.15.120:0/211978088 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fddc001b070 con 0x55a469b7b5c0 2024-09-07T03:33:32.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.256+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469b7f070 con 0x55a469a7e1f0 2024-09-07T03:33:32.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.257+0000 7fddd0e0b640 1 -- 172.21.15.120:0/211978088 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469a7e1f0 2024-09-07T03:33:32.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.257+0000 7fddd2b19800 1 Processor -- start 2024-09-07T03:33:32.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.257+0000 7fddd2b19800 1 -- start start 2024-09-07T03:33:32.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.257+0000 7fddd2b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b8df90 0x55a469b8e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.257+0000 7fddd2b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a469970a00 con 0x55a469b8df90 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fddd0e0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b8df90 0x55a469b8e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fddd0e0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b8df90 0x55a469b8e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44102/0 (socket says 172.21.15.120:44102) 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fddd0e0b640 1 -- 172.21.15.120:0/3706388820 learned_addr learned my addr 172.21.15.120:0/3706388820 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fddd0e0b640 1 -- 172.21.15.120:0/3706388820 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a469b8e9f0 con 0x55a469b8df90 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fddd0e0b640 1 --2- 172.21.15.120:0/3706388820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b8df90 0x55a469b8e3b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fddc800aa90 tx=0x7fddc800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fdcb5ffb640 1 -- 172.21.15.120:0/3706388820 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc8007d70 con 0x55a469b8df90 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fdcb5ffb640 1 -- 172.21.15.120:0/3706388820 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8018430 con 0x55a469b8df90 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fdcb5ffb640 1 -- 172.21.15.120:0/3706388820 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc8018750 con 0x55a469b8df90 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fddd2b19800 1 -- 172.21.15.120:0/3706388820 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a469b8f220 con 0x55a469b8df90 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.258+0000 7fddd2b19800 1 -- 172.21.15.120:0/3706388820 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a469b8f7c0 con 0x55a469b8df90 2024-09-07T03:33:32.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.259+0000 7fdcb5ffb640 1 -- 172.21.15.120:0/3706388820 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fddc8020020 con 0x55a469b8df90 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.259+0000 7fdcb5ffb640 1 --2- 172.21.15.120:0/3706388820 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdca803c840 0x7fdca803ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.259+0000 7fdcb5ffb640 1 -- 172.21.15.120:0/3706388820 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fddc801e020 con 0x55a469b8df90 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.259+0000 7fddd060a640 1 --2- 172.21.15.120:0/3706388820 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdca803c840 0x7fdca803ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.260+0000 7fddd2b19800 1 Processor -- start 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.260+0000 7fddd060a640 1 --2- 172.21.15.120:0/3706388820 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdca803c840 0x7fdca803ed00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55a469b74890 tx=0x7fddc0051f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.260+0000 7fddd2b19800 1 -- start start 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.260+0000 7fddd2b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469b9ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.260+0000 7fddd2b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a469a78690 con 0x55a469b9aa70 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.260+0000 7fddd0e0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469b9ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.260+0000 7fddd0e0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469b9ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44106/0 (socket says 172.21.15.120:44106) 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.260+0000 7fddd0e0b640 1 -- 172.21.15.120:0/3111500120 learned_addr learned my addr 172.21.15.120:0/3111500120 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.260+0000 7fddd0e0b640 1 -- 172.21.15.120:0/3111500120 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a469b9b460 con 0x55a469b9aa70 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fddd0e0b640 1 --2- 172.21.15.120:0/3111500120 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469b9ae70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fddc80531c0 tx=0x7fddc80206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ca41b18417227c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fdca77fe640 1 -- 172.21.15.120:0/3111500120 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc8020b70 con 0x55a469b9aa70 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fdca77fe640 1 -- 172.21.15.120:0/3111500120 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8022410 con 0x55a469b9aa70 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fdca77fe640 1 -- 172.21.15.120:0/3111500120 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc804c590 con 0x55a469b9aa70 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fddd2b19800 1 -- 172.21.15.120:0/3111500120 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 msgr2=0x55a469b9ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fddd2b19800 1 --2- 172.21.15.120:0/3111500120 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469b9ae70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fddc80531c0 tx=0x7fddc80206e0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fddd2b19800 1 -- 172.21.15.120:0/3111500120 shutdown_connections 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fddd2b19800 1 --2- 172.21.15.120:0/3111500120 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469b9ae70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fddd2b19800 1 -- 172.21.15.120:0/3111500120 >> 172.21.15.120:0/3111500120 conn(0x55a469b96e90 msgr2=0x55a469b950d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fddd2b19800 1 -- 172.21.15.120:0/3111500120 shutdown_connections 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.261+0000 7fddd2b19800 1 -- 172.21.15.120:0/3111500120 wait complete. 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fddd2b19800 1 Processor -- start 2024-09-07T03:33:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fddd2b19800 1 -- start start 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fddd2b19800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469ba2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fddd2b19800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a469b9ba80 con 0x55a469b9aa70 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fddd0e0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469ba2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fddd0e0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469ba2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44110/0 (socket says 172.21.15.120:44110) 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 learned_addr learned my addr 172.21.15.120:0/1321176359 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a469ba25e0 con 0x55a469b9aa70 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fddd0e0b640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469ba2080 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fddc8020d60 tx=0x7fddc8053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.262+0000 7fdca5ffb640 1 -- 172.21.15.120:0/1321176359 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc8017e60 con 0x55a469b9aa70 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.263+0000 7fdca5ffb640 1 -- 172.21.15.120:0/1321176359 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8020b70 con 0x55a469b9aa70 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.263+0000 7fdca5ffb640 1 -- 172.21.15.120:0/1321176359 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc8053700 con 0x55a469b9aa70 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.263+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a469ba2870 con 0x55a469b9aa70 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.263+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a469ba31f0 con 0x55a469b9aa70 2024-09-07T03:33:32.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.263+0000 7fdca5ffb640 1 -- 172.21.15.120:0/1321176359 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fddc8016040 con 0x55a469b9aa70 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.264+0000 7fdca5ffb640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdc9803c780 0x7fdc9803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.264+0000 7fdca5ffb640 1 -- 172.21.15.120:0/1321176359 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fddc804b040 con 0x55a469b9aa70 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.264+0000 7fddd060a640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdc9803c780 0x7fdc9803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.264+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.264+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469badba0 0x55a469bb0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.264+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb07b0 con 0x55a469badba0 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.264+0000 7fddcfe09640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469badba0 0x55a469bb0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.264+0000 7fddd060a640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdc9803c780 0x7fdc9803ec40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fddc0004bb0 tx=0x7fddc0033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.264+0000 7fddcfe09640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469badba0 0x55a469bb0060 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 20 realm 2024-09-07T03:33:32.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb0be0 con 0x55a469badba0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb14b0 con 0x55a469badba0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469bb1ed0 0x55a469bb42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb4a30 con 0x55a469bb1ed0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.265+0000 7fddd0e0b640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469bb1ed0 0x55a469bb42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd0e0b640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469bb1ed0 0x55a469bb42c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd2b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb52d0 con 0x55a469bb1ed0 2024-09-07T03:33:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd2b19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd2b19800 20 searching for the correct realm 2024-09-07T03:33:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a469bb7040 0x55a469bb9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.266+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb9b40 con 0x55a469bb7040 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.267+0000 7fddd060a640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a469bb7040 0x55a469bb9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.267+0000 7fddd060a640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a469bb7040 0x55a469bb9470 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.267+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.267+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb9b40 con 0x55a469bb1ed0 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.267+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.267+0000 7fddd0e0b640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fddc802d470 0x7fddc802ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.267+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb52d0 con 0x7fddc802d470 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.268+0000 7fddcfe09640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fddc802d470 0x7fddc802ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.268+0000 7fddcfe09640 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fddc802d470 0x7fddc802ca90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.268+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.268+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb52d0 con 0x55a469badba0 2024-09-07T03:33:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.268+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.268+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb52d0 con 0x55a469badba0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.269+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.269+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb52d0 con 0x55a469bb7040 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.269+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.269+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb52d0 con 0x55a469badba0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.269+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.269+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb52d0 con 0x55a469bb1ed0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.269+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.269+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb52d0 con 0x55a469bb1ed0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.270+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.270+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469badba0 2024-09-07T03:33:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.270+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.270+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x7fddc802d470 2024-09-07T03:33:32.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.270+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.270+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469badba0 2024-09-07T03:33:32.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.270+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.270+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x7fddc802d470 2024-09-07T03:33:32.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.271+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.271+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb1ed0 2024-09-07T03:33:32.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.271+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.271+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb7040 2024-09-07T03:33:32.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.271+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.271+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469badba0 2024-09-07T03:33:32.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.271+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.271+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb1ed0 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.272+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.272+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb7040 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.272+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.272+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469badba0 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.272+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.272+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469badba0 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.272+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.272+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469badba0 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.273+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.273+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb7040 2024-09-07T03:33:32.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.273+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.273+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x7fddc802d470 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.273+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.273+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x7fddc802d470 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.273+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.273+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x7fddc802d470 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.273+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.274+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb7040 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.274+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.274+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x7fddc802d470 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.274+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.274+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb1ed0 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.274+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.274+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb1ed0 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.275+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.275+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb7040 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.275+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.275+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb1ed0 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.275+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.275+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fddc8066040 con 0x55a469bb1ed0 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:32.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb5780 con 0x55a469badba0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb5b70 con 0x55a469bb1ed0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fddc80083e0 con 0x55a469bb1ed0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb5b70 con 0x55a469badba0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:32.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 zone default found 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 4 Realm: () 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 zonegroup default 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.276+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bb6440 con 0x7fddc802d470 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbb9b0 con 0x55a469bb7040 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbbd50 con 0x55a469bb7040 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 20 started sync module instance, tier type = 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.277+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbae50 con 0x55a469bb1ed0 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.279+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.279+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94164636906320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbae50 con 0x55a469bb1ed0 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.279+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbc750 con 0x55a469badba0 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.280+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94164636906320] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.280+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.280+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94164636903840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbadc0 con 0x55a469badba0 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.280+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbd610 con 0x55a469bb1ed0 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.281+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94164636903840] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.281+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.281+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94164636912448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbd610 con 0x55a469bb1ed0 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.281+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbe030 con 0x7fddc802d470 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.282+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94164636912448] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.282+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.282+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94164636916512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbd610 con 0x7fddc802d470 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.282+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbea80 con 0x55a469bb1ed0 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.283+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94164636916512] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.283+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.283+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94164636919184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbd610 con 0x55a469bb1ed0 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.283+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbf490 con 0x55a469bb7040 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.284+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94164636919184] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.284+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.284+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94164636921824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbf830 con 0x55a469bb7040 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.284+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bc0230 con 0x55a469bb7040 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.285+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94164636921824] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.285+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.286+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94164636914016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bc01f0 con 0x55a469bb7040 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.286+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bc0cc0 con 0x7fddc802d470 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94164636927888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bc0cc0 con 0x7fddc802d470 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddd2b19800 20 add_watcher() i=0 2024-09-07T03:33:32.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddd2b19800 20 add_watcher() i=1 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddd2b19800 20 add_watcher() i=2 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddd2b19800 20 add_watcher() i=3 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddd2b19800 20 add_watcher() i=4 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddd2b19800 20 add_watcher() i=5 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94164636914016] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.287+0000 7fddd2b19800 20 add_watcher() i=6 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.288+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94164636927888] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.288+0000 7fddd2b19800 20 add_watcher() i=7 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.288+0000 7fddd2b19800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.288+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbfd40 con 0x55a469badba0 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.288+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.288+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94164636929920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bbfd40 con 0x55a469badba0 2024-09-07T03:33:32.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.289+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94164636929920] v36'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.289+0000 7fdc86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.289+0000 7fddd2b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.289+0000 7fddd2b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.289+0000 7fddd2b19800 5 note: GC not initialized 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.289+0000 7fdc85fdb640 20 reqs_thread_entry: start 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.290+0000 7fddd2b19800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.290+0000 7fddd2b19800 20 Filter name: none 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.290+0000 7fdbf77fe640 20 reqs_thread_entry: start 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.290+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf79a0 con 0x55a469bb1ed0 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.290+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.290+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf79a0 con 0x55a469bb1ed0 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.290+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.290+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7960 con 0x55a469bb1ed0 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.291+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.291+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7960 con 0x55a469bb7040 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.291+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.291+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7960 con 0x55a469bb1ed0 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.291+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.291+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7960 con 0x55a469bb7040 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.291+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.291+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7960 con 0x55a469badba0 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.292+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.292+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7960 con 0x55a469badba0 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.292+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.292+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7960 con 0x55a469bb7040 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.292+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.292+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7960 con 0x55a469bb7040 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.292+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.292+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7960 con 0x55a469bb7040 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.293+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.293+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469badba0 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.293+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.293+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x7fddc802d470 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.293+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.293+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb7040 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.293+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.293+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x7fddc802d470 2024-09-07T03:33:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.293+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.294+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469badba0 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.294+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.294+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb7040 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.294+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.294+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469badba0 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.294+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.294+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb1ed0 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.295+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.295+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb1ed0 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.295+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.295+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb7040 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.295+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.295+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb1ed0 2024-09-07T03:33:32.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.295+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.295+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb7040 2024-09-07T03:33:32.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.296+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.296+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469badba0 2024-09-07T03:33:32.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.296+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.296+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb1ed0 2024-09-07T03:33:32.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.296+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.296+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb1ed0 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.296+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.296+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb1ed0 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.297+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.297+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469badba0 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.297+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.297+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb7040 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.297+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.297+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb7040 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.297+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.297+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469bb1ed0 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.298+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.298+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf7300 con 0x55a469badba0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.298+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.299+0000 7fdc86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.299+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94164636929920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf4d70 con 0x55a469badba0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.300+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94164636929920] v36'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.300+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94164636906320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf4d70 con 0x55a469bb1ed0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.301+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94164636906320] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.301+0000 7fddd2b19800 20 remove_watcher() i=0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.301+0000 7fddd2b19800 2 removed watcher, disabling cache 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.301+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94164636903840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf4d70 con 0x55a469badba0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.302+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94164636903840] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x55a469badba0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.302+0000 7fddd2b19800 20 remove_watcher() i=1 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.302+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94164636912448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf4d70 con 0x55a469bb1ed0 2024-09-07T03:33:32.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.303+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94164636912448] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.303+0000 7fddd2b19800 20 remove_watcher() i=2 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.303+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94164636916512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf4d70 con 0x7fddc802d470 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.304+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94164636916512] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.304+0000 7fddd2b19800 20 remove_watcher() i=3 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.304+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94164636919184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf4d70 con 0x55a469bb1ed0 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.305+0000 7fddd0e0b640 1 -- 172.21.15.120:0/1321176359 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94164636919184] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc8073040 con 0x55a469bb1ed0 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.305+0000 7fddd2b19800 20 remove_watcher() i=4 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.305+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94164636921824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf4d70 con 0x55a469bb7040 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.306+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94164636921824] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.306+0000 7fddd2b19800 20 remove_watcher() i=5 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.306+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94164636914016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf4d70 con 0x55a469bb7040 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.307+0000 7fddd060a640 1 -- 172.21.15.120:0/1321176359 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94164636914016] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc001b070 con 0x55a469bb7040 2024-09-07T03:33:32.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.307+0000 7fddd2b19800 20 remove_watcher() i=6 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.307+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94164636927888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a469bf4d70 con 0x7fddc802d470 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94164636927888] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddb8051070 con 0x7fddc802d470 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 20 remove_watcher() i=7 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469bb1ed0 msgr2=0x55a469bb42c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469bb1ed0 0x55a469bb42c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469badba0 msgr2=0x55a469bb0060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469badba0 0x55a469bb0060 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fddc802d470 msgr2=0x7fddc802ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fddc802d470 0x7fddc802ca90 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a469bb7040 msgr2=0x55a469bb9470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a469bb7040 0x55a469bb9470 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdc9803c780 msgr2=0x7fdc9803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdc9803c780 0x7fdc9803ec40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fddc0004bb0 tx=0x7fddc0033000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.308+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 msgr2=0x55a469ba2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddcfe09640 1 -- 172.21.15.120:0/1321176359 reap_dead start 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469ba2080 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fddc8020d60 tx=0x7fddc8053150 comp rx=0 tx=0).stop 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 shutdown_connections 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/1321176359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b9aa70 0x55a469ba2080 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 >> 172.21.15.120:0/1321176359 conn(0x55a469b96e90 msgr2=0x55a469b950a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 shutdown_connections 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/1321176359 wait complete. 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/3706388820 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdca803c840 msgr2=0x7fdca803ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/3706388820 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdca803c840 0x7fdca803ed00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55a469b74890 tx=0x7fddc0051f80 comp rx=0 tx=0).stop 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/3706388820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b8df90 msgr2=0x55a469b8e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/3706388820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b8df90 0x55a469b8e3b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fddc800aa90 tx=0x7fddc800af50 comp rx=0 tx=0).stop 2024-09-07T03:33:32.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/3706388820 shutdown_connections 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/3706388820 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdca803c840 0x7fdca803ed00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/3706388820 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469b8df90 0x55a469b8e3b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/3706388820 >> 172.21.15.120:0/3706388820 conn(0x55a469b82340 msgr2=0x55a469b82720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/3706388820 shutdown_connections 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/3706388820 wait complete. 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469b7b5c0 msgr2=0x55a469b7da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469b7b5c0 0x55a469b7da80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469a7e1f0 msgr2=0x55a469b7a7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469a7e1f0 0x55a469b7a7d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdcb803c780 msgr2=0x7fdcb803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdcb803c780 0x7fdcb803ec40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fddb8057000 tx=0x7fddb8052000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 msgr2=0x55a469b73180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469b73180 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fddc00066b0 tx=0x7fddc0001250 comp rx=0 tx=0).stop 2024-09-07T03:33:32.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 shutdown_connections 2024-09-07T03:33:32.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a469b7b5c0 0x55a469b7da80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.309+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a469a7e1f0 0x55a469b7a7d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.310+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdcb803c780 0x7fdcb803ec40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.310+0000 7fddd2b19800 1 --2- 172.21.15.120:0/211978088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a469a7a680 0x55a469b73180 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.310+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 >> 172.21.15.120:0/211978088 conn(0x55a469a741e0 msgr2=0x55a469b64b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.310+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 shutdown_connections 2024-09-07T03:33:32.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.310+0000 7fddd2b19800 1 -- 172.21.15.120:0/211978088 wait complete. 2024-09-07T03:33:32.325 INFO:teuthology.orchestra.run.smithi120.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-07T03:33:32.325 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:33:32.326 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-07T03:33:32.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-07T03:33:32.326 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-07T03:33:32.410 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:32.410 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:32.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.409+0000 7fce5ea13800 1 Processor -- start 2024-09-07T03:33:32.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.409+0000 7fce5ea13800 1 -- start start 2024-09-07T03:33:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.409+0000 7fce5ea13800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558ef004aff0 0x558ef004bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.409+0000 7fce5ea13800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558eefef4e40 con 0x558ef004c0f0 2024-09-07T03:33:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.409+0000 7fce5ea13800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x558eefebf680 con 0x558ef004aff0 2024-09-07T03:33:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.410+0000 7fce5a122640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558ef004aff0 0x558ef004bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.410+0000 7fce59921640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x558ef004c0f0 0x558ef0050e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42146/0 (socket says 172.21.15.120:42146) 2024-09-07T03:33:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.410+0000 7fce5a122640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x558ef004aff0 0x558ef004bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44112/0 (socket says 172.21.15.120:44112) 2024-09-07T03:33:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.410+0000 7fce59921640 1 -- 172.21.15.120:0/89952126 learned_addr learned my addr 172.21.15.120:0/89952126 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:33:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.410+0000 7fce5a122640 1 -- 172.21.15.120:0/89952126 >> v1:172.21.15.104:6789/0 conn(0x558ef004c0f0 legacy=0x558ef0050e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.410+0000 7fce5a122640 1 -- 172.21.15.120:0/89952126 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eefedb6b0 con 0x558ef004aff0 2024-09-07T03:33:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.412+0000 7fce5a122640 1 --2- 172.21.15.120:0/89952126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558ef004bbb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005fd0 tx=0x7fce4c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8debc318ab31957 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.412+0000 7fce59120640 1 -- 172.21.15.120:0/89952126 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c058530 con 0x558ef004aff0 2024-09-07T03:33:32.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.412+0000 7fce59120640 1 -- 172.21.15.120:0/89952126 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4c0586d0 con 0x558ef004aff0 2024-09-07T03:33:32.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.412+0000 7fce59120640 1 -- 172.21.15.120:0/89952126 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c0589d0 con 0x558ef004aff0 2024-09-07T03:33:32.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.413+0000 7fce5ea13800 1 -- 172.21.15.120:0/89952126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 msgr2=0x558ef004bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.413+0000 7fce5ea13800 1 --2- 172.21.15.120:0/89952126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558ef004bbb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005fd0 tx=0x7fce4c045c30 comp rx=0 tx=0).stop 2024-09-07T03:33:32.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.413+0000 7fce5ea13800 1 -- 172.21.15.120:0/89952126 shutdown_connections 2024-09-07T03:33:32.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.413+0000 7fce5ea13800 1 --2- 172.21.15.120:0/89952126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558ef004bbb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.413+0000 7fce5ea13800 1 -- 172.21.15.120:0/89952126 >> 172.21.15.120:0/89952126 conn(0x558ef00463c0 msgr2=0x558ef0048820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.413+0000 7fce5ea13800 1 -- 172.21.15.120:0/89952126 shutdown_connections 2024-09-07T03:33:32.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.413+0000 7fce5ea13800 1 -- 172.21.15.120:0/89952126 wait complete. 2024-09-07T03:33:32.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.426+0000 7fce5ea13800 1 Processor -- start 2024-09-07T03:33:32.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.427+0000 7fce5ea13800 1 -- start start 2024-09-07T03:33:32.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.427+0000 7fce5ea13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558eeffc06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.427+0000 7fce5ea13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558eefee3dd0 con 0x558ef004aff0 2024-09-07T03:33:32.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.427+0000 7fce5a122640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558eeffc06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.427+0000 7fce5a122640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558eeffc06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44122/0 (socket says 172.21.15.120:44122) 2024-09-07T03:33:32.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.427+0000 7fce5a122640 1 -- 172.21.15.120:0/1013113939 learned_addr learned my addr 172.21.15.120:0/1013113939 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.427+0000 7fce5a122640 1 -- 172.21.15.120:0/1013113939 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eefefce10 con 0x558ef004aff0 2024-09-07T03:33:32.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.427+0000 7fce5a122640 1 --2- 172.21.15.120:0/1013113939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558eeffc06d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fce4c025a60 tx=0x7fce4c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58bee80f581ab4a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fcd48608640 1 -- 172.21.15.120:0/1013113939 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c0589b0 con 0x558ef004aff0 2024-09-07T03:33:32.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fcd48608640 1 -- 172.21.15.120:0/1013113939 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4c068070 con 0x558ef004aff0 2024-09-07T03:33:32.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fcd48608640 1 -- 172.21.15.120:0/1013113939 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c058c80 con 0x558ef004aff0 2024-09-07T03:33:32.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fce5ea13800 1 -- 172.21.15.120:0/1013113939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 msgr2=0x558eeffc06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1013113939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558eeffc06d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fce4c025a60 tx=0x7fce4c051000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fce5ea13800 1 -- 172.21.15.120:0/1013113939 shutdown_connections 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1013113939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558eeffc06d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fce5ea13800 1 -- 172.21.15.120:0/1013113939 >> 172.21.15.120:0/1013113939 conn(0x558ef00463c0 msgr2=0x558ef0135fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fce5ea13800 1 -- 172.21.15.120:0/1013113939 shutdown_connections 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.428+0000 7fce5ea13800 1 -- 172.21.15.120:0/1013113939 wait complete. 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.429+0000 7fce5ea13800 1 Processor -- start 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.429+0000 7fce5ea13800 1 -- start start 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.429+0000 7fce5ea13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558ef0143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.429+0000 7fce5ea13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558ef004c7e0 con 0x558ef004aff0 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.429+0000 7fce5a122640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558ef0143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.429+0000 7fce5a122640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558ef0143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44136/0 (socket says 172.21.15.120:44136) 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.429+0000 7fce5a122640 1 -- 172.21.15.120:0/1021139334 learned_addr learned my addr 172.21.15.120:0/1021139334 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.430+0000 7fce5a122640 1 -- 172.21.15.120:0/1021139334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef0144540 con 0x558ef004aff0 2024-09-07T03:33:32.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.430+0000 7fce5a122640 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558ef0143fe0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fce4c025a60 tx=0x7fce4c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.430+0000 7fcd46e05640 1 -- 172.21.15.120:0/1021139334 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c0635f0 con 0x558ef004aff0 2024-09-07T03:33:32.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.430+0000 7fcd46e05640 1 -- 172.21.15.120:0/1021139334 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4c063790 con 0x558ef004aff0 2024-09-07T03:33:32.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.430+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ef01447d0 con 0x558ef004aff0 2024-09-07T03:33:32.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.430+0000 7fcd46e05640 1 -- 172.21.15.120:0/1021139334 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c063a90 con 0x558ef004aff0 2024-09-07T03:33:32.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.430+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef01451d0 con 0x558ef004aff0 2024-09-07T03:33:32.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.431+0000 7fcd46e05640 1 -- 172.21.15.120:0/1021139334 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fce4c075020 con 0x558ef004aff0 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.431+0000 7fcd46e05640 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd4003c730 0x7fcd4003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.431+0000 7fcd46e05640 1 -- 172.21.15.120:0/1021139334 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fce4c098000 con 0x558ef004aff0 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.431+0000 7fce59921640 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd4003c730 0x7fcd4003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.431+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef004c0f0 0x558ef014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.431+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef014bb70 con 0x558ef004c0f0 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.431+0000 7fce5a923640 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef004c0f0 0x558ef014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.431+0000 7fce59921640 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd4003c730 0x7fcd4003ebf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fce50001d70 tx=0x7fce500012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.432+0000 7fce5a923640 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef004c0f0 0x558ef014b630 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.432+0000 7fce5a923640 1 -- 172.21.15.120:0/1021139334 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce540083e0 con 0x558ef004c0f0 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.432+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef014c420 0x558ef014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.432+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef014f030 con 0x558ef014c420 2024-09-07T03:33:32.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.432+0000 7fce5a122640 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef014c420 0x558ef014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.432+0000 7fce5a122640 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef014c420 0x558ef014e8c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.433+0000 7fce5a122640 1 -- 172.21.15.120:0/1021139334 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef014c420 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.433+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef01508e0 con 0x558ef014c420 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.433+0000 7fce5a122640 1 -- 172.21.15.120:0/1021139334 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef014c420 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.433+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef014fa50 con 0x558ef014c420 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.433+0000 7fce5a122640 1 -- 172.21.15.120:0/1021139334 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef014c420 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.433+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef014fe70 con 0x558ef004c0f0 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.434+0000 7fce5a923640 1 -- 172.21.15.120:0/1021139334 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce540083e0 con 0x558ef004c0f0 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.434+0000 7fce5ea13800 1 Processor -- start 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.434+0000 7fce5ea13800 1 -- start start 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.434+0000 7fce5ea13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef015edc0 0x558ef015f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.434+0000 7fce5ea13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558eeff41a00 con 0x558ef015edc0 2024-09-07T03:33:32.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.434+0000 7fce5a923640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef015edc0 0x558ef015f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.434+0000 7fce5a923640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef015edc0 0x558ef015f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44142/0 (socket says 172.21.15.120:44142) 2024-09-07T03:33:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.434+0000 7fce5a923640 1 -- 172.21.15.120:0/1136751235 learned_addr learned my addr 172.21.15.120:0/1136751235 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.435+0000 7fce5a923640 1 -- 172.21.15.120:0/1136751235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef015f820 con 0x558ef015edc0 2024-09-07T03:33:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.435+0000 7fce5a923640 1 --2- 172.21.15.120:0/1136751235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef015edc0 0x558ef015f1e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fce5400aa90 tx=0x7fce5400af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.435+0000 7fcd3ffff640 1 -- 172.21.15.120:0/1136751235 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce54007d70 con 0x558ef015edc0 2024-09-07T03:33:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.435+0000 7fcd3ffff640 1 -- 172.21.15.120:0/1136751235 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce54018430 con 0x558ef015edc0 2024-09-07T03:33:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.435+0000 7fcd3ffff640 1 -- 172.21.15.120:0/1136751235 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce54018750 con 0x558ef015edc0 2024-09-07T03:33:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.435+0000 7fce5ea13800 1 -- 172.21.15.120:0/1136751235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ef0160050 con 0x558ef015edc0 2024-09-07T03:33:32.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.435+0000 7fce5ea13800 1 -- 172.21.15.120:0/1136751235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef01605f0 con 0x558ef015edc0 2024-09-07T03:33:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.436+0000 7fcd3ffff640 1 -- 172.21.15.120:0/1136751235 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fce54020020 con 0x558ef015edc0 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.436+0000 7fcd3ffff640 1 --2- 172.21.15.120:0/1136751235 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd3403c780 0x7fcd3403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.436+0000 7fcd3ffff640 1 -- 172.21.15.120:0/1136751235 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fce5401e020 con 0x558ef015edc0 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.436+0000 7fce5a122640 1 --2- 172.21.15.120:0/1136751235 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd3403c780 0x7fcd3403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.436+0000 7fce5ea13800 1 Processor -- start 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fce5ea13800 1 -- start start 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fce5a122640 1 --2- 172.21.15.120:0/1136751235 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd3403c780 0x7fcd3403ec40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x558ef014f570 tx=0x7fce4c089040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fce5ea13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef016bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fce5ea13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558eeffbef70 con 0x558ef016b8c0 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fce5a923640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef016bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fce5a923640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef016bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44156/0 (socket says 172.21.15.120:44156) 2024-09-07T03:33:32.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fce5a923640 1 -- 172.21.15.120:0/762158582 learned_addr learned my addr 172.21.15.120:0/762158582 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fce5a923640 1 -- 172.21.15.120:0/762158582 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef016c2b0 con 0x558ef016b8c0 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fce5a923640 1 --2- 172.21.15.120:0/762158582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef016bcc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fce540531c0 tx=0x7fce540206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a193dcad5ebcea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fcd3dffb640 1 -- 172.21.15.120:0/762158582 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5404a070 con 0x558ef016b8c0 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fcd3dffb640 1 -- 172.21.15.120:0/762158582 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce54020b70 con 0x558ef016b8c0 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.437+0000 7fcd3dffb640 1 -- 172.21.15.120:0/762158582 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce54022410 con 0x558ef016b8c0 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 -- 172.21.15.120:0/762158582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 msgr2=0x558ef016bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 --2- 172.21.15.120:0/762158582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef016bcc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fce540531c0 tx=0x7fce540206e0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 -- 172.21.15.120:0/762158582 shutdown_connections 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 --2- 172.21.15.120:0/762158582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef016bcc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 -- 172.21.15.120:0/762158582 >> 172.21.15.120:0/762158582 conn(0x558ef0167cc0 msgr2=0x558ef0165f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 -- 172.21.15.120:0/762158582 shutdown_connections 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 -- 172.21.15.120:0/762158582 wait complete. 2024-09-07T03:33:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 Processor -- start 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 -- start start 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef0172ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.438+0000 7fce5ea13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558ef016c8d0 con 0x558ef016b8c0 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fce5a923640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef0172ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fce5a923640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef0172ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44162/0 (socket says 172.21.15.120:44162) 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 learned_addr learned my addr 172.21.15.120:0/1345575459 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef0173400 con 0x558ef016b8c0 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fce5a923640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef0172ea0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fce54053120 tx=0x7fce54053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fcd2bfff640 1 -- 172.21.15.120:0/1345575459 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce54031020 con 0x558ef016b8c0 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fcd2bfff640 1 -- 172.21.15.120:0/1345575459 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5404b040 con 0x558ef016b8c0 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ef0173690 con 0x558ef016b8c0 2024-09-07T03:33:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fcd2bfff640 1 -- 172.21.15.120:0/1345575459 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce5404a030 con 0x558ef016b8c0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.439+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef0174010 con 0x558ef016b8c0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.440+0000 7fcd2bfff640 1 -- 172.21.15.120:0/1345575459 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fce54034020 con 0x558ef016b8c0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.440+0000 7fcd2bfff640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd2403c6e0 0x7fcd2403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.440+0000 7fcd2bfff640 1 -- 172.21.15.120:0/1345575459 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fce54013040 con 0x558ef016b8c0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.440+0000 7fce5a122640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd2403c6e0 0x7fcd2403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef017e9c0 0x558ef0180e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef01815d0 con 0x558ef017e9c0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce59921640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef017e9c0 0x558ef0180e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5a122640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd2403c6e0 0x7fcd2403eba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce4c06d010 tx=0x7fce4c08d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce59921640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef017e9c0 0x558ef0180e80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce50009050 con 0x558ef017e9c0 2024-09-07T03:33:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 20 realm 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef017dd60 con 0x558ef017e9c0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce50009050 con 0x558ef017e9c0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.441+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef01820b0 con 0x558ef017e9c0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.442+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce50009050 con 0x558ef017e9c0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.442+0000 7fce5ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.442+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.442+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef0182e90 0x558ef0185280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.442+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef0185950 con 0x558ef0182e90 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.442+0000 7fce5a923640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef0182e90 0x558ef0185280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.442+0000 7fce5a923640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef0182e90 0x558ef0185280 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5ea13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef01861f0 con 0x558ef0182e90 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5ea13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5ea13800 20 searching for the correct realm 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558ef0187f60 0x558ef018a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558ef018aa40 con 0x558ef0187f60 2024-09-07T03:33:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5a122640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558ef0187f60 0x558ef018a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.443+0000 7fce5a122640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558ef0187f60 0x558ef018a370 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.444+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.444+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558ef018aa40 con 0x558ef0182e90 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.444+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.444+0000 7fce5a923640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fce54036020 0x7fce54044400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.444+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558ef018aa40 con 0x7fce54036020 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.444+0000 7fce59921640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fce54036020 0x7fce54044400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.444+0000 7fce59921640 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fce54036020 0x7fce54044400 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50009050 con 0x7fce54036020 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558ef018aa40 con 0x558ef017e9c0 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50009050 con 0x558ef017e9c0 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558ef018aa40 con 0x558ef017e9c0 2024-09-07T03:33:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558ef018aa40 con 0x558ef0187f60 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558ef018aa40 con 0x558ef017e9c0 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.445+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558ef018aa40 con 0x558ef0182e90 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.446+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.446+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558ef018aa40 con 0x558ef0182e90 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.446+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.446+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef017e9c0 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.446+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.446+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x7fce54036020 2024-09-07T03:33:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.446+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.446+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef017e9c0 2024-09-07T03:33:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.447+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.447+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x7fce54036020 2024-09-07T03:33:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.447+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.447+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0182e90 2024-09-07T03:33:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.447+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.447+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0187f60 2024-09-07T03:33:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.447+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.448+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef017e9c0 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.448+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.448+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0182e90 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.448+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.448+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0187f60 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.448+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.448+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef017e9c0 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef017e9c0 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef017e9c0 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0187f60 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x7fce54036020 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.449+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x7fce54036020 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.450+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.450+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x7fce54036020 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.450+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.450+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0187f60 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.450+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.450+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x7fce54036020 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.450+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.450+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0182e90 2024-09-07T03:33:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.451+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.451+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0182e90 2024-09-07T03:33:32.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.451+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.451+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0187f60 2024-09-07T03:33:32.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.451+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.451+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0182e90 2024-09-07T03:33:32.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.451+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.451+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fce54066040 con 0x558ef0182e90 2024-09-07T03:33:32.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef0186a40 con 0x558ef017e9c0 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef0186e30 con 0x558ef0182e90 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce540083e0 con 0x558ef0182e90 2024-09-07T03:33:32.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef0186e30 con 0x558ef017e9c0 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 zone default found 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 4 Realm: () 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 zonegroup default 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.452+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef0186620 con 0x7fce54036020 2024-09-07T03:33:32.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef018ca00 con 0x558ef0187f60 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef018ce70 con 0x558ef0187f60 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 20 started sync module instance, tier type = 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.453+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018bda0 con 0x558ef0182e90 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.455+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce54073040 con 0x558ef0182e90 2024-09-07T03:33:32.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.455+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94072401871600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018bda0 con 0x558ef0182e90 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.455+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018d9b0 con 0x558ef017e9c0 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.456+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.456+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94072401871600] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce54073040 con 0x558ef0182e90 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.456+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94072401876128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018d9b0 con 0x558ef017e9c0 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.456+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018b8f0 con 0x558ef0182e90 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.457+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94072401876128] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.457+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce54073040 con 0x558ef0182e90 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.457+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94072401878480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018b8f0 con 0x558ef0182e90 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.457+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018ef40 con 0x7fce54036020 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.458+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.458+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94072401881744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018f360 con 0x7fce54036020 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.458+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018fe60 con 0x558ef0182e90 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.459+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94072401878480] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce54073040 con 0x558ef0182e90 2024-09-07T03:33:32.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.459+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94072401881744] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.460+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce54073040 con 0x558ef0182e90 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.460+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94072401885520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018eeb0 con 0x558ef0182e90 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.460+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef01902d0 con 0x558ef0187f60 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.461+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.461+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94072401886752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef0190730 con 0x558ef0187f60 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.461+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef0191230 con 0x558ef0187f60 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.461+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94072401885520] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce54073040 con 0x558ef0182e90 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.462+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94072401886752] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.462+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.462+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94072401890592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef01911f0 con 0x558ef0187f60 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.462+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef0191b00 con 0x7fce54036020 2024-09-07T03:33:32.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94072401890592] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94072401880176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef01911f0 con 0x7fce54036020 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce5ea13800 20 add_watcher() i=0 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce5ea13800 20 add_watcher() i=1 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce5ea13800 20 add_watcher() i=2 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce5ea13800 20 add_watcher() i=3 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce5ea13800 20 add_watcher() i=4 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce5ea13800 20 add_watcher() i=5 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.463+0000 7fce5ea13800 20 add_watcher() i=6 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.464+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94072401880176] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.464+0000 7fce5ea13800 20 add_watcher() i=7 2024-09-07T03:33:32.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.464+0000 7fce5ea13800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.464+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef0194c70 con 0x558ef017e9c0 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.465+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.465+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94072401892944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef01921c0 con 0x558ef017e9c0 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.466+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94072401892944] v36'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.466+0000 7fcd10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.466+0000 7fce5ea13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.466+0000 7fce5ea13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.466+0000 7fce5ea13800 5 note: GC not initialized 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.466+0000 7fcc8b7fe640 20 reqs_thread_entry: start 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.467+0000 7fce5ea13800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.467+0000 7fce5ea13800 20 Filter name: none 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.467+0000 7fcc897fa640 20 reqs_thread_entry: start 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.467+0000 7fce5ea13800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.467+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef01c7830 con 0x558ef017e9c0 2024-09-07T03:33:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.467+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.467+0000 7fce5ea13800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:33:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.467+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558ef01c8c20 con 0x558ef0187f60 2024-09-07T03:33:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.467+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.468+0000 7fcd10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.468+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94072401892944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef01c7150 con 0x558ef017e9c0 2024-09-07T03:33:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.469+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94072401892944] v36'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.469+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94072401871600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef0191650 con 0x558ef0182e90 2024-09-07T03:33:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.471+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94072401871600] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce54073040 con 0x558ef0182e90 2024-09-07T03:33:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.471+0000 7fce5ea13800 20 remove_watcher() i=0 2024-09-07T03:33:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.471+0000 7fce5ea13800 2 removed watcher, disabling cache 2024-09-07T03:33:32.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.471+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94072401876128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018c2d0 con 0x558ef017e9c0 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.472+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94072401876128] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce50028040 con 0x558ef017e9c0 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.472+0000 7fce5ea13800 20 remove_watcher() i=1 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.472+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94072401878480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018c2d0 con 0x558ef0182e90 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.473+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94072401878480] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce54073040 con 0x558ef0182e90 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.473+0000 7fce5ea13800 20 remove_watcher() i=2 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.473+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94072401881744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018ddd0 con 0x7fce54036020 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.474+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94072401881744] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.474+0000 7fce5ea13800 20 remove_watcher() i=3 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.474+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94072401885520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018ddd0 con 0x558ef0182e90 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.475+0000 7fce5a923640 1 -- 172.21.15.120:0/1345575459 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94072401885520] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce54073040 con 0x558ef0182e90 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.475+0000 7fce5ea13800 20 remove_watcher() i=4 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.475+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94072401886752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018f950 con 0x558ef0187f60 2024-09-07T03:33:32.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.476+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94072401886752] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.476+0000 7fce5ea13800 20 remove_watcher() i=5 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.476+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94072401890592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef018fe20 con 0x558ef0187f60 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.477+0000 7fce5a122640 1 -- 172.21.15.120:0/1345575459 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94072401890592] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06dd00 con 0x558ef0187f60 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.477+0000 7fce5ea13800 20 remove_watcher() i=6 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.477+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94072401880176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558ef0190d20 con 0x7fce54036020 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94072401880176] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce50028040 con 0x7fce54036020 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 20 remove_watcher() i=7 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef0182e90 msgr2=0x558ef0185280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef0182e90 0x558ef0185280 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef017e9c0 msgr2=0x558ef0180e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef017e9c0 0x558ef0180e80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fce54036020 msgr2=0x7fce54044400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fce54036020 0x7fce54044400 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558ef0187f60 msgr2=0x558ef018a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x558ef0187f60 0x558ef018a370 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd2403c6e0 msgr2=0x7fcd2403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd2403c6e0 0x7fcd2403eba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce4c06d010 tx=0x7fce4c08d000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 msgr2=0x558ef0172ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce59921640 1 -- 172.21.15.120:0/1345575459 reap_dead start 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef0172ea0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fce54053120 tx=0x7fce54053150 comp rx=0 tx=0).stop 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 shutdown_connections 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1345575459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef016b8c0 0x558ef0172ea0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 >> 172.21.15.120:0/1345575459 conn(0x558ef0167cc0 msgr2=0x558ef0165ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 shutdown_connections 2024-09-07T03:33:32.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.478+0000 7fce5ea13800 1 -- 172.21.15.120:0/1345575459 wait complete. 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1136751235 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd3403c780 msgr2=0x7fcd3403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1136751235 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd3403c780 0x7fcd3403ec40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x558ef014f570 tx=0x7fce4c089040 comp rx=0 tx=0).stop 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1136751235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef015edc0 msgr2=0x558ef015f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1136751235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef015edc0 0x558ef015f1e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fce5400aa90 tx=0x7fce5400af50 comp rx=0 tx=0).stop 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1136751235 shutdown_connections 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1136751235 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd3403c780 0x7fcd3403ec40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1136751235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef015edc0 0x558ef015f1e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1136751235 >> 172.21.15.120:0/1136751235 conn(0x558ef0153170 msgr2=0x558ef0153550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1136751235 shutdown_connections 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1136751235 wait complete. 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef014c420 msgr2=0x558ef014e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef014c420 0x558ef014e8c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef004c0f0 msgr2=0x558ef014b630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef004c0f0 0x558ef014b630 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd4003c730 msgr2=0x7fcd4003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd4003c730 0x7fcd4003ebf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fce50001d70 tx=0x7fce500012d0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 msgr2=0x558ef0143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558ef0143fe0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fce4c025a60 tx=0x7fce4c003330 comp rx=0 tx=0).stop 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 shutdown_connections 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x558ef014c420 0x558ef014e8c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x558ef004c0f0 0x558ef014b630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcd4003c730 0x7fcd4003ebf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 --2- 172.21.15.120:0/1021139334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558ef004aff0 0x558ef0143fe0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 >> 172.21.15.120:0/1021139334 conn(0x558ef00463c0 msgr2=0x558ef0135b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 shutdown_connections 2024-09-07T03:33:32.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.479+0000 7fce5ea13800 1 -- 172.21.15.120:0/1021139334 wait complete. 2024-09-07T03:33:32.490 INFO:teuthology.orchestra.run.smithi120.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-07T03:33:32.491 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:33:32.491 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-07T03:33:32.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-07T03:33:32.491 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-07T03:33:32.537 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:32.537 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b8739800 1 Processor -- start 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b8739800 1 -- start start 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b8739800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e4596274b0 0x55e4596278b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b8739800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4594d2e40 con 0x55e459627df0 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b8739800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e45949d680 con 0x55e4596274b0 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b43ce640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e4596274b0 0x55e4596278b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b3bcd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55e459627df0 0x55e4596282a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42156/0 (socket says 172.21.15.120:42156) 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b3bcd640 1 -- 172.21.15.120:0/2245404108 learned_addr learned my addr 172.21.15.120:0/2245404108 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b43ce640 1 -- 172.21.15.120:0/2245404108 >> v1:172.21.15.104:6789/0 conn(0x55e459627df0 legacy=0x55e4596282a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.537+0000 7f48b43ce640 1 -- 172.21.15.120:0/2245404108 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4594b96b0 con 0x55e4596274b0 2024-09-07T03:33:32.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.539+0000 7f48b43ce640 1 --2- 172.21.15.120:0/2245404108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e4596278b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f48ac005fd0 tx=0x7f48ac045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce86237656ef4816 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.539+0000 7f48b33cc640 1 -- 172.21.15.120:0/2245404108 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac058530 con 0x55e4596274b0 2024-09-07T03:33:32.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.539+0000 7f48b33cc640 1 -- 172.21.15.120:0/2245404108 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac0586d0 con 0x55e4596274b0 2024-09-07T03:33:32.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.539+0000 7f48b33cc640 1 -- 172.21.15.120:0/2245404108 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0589d0 con 0x55e4596274b0 2024-09-07T03:33:32.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.540+0000 7f48b8739800 1 -- 172.21.15.120:0/2245404108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 msgr2=0x55e4596278b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.540+0000 7f48b8739800 1 --2- 172.21.15.120:0/2245404108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e4596278b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f48ac005fd0 tx=0x7f48ac045c30 comp rx=0 tx=0).stop 2024-09-07T03:33:32.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.540+0000 7f48b8739800 1 -- 172.21.15.120:0/2245404108 shutdown_connections 2024-09-07T03:33:32.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.540+0000 7f48b8739800 1 --2- 172.21.15.120:0/2245404108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e4596278b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.540+0000 7f48b8739800 1 -- 172.21.15.120:0/2245404108 >> 172.21.15.120:0/2245404108 conn(0x55e459623200 msgr2=0x55e459625640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.540+0000 7f48b8739800 1 -- 172.21.15.120:0/2245404108 shutdown_connections 2024-09-07T03:33:32.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.540+0000 7f48b8739800 1 -- 172.21.15.120:0/2245404108 wait complete. 2024-09-07T03:33:32.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.554+0000 7f48b8739800 1 Processor -- start 2024-09-07T03:33:32.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.554+0000 7f48b8739800 1 -- start start 2024-09-07T03:33:32.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.554+0000 7f48b8739800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e45971a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.554+0000 7f48b8739800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e4594c1dd0 con 0x55e4596274b0 2024-09-07T03:33:32.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.554+0000 7f48b43ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e45971a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.554+0000 7f48b43ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e45971a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44184/0 (socket says 172.21.15.120:44184) 2024-09-07T03:33:32.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.554+0000 7f48b43ce640 1 -- 172.21.15.120:0/2087741824 learned_addr learned my addr 172.21.15.120:0/2087741824 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.554+0000 7f48b43ce640 1 -- 172.21.15.120:0/2087741824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4594dae10 con 0x55e4596274b0 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.555+0000 7f48b43ce640 1 --2- 172.21.15.120:0/2087741824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e45971a8d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f48ac025a60 tx=0x7f48ac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17204a8735793b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.555+0000 7f47a260c640 1 -- 172.21.15.120:0/2087741824 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0589b0 con 0x55e4596274b0 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.555+0000 7f47a260c640 1 -- 172.21.15.120:0/2087741824 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac068070 con 0x55e4596274b0 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.555+0000 7f47a260c640 1 -- 172.21.15.120:0/2087741824 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac058c80 con 0x55e4596274b0 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.555+0000 7f48b8739800 1 -- 172.21.15.120:0/2087741824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 msgr2=0x55e45971a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.555+0000 7f48b8739800 1 --2- 172.21.15.120:0/2087741824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e45971a8d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f48ac025a60 tx=0x7f48ac051000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b8739800 1 -- 172.21.15.120:0/2087741824 shutdown_connections 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b8739800 1 --2- 172.21.15.120:0/2087741824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e45971a8d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b8739800 1 -- 172.21.15.120:0/2087741824 >> 172.21.15.120:0/2087741824 conn(0x55e459623200 msgr2=0x55e459716250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b8739800 1 -- 172.21.15.120:0/2087741824 shutdown_connections 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b8739800 1 -- 172.21.15.120:0/2087741824 wait complete. 2024-09-07T03:33:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b8739800 1 Processor -- start 2024-09-07T03:33:32.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b8739800 1 -- start start 2024-09-07T03:33:32.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b8739800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e459722130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b8739800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e459628d70 con 0x55e4596274b0 2024-09-07T03:33:32.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b43ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e459722130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b43ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e459722130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44186/0 (socket says 172.21.15.120:44186) 2024-09-07T03:33:32.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.556+0000 7f48b43ce640 1 -- 172.21.15.120:0/59084006 learned_addr learned my addr 172.21.15.120:0/59084006 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.557+0000 7f48b43ce640 1 -- 172.21.15.120:0/59084006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e459722690 con 0x55e4596274b0 2024-09-07T03:33:32.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.557+0000 7f48b43ce640 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e459722130 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f48ac025a60 tx=0x7f48ac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.557+0000 7f47a0e09640 1 -- 172.21.15.120:0/59084006 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac063650 con 0x55e4596274b0 2024-09-07T03:33:32.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.557+0000 7f47a0e09640 1 -- 172.21.15.120:0/59084006 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac0637f0 con 0x55e4596274b0 2024-09-07T03:33:32.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.557+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e459722920 con 0x55e4596274b0 2024-09-07T03:33:32.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.557+0000 7f47a0e09640 1 -- 172.21.15.120:0/59084006 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac063af0 con 0x55e4596274b0 2024-09-07T03:33:32.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.557+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e459723530 con 0x55e4596274b0 2024-09-07T03:33:32.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.558+0000 7f47a0e09640 1 -- 172.21.15.120:0/59084006 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f48ac063c90 con 0x55e4596274b0 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.558+0000 7f47a0e09640 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f479c03c780 0x7f479c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.558+0000 7f47a0e09640 1 -- 172.21.15.120:0/59084006 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f48ac097dc0 con 0x55e4596274b0 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.558+0000 7f48b3bcd640 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f479c03c780 0x7f479c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.558+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e459627df0 0x55e459729780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.558+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e459729cc0 con 0x55e459627df0 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.558+0000 7f48b4bcf640 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e459627df0 0x55e459729780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.559+0000 7f48b3bcd640 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f479c03c780 0x7f479c03ec40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f489c001d70 tx=0x7f489c0012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.559+0000 7f48b4bcf640 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e459627df0 0x55e459729780 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.559+0000 7f48b4bcf640 1 -- 172.21.15.120:0/59084006 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459627df0 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.559+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e45972a570 0x55e45972ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.559+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e45972d180 con 0x55e45972a570 2024-09-07T03:33:32.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.559+0000 7f48b43ce640 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e45972a570 0x55e45972ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.560+0000 7f48b43ce640 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e45972a570 0x55e45972ca10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.560+0000 7f48b43ce640 1 -- 172.21.15.120:0/59084006 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e45972a570 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.560+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e45972ea30 con 0x55e45972a570 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.560+0000 7f48b43ce640 1 -- 172.21.15.120:0/59084006 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e45972a570 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.560+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e45972dba0 con 0x55e45972a570 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.560+0000 7f48b43ce640 1 -- 172.21.15.120:0/59084006 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e45972a570 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.561+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e45972dfc0 con 0x55e459627df0 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.561+0000 7f48b4bcf640 1 -- 172.21.15.120:0/59084006 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459627df0 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.561+0000 7f48b8739800 1 Processor -- start 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.561+0000 7f48b8739800 1 -- start start 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.561+0000 7f48b8739800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e45973cef0 0x55e45973d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.561+0000 7f48b8739800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e45951fa00 con 0x55e45973cef0 2024-09-07T03:33:32.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.561+0000 7f48b4bcf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e45973cef0 0x55e45973d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.561+0000 7f48b4bcf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e45973cef0 0x55e45973d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44190/0 (socket says 172.21.15.120:44190) 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.561+0000 7f48b4bcf640 1 -- 172.21.15.120:0/3986956603 learned_addr learned my addr 172.21.15.120:0/3986956603 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.562+0000 7f48b4bcf640 1 -- 172.21.15.120:0/3986956603 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45973d950 con 0x55e45973cef0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.562+0000 7f48b4bcf640 1 --2- 172.21.15.120:0/3986956603 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e45973cef0 0x55e45973d310 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f48a400aa90 tx=0x7f48a400af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.562+0000 7f4799ffb640 1 -- 172.21.15.120:0/3986956603 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a4007d70 con 0x55e45973cef0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.562+0000 7f4799ffb640 1 -- 172.21.15.120:0/3986956603 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a4018430 con 0x55e45973cef0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.562+0000 7f48b8739800 1 -- 172.21.15.120:0/3986956603 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e45973e180 con 0x55e45973cef0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.562+0000 7f4799ffb640 1 -- 172.21.15.120:0/3986956603 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a4018750 con 0x55e45973cef0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.562+0000 7f48b8739800 1 -- 172.21.15.120:0/3986956603 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45973e720 con 0x55e45973cef0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.563+0000 7f4799ffb640 1 -- 172.21.15.120:0/3986956603 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f48a4020020 con 0x55e45973cef0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.563+0000 7f4799ffb640 1 --2- 172.21.15.120:0/3986956603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478c03c780 0x7f478c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.563+0000 7f4799ffb640 1 -- 172.21.15.120:0/3986956603 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f48a401e020 con 0x55e45973cef0 2024-09-07T03:33:32.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.563+0000 7f48b43ce640 1 --2- 172.21.15.120:0/3986956603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478c03c780 0x7f478c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.563+0000 7f48b8739800 1 Processor -- start 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f48b43ce640 1 --2- 172.21.15.120:0/3986956603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478c03c780 0x7f478c03ec40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55e45972d6c0 tx=0x7f48ac08a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f48b8739800 1 -- start start 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f48b8739800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459749df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f48b8739800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e45971b060 con 0x55e4597499f0 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f48b4bcf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459749df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f48b4bcf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459749df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44194/0 (socket says 172.21.15.120:44194) 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1213347362 learned_addr learned my addr 172.21.15.120:0/1213347362 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1213347362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45974a3e0 con 0x55e4597499f0 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f48b4bcf640 1 --2- 172.21.15.120:0/1213347362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459749df0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f48a40531c0 tx=0x7f48a40206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412df6505c556c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f47937fe640 1 -- 172.21.15.120:0/1213347362 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a404a070 con 0x55e4597499f0 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f47937fe640 1 -- 172.21.15.120:0/1213347362 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a4020b70 con 0x55e4597499f0 2024-09-07T03:33:32.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.564+0000 7f47937fe640 1 -- 172.21.15.120:0/1213347362 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a4022410 con 0x55e4597499f0 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 -- 172.21.15.120:0/1213347362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 msgr2=0x55e459749df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 --2- 172.21.15.120:0/1213347362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459749df0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f48a40531c0 tx=0x7f48a40206e0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 -- 172.21.15.120:0/1213347362 shutdown_connections 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 --2- 172.21.15.120:0/1213347362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459749df0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 -- 172.21.15.120:0/1213347362 >> 172.21.15.120:0/1213347362 conn(0x55e459745df0 msgr2=0x55e459744030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 -- 172.21.15.120:0/1213347362 shutdown_connections 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 -- 172.21.15.120:0/1213347362 wait complete. 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 Processor -- start 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 -- start start 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459750fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b8739800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e45974aa00 con 0x55e4597499f0 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.565+0000 7f48b4bcf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459750fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.566+0000 7f48b4bcf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459750fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44196/0 (socket says 172.21.15.120:44196) 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.566+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 learned_addr learned my addr 172.21.15.120:0/1809148451 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.566+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e459751500 con 0x55e4597499f0 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.566+0000 7f48b4bcf640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459750fa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f48a4053120 tx=0x7f48a4053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.566+0000 7f4791ffb640 1 -- 172.21.15.120:0/1809148451 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a4031020 con 0x55e4597499f0 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.566+0000 7f4791ffb640 1 -- 172.21.15.120:0/1809148451 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a404b040 con 0x55e4597499f0 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.566+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e459751790 con 0x55e4597499f0 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.566+0000 7f4791ffb640 1 -- 172.21.15.120:0/1809148451 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a404a030 con 0x55e4597499f0 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.566+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e459752110 con 0x55e4597499f0 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.567+0000 7f4791ffb640 1 -- 172.21.15.120:0/1809148451 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f48a4034020 con 0x55e4597499f0 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.567+0000 7f4791ffb640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478403c6e0 0x7f478403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.567+0000 7f4791ffb640 1 -- 172.21.15.120:0/1809148451 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f48a4013040 con 0x55e4597499f0 2024-09-07T03:33:32.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.567+0000 7f48b43ce640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478403c6e0 0x7f478403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.567+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.567+0000 7f48b8739800 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e45975cac0 0x55e45975ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.567+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e45975f6d0 con 0x55e45975cac0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.567+0000 7f48b3bcd640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e45975cac0 0x55e45975ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b43ce640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478403c6e0 0x7f478403eba0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f48ac04ea70 tx=0x7f48ac092000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b3bcd640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e45975cac0 0x55e45975ef80 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f489c009050 con 0x55e45975cac0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 20 realm 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e45975be60 con 0x55e45975cac0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f489c009050 con 0x55e45975cac0 2024-09-07T03:33:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e4597601b0 con 0x55e45975cac0 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f489c009050 con 0x55e45975cac0 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e459760f90 0x55e459763380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.568+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e459763a50 con 0x55e459760f90 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.569+0000 7f48b4bcf640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e459760f90 0x55e459763380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.569+0000 7f48b4bcf640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e459760f90 0x55e459763380 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.569+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.569+0000 7f48b8739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.569+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.569+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e4597642f0 con 0x55e459760f90 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.570+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.570+0000 7f48b8739800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.570+0000 7f48b8739800 20 searching for the correct realm 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.570+0000 7f48b8739800 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e459766060 0x55e459768470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.570+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e459768b40 con 0x55e459766060 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.570+0000 7f48b43ce640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e459766060 0x55e459768470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.570+0000 7f48b43ce640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e459766060 0x55e459768470 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.570+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.570+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e459768b40 con 0x55e459760f90 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.571+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.571+0000 7f48b4bcf640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f48a4036020 0x7f48a4044400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.571+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e459768b40 con 0x7f48a4036020 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.571+0000 7f48b3bcd640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f48a4036020 0x7f48a4044400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.571+0000 7f48b3bcd640 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f48a4036020 0x7f48a4044400 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.571+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c009050 con 0x7f48a4036020 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.571+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e459768b40 con 0x55e45975cac0 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.571+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c009050 con 0x55e45975cac0 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.571+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e459768b40 con 0x55e45975cac0 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.572+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.572+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e459768b40 con 0x55e459766060 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.572+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.572+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e459768b40 con 0x55e45975cac0 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.572+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.572+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e459768b40 con 0x55e459760f90 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.572+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.572+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e459768b40 con 0x55e459760f90 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.573+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.573+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e45975cac0 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.573+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.573+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x7f48a4036020 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.573+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.573+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e45975cac0 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.573+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.573+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x7f48a4036020 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.574+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.574+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459760f90 2024-09-07T03:33:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.574+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.574+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459766060 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.574+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.574+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e45975cac0 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.575+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.575+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459760f90 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.575+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.575+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459766060 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.575+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.575+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e45975cac0 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.575+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.575+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e45975cac0 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.576+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.576+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e45975cac0 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.576+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.576+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459766060 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.576+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.576+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x7f48a4036020 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.576+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.576+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x7f48a4036020 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.577+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.577+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x7f48a4036020 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.577+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.577+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459766060 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.577+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.577+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x7f48a4036020 2024-09-07T03:33:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.577+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.577+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459760f90 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.578+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.578+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459760f90 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.578+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.578+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459766060 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.578+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.578+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459760f90 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.578+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.578+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f48a4066040 con 0x55e459760f90 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:32.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e459764b40 con 0x55e45975cac0 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e459764f30 con 0x55e459760f90 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48a40083e0 con 0x55e459760f90 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.579+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e459764f30 con 0x55e45975cac0 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 zone default found 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 4 Realm: () 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 zonegroup default 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e459764770 con 0x7f48a4036020 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e45976ab00 con 0x55e459766060 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e45976af80 con 0x55e459766060 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 started sync module instance, tier type = 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.580+0000 7f48b8739800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.581+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e459769ea0 con 0x55e459760f90 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.582+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4073040 con 0x55e459760f90 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.582+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94439241851840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e459769ea0 con 0x55e459760f90 2024-09-07T03:33:32.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.582+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976bae0 con 0x55e45975cac0 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.583+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.583+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94439241856432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976bae0 con 0x55e45975cac0 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.583+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976cae0 con 0x55e459760f90 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.583+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94439241851840] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4073040 con 0x55e459760f90 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.584+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94439241856432] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.584+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4073040 con 0x55e459760f90 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.584+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94439241860560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976caa0 con 0x55e459760f90 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.584+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976d380 con 0x7f48a4036020 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.585+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94439241860560] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4073040 con 0x55e459760f90 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.585+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.585+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94439241849328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976caa0 con 0x7f48a4036020 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.585+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976da40 con 0x55e459760f90 2024-09-07T03:33:32.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.587+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94439241849328] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.588+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4073040 con 0x55e459760f90 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.588+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94439241864432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976da00 con 0x55e459760f90 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.588+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976e490 con 0x55e459766060 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.589+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.589+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94439241867168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976ece0 con 0x55e459766060 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.589+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976f7b0 con 0x55e459766060 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.589+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94439241864432] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4073040 con 0x55e459760f90 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.590+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94439241867168] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.593+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.593+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94439241869360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976f270 con 0x55e459766060 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.593+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e459770090 con 0x7f48a4036020 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94439241874336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e459770040 con 0x7f48a4036020 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b8739800 20 add_watcher() i=0 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b8739800 20 add_watcher() i=1 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b8739800 20 add_watcher() i=2 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b8739800 20 add_watcher() i=3 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b8739800 20 add_watcher() i=4 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b8739800 20 add_watcher() i=5 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94439241869360] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.594+0000 7f48b8739800 20 add_watcher() i=6 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.595+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94439241874336] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.595+0000 7f48b8739800 20 add_watcher() i=7 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.595+0000 7f48b8739800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.595+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e45976ce80 con 0x55e45975cac0 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.595+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.595+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94439241876528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e45976ce80 con 0x55e45975cac0 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94439241876528] v36'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f476a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f48b8739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f48b8739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f48b8739800 5 note: GC not initialized 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f47697e2640 20 reqs_thread_entry: start 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f48b8739800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f48b8739800 20 Filter name: none 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f46daffd640 20 reqs_thread_entry: start 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f48b8739800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.597+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a61f0 con 0x55e45975cac0 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.598+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.598+0000 7f48b8739800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.598+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a7610 con 0x55e459766060 2024-09-07T03:33:32.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.598+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.599+0000 7f476a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.599+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94439241876528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a5b10 con 0x55e45975cac0 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.600+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94439241876528] v36'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.600+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94439241851840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a4130 con 0x55e459760f90 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.601+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94439241851840] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4073040 con 0x55e459760f90 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.601+0000 7f48b8739800 20 remove_watcher() i=0 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.601+0000 7f48b8739800 2 removed watcher, disabling cache 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.601+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94439241856432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a4130 con 0x55e45975cac0 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.602+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94439241856432] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c028040 con 0x55e45975cac0 2024-09-07T03:33:32.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.602+0000 7f48b8739800 20 remove_watcher() i=1 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.602+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94439241860560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a4130 con 0x55e459760f90 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.603+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94439241860560] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4073040 con 0x55e459760f90 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.603+0000 7f48b8739800 20 remove_watcher() i=2 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.604+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94439241849328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a4130 con 0x7f48a4036020 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.604+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94439241849328] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.604+0000 7f48b8739800 20 remove_watcher() i=3 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.604+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94439241864432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a4130 con 0x55e459760f90 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.605+0000 7f48b4bcf640 1 -- 172.21.15.120:0/1809148451 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94439241864432] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a4073040 con 0x55e459760f90 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.605+0000 7f48b8739800 20 remove_watcher() i=4 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.605+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94439241867168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a4130 con 0x55e459766060 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.606+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94439241867168] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.606+0000 7f48b8739800 20 remove_watcher() i=5 2024-09-07T03:33:32.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.606+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94439241869360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a4130 con 0x55e459766060 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.607+0000 7f48b43ce640 1 -- 172.21.15.120:0/1809148451 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94439241869360] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ac0743e0 con 0x55e459766060 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.607+0000 7f48b8739800 20 remove_watcher() i=6 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.607+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94439241874336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e4597a4130 con 0x7f48a4036020 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94439241874336] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c028040 con 0x7f48a4036020 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b8739800 20 remove_watcher() i=7 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e459760f90 msgr2=0x55e459763380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b8739800 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e459760f90 0x55e459763380 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e45975cac0 msgr2=0x55e45975ef80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b8739800 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e45975cac0 0x55e45975ef80 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f48a4036020 msgr2=0x7f48a4044400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b8739800 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f48a4036020 0x7f48a4044400 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e459766060 msgr2=0x55e459768470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.608+0000 7f48b8739800 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e459766060 0x55e459768470 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478403c6e0 msgr2=0x7f478403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478403c6e0 0x7f478403eba0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f48ac04ea70 tx=0x7f48ac092000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 msgr2=0x55e459750fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/1809148451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4597499f0 0x55e459750fa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f48a4053120 tx=0x7f48a4053150 comp rx=0 tx=0).stop 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 reap_dead start 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b3bcd640 1 -- 172.21.15.120:0/1809148451 reap_dead start 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 shutdown_connections 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 >> 172.21.15.120:0/1809148451 conn(0x55e459745df0 msgr2=0x55e459744000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 shutdown_connections 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/1809148451 wait complete. 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/3986956603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478c03c780 msgr2=0x7f478c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/3986956603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478c03c780 0x7f478c03ec40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55e45972d6c0 tx=0x7f48ac08a040 comp rx=0 tx=0).stop 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/3986956603 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e45973cef0 msgr2=0x55e45973d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/3986956603 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e45973cef0 0x55e45973d310 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f48a400aa90 tx=0x7f48a400af50 comp rx=0 tx=0).stop 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/3986956603 shutdown_connections 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/3986956603 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f478c03c780 0x7f478c03ec40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/3986956603 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e45973cef0 0x55e45973d310 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/3986956603 >> 172.21.15.120:0/3986956603 conn(0x55e4597312a0 msgr2=0x55e459731680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/3986956603 shutdown_connections 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/3986956603 wait complete. 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e45972a570 msgr2=0x55e45972ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e45972a570 0x55e45972ca10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e459627df0 msgr2=0x55e459729780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e459627df0 0x55e459729780 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f479c03c780 msgr2=0x7f479c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f479c03c780 0x7f479c03ec40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f489c001d70 tx=0x7f489c0012d0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 msgr2=0x55e459722130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e459722130 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f48ac025a60 tx=0x7f48ac003330 comp rx=0 tx=0).stop 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.609+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 shutdown_connections 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.610+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e45972a570 0x55e45972ca10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.610+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e459627df0 0x55e459729780 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.610+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f479c03c780 0x7f479c03ec40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.610+0000 7f48b8739800 1 --2- 172.21.15.120:0/59084006 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e4596274b0 0x55e459722130 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.610+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 >> 172.21.15.120:0/59084006 conn(0x55e459623200 msgr2=0x55e459714a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.610+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 shutdown_connections 2024-09-07T03:33:32.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.610+0000 7f48b8739800 1 -- 172.21.15.120:0/59084006 wait complete. 2024-09-07T03:33:32.619 INFO:teuthology.orchestra.run.smithi120.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-07T03:33:32.620 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:33:32.620 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-07T03:33:32.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-07T03:33:32.620 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-07T03:33:32.666 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:32.667 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:32.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.666+0000 7f787dfaf800 1 Processor -- start 2024-09-07T03:33:32.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.666+0000 7f787dfaf800 1 -- start start 2024-09-07T03:33:32.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.666+0000 7f787dfaf800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560c1b553000 0x560c1b553bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.666+0000 7f787dfaf800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c1b3fce40 con 0x560c1b554100 2024-09-07T03:33:32.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.666+0000 7f787dfaf800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560c1b3c7680 con 0x560c1b553000 2024-09-07T03:33:32.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.666+0000 7f787baa0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560c1b553000 0x560c1b553bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.666+0000 7f787b29f640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x560c1b554100 0x560c1b558e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42158/0 (socket says 172.21.15.120:42158) 2024-09-07T03:33:32.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.666+0000 7f787b29f640 1 -- 172.21.15.120:0/408391195 learned_addr learned my addr 172.21.15.120:0/408391195 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:33:32.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.667+0000 7f787baa0640 1 -- 172.21.15.120:0/408391195 >> v1:172.21.15.104:6789/0 conn(0x560c1b554100 legacy=0x560c1b558e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.667+0000 7f787baa0640 1 -- 172.21.15.120:0/408391195 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1b3e36b0 con 0x560c1b553000 2024-09-07T03:33:32.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.668+0000 7f787baa0640 1 --2- 172.21.15.120:0/408391195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b553bc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f786c00a470 tx=0x7f786c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c80a80f135c7a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787aa9e640 1 -- 172.21.15.120:0/408391195 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c053570 con 0x560c1b553000 2024-09-07T03:33:32.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787aa9e640 1 -- 172.21.15.120:0/408391195 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786c058070 con 0x560c1b553000 2024-09-07T03:33:32.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787aa9e640 1 -- 172.21.15.120:0/408391195 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c053880 con 0x560c1b553000 2024-09-07T03:33:32.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787dfaf800 1 -- 172.21.15.120:0/408391195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 msgr2=0x560c1b553bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787dfaf800 1 --2- 172.21.15.120:0/408391195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b553bc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f786c00a470 tx=0x7f786c045a20 comp rx=0 tx=0).stop 2024-09-07T03:33:32.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787dfaf800 1 -- 172.21.15.120:0/408391195 shutdown_connections 2024-09-07T03:33:32.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787dfaf800 1 --2- 172.21.15.120:0/408391195 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b553bc0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787dfaf800 1 -- 172.21.15.120:0/408391195 >> 172.21.15.120:0/408391195 conn(0x560c1b54e3d0 msgr2=0x560c1b550830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787dfaf800 1 -- 172.21.15.120:0/408391195 shutdown_connections 2024-09-07T03:33:32.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.669+0000 7f787dfaf800 1 -- 172.21.15.120:0/408391195 wait complete. 2024-09-07T03:33:32.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.683+0000 7f787dfaf800 1 Processor -- start 2024-09-07T03:33:32.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.683+0000 7f787dfaf800 1 -- start start 2024-09-07T03:33:32.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.683+0000 7f787dfaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b642650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.683+0000 7f787dfaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c1b3ebdd0 con 0x560c1b553000 2024-09-07T03:33:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.683+0000 7f787baa0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b642650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.683+0000 7f787baa0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b642650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44214/0 (socket says 172.21.15.120:44214) 2024-09-07T03:33:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.683+0000 7f787baa0640 1 -- 172.21.15.120:0/1554744504 learned_addr learned my addr 172.21.15.120:0/1554744504 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.684+0000 7f787baa0640 1 -- 172.21.15.120:0/1554744504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1b404e10 con 0x560c1b553000 2024-09-07T03:33:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.684+0000 7f787baa0640 1 --2- 172.21.15.120:0/1554744504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b642650 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f786c025c20 tx=0x7f786c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8853c06c477cee server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.684+0000 7f7769e0b640 1 -- 172.21.15.120:0/1554744504 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c053a20 con 0x560c1b553000 2024-09-07T03:33:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.684+0000 7f7769e0b640 1 -- 172.21.15.120:0/1554744504 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786c063070 con 0x560c1b553000 2024-09-07T03:33:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.684+0000 7f7769e0b640 1 -- 172.21.15.120:0/1554744504 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c053cf0 con 0x560c1b553000 2024-09-07T03:33:32.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 -- 172.21.15.120:0/1554744504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 msgr2=0x560c1b642650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1554744504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b642650 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f786c025c20 tx=0x7f786c051000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 -- 172.21.15.120:0/1554744504 shutdown_connections 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1554744504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b642650 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 -- 172.21.15.120:0/1554744504 >> 172.21.15.120:0/1554744504 conn(0x560c1b54e3d0 msgr2=0x560c1b63dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 -- 172.21.15.120:0/1554744504 shutdown_connections 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 -- 172.21.15.120:0/1554744504 wait complete. 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 Processor -- start 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 -- start start 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b649fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787dfaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c1b5547f0 con 0x560c1b553000 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787baa0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b649fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787baa0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b649fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44222/0 (socket says 172.21.15.120:44222) 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.685+0000 7f787baa0640 1 -- 172.21.15.120:0/1163500829 learned_addr learned my addr 172.21.15.120:0/1163500829 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.686+0000 7f787baa0640 1 -- 172.21.15.120:0/1163500829 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1b64a510 con 0x560c1b553000 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.686+0000 7f787baa0640 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b649fb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f786c025c20 tx=0x7f786c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.686+0000 7f7763fff640 1 -- 172.21.15.120:0/1163500829 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c068660 con 0x560c1b553000 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.686+0000 7f7763fff640 1 -- 172.21.15.120:0/1163500829 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786c068800 con 0x560c1b553000 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.686+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c1b64a7a0 con 0x560c1b553000 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.686+0000 7f7763fff640 1 -- 172.21.15.120:0/1163500829 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c068ae0 con 0x560c1b553000 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.686+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c1b64b3b0 con 0x560c1b553000 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.687+0000 7f7763fff640 1 -- 172.21.15.120:0/1163500829 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f786c068c80 con 0x560c1b553000 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.687+0000 7f7763fff640 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f776403c780 0x7f776403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.687+0000 7f7763fff640 1 -- 172.21.15.120:0/1163500829 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f786c098290 con 0x560c1b553000 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.687+0000 7f787b29f640 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f776403c780 0x7f776403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.687+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b554100 0x560c1b651600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.687+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b651b40 con 0x560c1b554100 2024-09-07T03:33:32.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.687+0000 7f787c2a1640 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b554100 0x560c1b651600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.688+0000 7f787b29f640 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f776403c780 0x7f776403ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7870001d70 tx=0x7f78700012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.688+0000 7f787c2a1640 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b554100 0x560c1b651600 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.688+0000 7f787c2a1640 1 -- 172.21.15.120:0/1163500829 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f787400a4d0 con 0x560c1b554100 2024-09-07T03:33:32.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.688+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b6523f0 0x560c1b654860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.688+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b654fd0 con 0x560c1b6523f0 2024-09-07T03:33:32.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.688+0000 7f787baa0640 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b6523f0 0x560c1b654860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.689+0000 7f787baa0640 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b6523f0 0x560c1b654860 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.689+0000 7f787baa0640 1 -- 172.21.15.120:0/1163500829 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f786c051070 con 0x560c1b6523f0 2024-09-07T03:33:32.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.689+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b656880 con 0x560c1b6523f0 2024-09-07T03:33:32.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.689+0000 7f787baa0640 1 -- 172.21.15.120:0/1163500829 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f786c051070 con 0x560c1b6523f0 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.689+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6559c0 con 0x560c1b6523f0 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.690+0000 7f787baa0640 1 -- 172.21.15.120:0/1163500829 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f786c051070 con 0x560c1b6523f0 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.690+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b655e20 con 0x560c1b554100 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.690+0000 7f787c2a1640 1 -- 172.21.15.120:0/1163500829 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f787400a4d0 con 0x560c1b554100 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.690+0000 7f787dfaf800 1 Processor -- start 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.690+0000 7f787dfaf800 1 -- start start 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.690+0000 7f787dfaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b664d00 0x560c1b665120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.690+0000 7f787dfaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c1b449a00 con 0x560c1b664d00 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f787c2a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b664d00 0x560c1b665120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f787c2a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b664d00 0x560c1b665120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44228/0 (socket says 172.21.15.120:44228) 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f787c2a1640 1 -- 172.21.15.120:0/557320578 learned_addr learned my addr 172.21.15.120:0/557320578 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f787c2a1640 1 -- 172.21.15.120:0/557320578 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1b665760 con 0x560c1b664d00 2024-09-07T03:33:32.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f787c2a1640 1 --2- 172.21.15.120:0/557320578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b664d00 0x560c1b665120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7874016d20 tx=0x7f787400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f77617fa640 1 -- 172.21.15.120:0/557320578 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7874017660 con 0x560c1b664d00 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f77617fa640 1 -- 172.21.15.120:0/557320578 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787401b030 con 0x560c1b664d00 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f787dfaf800 1 -- 172.21.15.120:0/557320578 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c1b665f90 con 0x560c1b664d00 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f77617fa640 1 -- 172.21.15.120:0/557320578 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7874017950 con 0x560c1b664d00 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.691+0000 7f787dfaf800 1 -- 172.21.15.120:0/557320578 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c1b666530 con 0x560c1b664d00 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.692+0000 7f77617fa640 1 -- 172.21.15.120:0/557320578 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7874017af0 con 0x560c1b664d00 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.692+0000 7f77617fa640 1 --2- 172.21.15.120:0/557320578 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f775403c780 0x7f775403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.692+0000 7f77617fa640 1 -- 172.21.15.120:0/557320578 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f787400e040 con 0x560c1b664d00 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.692+0000 7f787baa0640 1 --2- 172.21.15.120:0/557320578 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f775403c780 0x7f775403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.692+0000 7f787dfaf800 1 Processor -- start 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f787dfaf800 1 -- start start 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f787baa0640 1 --2- 172.21.15.120:0/557320578 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f775403c780 0x7f775403ec40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x560c1b64b870 tx=0x7f786c083040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f787dfaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b4c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f787dfaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c1b642e40 con 0x560c1b4c8000 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f787c2a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b4c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f787c2a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b4c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44234/0 (socket says 172.21.15.120:44234) 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f787c2a1640 1 -- 172.21.15.120:0/2946305076 learned_addr learned my addr 172.21.15.120:0/2946305076 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f787c2a1640 1 -- 172.21.15.120:0/2946305076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1b4c8940 con 0x560c1b4c8000 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f787c2a1640 1 --2- 172.21.15.120:0/2946305076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b4c8400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7874053e00 tx=0x7f7874017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bb3410b3c53c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f775affd640 1 -- 172.21.15.120:0/2946305076 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7874014d40 con 0x560c1b4c8000 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f775affd640 1 -- 172.21.15.120:0/2946305076 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7874051070 con 0x560c1b4c8000 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.693+0000 7f775affd640 1 -- 172.21.15.120:0/2946305076 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78740149b0 con 0x560c1b4c8000 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 -- 172.21.15.120:0/2946305076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 msgr2=0x560c1b4c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2946305076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b4c8400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7874053e00 tx=0x7f7874017de0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 -- 172.21.15.120:0/2946305076 shutdown_connections 2024-09-07T03:33:32.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2946305076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b4c8400 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 -- 172.21.15.120:0/2946305076 >> 172.21.15.120:0/2946305076 conn(0x560c1b66dbe0 msgr2=0x560c1b66be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 -- 172.21.15.120:0/2946305076 shutdown_connections 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 -- 172.21.15.120:0/2946305076 wait complete. 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 Processor -- start 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 -- start start 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b67b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.694+0000 7f787dfaf800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c1b4c6ec0 con 0x560c1b4c8000 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f787c2a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b67b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f787c2a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b67b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44248/0 (socket says 172.21.15.120:44248) 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 learned_addr learned my addr 172.21.15.120:0/2080967268 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1b67b640 con 0x560c1b4c8000 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f787c2a1640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b67b0e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7874013550 tx=0x7f7874053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f77597fa640 1 -- 172.21.15.120:0/2080967268 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7874028990 con 0x560c1b4c8000 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f77597fa640 1 -- 172.21.15.120:0/2080967268 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787402e070 con 0x560c1b4c8000 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f77597fa640 1 -- 172.21.15.120:0/2080967268 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7874012da0 con 0x560c1b4c8000 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c1b67b8d0 con 0x560c1b4c8000 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.695+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c1b67c250 con 0x560c1b4c8000 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.696+0000 7f77597fa640 1 -- 172.21.15.120:0/2080967268 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7874030070 con 0x560c1b4c8000 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.696+0000 7f77597fa640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f774403c730 0x7f774403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.696+0000 7f77597fa640 1 -- 172.21.15.120:0/2080967268 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f787403d690 con 0x560c1b4c8000 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.696+0000 7f787baa0640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f774403c730 0x7f774403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.696+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.696+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b686b80 0x560c1b689040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.696+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b689790 con 0x560c1b686b80 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787b29f640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b686b80 0x560c1b689040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787baa0640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f774403c730 0x7f774403ebf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f786c074fd0 tx=0x7f786c08d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787b29f640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b686b80 0x560c1b689040 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7870009050 con 0x560c1b686b80 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787dfaf800 20 realm 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b685ed0 con 0x560c1b686b80 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7870009050 con 0x560c1b686b80 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787dfaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.697+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b68a270 con 0x560c1b686b80 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7870009050 con 0x560c1b686b80 2024-09-07T03:33:32.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b68b050 0x560c1b68d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b68db10 con 0x560c1b68b050 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787c2a1640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b68b050 0x560c1b68d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787c2a1640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b68b050 0x560c1b68d440 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787dfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.698+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b68e3b0 con 0x560c1b68b050 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.699+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.699+0000 7f787dfaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.699+0000 7f787dfaf800 20 searching for the correct realm 2024-09-07T03:33:32.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.699+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c1b690120 0x560c1b692570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.699+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b690120 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.699+0000 7f787baa0640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c1b690120 0x560c1b692570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.699+0000 7f787baa0640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c1b690120 0x560c1b692570 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.699+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.699+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b68b050 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.700+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.700+0000 7f787c2a1640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7874032070 0x7f7874055430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.700+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x7f7874032070 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.700+0000 7f787b29f640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7874032070 0x7f7874055430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.700+0000 7f787b29f640 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7874032070 0x7f7874055430 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.700+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870009050 con 0x7f7874032070 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.700+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b686b80 2024-09-07T03:33:32.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.700+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870009050 con 0x560c1b686b80 2024-09-07T03:33:32.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.700+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b686b80 2024-09-07T03:33:32.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.701+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.701+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b690120 2024-09-07T03:33:32.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.701+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.701+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b686b80 2024-09-07T03:33:32.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.701+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.701+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b68b050 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.701+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.702+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b68b050 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.702+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.702+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b686b80 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.702+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.702+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x7f7874032070 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.702+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.702+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b686b80 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.702+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.702+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x7f7874032070 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.703+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.703+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b68b050 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.703+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.703+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b690120 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.703+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.703+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b686b80 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.703+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.703+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b68b050 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b690120 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b686b80 2024-09-07T03:33:32.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b686b80 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b686b80 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.704+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b690120 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.705+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.705+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x7f7874032070 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.705+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.705+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x7f7874032070 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.705+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.705+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x7f7874032070 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.705+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.705+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b690120 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.706+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.706+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x7f7874032070 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.706+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.706+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b68b050 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.706+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.706+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b68b050 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.706+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.706+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b690120 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b68b050 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c1b692c40 con 0x560c1b68b050 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b68ed30 con 0x560c1b686b80 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.707+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b68f150 con 0x560c1b68b050 2024-09-07T03:33:32.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b68f5f0 con 0x560c1b686b80 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 20 zone default found 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 4 Realm: () 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 20 zonegroup default 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b68e8b0 con 0x7f7874032070 2024-09-07T03:33:32.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.708+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6952f0 con 0x560c1b690120 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.709+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.709+0000 7f787dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.709+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.709+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6957b0 con 0x560c1b690120 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.709+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.709+0000 7f787dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.709+0000 7f787dfaf800 20 started sync module instance, tier type = 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.709+0000 7f787dfaf800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.709+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6940f0 con 0x560c1b68b050 2024-09-07T03:33:32.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.710+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.710+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94609999480080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6940f0 con 0x560c1b68b050 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.710+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6960c0 con 0x560c1b686b80 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.711+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94609999480080] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.711+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.711+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94609999478096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6960c0 con 0x560c1b686b80 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.711+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b696a80 con 0x560c1b68b050 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.712+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94609999478096] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.712+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.712+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94609999486448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b696a80 con 0x560c1b68b050 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.712+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b697480 con 0x7f7874032070 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.713+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.713+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94609999490960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6978e0 con 0x7f7874032070 2024-09-07T03:33:32.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.713+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b698400 con 0x560c1b68b050 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.714+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94609999486448] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.714+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94609999490960] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.714+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.714+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94609999492016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6983c0 con 0x560c1b68b050 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.715+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b698ca0 con 0x560c1b690120 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.715+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.716+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94609999492016] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.716+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94609999494864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6983c0 con 0x560c1b690120 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.716+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6992c0 con 0x560c1b690120 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.716+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.717+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94609999498768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b699270 con 0x560c1b690120 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.717+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b69a280 con 0x7f7874032070 2024-09-07T03:33:32.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.717+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94609999494864] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94609999498768] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94609999502640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b69a240 con 0x7f7874032070 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787dfaf800 20 add_watcher() i=0 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787dfaf800 20 add_watcher() i=1 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787dfaf800 20 add_watcher() i=2 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787dfaf800 20 add_watcher() i=3 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787dfaf800 20 add_watcher() i=4 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787dfaf800 20 add_watcher() i=5 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.718+0000 7f787dfaf800 20 add_watcher() i=6 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.719+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94609999502640] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.719+0000 7f787dfaf800 20 add_watcher() i=7 2024-09-07T03:33:32.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.719+0000 7f787dfaf800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.719+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b699710 con 0x560c1b686b80 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.719+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.719+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94609999497200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b699710 con 0x560c1b686b80 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.720+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94609999497200] v36'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.720+0000 7f7731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.720+0000 7f787dfaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.720+0000 7f787dfaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.720+0000 7f787dfaf800 5 note: GC not initialized 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.721+0000 7f7730fe1640 20 reqs_thread_entry: start 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.721+0000 7f787dfaf800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.721+0000 7f787dfaf800 20 Filter name: none 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.721+0000 7f76aa7fc640 20 reqs_thread_entry: start 2024-09-07T03:33:32.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.721+0000 7f787dfaf800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.721+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6cfe60 con 0x560c1b686b80 2024-09-07T03:33:32.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.721+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.721+0000 7f787dfaf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:33:32.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.721+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6d1280 con 0x560c1b690120 2024-09-07T03:33:32.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.722+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.723+0000 7f7731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.723+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94609999497200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6cf780 con 0x560c1b686b80 2024-09-07T03:33:32.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.724+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94609999497200] v36'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.724+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94609999480080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b6987f0 con 0x560c1b68b050 2024-09-07T03:33:32.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.725+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94609999480080] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.725+0000 7f787dfaf800 20 remove_watcher() i=0 2024-09-07T03:33:32.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.725+0000 7f787dfaf800 2 removed watcher, disabling cache 2024-09-07T03:33:32.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.725+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94609999478096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b694510 con 0x560c1b686b80 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.726+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94609999478096] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870028040 con 0x560c1b686b80 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.726+0000 7f787dfaf800 20 remove_watcher() i=1 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.726+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94609999486448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b694510 con 0x560c1b68b050 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.727+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94609999486448] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.727+0000 7f787dfaf800 20 remove_watcher() i=2 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.727+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94609999490960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b694510 con 0x7f7874032070 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.728+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94609999490960] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.728+0000 7f787dfaf800 20 remove_watcher() i=3 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.728+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94609999492016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b694510 con 0x560c1b68b050 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.729+0000 7f787c2a1640 1 -- 172.21.15.120:0/2080967268 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94609999492016] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f787403bd70 con 0x560c1b68b050 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.729+0000 7f787dfaf800 20 remove_watcher() i=4 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.729+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94609999494864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b694510 con 0x560c1b690120 2024-09-07T03:33:32.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.730+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94609999494864] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.730+0000 7f787dfaf800 20 remove_watcher() i=5 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.730+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94609999498768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b694510 con 0x560c1b690120 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.731+0000 7f787baa0640 1 -- 172.21.15.120:0/2080967268 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94609999498768] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f786c051070 con 0x560c1b690120 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.731+0000 7f787dfaf800 20 remove_watcher() i=6 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.731+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94609999502640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c1b698e10 con 0x7f7874032070 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94609999502640] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870028040 con 0x7f7874032070 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 20 remove_watcher() i=7 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b68b050 msgr2=0x560c1b68d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b68b050 0x560c1b68d440 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b686b80 msgr2=0x560c1b689040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b686b80 0x560c1b689040 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7874032070 msgr2=0x7f7874055430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7874032070 0x7f7874055430 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c1b690120 msgr2=0x560c1b692570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c1b690120 0x560c1b692570 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f774403c730 msgr2=0x7f774403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f774403c730 0x7f774403ebf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f786c074fd0 tx=0x7f786c08d000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 msgr2=0x560c1b67b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/2080967268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b4c8000 0x560c1b67b0e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7874013550 tx=0x7f7874053d60 comp rx=0 tx=0).stop 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 reap_dead start 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787b29f640 1 -- 172.21.15.120:0/2080967268 reap_dead start 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 shutdown_connections 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 >> 172.21.15.120:0/2080967268 conn(0x560c1b66dbe0 msgr2=0x560c1b66bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 shutdown_connections 2024-09-07T03:33:32.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/2080967268 wait complete. 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/557320578 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f775403c780 msgr2=0x7f775403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/557320578 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f775403c780 0x7f775403ec40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x560c1b64b870 tx=0x7f786c083040 comp rx=0 tx=0).stop 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/557320578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b664d00 msgr2=0x560c1b665120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/557320578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b664d00 0x560c1b665120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7874016d20 tx=0x7f787400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/557320578 shutdown_connections 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/557320578 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f775403c780 0x7f775403ec40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 --2- 172.21.15.120:0/557320578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b664d00 0x560c1b665120 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/557320578 >> 172.21.15.120:0/557320578 conn(0x560c1b6590b0 msgr2=0x560c1b659490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/557320578 shutdown_connections 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.732+0000 7f787dfaf800 1 -- 172.21.15.120:0/557320578 wait complete. 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b6523f0 msgr2=0x560c1b654860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b6523f0 0x560c1b654860 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b554100 msgr2=0x560c1b651600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b554100 0x560c1b651600 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f776403c780 msgr2=0x7f776403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f776403c780 0x7f776403ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7870001d70 tx=0x7f78700012d0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 msgr2=0x560c1b649fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b649fb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f786c025c20 tx=0x7f786c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 shutdown_connections 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c1b6523f0 0x560c1b654860 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c1b554100 0x560c1b651600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f776403c780 0x7f776403ec40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 --2- 172.21.15.120:0/1163500829 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c1b553000 0x560c1b649fb0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 >> 172.21.15.120:0/1163500829 conn(0x560c1b54e3d0 msgr2=0x560c1b63c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 shutdown_connections 2024-09-07T03:33:32.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.733+0000 7f787dfaf800 1 -- 172.21.15.120:0/1163500829 wait complete. 2024-09-07T03:33:32.746 INFO:teuthology.orchestra.run.smithi120.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-07T03:33:32.747 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:33:32.747 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-07T03:33:32.747 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-07T03:33:32.747 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-07T03:33:32.793 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:32.794 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.793+0000 7f937f126800 1 Processor -- start 2024-09-07T03:33:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.793+0000 7f937f126800 1 -- start start 2024-09-07T03:33:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.793+0000 7f937f126800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55de12517210 0x55de1251cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.793+0000 7f937f126800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de123c0e40 con 0x55de12515e00 2024-09-07T03:33:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.793+0000 7f937f126800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55de1238b680 con 0x55de12517210 2024-09-07T03:33:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.794+0000 7f9372508640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55de12517210 0x55de1251cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.794+0000 7f937ad09640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55de12515e00 0x55de12516b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42174/0 (socket says 172.21.15.120:42174) 2024-09-07T03:33:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.794+0000 7f937ad09640 1 -- 172.21.15.120:0/3306762942 learned_addr learned my addr 172.21.15.120:0/3306762942 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:33:32.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.794+0000 7f9372508640 1 -- 172.21.15.120:0/3306762942 >> v1:172.21.15.104:6789/0 conn(0x55de12515e00 legacy=0x55de12516b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.794+0000 7f937a508640 1 -- 172.21.15.120:0/3306762942 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324268232 0 0) 0x55de123c0e40 con 0x55de12515e00 2024-09-07T03:33:32.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.794+0000 7f9372508640 1 -- 172.21.15.120:0/3306762942 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de123a76b0 con 0x55de12517210 2024-09-07T03:33:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f9372508640 1 --2- 172.21.15.120:0/3306762942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12517210 0x55de1251cdb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f936400a470 tx=0x7f9364045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af123a2eef27c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937a508640 1 -- 172.21.15.120:0/3306762942 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9364053570 con 0x55de12517210 2024-09-07T03:33:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937a508640 1 -- 172.21.15.120:0/3306762942 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9364058070 con 0x55de12517210 2024-09-07T03:33:32.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937a508640 1 -- 172.21.15.120:0/3306762942 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9364053880 con 0x55de12517210 2024-09-07T03:33:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937f126800 1 -- 172.21.15.120:0/3306762942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12517210 msgr2=0x55de1251cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937f126800 1 --2- 172.21.15.120:0/3306762942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12517210 0x55de1251cdb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f936400a470 tx=0x7f9364045a20 comp rx=0 tx=0).stop 2024-09-07T03:33:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937f126800 1 -- 172.21.15.120:0/3306762942 shutdown_connections 2024-09-07T03:33:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937f126800 1 --2- 172.21.15.120:0/3306762942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12517210 0x55de1251cdb0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937f126800 1 -- 172.21.15.120:0/3306762942 >> 172.21.15.120:0/3306762942 conn(0x55de125111d0 msgr2=0x55de12513630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937f126800 1 -- 172.21.15.120:0/3306762942 shutdown_connections 2024-09-07T03:33:32.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.796+0000 7f937f126800 1 -- 172.21.15.120:0/3306762942 wait complete. 2024-09-07T03:33:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.810+0000 7f937f126800 1 Processor -- start 2024-09-07T03:33:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.810+0000 7f937f126800 1 -- start start 2024-09-07T03:33:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.810+0000 7f937f126800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de12489dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.810+0000 7f937f126800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55de123afdd0 con 0x55de12515e00 2024-09-07T03:33:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.811+0000 7f937ad09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de12489dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.811+0000 7f937ad09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de12489dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44276/0 (socket says 172.21.15.120:44276) 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.811+0000 7f937ad09640 1 -- 172.21.15.120:0/4178337481 learned_addr learned my addr 172.21.15.120:0/4178337481 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.811+0000 7f937ad09640 1 -- 172.21.15.120:0/4178337481 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de123c8e10 con 0x55de12515e00 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.811+0000 7f937ad09640 1 --2- 172.21.15.120:0/4178337481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de12489dc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f936c001ea0 tx=0x7f936c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37f38393c8f168e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.811+0000 7f9268e09640 1 -- 172.21.15.120:0/4178337481 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c008070 con 0x55de12515e00 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.811+0000 7f9268e09640 1 -- 172.21.15.120:0/4178337481 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c00d500 con 0x55de12515e00 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.811+0000 7f9268e09640 1 -- 172.21.15.120:0/4178337481 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c00d880 con 0x55de12515e00 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.812+0000 7f937f126800 1 -- 172.21.15.120:0/4178337481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 msgr2=0x55de12489dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.812+0000 7f937f126800 1 --2- 172.21.15.120:0/4178337481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de12489dc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f936c001ea0 tx=0x7f936c00b6a0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.812+0000 7f937f126800 1 -- 172.21.15.120:0/4178337481 shutdown_connections 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.812+0000 7f937f126800 1 --2- 172.21.15.120:0/4178337481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de12489dc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.812+0000 7f937f126800 1 -- 172.21.15.120:0/4178337481 >> 172.21.15.120:0/4178337481 conn(0x55de125111d0 msgr2=0x55de12600d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.812+0000 7f937f126800 1 -- 172.21.15.120:0/4178337481 shutdown_connections 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.812+0000 7f937f126800 1 -- 172.21.15.120:0/4178337481 wait complete. 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.812+0000 7f937f126800 1 Processor -- start 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.812+0000 7f937f126800 1 -- start start 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f937f126800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de126067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f937f126800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55de12517900 con 0x55de12515e00 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f937ad09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de126067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f937ad09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de126067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44278/0 (socket says 172.21.15.120:44278) 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f937ad09640 1 -- 172.21.15.120:0/1080881477 learned_addr learned my addr 172.21.15.120:0/1080881477 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f937ad09640 1 -- 172.21.15.120:0/1080881477 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de12606d40 con 0x55de12515e00 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f937ad09640 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de126067e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f936c0012f0 tx=0x7f936c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f9267606640 1 -- 172.21.15.120:0/1080881477 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c00f9d0 con 0x55de12515e00 2024-09-07T03:33:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f9267606640 1 -- 172.21.15.120:0/1080881477 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c00fb70 con 0x55de12515e00 2024-09-07T03:33:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f9267606640 1 -- 172.21.15.120:0/1080881477 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c00fe50 con 0x55de12515e00 2024-09-07T03:33:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de126050f0 con 0x55de12515e00 2024-09-07T03:33:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.813+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de126056b0 con 0x55de12515e00 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.814+0000 7f9267606640 1 -- 172.21.15.120:0/1080881477 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f936c017040 con 0x55de12515e00 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.814+0000 7f9267606640 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f926003c920 0x7f926003ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.814+0000 7f9267606640 1 -- 172.21.15.120:0/1080881477 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f936c015020 con 0x55de12515e00 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.815+0000 7f9372508640 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f926003c920 0x7f926003ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.815+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de12517210 0x55de12617370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.815+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de126178b0 con 0x55de12517210 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.815+0000 7f937b50a640 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de12517210 0x55de12617370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.815+0000 7f9372508640 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f926003c920 0x7f926003ede0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9364057000 tx=0x7f9364052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.815+0000 7f937b50a640 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de12517210 0x55de12617370 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.815+0000 7f937b50a640 1 -- 172.21.15.120:0/1080881477 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f937400a4d0 con 0x55de12517210 2024-09-07T03:33:32.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.815+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de126186a0 0x55de1261aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.815+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de1261b0d0 con 0x55de126186a0 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.816+0000 7f937ad09640 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de126186a0 0x55de1261aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.816+0000 7f937ad09640 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de126186a0 0x55de1261aa90 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.816+0000 7f937ad09640 1 -- 172.21.15.120:0/1080881477 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f936c02d070 con 0x55de126186a0 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.816+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de1261c980 con 0x55de126186a0 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.816+0000 7f937ad09640 1 -- 172.21.15.120:0/1080881477 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f936c02d070 con 0x55de126186a0 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.816+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de1261baf0 con 0x55de126186a0 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.817+0000 7f937ad09640 1 -- 172.21.15.120:0/1080881477 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f936c02d070 con 0x55de126186a0 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.817+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de1261bf10 con 0x55de12517210 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.817+0000 7f937b50a640 1 -- 172.21.15.120:0/1080881477 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f937400a4d0 con 0x55de12517210 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.817+0000 7f937f126800 1 Processor -- start 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.817+0000 7f937f126800 1 -- start start 2024-09-07T03:33:32.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f937f126800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de1262ae70 0x55de1262b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f937f126800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55de1240da00 con 0x55de1262ae70 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f937b50a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de1262ae70 0x55de1262b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f937b50a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de1262ae70 0x55de1262b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44288/0 (socket says 172.21.15.120:44288) 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f937b50a640 1 -- 172.21.15.120:0/1716486940 learned_addr learned my addr 172.21.15.120:0/1716486940 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f937b50a640 1 -- 172.21.15.120:0/1716486940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de1262b8d0 con 0x55de1262ae70 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f937b50a640 1 --2- 172.21.15.120:0/1716486940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de1262ae70 0x55de1262b290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9374016d20 tx=0x7f937400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f9264e01640 1 -- 172.21.15.120:0/1716486940 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9374017660 con 0x55de1262ae70 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f9264e01640 1 -- 172.21.15.120:0/1716486940 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937401b030 con 0x55de1262ae70 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f937f126800 1 -- 172.21.15.120:0/1716486940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de1262c100 con 0x55de1262ae70 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f9264e01640 1 -- 172.21.15.120:0/1716486940 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9374017950 con 0x55de1262ae70 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.818+0000 7f937f126800 1 -- 172.21.15.120:0/1716486940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de1262c6a0 con 0x55de1262ae70 2024-09-07T03:33:32.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.819+0000 7f9264e01640 1 -- 172.21.15.120:0/1716486940 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9374017af0 con 0x55de1262ae70 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.819+0000 7f9264e01640 1 --2- 172.21.15.120:0/1716486940 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f925403c780 0x7f925403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.819+0000 7f9264e01640 1 -- 172.21.15.120:0/1716486940 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f937400e040 con 0x55de1262ae70 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.819+0000 7f937ad09640 1 --2- 172.21.15.120:0/1716486940 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f925403c780 0x7f925403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937f126800 1 Processor -- start 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937ad09640 1 --2- 172.21.15.120:0/1716486940 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f925403c780 0x7f925403ec40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55de1261b610 tx=0x7f936c001460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937f126800 1 -- start start 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937f126800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de12637d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937f126800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55de126091e0 con 0x55de12637960 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937b50a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de12637d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937b50a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de12637d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44302/0 (socket says 172.21.15.120:44302) 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937b50a640 1 -- 172.21.15.120:0/1688380519 learned_addr learned my addr 172.21.15.120:0/1688380519 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937b50a640 1 -- 172.21.15.120:0/1688380519 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de12638350 con 0x55de12637960 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.820+0000 7f937b50a640 1 --2- 172.21.15.120:0/1688380519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de12637d60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9374005cf0 tx=0x7f9374017ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5886d7c2979d76c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f925e7fc640 1 -- 172.21.15.120:0/1688380519 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937404a070 con 0x55de12637960 2024-09-07T03:33:32.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f925e7fc640 1 -- 172.21.15.120:0/1688380519 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9374055040 con 0x55de12637960 2024-09-07T03:33:32.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f925e7fc640 1 -- 172.21.15.120:0/1688380519 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9374052070 con 0x55de12637960 2024-09-07T03:33:32.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 -- 172.21.15.120:0/1688380519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 msgr2=0x55de12637d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 --2- 172.21.15.120:0/1688380519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de12637d60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9374005cf0 tx=0x7f9374017ea0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 -- 172.21.15.120:0/1688380519 shutdown_connections 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 --2- 172.21.15.120:0/1688380519 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de12637d60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 -- 172.21.15.120:0/1688380519 >> 172.21.15.120:0/1688380519 conn(0x55de12633d60 msgr2=0x55de12631fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 -- 172.21.15.120:0/1688380519 shutdown_connections 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 -- 172.21.15.120:0/1688380519 wait complete. 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 Processor -- start 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 -- start start 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de1263efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.821+0000 7f937f126800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55de12638970 con 0x55de12637960 2024-09-07T03:33:32.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f937b50a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de1263efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f937b50a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de1263efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44306/0 (socket says 172.21.15.120:44306) 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 learned_addr learned my addr 172.21.15.120:0/3297679715 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de1263f540 con 0x55de12637960 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f937b50a640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de1263efe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9374005cf0 tx=0x7f9374053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f925cff9640 1 -- 172.21.15.120:0/3297679715 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937402e070 con 0x55de12637960 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f925cff9640 1 -- 172.21.15.120:0/3297679715 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9374028480 con 0x55de12637960 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f925cff9640 1 -- 172.21.15.120:0/3297679715 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937404a040 con 0x55de12637960 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de1263f7d0 con 0x55de12637960 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.822+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de12640150 con 0x55de12637960 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.823+0000 7f925cff9640 1 -- 172.21.15.120:0/3297679715 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f93740127a0 con 0x55de12637960 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.823+0000 7f925cff9640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f924403c730 0x7f924403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.823+0000 7f925cff9640 1 -- 172.21.15.120:0/3297679715 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f937403cd00 con 0x55de12637960 2024-09-07T03:33:32.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.823+0000 7f937ad09640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f924403c730 0x7f924403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.823+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.823+0000 7f937f126800 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de1264aa80 0x55de1264cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.823+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de1264d690 con 0x55de1264aa80 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f937ad09640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f924403c730 0x7f924403ebf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f936c054010 tx=0x7f936c043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f9372508640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de1264aa80 0x55de1264cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f9372508640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de1264aa80 0x55de1264cf40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f937f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f937f126800 20 realm 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de1264dac0 con 0x55de1264aa80 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f937f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f937f126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de1264e390 con 0x55de1264aa80 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.824+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937f126800 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de1264edb0 0x55de126511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de12651910 con 0x55de1264edb0 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937b50a640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de1264edb0 0x55de126511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937b50a640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de1264edb0 0x55de126511a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937f126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.825+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de126521b0 con 0x55de1264edb0 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.826+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.826+0000 7f937f126800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.826+0000 7f937f126800 20 searching for the correct realm 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.826+0000 7f937f126800 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55de12653f20 0x55de12656330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.826+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de12653f20 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.826+0000 7f937ad09640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55de12653f20 0x55de12656330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.826+0000 7f937ad09640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55de12653f20 0x55de12656330 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.826+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.826+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264edb0 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.827+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.827+0000 7f937b50a640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9374052070 0x7f9374033a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.827+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x7f9374052070 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.827+0000 7f9372508640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9374052070 0x7f9374033a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.827+0000 7f9372508640 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9374052070 0x7f9374033a30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.827+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.827+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264aa80 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.827+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.827+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264aa80 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.828+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.828+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de12653f20 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.828+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.828+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264aa80 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.828+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.828+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264edb0 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.828+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.828+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264edb0 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264aa80 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x7f9374052070 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264aa80 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x7f9374052070 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.829+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264edb0 2024-09-07T03:33:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.830+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.830+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de12653f20 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.830+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.830+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264aa80 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.830+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.830+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264edb0 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.830+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.830+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de12653f20 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.831+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.831+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264aa80 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.831+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.831+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264aa80 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.831+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.831+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264aa80 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.831+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.831+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de12653f20 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.831+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.832+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x7f9374052070 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.832+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.832+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x7f9374052070 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.832+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.832+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x7f9374052070 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.832+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.832+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de12653f20 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.832+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.832+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x7f9374052070 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.833+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.833+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264edb0 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.833+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.833+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264edb0 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.833+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.833+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de12653f20 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.833+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.833+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264edb0 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55de12656a00 con 0x55de1264edb0 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:32.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de12652b30 con 0x55de1264aa80 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de12652f20 con 0x55de1264edb0 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.834+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de12653380 con 0x55de1264aa80 2024-09-07T03:33:32.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 20 zone default found 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 4 Realm: () 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 20 zonegroup default 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de12656ed0 con 0x7f9374052070 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de12659190 con 0x55de12653f20 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.835+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de12659550 con 0x55de12653f20 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.836+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.836+0000 7f937f126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.836+0000 7f937f126800 20 started sync module instance, tier type = 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.836+0000 7f937f126800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.836+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de12658620 con 0x55de1264edb0 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.837+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.837+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94412279745088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de12658280 con 0x55de1264edb0 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.837+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265a480 con 0x55de1264aa80 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.838+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94412279745088] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.838+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.838+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94412279750608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265a820 con 0x55de1264aa80 2024-09-07T03:33:32.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.838+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265b240 con 0x55de1264edb0 2024-09-07T03:33:32.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.839+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94412279750608] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.839+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.839+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94412279754032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265b200 con 0x55de1264edb0 2024-09-07T03:33:32.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.839+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265bca0 con 0x7f9374052070 2024-09-07T03:33:32.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.840+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94412279754032] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.840+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.840+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94412279756752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265bca0 con 0x7f9374052070 2024-09-07T03:33:32.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.840+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265c6e0 con 0x55de1264edb0 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.841+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94412279756752] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.841+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.841+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94412279749040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265c6e0 con 0x55de1264edb0 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.841+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265d120 con 0x55de12653f20 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.842+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94412279749040] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.842+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.842+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94412279759408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265c650 con 0x55de12653f20 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.842+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265deb0 con 0x55de12653f20 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.843+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.844+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94412279765440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265e750 con 0x55de12653f20 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.844+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265f200 con 0x7f9374052070 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.844+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94412279759408] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94412279765440] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94412279764240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265e2a0 con 0x7f9374052070 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f937f126800 20 add_watcher() i=0 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f937f126800 20 add_watcher() i=1 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f937f126800 20 add_watcher() i=2 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f937f126800 20 add_watcher() i=3 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f937f126800 20 add_watcher() i=4 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f937f126800 20 add_watcher() i=5 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.845+0000 7f937f126800 20 add_watcher() i=6 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.846+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94412279764240] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.846+0000 7f937f126800 20 add_watcher() i=7 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.846+0000 7f937f126800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:32.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.846+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de1265e2a0 con 0x55de1264aa80 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.846+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.846+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94412279770336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265f9f0 con 0x55de1264aa80 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.847+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94412279770336] v36'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.847+0000 7f92317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.847+0000 7f937f126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.847+0000 7f937f126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.847+0000 7f937f126800 5 note: GC not initialized 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.848+0000 7f91abfff640 20 reqs_thread_entry: start 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.848+0000 7f937f126800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.848+0000 7f937f126800 20 Filter name: none 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.848+0000 7f91a9ffb640 20 reqs_thread_entry: start 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.848+0000 7f937f126800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.848+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de12694db0 con 0x55de1264aa80 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.848+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.848+0000 7f937f126800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.848+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55de126961d0 con 0x55de12653f20 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.849+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.849+0000 7f92317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.849+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94412279770336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de126946d0 con 0x55de1264aa80 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.850+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94412279770336] v36'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.850+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94412279745088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265ece0 con 0x55de1264edb0 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.851+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94412279745088] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.852+0000 7f937f126800 20 remove_watcher() i=0 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.852+0000 7f937f126800 2 removed watcher, disabling cache 2024-09-07T03:33:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.852+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94412279750608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265ece0 con 0x55de1264aa80 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.852+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94412279750608] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9364051070 con 0x55de1264aa80 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.852+0000 7f937f126800 20 remove_watcher() i=1 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.852+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94412279754032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de12659fd0 con 0x55de1264edb0 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.854+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94412279754032] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.854+0000 7f937f126800 20 remove_watcher() i=2 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.854+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94412279756752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265ece0 con 0x7f9374052070 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.854+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94412279756752] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.855+0000 7f937f126800 20 remove_watcher() i=3 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.855+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94412279749040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265ad30 con 0x55de1264edb0 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.855+0000 7f937b50a640 1 -- 172.21.15.120:0/3297679715 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94412279749040] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9374039070 con 0x55de1264edb0 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.856+0000 7f937f126800 20 remove_watcher() i=4 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.856+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94412279759408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265b7d0 con 0x55de12653f20 2024-09-07T03:33:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.856+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94412279759408] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.856+0000 7f937f126800 20 remove_watcher() i=5 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.856+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94412279765440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265ece0 con 0x55de12653f20 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.857+0000 7f937ad09640 1 -- 172.21.15.120:0/3297679715 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94412279765440] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f936c02d070 con 0x55de12653f20 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.857+0000 7f937f126800 20 remove_watcher() i=6 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.857+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94412279764240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55de1265ad30 con 0x7f9374052070 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94412279764240] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9364051070 con 0x7f9374052070 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f937f126800 20 remove_watcher() i=7 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de1264edb0 msgr2=0x55de126511a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f937f126800 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de1264edb0 0x55de126511a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de1264aa80 msgr2=0x55de1264cf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f937f126800 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de1264aa80 0x55de1264cf40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9374052070 msgr2=0x7f9374033a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f937f126800 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9374052070 0x7f9374033a30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55de12653f20 msgr2=0x55de12656330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.858+0000 7f937f126800 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55de12653f20 0x55de12656330 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f924403c730 msgr2=0x7f924403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f924403c730 0x7f924403ebf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f936c054010 tx=0x7f936c043000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 msgr2=0x55de1263efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/3297679715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12637960 0x55de1263efe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9374005cf0 tx=0x7f9374053d00 comp rx=0 tx=0).stop 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f9372508640 1 -- 172.21.15.120:0/3297679715 reap_dead start 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 shutdown_connections 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 >> 172.21.15.120:0/3297679715 conn(0x55de12633d60 msgr2=0x55de12631f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 shutdown_connections 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/3297679715 wait complete. 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1716486940 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f925403c780 msgr2=0x7f925403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/1716486940 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f925403c780 0x7f925403ec40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55de1261b610 tx=0x7f936c001460 comp rx=0 tx=0).stop 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1716486940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de1262ae70 msgr2=0x55de1262b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/1716486940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de1262ae70 0x55de1262b290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9374016d20 tx=0x7f937400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1716486940 shutdown_connections 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/1716486940 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f925403c780 0x7f925403ec40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/1716486940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de1262ae70 0x55de1262b290 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1716486940 >> 172.21.15.120:0/1716486940 conn(0x55de1261f220 msgr2=0x55de1261f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1716486940 shutdown_connections 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1716486940 wait complete. 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de126186a0 msgr2=0x55de1261aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de126186a0 0x55de1261aa90 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de12517210 msgr2=0x55de12617370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de12517210 0x55de12617370 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f926003c920 msgr2=0x7f926003ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f926003c920 0x7f926003ede0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9364057000 tx=0x7f9364052000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 msgr2=0x55de126067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.859+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de126067e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f936c0012f0 tx=0x7f936c000ed0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.860+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 shutdown_connections 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.860+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55de126186a0 0x55de1261aa90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.860+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55de12517210 0x55de12617370 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.860+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f926003c920 0x7f926003ede0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.860+0000 7f937f126800 1 --2- 172.21.15.120:0/1080881477 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55de12515e00 0x55de126067e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.860+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 >> 172.21.15.120:0/1080881477 conn(0x55de125111d0 msgr2=0x55de125ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.860+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 shutdown_connections 2024-09-07T03:33:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.860+0000 7f937f126800 1 -- 172.21.15.120:0/1080881477 wait complete. 2024-09-07T03:33:32.873 INFO:teuthology.orchestra.run.smithi120.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-07T03:33:32.873 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:33:32.874 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-07T03:33:32.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-07T03:33:32.874 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-07T03:33:32.920 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:32.920 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.919+0000 7fe1c32bb800 1 Processor -- start 2024-09-07T03:33:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.919+0000 7fe1c32bb800 1 -- start start 2024-09-07T03:33:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.919+0000 7fe1c32bb800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555e6a7f6210 0x555e6a7fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.919+0000 7fe1c32bb800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e6a69fe40 con 0x555e6a7f4e00 2024-09-07T03:33:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.919+0000 7fe1c32bb800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x555e6a66a680 con 0x555e6a7f6210 2024-09-07T03:33:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.920+0000 7fe1b85a4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555e6a7f6210 0x555e6a7fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.920+0000 7fe1b85a4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x555e6a7f6210 0x555e6a7fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44322/0 (socket says 172.21.15.120:44322) 2024-09-07T03:33:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.920+0000 7fe1b85a4640 1 -- 172.21.15.120:0/987989453 learned_addr learned my addr 172.21.15.120:0/987989453 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.920+0000 7fe1c0da5640 1 --1- 172.21.15.120:0/987989453 >> v1:172.21.15.104:6789/0 conn(0x555e6a7f4e00 0x555e6a7f5b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42180/0 (socket says 172.21.15.120:42180) 2024-09-07T03:33:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.920+0000 7fe1b85a4640 1 -- 172.21.15.120:0/987989453 >> v1:172.21.15.104:6789/0 conn(0x555e6a7f4e00 legacy=0x555e6a7f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.920+0000 7fe1b85a4640 1 -- 172.21.15.120:0/987989453 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e6a6866b0 con 0x555e6a7f6210 2024-09-07T03:33:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.922+0000 7fe1b85a4640 1 --2- 172.21.15.120:0/987989453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f6210 0x555e6a7fbdb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800a520 tx=0x7fe1a8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b152b2da9386953 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.922+0000 7fe1bbfff640 1 -- 172.21.15.120:0/987989453 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1a8055070 con 0x555e6a7f6210 2024-09-07T03:33:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.922+0000 7fe1bbfff640 1 -- 172.21.15.120:0/987989453 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a80515b0 con 0x555e6a7f6210 2024-09-07T03:33:32.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.922+0000 7fe1bbfff640 1 -- 172.21.15.120:0/987989453 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1a80518d0 con 0x555e6a7f6210 2024-09-07T03:33:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.922+0000 7fe1c32bb800 1 -- 172.21.15.120:0/987989453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f6210 msgr2=0x555e6a7fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.922+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/987989453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f6210 0x555e6a7fbdb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800a520 tx=0x7fe1a8045ba0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.922+0000 7fe1c32bb800 1 -- 172.21.15.120:0/987989453 shutdown_connections 2024-09-07T03:33:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.922+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/987989453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f6210 0x555e6a7fbdb0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.922+0000 7fe1c32bb800 1 -- 172.21.15.120:0/987989453 >> 172.21.15.120:0/987989453 conn(0x555e6a7f01d0 msgr2=0x555e6a7f2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.923+0000 7fe1c32bb800 1 -- 172.21.15.120:0/987989453 shutdown_connections 2024-09-07T03:33:32.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.923+0000 7fe1c32bb800 1 -- 172.21.15.120:0/987989453 wait complete. 2024-09-07T03:33:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.936+0000 7fe1c32bb800 1 Processor -- start 2024-09-07T03:33:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.936+0000 7fe1c32bb800 1 -- start start 2024-09-07T03:33:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.936+0000 7fe1c32bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a768d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.936+0000 7fe1c32bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e6a68edd0 con 0x555e6a7f4e00 2024-09-07T03:33:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.937+0000 7fe1c0da5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a768d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.937+0000 7fe1c0da5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a768d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44334/0 (socket says 172.21.15.120:44334) 2024-09-07T03:33:32.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.937+0000 7fe1c0da5640 1 -- 172.21.15.120:0/1021475605 learned_addr learned my addr 172.21.15.120:0/1021475605 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.937+0000 7fe1c0da5640 1 -- 172.21.15.120:0/1021475605 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e6a6a7e10 con 0x555e6a7f4e00 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.937+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/1021475605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a768d60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b260 tx=0x7fe1b000b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3373ce9aa233803c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.937+0000 7fe0aee0d640 1 -- 172.21.15.120:0/1021475605 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b000be60 con 0x555e6a7f4e00 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.937+0000 7fe0aee0d640 1 -- 172.21.15.120:0/1021475605 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b0006070 con 0x555e6a7f4e00 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.937+0000 7fe0aee0d640 1 -- 172.21.15.120:0/1021475605 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b000e710 con 0x555e6a7f4e00 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 -- 172.21.15.120:0/1021475605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 msgr2=0x555e6a768d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/1021475605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a768d60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b260 tx=0x7fe1b000b660 comp rx=0 tx=0).stop 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 -- 172.21.15.120:0/1021475605 shutdown_connections 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/1021475605 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a768d60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 -- 172.21.15.120:0/1021475605 >> 172.21.15.120:0/1021475605 conn(0x555e6a7f01d0 msgr2=0x555e6a8dff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 -- 172.21.15.120:0/1021475605 shutdown_connections 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 -- 172.21.15.120:0/1021475605 wait complete. 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 Processor -- start 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 -- start start 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a8ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.938+0000 7fe1c32bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e6a7f6900 con 0x555e6a7f4e00 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe1c0da5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a8ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe1c0da5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a8ed050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44336/0 (socket says 172.21.15.120:44336) 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe1c0da5640 1 -- 172.21.15.120:0/2355273227 learned_addr learned my addr 172.21.15.120:0/2355273227 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe1c0da5640 1 -- 172.21.15.120:0/2355273227 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e6a8ed5b0 con 0x555e6a7f4e00 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a8ed050 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x555e6a768890 tx=0x7fe1b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe0ad60a640 1 -- 172.21.15.120:0/2355273227 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b000ee10 con 0x555e6a7f4e00 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe0ad60a640 1 -- 172.21.15.120:0/2355273227 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b000fa30 con 0x555e6a7f4e00 2024-09-07T03:33:32.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e6a8ed840 con 0x555e6a7f4e00 2024-09-07T03:33:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe0ad60a640 1 -- 172.21.15.120:0/2355273227 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b000fd30 con 0x555e6a7f4e00 2024-09-07T03:33:32.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.939+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e6a8ee240 con 0x555e6a7f4e00 2024-09-07T03:33:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.940+0000 7fe0ad60a640 1 -- 172.21.15.120:0/2355273227 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe1b0017070 con 0x555e6a7f4e00 2024-09-07T03:33:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.940+0000 7fe0ad60a640 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe0a803c730 0x7fe0a803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.940+0000 7fe0ad60a640 1 -- 172.21.15.120:0/2355273227 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe1b0015020 con 0x555e6a7f4e00 2024-09-07T03:33:32.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.941+0000 7fe1b85a4640 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe0a803c730 0x7fe0a803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.941+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a7f6210 0x555e6a8f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.941+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a8f4be0 con 0x555e6a7f6210 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.941+0000 7fe1c15a6640 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a7f6210 0x555e6a8f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.941+0000 7fe1b85a4640 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe0a803c730 0x7fe0a803ebf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8057000 tx=0x7fe1a8052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.941+0000 7fe1c15a6640 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a7f6210 0x555e6a8f46a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.941+0000 7fe1c15a6640 1 -- 172.21.15.120:0/2355273227 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1bc00a4d0 con 0x555e6a7f6210 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.941+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a8f5490 0x555e6a8f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.941+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a8f80c0 con 0x555e6a8f5490 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.942+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a8f5490 0x555e6a8f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.942+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a8f5490 0x555e6a8f7950 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.942+0000 7fe1c0da5640 1 -- 172.21.15.120:0/2355273227 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a8f5490 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.942+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a8f9970 con 0x555e6a8f5490 2024-09-07T03:33:32.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.942+0000 7fe1c0da5640 1 -- 172.21.15.120:0/2355273227 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a8f5490 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.942+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a8f8a80 con 0x555e6a8f5490 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.943+0000 7fe1c0da5640 1 -- 172.21.15.120:0/2355273227 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a8f5490 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.943+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a8f8ea0 con 0x555e6a7f6210 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.943+0000 7fe1c15a6640 1 -- 172.21.15.120:0/2355273227 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe1bc00a4d0 con 0x555e6a7f6210 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.943+0000 7fe1c32bb800 1 Processor -- start 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.943+0000 7fe1c32bb800 1 -- start start 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.944+0000 7fe1c32bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a8e5a60 0x555e6a8e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.944+0000 7fe1c32bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e6a6eca00 con 0x555e6a8e5a60 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.944+0000 7fe1c15a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a8e5a60 0x555e6a8e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.944+0000 7fe1c15a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a8e5a60 0x555e6a8e42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44348/0 (socket says 172.21.15.120:44348) 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.944+0000 7fe1c15a6640 1 -- 172.21.15.120:0/23705440 learned_addr learned my addr 172.21.15.120:0/23705440 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.944+0000 7fe1c15a6640 1 -- 172.21.15.120:0/23705440 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e6a8e5f80 con 0x555e6a8e5a60 2024-09-07T03:33:32.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.944+0000 7fe1c15a6640 1 --2- 172.21.15.120:0/23705440 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a8e5a60 0x555e6a8e42d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc016d20 tx=0x7fe1bc00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.945+0000 7fe0a67fc640 1 -- 172.21.15.120:0/23705440 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc017660 con 0x555e6a8e5a60 2024-09-07T03:33:32.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.945+0000 7fe0a67fc640 1 -- 172.21.15.120:0/23705440 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc01b030 con 0x555e6a8e5a60 2024-09-07T03:33:32.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.945+0000 7fe1c32bb800 1 -- 172.21.15.120:0/23705440 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e6a8e4810 con 0x555e6a8e5a60 2024-09-07T03:33:32.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.945+0000 7fe0a67fc640 1 -- 172.21.15.120:0/23705440 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc017950 con 0x555e6a8e5a60 2024-09-07T03:33:32.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.945+0000 7fe1c32bb800 1 -- 172.21.15.120:0/23705440 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e6a8e4d60 con 0x555e6a8e5a60 2024-09-07T03:33:32.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.945+0000 7fe0a67fc640 1 -- 172.21.15.120:0/23705440 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe1bc017b40 con 0x555e6a8e5a60 2024-09-07T03:33:32.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe0a67fc640 1 --2- 172.21.15.120:0/23705440 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe09803c7f0 0x7fe09803ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe0a67fc640 1 -- 172.21.15.120:0/23705440 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe1bc00e040 con 0x555e6a8e5a60 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/23705440 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe09803c7f0 0x7fe09803ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe1c32bb800 1 Processor -- start 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/23705440 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe09803c7f0 0x7fe09803ecb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x555e6a8f85a0 tx=0x7fe1b0046040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe1c32bb800 1 -- start start 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe1c32bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a916f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe1c32bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e6a8e8380 con 0x555e6a916b30 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe1c15a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a916f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe1c15a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a916f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44358/0 (socket says 172.21.15.120:44358) 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.946+0000 7fe1c15a6640 1 -- 172.21.15.120:0/108449050 learned_addr learned my addr 172.21.15.120:0/108449050 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe1c15a6640 1 -- 172.21.15.120:0/108449050 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e6a917520 con 0x555e6a916b30 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe1c15a6640 1 --2- 172.21.15.120:0/108449050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a916f30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005cf0 tx=0x7fe1bc013450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28d02f1654784b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe097fff640 1 -- 172.21.15.120:0/108449050 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc051070 con 0x555e6a916b30 2024-09-07T03:33:32.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe097fff640 1 -- 172.21.15.120:0/108449050 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc044040 con 0x555e6a916b30 2024-09-07T03:33:32.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe097fff640 1 -- 172.21.15.120:0/108449050 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc014a00 con 0x555e6a916b30 2024-09-07T03:33:32.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe1c32bb800 1 -- 172.21.15.120:0/108449050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 msgr2=0x555e6a916f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/108449050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a916f30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005cf0 tx=0x7fe1bc013450 comp rx=0 tx=0).stop 2024-09-07T03:33:32.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe1c32bb800 1 -- 172.21.15.120:0/108449050 shutdown_connections 2024-09-07T03:33:32.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/108449050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a916f30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe1c32bb800 1 -- 172.21.15.120:0/108449050 >> 172.21.15.120:0/108449050 conn(0x555e6a912f30 msgr2=0x555e6a911170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe1c32bb800 1 -- 172.21.15.120:0/108449050 shutdown_connections 2024-09-07T03:33:32.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.947+0000 7fe1c32bb800 1 -- 172.21.15.120:0/108449050 wait complete. 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.948+0000 7fe1c32bb800 1 Processor -- start 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.948+0000 7fe1c32bb800 1 -- start start 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.948+0000 7fe1c32bb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a91e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.948+0000 7fe1c32bb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x555e6a917b40 con 0x555e6a916b30 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.948+0000 7fe1c15a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a91e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.948+0000 7fe1c15a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a91e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44374/0 (socket says 172.21.15.120:44374) 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.948+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 learned_addr learned my addr 172.21.15.120:0/3840819090 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.948+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e6a91e740 con 0x555e6a916b30 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.948+0000 7fe1c15a6640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a91e1e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc053da0 tx=0x7fe1bc053dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.949+0000 7fe0967fc640 1 -- 172.21.15.120:0/3840819090 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc012ae0 con 0x555e6a916b30 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.949+0000 7fe0967fc640 1 -- 172.21.15.120:0/3840819090 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc012c80 con 0x555e6a916b30 2024-09-07T03:33:32.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.949+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e6a91e9d0 con 0x555e6a916b30 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.949+0000 7fe0967fc640 1 -- 172.21.15.120:0/3840819090 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc0135c0 con 0x555e6a916b30 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.949+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e6a91f350 con 0x555e6a916b30 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.949+0000 7fe0967fc640 1 -- 172.21.15.120:0/3840819090 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe1bc04b050 con 0x555e6a916b30 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.949+0000 7fe0967fc640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe08c03c780 0x7fe08c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.950+0000 7fe0967fc640 1 -- 172.21.15.120:0/3840819090 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe1bc049020 con 0x555e6a916b30 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.950+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe08c03c780 0x7fe08c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.950+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe08c03c780 0x7fe08c03ec40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0017fd0 tx=0x7fe1b0032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.950+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.950+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a929ba0 0x555e6a92c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.950+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a92c7b0 con 0x555e6a929ba0 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.950+0000 7fe1b85a4640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a929ba0 0x555e6a92c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.950+0000 7fe1b85a4640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a929ba0 0x555e6a92c060 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 20 realm 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a92cbe0 con 0x555e6a929ba0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a92d4b0 con 0x555e6a929ba0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a92ded0 0x555e6a9302c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a930a30 con 0x555e6a92ded0 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.951+0000 7fe1c15a6640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a92ded0 0x555e6a9302c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.952+0000 7fe1c15a6640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a92ded0 0x555e6a9302c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.952+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.952+0000 7fe1c32bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.952+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.952+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a9312d0 con 0x555e6a92ded0 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.953+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.953+0000 7fe1c32bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.953+0000 7fe1c32bb800 20 searching for the correct realm 2024-09-07T03:33:32.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.953+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e6a933040 0x555e6a935470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.953+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a933040 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.953+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e6a933040 0x555e6a935470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.953+0000 7fe1c0da5640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e6a933040 0x555e6a935470 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.953+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.953+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a92ded0 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.954+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.954+0000 7fe1c15a6640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe1bc011a50 0x7fe1bc0113d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.954+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x7fe1bc011a50 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.954+0000 7fe1b85a4640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe1bc011a50 0x7fe1bc0113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.954+0000 7fe1b85a4640 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe1bc011a50 0x7fe1bc0113d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.954+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.954+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a929ba0 2024-09-07T03:33:32.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.955+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.955+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a929ba0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.955+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.955+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a933040 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.955+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.955+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a929ba0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.955+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.955+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a92ded0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a92ded0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a929ba0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x7fe1bc011a50 2024-09-07T03:33:32.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a929ba0 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.956+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x7fe1bc011a50 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.957+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.957+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a92ded0 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.957+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.957+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a933040 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.957+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.957+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a929ba0 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.957+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.958+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a92ded0 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.958+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.958+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a933040 2024-09-07T03:33:32.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.958+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.958+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a929ba0 2024-09-07T03:33:32.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.958+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.958+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a929ba0 2024-09-07T03:33:32.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a929ba0 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a933040 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x7fe1bc011a50 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x7fe1bc011a50 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.959+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x7fe1bc011a50 2024-09-07T03:33:32.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.960+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.960+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a933040 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.960+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.960+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x7fe1bc011a50 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.960+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.960+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a92ded0 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.961+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.961+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a92ded0 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.961+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.961+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a933040 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.961+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.961+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a92ded0 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.961+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.961+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555e6a935b40 con 0x555e6a92ded0 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a931c50 con 0x555e6a929ba0 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a9320a0 con 0x555e6a92ded0 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.962+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a932500 con 0x555e6a929ba0 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 zone default found 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 4 Realm: () 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:32.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 zonegroup default 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a931800 con 0x7fe1bc011a50 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a938240 con 0x555e6a933040 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a9386d0 con 0x555e6a933040 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 started sync module instance, tier type = 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.963+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a937040 con 0x555e6a92ded0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.965+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.965+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93864003335488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a938b30 con 0x555e6a92ded0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.965+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a939380 con 0x555e6a929ba0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.966+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93864003335488] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.966+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.966+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93864003341104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a938f50 con 0x555e6a929ba0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.966+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93a080 con 0x555e6a92ded0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.967+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93864003341104] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.967+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.967+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93864003344160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93a030 con 0x555e6a92ded0 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.967+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93ab30 con 0x7fe1bc011a50 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.968+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93864003344160] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.969+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.969+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93864003348000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93aaf0 con 0x7fe1bc011a50 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.969+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93b570 con 0x555e6a92ded0 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.970+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93864003348000] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.972+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.972+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93864003345216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93b570 con 0x555e6a92ded0 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.972+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93bff0 con 0x555e6a933040 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.973+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.973+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93864003353344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93c890 con 0x555e6a933040 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.973+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93d300 con 0x555e6a933040 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.973+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93864003345216] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.974+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93864003353344] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.974+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.974+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93864003355616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93b0c0 con 0x555e6a933040 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.974+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93dbe0 con 0x7fe1bc011a50 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.975+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93864003355616] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93864003358160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93dba0 con 0x7fe1bc011a50 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 20 add_watcher() i=0 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 20 add_watcher() i=1 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 20 add_watcher() i=2 2024-09-07T03:33:32.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 20 add_watcher() i=3 2024-09-07T03:33:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 20 add_watcher() i=4 2024-09-07T03:33:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 20 add_watcher() i=5 2024-09-07T03:33:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 20 add_watcher() i=6 2024-09-07T03:33:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93864003358160] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 20 add_watcher() i=7 2024-09-07T03:33:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:32.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.976+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a941120 con 0x555e6a929ba0 2024-09-07T03:33:32.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.977+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.977+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93864003360960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93e640 con 0x555e6a929ba0 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.978+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93864003360960] v36'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.978+0000 7fe076fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.978+0000 7fe1c32bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.978+0000 7fe1c32bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.978+0000 7fe1c32bb800 5 note: GC not initialized 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.978+0000 7fe075fe3640 20 reqs_thread_entry: start 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.979+0000 7fe1c32bb800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.979+0000 7fe1c32bb800 20 Filter name: none 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.979+0000 7fdfe77fe640 20 reqs_thread_entry: start 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.979+0000 7fe1c32bb800 20 rados->read ofs=0 len=0 2024-09-07T03:33:32.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.979+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a973c90 con 0x555e6a929ba0 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.979+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.979+0000 7fe1c32bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.979+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555e6a9750b0 con 0x555e6a933040 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.980+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.980+0000 7fe076fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.980+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93864003360960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a9735b0 con 0x555e6a929ba0 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.982+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93864003360960] v36'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.982+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93864003335488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a93d890 con 0x555e6a92ded0 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.983+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93864003335488] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.983+0000 7fe1c32bb800 20 remove_watcher() i=0 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.983+0000 7fe1c32bb800 2 removed watcher, disabling cache 2024-09-07T03:33:32.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.983+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93864003341104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a937540 con 0x555e6a929ba0 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.984+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93864003341104] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x555e6a929ba0 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.984+0000 7fe1c32bb800 20 remove_watcher() i=1 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.984+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93864003344160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a937540 con 0x555e6a92ded0 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.985+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93864003344160] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.985+0000 7fe1c32bb800 20 remove_watcher() i=2 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.985+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93864003348000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a937540 con 0x7fe1bc011a50 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.986+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93864003348000] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.986+0000 7fe1c32bb800 20 remove_watcher() i=3 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.986+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93864003345216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a937540 con 0x555e6a92ded0 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.987+0000 7fe1c15a6640 1 -- 172.21.15.120:0/3840819090 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93864003345216] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1bc027070 con 0x555e6a92ded0 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.987+0000 7fe1c32bb800 20 remove_watcher() i=4 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.987+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93864003353344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a937540 con 0x555e6a933040 2024-09-07T03:33:32.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.988+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93864003353344] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.988+0000 7fe1c32bb800 20 remove_watcher() i=5 2024-09-07T03:33:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.988+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93864003355616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a937540 con 0x555e6a933040 2024-09-07T03:33:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.989+0000 7fe1c0da5640 1 -- 172.21.15.120:0/3840819090 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93864003355616] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1b002e070 con 0x555e6a933040 2024-09-07T03:33:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.989+0000 7fe1c32bb800 20 remove_watcher() i=6 2024-09-07T03:33:32.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.989+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93864003358160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555e6a937540 con 0x7fe1bc011a50 2024-09-07T03:33:32.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93864003358160] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1a8057030 con 0x7fe1bc011a50 2024-09-07T03:33:32.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 20 remove_watcher() i=7 2024-09-07T03:33:32.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a92ded0 msgr2=0x555e6a9302c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a92ded0 0x555e6a9302c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a929ba0 msgr2=0x555e6a92c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a929ba0 0x555e6a92c060 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe1bc011a50 msgr2=0x7fe1bc0113d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe1bc011a50 0x7fe1bc0113d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e6a933040 msgr2=0x555e6a935470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x555e6a933040 0x555e6a935470 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe08c03c780 msgr2=0x7fe08c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe08c03c780 0x7fe08c03ec40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0017fd0 tx=0x7fe1b0032000 comp rx=0 tx=0).stop 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 msgr2=0x555e6a91e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1b85a4640 1 -- 172.21.15.120:0/3840819090 reap_dead start 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a91e1e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc053da0 tx=0x7fe1bc053dd0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 shutdown_connections 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/3840819090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a916b30 0x555e6a91e1e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 >> 172.21.15.120:0/3840819090 conn(0x555e6a912f30 msgr2=0x555e6a911140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 shutdown_connections 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/3840819090 wait complete. 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/23705440 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe09803c7f0 msgr2=0x7fe09803ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/23705440 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe09803c7f0 0x7fe09803ecb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x555e6a8f85a0 tx=0x7fe1b0046040 comp rx=0 tx=0).stop 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/23705440 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a8e5a60 msgr2=0x555e6a8e42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/23705440 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a8e5a60 0x555e6a8e42d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc016d20 tx=0x7fe1bc00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 -- 172.21.15.120:0/23705440 shutdown_connections 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/23705440 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe09803c7f0 0x7fe09803ecb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.990+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/23705440 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a8e5a60 0x555e6a8e42d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/23705440 >> 172.21.15.120:0/23705440 conn(0x555e6a8fc1d0 msgr2=0x555e6a8fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/23705440 shutdown_connections 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/23705440 wait complete. 2024-09-07T03:33:32.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a8f5490 msgr2=0x555e6a8f7950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a8f5490 0x555e6a8f7950 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a7f6210 msgr2=0x555e6a8f46a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a7f6210 0x555e6a8f46a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe0a803c730 msgr2=0x7fe0a803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe0a803c730 0x7fe0a803ebf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8057000 tx=0x7fe1a8052000 comp rx=0 tx=0).stop 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 msgr2=0x555e6a8ed050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a8ed050 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x555e6a768890 tx=0x7fe1b0000ed0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 shutdown_connections 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x555e6a8f5490 0x555e6a8f7950 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x555e6a7f6210 0x555e6a8f46a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe0a803c730 0x7fe0a803ebf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 --2- 172.21.15.120:0/2355273227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555e6a7f4e00 0x555e6a8ed050 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 >> 172.21.15.120:0/2355273227 conn(0x555e6a7f01d0 msgr2=0x555e6a8de720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 shutdown_connections 2024-09-07T03:33:33.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:32.991+0000 7fe1c32bb800 1 -- 172.21.15.120:0/2355273227 wait complete. 2024-09-07T03:33:33.002 INFO:teuthology.orchestra.run.smithi120.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-07T03:00:00.000000Z","epoch":1725678000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-07T03:33:33.002 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:33:33.002 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-07T03:33:33.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-07T03:33:33.002 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-07T03:33:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.054+0000 7f2231121800 1 Processor -- start 2024-09-07T03:33:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.054+0000 7f2231121800 1 -- start start 2024-09-07T03:33:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.054+0000 7f2231121800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563600f7be30 0x563600f7cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.055+0000 7f2231121800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563600e26e40 con 0x563600f7d070 2024-09-07T03:33:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.055+0000 7f2231121800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x563600df1680 con 0x563600f7be30 2024-09-07T03:33:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.055+0000 7f222cd56640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563600f7be30 0x563600f7cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.055+0000 7f222c555640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x563600f7d070 0x563600f81dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42188/0 (socket says 172.21.15.120:42188) 2024-09-07T03:33:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.055+0000 7f222c555640 1 -- 172.21.15.120:0/2712448408 learned_addr learned my addr 172.21.15.120:0/2712448408 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:33:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.055+0000 7f222cd56640 1 -- 172.21.15.120:0/2712448408 >> v1:172.21.15.104:6789/0 conn(0x563600f7d070 legacy=0x563600f81dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.055+0000 7f222cd56640 1 -- 172.21.15.120:0/2712448408 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563600e0d6b0 con 0x563600f7be30 2024-09-07T03:33:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.057+0000 7f222cd56640 1 --2- 172.21.15.120:0/2712448408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563600f7cb30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f221c00a470 tx=0x7f221c045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d2e074c5d320eb server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.057+0000 7f222bd54640 1 -- 172.21.15.120:0/2712448408 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c059070 con 0x563600f7be30 2024-09-07T03:33:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.057+0000 7f222bd54640 1 -- 172.21.15.120:0/2712448408 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c054570 con 0x563600f7be30 2024-09-07T03:33:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.057+0000 7f222bd54640 1 -- 172.21.15.120:0/2712448408 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c054870 con 0x563600f7be30 2024-09-07T03:33:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.057+0000 7f2231121800 1 -- 172.21.15.120:0/2712448408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 msgr2=0x563600f7cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.057+0000 7f2231121800 1 --2- 172.21.15.120:0/2712448408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563600f7cb30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f221c00a470 tx=0x7f221c045880 comp rx=0 tx=0).stop 2024-09-07T03:33:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.058+0000 7f2231121800 1 -- 172.21.15.120:0/2712448408 shutdown_connections 2024-09-07T03:33:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.058+0000 7f2231121800 1 --2- 172.21.15.120:0/2712448408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563600f7cb30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.058+0000 7f2231121800 1 -- 172.21.15.120:0/2712448408 >> 172.21.15.120:0/2712448408 conn(0x563600f77200 msgr2=0x563600f79660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.058+0000 7f2231121800 1 -- 172.21.15.120:0/2712448408 shutdown_connections 2024-09-07T03:33:33.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.058+0000 7f2231121800 1 -- 172.21.15.120:0/2712448408 wait complete. 2024-09-07T03:33:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.071+0000 7f2231121800 1 Processor -- start 2024-09-07T03:33:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.071+0000 7f2231121800 1 -- start start 2024-09-07T03:33:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.071+0000 7f2231121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563600eefd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.071+0000 7f2231121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563600e15dd0 con 0x563600f7be30 2024-09-07T03:33:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.072+0000 7f222cd56640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563600eefd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.072+0000 7f222cd56640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563600eefd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44396/0 (socket says 172.21.15.120:44396) 2024-09-07T03:33:33.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.072+0000 7f222cd56640 1 -- 172.21.15.120:0/4241296722 learned_addr learned my addr 172.21.15.120:0/4241296722 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.072+0000 7f222cd56640 1 -- 172.21.15.120:0/4241296722 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563600e2ee10 con 0x563600f7be30 2024-09-07T03:33:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.072+0000 7f222cd56640 1 --2- 172.21.15.120:0/4241296722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563600eefd50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f221c00a470 tx=0x7f221c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486edda82b7a5b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.072+0000 7f211ae0d640 1 -- 172.21.15.120:0/4241296722 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c064070 con 0x563600f7be30 2024-09-07T03:33:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.072+0000 7f211ae0d640 1 -- 172.21.15.120:0/4241296722 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c054850 con 0x563600f7be30 2024-09-07T03:33:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.072+0000 7f211ae0d640 1 -- 172.21.15.120:0/4241296722 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c059040 con 0x563600f7be30 2024-09-07T03:33:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 -- 172.21.15.120:0/4241296722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 msgr2=0x563600eefd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 --2- 172.21.15.120:0/4241296722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563600eefd50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f221c00a470 tx=0x7f221c04e000 comp rx=0 tx=0).stop 2024-09-07T03:33:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 -- 172.21.15.120:0/4241296722 shutdown_connections 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 --2- 172.21.15.120:0/4241296722 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563600eefd50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 -- 172.21.15.120:0/4241296722 >> 172.21.15.120:0/4241296722 conn(0x563600f77200 msgr2=0x563601067050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 -- 172.21.15.120:0/4241296722 shutdown_connections 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 -- 172.21.15.120:0/4241296722 wait complete. 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 Processor -- start 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 -- start start 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563601076250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.073+0000 7f2231121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563600f7d760 con 0x563600f7be30 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f222cd56640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563601076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f222cd56640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563601076250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44408/0 (socket says 172.21.15.120:44408) 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f222cd56640 1 -- 172.21.15.120:0/1803649464 learned_addr learned my addr 172.21.15.120:0/1803649464 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f222cd56640 1 -- 172.21.15.120:0/1803649464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636010767b0 con 0x563600f7be30 2024-09-07T03:33:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f222cd56640 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563601076250 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f221c00a470 tx=0x7f221c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f211960a640 1 -- 172.21.15.120:0/1803649464 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c06d070 con 0x563600f7be30 2024-09-07T03:33:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f211960a640 1 -- 172.21.15.120:0/1803649464 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c0695b0 con 0x563600f7be30 2024-09-07T03:33:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f211960a640 1 -- 172.21.15.120:0/1803649464 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c064050 con 0x563600f7be30 2024-09-07T03:33:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563601076a40 con 0x563600f7be30 2024-09-07T03:33:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.074+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563601077650 con 0x563600f7be30 2024-09-07T03:33:33.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.075+0000 7f211960a640 1 -- 172.21.15.120:0/1803649464 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f221c069890 con 0x563600f7be30 2024-09-07T03:33:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.075+0000 7f211960a640 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f211403c780 0x7f211403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.075+0000 7f211960a640 1 -- 172.21.15.120:0/1803649464 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f221c0970c0 con 0x563600f7be30 2024-09-07T03:33:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.075+0000 7f222c555640 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f211403c780 0x7f211403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.076+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563600f7d070 0x56360107d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.076+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56360107dde0 con 0x563600f7d070 2024-09-07T03:33:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.076+0000 7f222d557640 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563600f7d070 0x56360107d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.076+0000 7f222c555640 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f211403c780 0x7f211403ec40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f221400b3b0 tx=0x7f2214001560 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.076+0000 7f222d557640 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563600f7d070 0x56360107d8a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.076+0000 7f222d557640 1 -- 172.21.15.120:0/1803649464 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f222400a4d0 con 0x563600f7d070 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.076+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56360107e6e0 0x563601080b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.076+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010812e0 con 0x56360107e6e0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.076+0000 7f222cd56640 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56360107e6e0 0x563601080b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.077+0000 7f222cd56640 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56360107e6e0 0x563601080b70 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.077+0000 7f222cd56640 1 -- 172.21.15.120:0/1803649464 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f221c078070 con 0x56360107e6e0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.077+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563601082b90 con 0x56360107e6e0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.077+0000 7f222cd56640 1 -- 172.21.15.120:0/1803649464 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f221c078070 con 0x56360107e6e0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.077+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563601081ca0 con 0x56360107e6e0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.078+0000 7f222cd56640 1 -- 172.21.15.120:0/1803649464 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f221c078070 con 0x56360107e6e0 2024-09-07T03:33:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.078+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010820c0 con 0x563600f7d070 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.078+0000 7f222d557640 1 -- 172.21.15.120:0/1803649464 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f222400a4d0 con 0x563600f7d070 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.078+0000 7f2231121800 1 Processor -- start 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.078+0000 7f2231121800 1 -- start start 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.079+0000 7f2231121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563601090fd0 0x5636010913f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.079+0000 7f2231121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563600e73a00 con 0x563601090fd0 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.079+0000 7f222d557640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563601090fd0 0x5636010913f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.079+0000 7f222d557640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563601090fd0 0x5636010913f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44414/0 (socket says 172.21.15.120:44414) 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.079+0000 7f222d557640 1 -- 172.21.15.120:0/1753561626 learned_addr learned my addr 172.21.15.120:0/1753561626 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.079+0000 7f222d557640 1 -- 172.21.15.120:0/1753561626 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563601091a30 con 0x563601090fd0 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.079+0000 7f222d557640 1 --2- 172.21.15.120:0/1753561626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563601090fd0 0x5636010913f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2224016d20 tx=0x7f222400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.080+0000 7f21127fc640 1 -- 172.21.15.120:0/1753561626 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2224017660 con 0x563601090fd0 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.080+0000 7f21127fc640 1 -- 172.21.15.120:0/1753561626 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222401b030 con 0x563601090fd0 2024-09-07T03:33:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.080+0000 7f2231121800 1 -- 172.21.15.120:0/1753561626 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563601092260 con 0x563601090fd0 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.080+0000 7f21127fc640 1 -- 172.21.15.120:0/1753561626 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2224017950 con 0x563601090fd0 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.080+0000 7f2231121800 1 -- 172.21.15.120:0/1753561626 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563601092800 con 0x563601090fd0 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.080+0000 7f21127fc640 1 -- 172.21.15.120:0/1753561626 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2224017af0 con 0x563601090fd0 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f21127fc640 1 --2- 172.21.15.120:0/1753561626 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f210403c840 0x7f210403ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f21127fc640 1 -- 172.21.15.120:0/1753561626 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f222400e040 con 0x563601090fd0 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f222cd56640 1 --2- 172.21.15.120:0/1753561626 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f210403c840 0x7f210403ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f2231121800 1 Processor -- start 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f222cd56640 1 --2- 172.21.15.120:0/1753561626 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f210403c840 0x7f210403ed00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5636010817c0 tx=0x7f221c094040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f2231121800 1 -- start start 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f2231121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x56360109ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f2231121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563600ef03d0 con 0x56360109dad0 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f222d557640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x56360109ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f222d557640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x56360109ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44426/0 (socket says 172.21.15.120:44426) 2024-09-07T03:33:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.081+0000 7f222d557640 1 -- 172.21.15.120:0/1866043950 learned_addr learned my addr 172.21.15.120:0/1866043950 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f222d557640 1 -- 172.21.15.120:0/1866043950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56360109e4c0 con 0x56360109dad0 2024-09-07T03:33:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f222d557640 1 --2- 172.21.15.120:0/1866043950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x56360109ded0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2224053e00 tx=0x7f2224017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d33be124b6d086 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2103fff640 1 -- 172.21.15.120:0/1866043950 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2224014d40 con 0x56360109dad0 2024-09-07T03:33:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2103fff640 1 -- 172.21.15.120:0/1866043950 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2224051070 con 0x56360109dad0 2024-09-07T03:33:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2103fff640 1 -- 172.21.15.120:0/1866043950 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22240149b0 con 0x56360109dad0 2024-09-07T03:33:33.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2231121800 1 -- 172.21.15.120:0/1866043950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 msgr2=0x56360109ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2231121800 1 --2- 172.21.15.120:0/1866043950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x56360109ded0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2224053e00 tx=0x7f2224017de0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2231121800 1 -- 172.21.15.120:0/1866043950 shutdown_connections 2024-09-07T03:33:33.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2231121800 1 --2- 172.21.15.120:0/1866043950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x56360109ded0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2231121800 1 -- 172.21.15.120:0/1866043950 >> 172.21.15.120:0/1866043950 conn(0x563601099ed0 msgr2=0x563601098110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2231121800 1 -- 172.21.15.120:0/1866043950 shutdown_connections 2024-09-07T03:33:33.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.082+0000 7f2231121800 1 -- 172.21.15.120:0/1866043950 wait complete. 2024-09-07T03:33:33.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f2231121800 1 Processor -- start 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f2231121800 1 -- start start 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f2231121800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x5636010a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f2231121800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56360109eae0 con 0x56360109dad0 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f222d557640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x5636010a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f222d557640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x5636010a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44438/0 (socket says 172.21.15.120:44438) 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 learned_addr learned my addr 172.21.15.120:0/1055204671 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636010a56e0 con 0x56360109dad0 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f222d557640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x5636010a5180 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2224013550 tx=0x7f2224053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.083+0000 7f21027fc640 1 -- 172.21.15.120:0/1055204671 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2224028990 con 0x56360109dad0 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.084+0000 7f21027fc640 1 -- 172.21.15.120:0/1055204671 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222402e070 con 0x56360109dad0 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.084+0000 7f21027fc640 1 -- 172.21.15.120:0/1055204671 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2224012da0 con 0x56360109dad0 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.084+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636010a5970 con 0x56360109dad0 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.084+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636010a62f0 con 0x56360109dad0 2024-09-07T03:33:33.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.084+0000 7f21027fc640 1 -- 172.21.15.120:0/1055204671 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2224030070 con 0x56360109dad0 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.085+0000 7f21027fc640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f20f803c780 0x7f20f803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.085+0000 7f21027fc640 1 -- 172.21.15.120:0/1055204671 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f222403d5d0 con 0x56360109dad0 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.085+0000 7f222cd56640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f20f803c780 0x7f20f803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.085+0000 7f222cd56640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f20f803c780 0x7f20f803ec40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f221c097070 tx=0x7f221c080000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.085+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.085+0000 7f2231121800 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5636010b0c20 0x5636010b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.085+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010b3830 con 0x5636010b0c20 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.085+0000 7f222c555640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5636010b0c20 0x5636010b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f222c555640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5636010b0c20 0x5636010b30e0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 20 realm 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010aff70 con 0x5636010b0c20 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010b4320 con 0x5636010b0c20 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5636010b5100 0x5636010b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010b7bc0 con 0x5636010b5100 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.086+0000 7f222d557640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5636010b5100 0x5636010b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.087+0000 7f222d557640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5636010b5100 0x5636010b74f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.087+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.087+0000 7f2231121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.087+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.087+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010b8410 con 0x5636010b5100 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.087+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.087+0000 7f2231121800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.087+0000 7f2231121800 20 searching for the correct realm 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.088+0000 7f2231121800 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5636010ba180 0x5636010bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.088+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010ba180 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.088+0000 7f222cd56640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5636010ba180 0x5636010bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.088+0000 7f222cd56640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5636010ba180 0x5636010bc5d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.088+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.088+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b5100 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.088+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.088+0000 7f222d557640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2224032070 0x7f2224019990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.088+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x7f2224032070 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.089+0000 7f222c555640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2224032070 0x7f2224019990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.089+0000 7f222c555640 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2224032070 0x7f2224019990 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.089+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x7f2224032070 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.089+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b0c20 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.089+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.089+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b0c20 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.090+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.090+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010ba180 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.090+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.090+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b0c20 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.090+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.090+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b5100 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.091+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.091+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b5100 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.091+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.091+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b0c20 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.091+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.091+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x7f2224032070 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.091+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x7f2224032070 2024-09-07T03:33:33.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.091+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b0c20 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.092+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.092+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x7f2224032070 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.092+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f221400f7f0 con 0x7f2224032070 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.092+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b5100 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.092+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.092+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010ba180 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.092+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.092+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b0c20 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.093+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.093+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b5100 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.093+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.093+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010ba180 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.093+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.093+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b0c20 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.093+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.093+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b0c20 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b0c20 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x5636010b0c20 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010ba180 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x7f2224032070 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x7f2224032070 2024-09-07T03:33:33.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x7f2224032070 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x7f2224032070 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.094+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x7f2224032070 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.095+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x7f2224032070 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.095+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010ba180 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.095+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.095+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x7f2224032070 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.095+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221400f7f0 con 0x7f2224032070 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.095+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b5100 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.095+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.095+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b5100 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010ba180 2024-09-07T03:33:33.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b5100 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5636010bcca0 con 0x5636010b5100 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f2231121800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f2231121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f2231121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f2231121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f2231121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f2231121800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.096+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010b8d90 con 0x5636010b0c20 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010b89a0 con 0x5636010b5100 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010b96c0 con 0x5636010b0c20 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 20 zone default found 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 4 Realm: () 2024-09-07T03:33:33.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 20 zonegroup default 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010bd5d0 con 0x7f2224032070 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.097+0000 7f2231121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010bf810 con 0x5636010ba180 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f2231121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010bfbb0 con 0x5636010ba180 2024-09-07T03:33:33.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f2231121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f2231121800 20 started sync module instance, tier type = 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f2231121800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.098+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010bec50 con 0x5636010b5100 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.099+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.099+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94789945782336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010bf460 con 0x5636010b5100 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.100+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c0a20 con 0x5636010b0c20 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.101+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.101+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94789945789888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c1690 con 0x5636010b0c20 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.101+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94789945782336] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.101+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010bff50 con 0x5636010b5100 2024-09-07T03:33:33.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.102+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94789945789888] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.104+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.104+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94789945790944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c1600 con 0x5636010b5100 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.104+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c2560 con 0x7f2224032070 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.105+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94789945790944] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.105+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.105+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94789945793440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c2520 con 0x7f2224032070 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.105+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c2fb0 con 0x5636010b5100 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.106+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94789945793440] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.107+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.107+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94789945794496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c2f70 con 0x5636010b5100 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.107+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c39c0 con 0x5636010ba180 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.108+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94789945794496] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.108+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.108+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94789945799952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c3d60 con 0x5636010ba180 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.108+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c47a0 con 0x5636010ba180 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.109+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94789945799952] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.109+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.109+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94789945803376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c4760 con 0x5636010ba180 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.109+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c5250 con 0x7f2224032070 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94789945806176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c5250 con 0x7f2224032070 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94789945803376] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f2231121800 20 add_watcher() i=0 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f2231121800 20 add_watcher() i=1 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f2231121800 20 add_watcher() i=2 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f2231121800 20 add_watcher() i=3 2024-09-07T03:33:33.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f2231121800 20 add_watcher() i=4 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f2231121800 20 add_watcher() i=5 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.110+0000 7f2231121800 20 add_watcher() i=6 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.111+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94789945806176] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.111+0000 7f2231121800 20 add_watcher() i=7 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.111+0000 7f2231121800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.111+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010c2b80 con 0x5636010b0c20 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.111+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.111+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94789945808224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010c2b80 con 0x5636010b0c20 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.112+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94789945808224] v36'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.112+0000 7f20e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:33.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 5 note: GC not initialized 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f20e1fe3640 20 reqs_thread_entry: start 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 20 Filter name: none 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f20537fe640 20 reqs_thread_entry: start 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010fb910 con 0x7f2224032070 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-07T03:33:33.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.113+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9fd0 con 0x5636010b0c20 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.114+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.114+0000 7f2231121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.114+0000 7f2231121800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.114+0000 7f2231121800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.114+0000 7f2231121800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.114+0000 7f2231121800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.114+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010fa8a0 con 0x7f2224032070 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v36'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f2231121800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f2231121800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f2231121800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94789946024944 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010ff250 con 0x7f2224032070 2024-09-07T03:33:33.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== watch-notify(notify (1) cookie 94789945806176 notify 154618822681 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5636010fac40 con 0x7f2224032070 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f2103fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822681 cookie 94789945806176 notifier 4722 bl.length()=556 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(65 notify.7 [notify cookie 94789946024944 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f2103fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f2103fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.115+0000 7f2103fff640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f20f0003ea0 con 0x7f2224032070 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.116+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== watch-notify(notify_complete (2) cookie 94789946024944 notify 154618822681 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5636010fb260 con 0x7f2224032070 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.116+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.116+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010fcd50 con 0x5636010b0c20 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v36'11 uv11 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f2231121800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f2231121800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f2231121800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-07T03:33:33.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94789946024800 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5636010ff220 con 0x5636010ba180 2024-09-07T03:33:33.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== watch-notify(notify (1) cookie 94789945799952 notify 154618822676 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f221c0a0040 con 0x5636010ba180 2024-09-07T03:33:33.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f2103fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822676 cookie 94789945799952 notifier 4722 bl.length()=177 2024-09-07T03:33:33.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f2103fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-07T03:33:33.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f2103fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-07T03:33:33.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(68 notify.5 [notify cookie 94789946024800 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f2103fff640 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f20f0003ea0 con 0x5636010ba180 2024-09-07T03:33:33.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== watch-notify(notify_complete (2) cookie 94789946024800 notify 154618822676 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563601077650 con 0x5636010ba180 2024-09-07T03:33:33.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.117+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.129 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-07T03:33:33.115132Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:33:33.115118Z","tags":[],"group_ids":[]} 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.118+0000 7f20e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.118+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94789945808224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9740 con 0x5636010b0c20 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.119+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94789945808224] v36'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.119+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94789945782336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9740 con 0x5636010b5100 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.120+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94789945782336] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.120+0000 7f2231121800 20 remove_watcher() i=0 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.120+0000 7f2231121800 2 removed watcher, disabling cache 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.120+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94789945789888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9740 con 0x5636010b0c20 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.121+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94789945789888] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x5636010b0c20 2024-09-07T03:33:33.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.121+0000 7f2231121800 20 remove_watcher() i=1 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.121+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94789945790944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9740 con 0x5636010b5100 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.122+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94789945790944] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.122+0000 7f2231121800 20 remove_watcher() i=2 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.122+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94789945793440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9740 con 0x7f2224032070 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.123+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94789945793440] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.123+0000 7f2231121800 20 remove_watcher() i=3 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.123+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94789945794496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9740 con 0x5636010b5100 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.124+0000 7f222d557640 1 -- 172.21.15.120:0/1055204671 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94789945794496] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2224027070 con 0x5636010b5100 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.124+0000 7f2231121800 20 remove_watcher() i=4 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.124+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94789945799952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9740 con 0x5636010ba180 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.125+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94789945799952] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.125+0000 7f2231121800 20 remove_watcher() i=5 2024-09-07T03:33:33.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.125+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94789945803376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9740 con 0x5636010ba180 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.126+0000 7f222cd56640 1 -- 172.21.15.120:0/1055204671 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94789945803376] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c078070 con 0x5636010ba180 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.126+0000 7f2231121800 20 remove_watcher() i=6 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.126+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94789945806176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5636010f9740 con 0x7f2224032070 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.127+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94789945806176] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221403c040 con 0x7f2224032070 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.127+0000 7f2231121800 20 remove_watcher() i=7 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5636010b5100 msgr2=0x5636010b74f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5636010b5100 0x5636010b74f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5636010b0c20 msgr2=0x5636010b30e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5636010b0c20 0x5636010b30e0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2224032070 msgr2=0x7f2224019990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f2224032070 0x7f2224019990 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5636010ba180 msgr2=0x5636010bc5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5636010ba180 0x5636010bc5d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f20f803c780 msgr2=0x7f20f803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f20f803c780 0x7f20f803ec40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f221c097070 tx=0x7f221c080000 comp rx=0 tx=0).stop 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 msgr2=0x5636010a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1055204671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56360109dad0 0x5636010a5180 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2224013550 tx=0x7f2224053d60 comp rx=0 tx=0).stop 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f222c555640 1 -- 172.21.15.120:0/1055204671 reap_dead start 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 shutdown_connections 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 >> 172.21.15.120:0/1055204671 conn(0x563601099ed0 msgr2=0x5636010980e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 shutdown_connections 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1055204671 wait complete. 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1753561626 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f210403c840 msgr2=0x7f210403ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1753561626 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f210403c840 0x7f210403ed00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5636010817c0 tx=0x7f221c094040 comp rx=0 tx=0).stop 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1753561626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563601090fd0 msgr2=0x5636010913f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1753561626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563601090fd0 0x5636010913f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2224016d20 tx=0x7f222400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1753561626 shutdown_connections 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1753561626 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f210403c840 0x7f210403ed00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 --2- 172.21.15.120:0/1753561626 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563601090fd0 0x5636010913f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1753561626 >> 172.21.15.120:0/1753561626 conn(0x563601085380 msgr2=0x563601085760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1753561626 shutdown_connections 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.128+0000 7f2231121800 1 -- 172.21.15.120:0/1753561626 wait complete. 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56360107e6e0 msgr2=0x563601080b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56360107e6e0 0x563601080b70 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563600f7d070 msgr2=0x56360107d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563600f7d070 0x56360107d8a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f211403c780 msgr2=0x7f211403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f211403c780 0x7f211403ec40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f221400b3b0 tx=0x7f2214001560 comp rx=0 tx=0).stop 2024-09-07T03:33:33.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 msgr2=0x563601076250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563601076250 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f221c00a470 tx=0x7f221c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 shutdown_connections 2024-09-07T03:33:33.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x56360107e6e0 0x563601080b70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563600f7d070 0x56360107d8a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f211403c780 0x7f211403ec40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 --2- 172.21.15.120:0/1803649464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563600f7be30 0x563601076250 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 >> 172.21.15.120:0/1803649464 conn(0x563600f77200 msgr2=0x563601065840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 shutdown_connections 2024-09-07T03:33:33.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.129+0000 7f2231121800 1 -- 172.21.15.120:0/1803649464 wait complete. 2024-09-07T03:33:33.141 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-07T03:33:33.115132Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:33:33.115118Z', 'tags': [], 'group_ids': []} 2024-09-07T03:33:33.162 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:33:33.167 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-07T03:33:33.167 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-07T03:33:33.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-07T03:33:33.168 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-07T03:33:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:33.214 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.213+0000 7f886b7a9800 1 Processor -- start 2024-09-07T03:33:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f886b7a9800 1 -- start start 2024-09-07T03:33:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f886b7a9800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5634ed05b000 0x5634ed05bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f886b7a9800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634ecf04e40 con 0x5634ed05c100 2024-09-07T03:33:33.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f886b7a9800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5634ececf680 con 0x5634ed05b000 2024-09-07T03:33:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f8869293640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5634ed05b000 0x5634ed05bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f8868a92640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5634ed05c100 0x5634ed060e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:42198/0 (socket says 172.21.15.120:42198) 2024-09-07T03:33:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f8869293640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5634ed05b000 0x5634ed05bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44440/0 (socket says 172.21.15.120:44440) 2024-09-07T03:33:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f8868a92640 1 -- 172.21.15.120:0/3508283293 learned_addr learned my addr 172.21.15.120:0/3508283293 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:33:33.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f8869293640 1 -- 172.21.15.120:0/3508283293 >> v1:172.21.15.104:6789/0 conn(0x5634ed05c100 legacy=0x5634ed060e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f8869293640 1 -- 172.21.15.120:0/3508283293 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634eceeb6b0 con 0x5634ed05b000 2024-09-07T03:33:33.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.214+0000 7f8863fff640 1 -- 172.21.15.120:0/3508283293 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959759951 0 0) 0x5634ecf04e40 con 0x5634ed05c100 2024-09-07T03:33:33.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.216+0000 7f8869293640 1 --2- 172.21.15.120:0/3508283293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed05bbc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f885c00a470 tx=0x7f885c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad549f6e680e606d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.216+0000 7f8863fff640 1 -- 172.21.15.120:0/3508283293 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f885c053570 con 0x5634ed05b000 2024-09-07T03:33:33.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.216+0000 7f8863fff640 1 -- 172.21.15.120:0/3508283293 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f885c058070 con 0x5634ed05b000 2024-09-07T03:33:33.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.216+0000 7f8863fff640 1 -- 172.21.15.120:0/3508283293 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f885c053880 con 0x5634ed05b000 2024-09-07T03:33:33.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.217+0000 7f886b7a9800 1 -- 172.21.15.120:0/3508283293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 msgr2=0x5634ed05bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.217+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3508283293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed05bbc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f885c00a470 tx=0x7f885c045a20 comp rx=0 tx=0).stop 2024-09-07T03:33:33.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.217+0000 7f886b7a9800 1 -- 172.21.15.120:0/3508283293 shutdown_connections 2024-09-07T03:33:33.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.217+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3508283293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed05bbc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.217+0000 7f886b7a9800 1 -- 172.21.15.120:0/3508283293 >> 172.21.15.120:0/3508283293 conn(0x5634ed0563d0 msgr2=0x5634ed058830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.217+0000 7f886b7a9800 1 -- 172.21.15.120:0/3508283293 shutdown_connections 2024-09-07T03:33:33.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.217+0000 7f886b7a9800 1 -- 172.21.15.120:0/3508283293 wait complete. 2024-09-07T03:33:33.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.231+0000 7f886b7a9800 1 Processor -- start 2024-09-07T03:33:33.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.231+0000 7f886b7a9800 1 -- start start 2024-09-07T03:33:33.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.231+0000 7f886b7a9800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed14a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.231+0000 7f886b7a9800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5634ecef3dd0 con 0x5634ed05b000 2024-09-07T03:33:33.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.232+0000 7f8869293640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.232+0000 7f8869293640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed14a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44456/0 (socket says 172.21.15.120:44456) 2024-09-07T03:33:33.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.232+0000 7f8869293640 1 -- 172.21.15.120:0/2010680080 learned_addr learned my addr 172.21.15.120:0/2010680080 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.232+0000 7f8869293640 1 -- 172.21.15.120:0/2010680080 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ecf0ce10 con 0x5634ed05b000 2024-09-07T03:33:33.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.232+0000 7f8869293640 1 --2- 172.21.15.120:0/2010680080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed14a480 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f885c025c20 tx=0x7f885c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6286dd8c7e5c9d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.232+0000 7f8757606640 1 -- 172.21.15.120:0/2010680080 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f885c053a20 con 0x5634ed05b000 2024-09-07T03:33:33.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.232+0000 7f8757606640 1 -- 172.21.15.120:0/2010680080 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f885c063070 con 0x5634ed05b000 2024-09-07T03:33:33.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.232+0000 7f8757606640 1 -- 172.21.15.120:0/2010680080 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f885c053d30 con 0x5634ed05b000 2024-09-07T03:33:33.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 -- 172.21.15.120:0/2010680080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 msgr2=0x5634ed14a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 --2- 172.21.15.120:0/2010680080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed14a480 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f885c025c20 tx=0x7f885c051000 comp rx=0 tx=0).stop 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 -- 172.21.15.120:0/2010680080 shutdown_connections 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 --2- 172.21.15.120:0/2010680080 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed14a480 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 -- 172.21.15.120:0/2010680080 >> 172.21.15.120:0/2010680080 conn(0x5634ed0563d0 msgr2=0x5634ed145e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 -- 172.21.15.120:0/2010680080 shutdown_connections 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 -- 172.21.15.120:0/2010680080 wait complete. 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 Processor -- start 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 -- start start 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.233+0000 7f886b7a9800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f886b7a9800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5634ed05c7f0 con 0x5634ed05b000 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f8869293640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f8869293640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44468/0 (socket says 172.21.15.120:44468) 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f8869293640 1 -- 172.21.15.120:0/790009079 learned_addr learned my addr 172.21.15.120:0/790009079 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f8869293640 1 -- 172.21.15.120:0/790009079 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ed152330 con 0x5634ed05b000 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f8869293640 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed151dd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f885c025c20 tx=0x7f885c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f8755e03640 1 -- 172.21.15.120:0/790009079 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f885c078070 con 0x5634ed05b000 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f8755e03640 1 -- 172.21.15.120:0/790009079 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f885c073470 con 0x5634ed05b000 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634ed1525c0 con 0x5634ed05b000 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.234+0000 7f8755e03640 1 -- 172.21.15.120:0/790009079 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f885c073750 con 0x5634ed05b000 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.235+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ed1531d0 con 0x5634ed05b000 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.235+0000 7f8755e03640 1 -- 172.21.15.120:0/790009079 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f885c07b070 con 0x5634ed05b000 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.235+0000 7f8755e03640 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f875003c780 0x7f875003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.235+0000 7f8755e03640 1 -- 172.21.15.120:0/790009079 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f885c097c40 con 0x5634ed05b000 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.236+0000 7f8868a92640 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f875003c780 0x7f875003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.236+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed05c100 0x5634ed159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.236+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed153b90 con 0x5634ed05c100 2024-09-07T03:33:33.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.236+0000 7f8869a94640 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed05c100 0x5634ed159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.236+0000 7f8868a92640 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f875003c780 0x7f875003ec40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8854000c00 tx=0x7f88540013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.236+0000 7f8869a94640 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed05c100 0x5634ed159420 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.236+0000 7f8869a94640 1 -- 172.21.15.120:0/790009079 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f886400a4d0 con 0x5634ed05c100 2024-09-07T03:33:33.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.236+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed15a350 0x5634ed15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.236+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed15cd70 con 0x5634ed15a350 2024-09-07T03:33:33.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.237+0000 7f8869293640 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed15a350 0x5634ed15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.237+0000 7f8869293640 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed15a350 0x5634ed15c740 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.237+0000 7f8869293640 1 -- 172.21.15.120:0/790009079 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f885c07a030 con 0x5634ed15a350 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.237+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed15e620 con 0x5634ed15a350 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.238+0000 7f8869293640 1 -- 172.21.15.120:0/790009079 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f885c07a030 con 0x5634ed15a350 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.238+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed15d760 con 0x5634ed15a350 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.238+0000 7f8869293640 1 -- 172.21.15.120:0/790009079 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f885c07a030 con 0x5634ed15a350 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.238+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed15dbc0 con 0x5634ed05c100 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.238+0000 7f8869a94640 1 -- 172.21.15.120:0/790009079 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f886400a4d0 con 0x5634ed05c100 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.239+0000 7f886b7a9800 1 Processor -- start 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.239+0000 7f886b7a9800 1 -- start start 2024-09-07T03:33:33.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.239+0000 7f886b7a9800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed16caa0 0x5634ed16cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.239+0000 7f886b7a9800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5634ecf51a00 con 0x5634ed16caa0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.239+0000 7f8869a94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed16caa0 0x5634ed16cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.239+0000 7f8869a94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed16caa0 0x5634ed16cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44482/0 (socket says 172.21.15.120:44482) 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.239+0000 7f8869a94640 1 -- 172.21.15.120:0/4025132894 learned_addr learned my addr 172.21.15.120:0/4025132894 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.239+0000 7f8869a94640 1 -- 172.21.15.120:0/4025132894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ed16d500 con 0x5634ed16caa0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.240+0000 7f8869a94640 1 --2- 172.21.15.120:0/4025132894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed16caa0 0x5634ed16cec0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8864016d20 tx=0x7f886400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.240+0000 7f874effd640 1 -- 172.21.15.120:0/4025132894 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8864017660 con 0x5634ed16caa0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.240+0000 7f874effd640 1 -- 172.21.15.120:0/4025132894 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f886401b030 con 0x5634ed16caa0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.240+0000 7f886b7a9800 1 -- 172.21.15.120:0/4025132894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634ed16dd30 con 0x5634ed16caa0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.240+0000 7f874effd640 1 -- 172.21.15.120:0/4025132894 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8864017950 con 0x5634ed16caa0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.240+0000 7f886b7a9800 1 -- 172.21.15.120:0/4025132894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ed16e2d0 con 0x5634ed16caa0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.241+0000 7f874effd640 1 -- 172.21.15.120:0/4025132894 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8864017af0 con 0x5634ed16caa0 2024-09-07T03:33:33.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.241+0000 7f874effd640 1 --2- 172.21.15.120:0/4025132894 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f874003c780 0x7f874003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.241+0000 7f874effd640 1 -- 172.21.15.120:0/4025132894 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f886400e040 con 0x5634ed16caa0 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.241+0000 7f8869293640 1 --2- 172.21.15.120:0/4025132894 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f874003c780 0x7f874003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.241+0000 7f886b7a9800 1 Processor -- start 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.241+0000 7f886b7a9800 1 -- start start 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.241+0000 7f8869293640 1 --2- 172.21.15.120:0/4025132894 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f874003c780 0x7f874003ec40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5634ed159b10 tx=0x7f885c08b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.241+0000 7f886b7a9800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed179940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.241+0000 7f886b7a9800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5634ed14ac70 con 0x5634ed179540 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f8869a94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed179940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f8869a94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed179940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44492/0 (socket says 172.21.15.120:44492) 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f8869a94640 1 -- 172.21.15.120:0/1350668362 learned_addr learned my addr 172.21.15.120:0/1350668362 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f8869a94640 1 -- 172.21.15.120:0/1350668362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ed179f30 con 0x5634ed179540 2024-09-07T03:33:33.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f8869a94640 1 --2- 172.21.15.120:0/1350668362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed179940 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8864053de0 tx=0x7f8864054090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf528dbb2c87e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f874cff9640 1 -- 172.21.15.120:0/1350668362 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8864049070 con 0x5634ed179540 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f874cff9640 1 -- 172.21.15.120:0/1350668362 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8864051070 con 0x5634ed179540 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f874cff9640 1 -- 172.21.15.120:0/1350668362 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8864014ae0 con 0x5634ed179540 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f886b7a9800 1 -- 172.21.15.120:0/1350668362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 msgr2=0x5634ed179940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f886b7a9800 1 --2- 172.21.15.120:0/1350668362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed179940 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8864053de0 tx=0x7f8864054090 comp rx=0 tx=0).stop 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f886b7a9800 1 -- 172.21.15.120:0/1350668362 shutdown_connections 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f886b7a9800 1 --2- 172.21.15.120:0/1350668362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed179940 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.242+0000 7f886b7a9800 1 -- 172.21.15.120:0/1350668362 >> 172.21.15.120:0/1350668362 conn(0x5634ed175960 msgr2=0x5634ed173ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f886b7a9800 1 -- 172.21.15.120:0/1350668362 shutdown_connections 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f886b7a9800 1 -- 172.21.15.120:0/1350668362 wait complete. 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f886b7a9800 1 Processor -- start 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f886b7a9800 1 -- start start 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f886b7a9800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed180b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f886b7a9800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5634ed17a550 con 0x5634ed179540 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f8869a94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed180b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f8869a94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed180b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:44494/0 (socket says 172.21.15.120:44494) 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 learned_addr learned my addr 172.21.15.120:0/3394810457 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.243+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ed1810d0 con 0x5634ed179540 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.244+0000 7f8869a94640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed180b70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8864013550 tx=0x7f8864053d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.244+0000 7f873effd640 1 -- 172.21.15.120:0/3394810457 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8864049040 con 0x5634ed179540 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.244+0000 7f873effd640 1 -- 172.21.15.120:0/3394810457 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8864028690 con 0x5634ed179540 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.244+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634ed181360 con 0x5634ed179540 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.244+0000 7f873effd640 1 -- 172.21.15.120:0/3394810457 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8864028970 con 0x5634ed179540 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.244+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ed181ef0 con 0x5634ed179540 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.244+0000 7f873effd640 1 -- 172.21.15.120:0/3394810457 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f88640127a0 con 0x5634ed179540 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.245+0000 7f873effd640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f873403c780 0x7f873403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.245+0000 7f873effd640 1 -- 172.21.15.120:0/3394810457 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f8864033d20 con 0x5634ed179540 2024-09-07T03:33:33.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.245+0000 7f8869293640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f873403c780 0x7f873403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.245+0000 7f8869293640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f873403c780 0x7f873403ec40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f885c0893f0 tx=0x7f885c08d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.245+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.245+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed18c640 0x5634ed18eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.245+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed18f250 con 0x5634ed18c640 2024-09-07T03:33:33.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.245+0000 7f8868a92640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed18c640 0x5634ed18eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f8868a92640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed18c640 0x5634ed18eb00 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 20 realm 2024-09-07T03:33:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed18b990 con 0x5634ed18c640 2024-09-07T03:33:33.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed18fd40 con 0x5634ed18c640 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.246+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.247+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed190b20 0x5634ed192f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.247+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1935e0 con 0x5634ed190b20 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.247+0000 7f8869a94640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed190b20 0x5634ed192f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.247+0000 7f8869a94640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed190b20 0x5634ed192f10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.247+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.247+0000 7f886b7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.247+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.247+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed193e30 con 0x5634ed190b20 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.248+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.248+0000 7f886b7a9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.248+0000 7f886b7a9800 20 searching for the correct realm 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.248+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5634ed195ba0 0x5634ed198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.248+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed195ba0 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.248+0000 7f8869293640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5634ed195ba0 0x5634ed198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.248+0000 7f8869293640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5634ed195ba0 0x5634ed198010 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.248+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.248+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed190b20 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.249+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.249+0000 7f8869a94640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8864014440 0x7f8864012a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.249+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x7f8864014440 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.249+0000 7f8868a92640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8864014440 0x7f8864012a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.249+0000 7f8868a92640 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8864014440 0x7f8864012a90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.249+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x7f8864014440 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.249+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed18c640 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.250+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.250+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed18c640 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.250+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.250+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed195ba0 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.250+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.250+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed18c640 2024-09-07T03:33:33.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.250+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.250+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed190b20 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed190b20 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed18c640 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x7f8864014440 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x7f8864014440 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed18c640 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.251+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x7f8864014440 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.252+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f885400f5f0 con 0x7f8864014440 2024-09-07T03:33:33.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.252+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed190b20 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.252+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.252+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed195ba0 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.252+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.252+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed18c640 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.252+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.252+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed190b20 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.253+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.253+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed195ba0 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.253+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.253+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed18c640 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.253+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.253+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed18c640 2024-09-07T03:33:33.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.253+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.253+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed18c640 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x5634ed18c640 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed195ba0 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x7f8864014440 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x7f8864014440 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x7f8864014440 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x7f8864014440 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x7f8864014440 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x7f8864014440 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.254+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed195ba0 2024-09-07T03:33:33.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.255+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.255+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x7f8864014440 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.255+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885400f5f0 con 0x7f8864014440 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.255+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed190b20 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.255+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.255+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed190b20 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed195ba0 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed190b20 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1986e0 con 0x5634ed190b20 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f886b7a9800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f886b7a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f886b7a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f886b7a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f886b7a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f886b7a9800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.256+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1947b0 con 0x5634ed18c640 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1943c0 con 0x5634ed190b20 2024-09-07T03:33:33.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1950e0 con 0x5634ed18c640 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 20 zone default found 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 4 Realm: () 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 20 zonegroup default 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.257+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed199010 con 0x7f8864014440 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19b250 con 0x5634ed195ba0 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19b5f0 con 0x5634ed195ba0 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 20 started sync module instance, tier type = 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:33.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.258+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19a690 con 0x5634ed190b20 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.259+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.259+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94785316170640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19a690 con 0x5634ed190b20 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.259+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19bc10 con 0x5634ed18c640 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.261+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94785316170640] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.261+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.261+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94785316168160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19a600 con 0x5634ed18c640 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.261+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19ca80 con 0x5634ed190b20 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.262+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.262+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94785316177360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19c9f0 con 0x5634ed190b20 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.262+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19da70 con 0x7f8864014440 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.262+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94785316168160] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.263+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94785316177360] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.263+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.263+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94785316179568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19da30 con 0x7f8864014440 2024-09-07T03:33:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.263+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19e310 con 0x5634ed190b20 2024-09-07T03:33:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.264+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94785316179568] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.264+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.264+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94785316181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19da30 con 0x5634ed190b20 2024-09-07T03:33:33.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.264+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19e970 con 0x5634ed195ba0 2024-09-07T03:33:33.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.265+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.265+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94785316185216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19e900 con 0x5634ed195ba0 2024-09-07T03:33:33.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.265+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19f920 con 0x5634ed195ba0 2024-09-07T03:33:33.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.265+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94785316181312] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.266+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94785316185216] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.266+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.266+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94785316187488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed19f920 con 0x5634ed195ba0 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.266+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1a01c0 con 0x7f8864014440 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94785316191504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1a05e0 con 0x7f8864014440 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94785316187488] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f886b7a9800 20 add_watcher() i=0 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f886b7a9800 20 add_watcher() i=1 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f886b7a9800 20 add_watcher() i=2 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f886b7a9800 20 add_watcher() i=3 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f886b7a9800 20 add_watcher() i=4 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f886b7a9800 20 add_watcher() i=5 2024-09-07T03:33:33.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.267+0000 7f886b7a9800 20 add_watcher() i=6 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.268+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94785316191504] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.268+0000 7f886b7a9800 20 add_watcher() i=7 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.268+0000 7f886b7a9800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.268+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1a3610 con 0x5634ed18c640 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.268+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.268+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94785316192560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1a0a00 con 0x5634ed18c640 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94785316192560] v36'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f871ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f886b7a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f886b7a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f886b7a9800 5 note: GC not initialized 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f871efe5640 20 reqs_thread_entry: start 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f886b7a9800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:33.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f886b7a9800 20 Filter name: none 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f871cfe1640 20 reqs_thread_entry: start 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f886b7a9800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.270+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d63a0 con 0x7f8864014440 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.271+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.271+0000 7f886b7a9800 20 rados_obj.operate() r=0 bl.length=380 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.271+0000 7f886b7a9800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.271+0000 7f886b7a9800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.271+0000 7f886b7a9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.271+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1da510 con 0x7f8864014440 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v36'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f886b7a9800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-07T03:33:33.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f886b7a9800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f886b7a9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94785316425536 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1db180 con 0x5634ed195ba0 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== watch-notify(notify (1) cookie 94785316185216 notify 154618822678 ret 0) ==== 424+0+0 (crc 0 0 0) 0x5634ed1531d0 con 0x5634ed195ba0 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f874cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822678 cookie 94785316185216 notifier 4729 bl.length()=382 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f874cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f874cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f874cff9640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f872c003ea0 con 0x5634ed195ba0 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.272+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(64 notify.5 [notify cookie 94785316425536 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.273+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.273+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== watch-notify(notify_complete (2) cookie 94785316425536 notify 154618822678 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634ed1525c0 con 0x5634ed195ba0 2024-09-07T03:33:33.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.273+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1db100 con 0x5634ed18c640 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.273+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.273+0000 7f886b7a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 : miss 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.273+0000 7f886b7a9800 20 rados->read ofs=0 len=0 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.273+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 8.e 8:77f8e929:root::.bucket.meta.myfoo6%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8a50 con 0x7f8864014440 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.274+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(67 .bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.274+0000 7f886b7a9800 20 rados_obj.operate() r=0 bl.length=388 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.274+0000 7f886b7a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 info.flags=0x17 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.274+0000 7f886b7a9800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 to cache LRU end 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.274+0000 7f886b7a9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.274+0000 7f886b7a9800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.274+0000 7f886b7a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.274+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 8.e 8:77f8e929:root::.bucket.meta.myfoo6%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1e2200 con 0x7f8864014440 2024-09-07T03:33:33.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.275+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(68 .bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v36'5 uv5 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.275+0000 7f886b7a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 info.flags=0x17 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.275+0000 7f886b7a9800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 to cache LRU end 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.275+0000 7f886b7a9800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.275+0000 7f886b7a9800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9, ofs0, ns] 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.275+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94785316418960 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1e0f30 con 0x5634ed195ba0 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.275+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== watch-notify(notify (1) cookie 94785316187488 notify 154618822679 ret 0) ==== 798+0+0 (crc 0 0 0) 0x5634ed1525c0 con 0x5634ed195ba0 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.275+0000 7f873ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822679 cookie 94785316187488 notifier 4729 bl.length()=756 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f873ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 info.flags=0x17 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f873ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 to cache LRU end 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f873ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(69 notify.6 [notify cookie 94785316418960 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f873ffff640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f8690003530 con 0x5634ed195ba0 2024-09-07T03:33:33.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== watch-notify(notify_complete (2) cookie 94785316418960 notify 154618822679 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634ed152330 con 0x5634ed195ba0 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(70 notify.6 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f886b7a9800 20 handle_bi_update(): bucket=:myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9]): orig_sources= new_sources= 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f886b7a9800 20 handle_bi_update(): bucket=:myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9]): potential sources added=[] removed=[] 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f886b7a9800 20 handle_bi_update(): bucket=:myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9]): orig_dests= new_dests= 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f886b7a9800 20 handle_bi_update(): bucket=:myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9]): potential dests added=[] removed=[] 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.276+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d7590 con 0x5634ed190b20 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.277+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(71 bud.buckets [call] v36'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.277+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d7590 con 0x5634ed190b20 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.278+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(72 bud.buckets [call] v36'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.278+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d7590 con 0x5634ed18c640 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v36'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f886b7a9800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-07T03:33:33.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f886b7a9800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f886b7a9800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94785316418960 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1db7b0 con 0x7f8864014440 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== watch-notify(notify (1) cookie 94785316179568 notify 154618822683 ret 0) ==== 358+0+0 (crc 0 0 0) 0x5634ed1df5f0 con 0x7f8864014440 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f874cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822683 cookie 94785316179568 notifier 4729 bl.length()=316 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(74 notify.3 [notify cookie 94785316418960 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f874cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f874cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.279+0000 7f874cff9640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f872c003ea0 con 0x7f8864014440 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.280+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== watch-notify(notify_complete (2) cookie 94785316418960 notify 154618822683 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634ed1d8e40 con 0x7f8864014440 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.280+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.280+0000 7f886b7a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.280+0000 7f886b7a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 2024-09-07T03:33:33.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.280+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:76 8.e 8:77f8e929:root::.bucket.meta.myfoo6%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d7fd0 con 0x7f8864014440 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.281+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(76 .bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v36'6 uv6 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.281+0000 7f886b7a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 info.flags=0x17 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.281+0000 7f886b7a9800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 to cache LRU end 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.281+0000 7f886b7a9800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.281+0000 7f886b7a9800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9, ofs0, ns] 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.281+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94785316423280 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d7a90 con 0x5634ed195ba0 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== watch-notify(notify (1) cookie 94785316187488 notify 154618822680 ret 0) ==== 798+0+0 (crc 0 0 0) 0x5634ed152330 con 0x5634ed195ba0 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(77 notify.6 [notify cookie 94785316423280 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f874cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822680 cookie 94785316187488 notifier 4729 bl.length()=756 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f874cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 info.flags=0x17 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f874cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 to cache LRU end 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f874cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-07T03:33:33.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f874cff9640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f872c003ea0 con 0x5634ed195ba0 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== watch-notify(notify_complete (2) cookie 94785316423280 notify 154618822680 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634ecf0ce10 con 0x5634ed195ba0 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f886b7a9800 20 handle_bi_update(): bucket=:myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9]): orig_sources= new_sources= 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f886b7a9800 20 handle_bi_update(): bucket=:myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9]): potential sources added=[] removed=[] 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f886b7a9800 20 handle_bi_update(): bucket=:myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9]): orig_dests= new_dests= 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f886b7a9800 20 handle_bi_update(): bucket=:myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9]): potential dests added=[] removed=[] 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:79 4.1b 4:da40954c:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x7f8864014440 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 22 ==== osd_op_reply(79 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.282+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:80 4.29 4:972561a8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x5634ed195ba0 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.283+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(80 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.283+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:81 4.13 4:cba80643:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x7f8864014440 2024-09-07T03:33:33.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.283+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 23 ==== osd_op_reply(81 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.283+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:82 4.2c 4:34339c66:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x5634ed18c640 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.283+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(82 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.283+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 4.28 4:1626f919:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x5634ed190b20 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.284+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(83 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.284+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:84 4.12 4:4b87693e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x5634ed18c640 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.284+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(84 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.284+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:85 4.12 4:49013094:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x5634ed18c640 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.284+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(85 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.284+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:86 4.2f 4:f4518968:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x5634ed18c640 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.285+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(86 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.285+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 4.16 4:693b3a84:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x5634ed195ba0 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.285+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(87 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.285+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:88 4.1b 4:d90d13aa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x7f8864014440 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.285+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 24 ==== osd_op_reply(88 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 [call out=381b] v0'0 uv6 ondisk = 0) ==== 194+0+381 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.285+0000 7f886b7a9800 10 cls_bucket_list_unordered: got thirteen 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.285+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 4.32 4:4d937eb2:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x5634ed190b20 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(89 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 get_obj_state: octx=0x7f885400f570 obj=myfoo6:thirteen state=0x5634ed1d92b8 s->prefetch_data=0 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:90 3.14s0 3:2b63b4d3:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d8670 con 0x5634ed190b20 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(90 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 10 manifest: total_size = 8 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 get_obj_state: setting s->obj_tag to cf0fab6f-a978-4ce5-bacd-166891c31743.4225.4765125351008806182 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-07T03:33:33.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 get_obj_state: octx=0x7f885400f570 obj=myfoo6:thirteen state=0x5634ed1d92b8 s->prefetch_data=0 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.286+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:91 4.1b 4:d90d13aa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1df1a0 con 0x7f8864014440 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.287+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 25 ==== osd_op_reply(91 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.287+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:92 3.14s0 3:2b63b4d3:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1df1a0 con 0x5634ed190b20 2024-09-07T03:33:33.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.288+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(92 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v36'4 uv4 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.306 INFO:teuthology.orchestra.run.smithi120.stderr:1 objects processed in :myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9]). Next marker thirteen 2024-09-07T03:33:33.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.289+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 4.1b 4:d90d13aa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1e4fb0 con 0x7f8864014440 2024-09-07T03:33:33.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.289+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1e4fb0 con 0x7f8864014440 2024-09-07T03:33:33.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.290+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 26 ==== osd_op_reply(93 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 [stat,call,call] v36'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.290+0000 7f874cff9640 20 handle_completion(): completion ok for obj=thirteen 2024-09-07T03:33:33.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 27 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v36'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f886b7a9800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f886b7a9800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f886b7a9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94785316420208 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d90d0 con 0x5634ed195ba0 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== watch-notify(notify (1) cookie 94785316185216 notify 154618822681 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5634ecf0ce10 con 0x5634ed195ba0 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f873ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822681 cookie 94785316185216 notifier 4729 bl.length()=556 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f873ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f873ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(95 notify.5 [notify cookie 94785316420208 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.292+0000 7f873ffff640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f8690003590 con 0x5634ed195ba0 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.293+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.293+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== watch-notify(notify_complete (2) cookie 94785316420208 notify 154618822681 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634eceeb6b0 con 0x5634ed195ba0 2024-09-07T03:33:33.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.293+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d6f20 con 0x5634ed18c640 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v36'12 uv12 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f886b7a9800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f886b7a9800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f886b7a9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94785316420208 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d90d0 con 0x5634ed195ba0 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== watch-notify(notify (1) cookie 94785316185216 notify 154618822682 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5634eceeb6b0 con 0x5634ed195ba0 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f874cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822682 cookie 94785316185216 notifier 4729 bl.length()=177 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f874cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f874cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f874cff9640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f872c003ea0 con 0x5634ed195ba0 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 33 ==== osd_op_reply(98 notify.5 [notify cookie 94785316420208 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 34 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 35 ==== watch-notify(notify_complete (2) cookie 94785316420208 notify 154618822682 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f885c05c870 con 0x5634ed195ba0 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f886b7a9800 10 removing user index: bar 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.294+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d6f20 con 0x7f8864014440 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 28 ==== osd_op_reply(100 bar [delete] v36'7 uv7 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f886b7a9800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f886b7a9800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94785316420208 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1e5520 con 0x7f8864014440 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 29 ==== watch-notify(notify (1) cookie 94785316191504 notify 154618822684 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5634ed1e5350 con 0x7f8864014440 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f873ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 94785316191504 notifier 4729 bl.length()=152 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 30 ==== osd_op_reply(101 notify.7 [notify cookie 94785316420208 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f873ffff640 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f8690003590 con 0x7f8864014440 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 31 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.296+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 32 ==== watch-notify(notify_complete (2) cookie 94785316420208 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634ed1d7590 con 0x7f8864014440 2024-09-07T03:33:33.310 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-07T03:33:33.115132Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:33:33.115118Z","tags":[],"group_ids":[]} 2024-09-07T03:33:33.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.297+0000 7f871ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.297+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94785316192560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d4240 con 0x5634ed18c640 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.298+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94785316192560] v36'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.298+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94785316170640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d4240 con 0x5634ed190b20 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.299+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94785316170640] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.299+0000 7f886b7a9800 20 remove_watcher() i=0 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.299+0000 7f886b7a9800 2 removed watcher, disabling cache 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.299+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94785316168160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d4240 con 0x5634ed18c640 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.300+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94785316168160] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x5634ed18c640 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.300+0000 7f886b7a9800 20 remove_watcher() i=1 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.300+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94785316177360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d4240 con 0x5634ed190b20 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.301+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94785316177360] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.301+0000 7f886b7a9800 20 remove_watcher() i=2 2024-09-07T03:33:33.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.301+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94785316179568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d4240 con 0x7f8864014440 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.302+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 33 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94785316179568] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.302+0000 7f886b7a9800 20 remove_watcher() i=3 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.302+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94785316181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d4240 con 0x5634ed190b20 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.303+0000 7f8869a94640 1 -- 172.21.15.120:0/3394810457 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94785316181312] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8864038020 con 0x5634ed190b20 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.303+0000 7f886b7a9800 20 remove_watcher() i=4 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.303+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94785316185216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d4240 con 0x5634ed195ba0 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.304+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 36 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94785316185216] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.304+0000 7f886b7a9800 20 remove_watcher() i=5 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.304+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94785316187488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d4240 con 0x5634ed195ba0 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.305+0000 7f8869293640 1 -- 172.21.15.120:0/3394810457 <== osd.3 v2:172.21.15.120:6800/1193158925 37 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94785316187488] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885c0a0070 con 0x5634ed195ba0 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.305+0000 7f886b7a9800 20 remove_watcher() i=6 2024-09-07T03:33:33.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.305+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94785316191504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5634ed1d4240 con 0x7f8864014440 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.306+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 <== osd.2 v2:172.21.15.120:6809/3781833098 34 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94785316191504] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f885403c040 con 0x7f8864014440 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.306+0000 7f886b7a9800 20 remove_watcher() i=7 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.306+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed190b20 msgr2=0x5634ed192f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed190b20 0x5634ed192f10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed18c640 msgr2=0x5634ed18eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed18c640 0x5634ed18eb00 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8864014440 msgr2=0x7f8864012a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8864014440 0x7f8864012a90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5634ed195ba0 msgr2=0x5634ed198010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5634ed195ba0 0x5634ed198010 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f873403c780 msgr2=0x7f873403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f873403c780 0x7f873403ec40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f885c0893f0 tx=0x7f885c08d000 comp rx=0 tx=0).stop 2024-09-07T03:33:33.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 msgr2=0x5634ed180b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f8868a92640 1 -- 172.21.15.120:0/3394810457 reap_dead start 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed180b70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8864013550 tx=0x7f8864053d70 comp rx=0 tx=0).stop 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 shutdown_connections 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/3394810457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed179540 0x5634ed180b70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 >> 172.21.15.120:0/3394810457 conn(0x5634ed175960 msgr2=0x5634ed173b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 shutdown_connections 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/3394810457 wait complete. 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/4025132894 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f874003c780 msgr2=0x7f874003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/4025132894 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f874003c780 0x7f874003ec40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5634ed159b10 tx=0x7f885c08b040 comp rx=0 tx=0).stop 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/4025132894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed16caa0 msgr2=0x5634ed16cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/4025132894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed16caa0 0x5634ed16cec0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8864016d20 tx=0x7f886400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/4025132894 shutdown_connections 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/4025132894 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f874003c780 0x7f874003ec40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/4025132894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed16caa0 0x5634ed16cec0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/4025132894 >> 172.21.15.120:0/4025132894 conn(0x5634ed160e50 msgr2=0x5634ed161230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/4025132894 shutdown_connections 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/4025132894 wait complete. 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed15a350 msgr2=0x5634ed15c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.307+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed15a350 0x5634ed15c740 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed05c100 msgr2=0x5634ed159420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed05c100 0x5634ed159420 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f875003c780 msgr2=0x7f875003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f875003c780 0x7f875003ec40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8854000c00 tx=0x7f88540013b0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 msgr2=0x5634ed151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed151dd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f885c025c20 tx=0x7f885c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 shutdown_connections 2024-09-07T03:33:33.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5634ed15a350 0x5634ed15c740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5634ed05c100 0x5634ed159420 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f875003c780 0x7f875003ec40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 --2- 172.21.15.120:0/790009079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5634ed05b000 0x5634ed151dd0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:33.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 >> 172.21.15.120:0/790009079 conn(0x5634ed0563d0 msgr2=0x5634ed14b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:33.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 shutdown_connections 2024-09-07T03:33:33.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:33.308+0000 7f886b7a9800 1 -- 172.21.15.120:0/790009079 wait complete. 2024-09-07T03:33:33.321 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-07T03:33:33.115132Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:33:33.115118Z', 'tags': [], 'group_ids': []} 2024-09-07T03:33:38.331 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:33:38.331 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-07T03:33:38.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-07T03:33:38.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-07T03:33:38.331 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-07T03:33:38.392 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:38.392 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.391+0000 7f0104123800 1 Processor -- start 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.391+0000 7f0104123800 1 -- start start 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.391+0000 7f0104123800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55dc412ea4f0 0x55dc412ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.391+0000 7f0104123800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc41195e40 con 0x55dc412eae30 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.391+0000 7f0104123800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55dc41160680 con 0x55dc412ea4f0 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.392+0000 7f00ffe0c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55dc412ea4f0 0x55dc412ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.392+0000 7f00ffe0c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55dc412ea4f0 0x55dc412ea8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36052/0 (socket says 172.21.15.120:36052) 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.392+0000 7f00f7fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55dc412eae30 0x55dc412eb2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:57268/0 (socket says 172.21.15.120:57268) 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.392+0000 7f00ffe0c640 1 -- 172.21.15.120:0/538263972 learned_addr learned my addr 172.21.15.120:0/538263972 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.392+0000 7f00ffe0c640 1 -- 172.21.15.120:0/538263972 >> v1:172.21.15.104:6789/0 conn(0x55dc412eae30 legacy=0x55dc412eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.392+0000 7f00ffe0c640 1 -- 172.21.15.120:0/538263972 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc4117c6b0 con 0x55dc412ea4f0 2024-09-07T03:33:38.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.392+0000 7f00ff60b640 1 -- 172.21.15.120:0/538263972 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1941867512 0 0) 0x55dc41195e40 con 0x55dc412eae30 2024-09-07T03:33:38.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.394+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/538263972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc412ea8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f00f000a520 tx=0x7f00f0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922a40a45f4d3e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.394+0000 7f00ff60b640 1 -- 172.21.15.120:0/538263972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f0055070 con 0x55dc412ea4f0 2024-09-07T03:33:38.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.394+0000 7f00ff60b640 1 -- 172.21.15.120:0/538263972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f00515b0 con 0x55dc412ea4f0 2024-09-07T03:33:38.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.394+0000 7f00ff60b640 1 -- 172.21.15.120:0/538263972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f00518d0 con 0x55dc412ea4f0 2024-09-07T03:33:38.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.395+0000 7f0104123800 1 -- 172.21.15.120:0/538263972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 msgr2=0x55dc412ea8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.395+0000 7f0104123800 1 --2- 172.21.15.120:0/538263972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc412ea8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f00f000a520 tx=0x7f00f0045ba0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.395+0000 7f0104123800 1 -- 172.21.15.120:0/538263972 shutdown_connections 2024-09-07T03:33:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.395+0000 7f0104123800 1 --2- 172.21.15.120:0/538263972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc412ea8f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.395+0000 7f0104123800 1 -- 172.21.15.120:0/538263972 >> 172.21.15.120:0/538263972 conn(0x55dc412e6200 msgr2=0x55dc412e8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.395+0000 7f0104123800 1 -- 172.21.15.120:0/538263972 shutdown_connections 2024-09-07T03:33:38.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.395+0000 7f0104123800 1 -- 172.21.15.120:0/538263972 wait complete. 2024-09-07T03:33:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.410+0000 7f0104123800 1 Processor -- start 2024-09-07T03:33:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.410+0000 7f0104123800 1 -- start start 2024-09-07T03:33:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.411+0000 7f0104123800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413dd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.411+0000 7f0104123800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55dc41184dd0 con 0x55dc412ea4f0 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.411+0000 7f00ffe0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413dd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.411+0000 7f00ffe0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413dd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36056/0 (socket says 172.21.15.120:36056) 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.411+0000 7f00ffe0c640 1 -- 172.21.15.120:0/404994903 learned_addr learned my addr 172.21.15.120:0/404994903 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.411+0000 7f00ffe0c640 1 -- 172.21.15.120:0/404994903 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc4119de10 con 0x55dc412ea4f0 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.411+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/404994903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413dd7a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f00f0025da0 tx=0x7f00f0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7a7eefea5ee6d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7effede0b640 1 -- 172.21.15.120:0/404994903 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f0051950 con 0x55dc412ea4f0 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7effede0b640 1 -- 172.21.15.120:0/404994903 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f0051af0 con 0x55dc412ea4f0 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7effede0b640 1 -- 172.21.15.120:0/404994903 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f0051dd0 con 0x55dc412ea4f0 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7f0104123800 1 -- 172.21.15.120:0/404994903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 msgr2=0x55dc413dd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7f0104123800 1 --2- 172.21.15.120:0/404994903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413dd7a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f00f0025da0 tx=0x7f00f0051000 comp rx=0 tx=0).stop 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7f0104123800 1 -- 172.21.15.120:0/404994903 shutdown_connections 2024-09-07T03:33:38.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7f0104123800 1 --2- 172.21.15.120:0/404994903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413dd7a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7f0104123800 1 -- 172.21.15.120:0/404994903 >> 172.21.15.120:0/404994903 conn(0x55dc412e6200 msgr2=0x55dc413d9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7f0104123800 1 -- 172.21.15.120:0/404994903 shutdown_connections 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.412+0000 7f0104123800 1 -- 172.21.15.120:0/404994903 wait complete. 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.413+0000 7f0104123800 1 Processor -- start 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.413+0000 7f0104123800 1 -- start start 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.413+0000 7f0104123800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.413+0000 7f0104123800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55dc412ebd50 con 0x55dc412ea4f0 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.413+0000 7f00ffe0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.413+0000 7f00ffe0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413e4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36062/0 (socket says 172.21.15.120:36062) 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.413+0000 7f00ffe0c640 1 -- 172.21.15.120:0/1809070956 learned_addr learned my addr 172.21.15.120:0/1809070956 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.414+0000 7f00ffe0c640 1 -- 172.21.15.120:0/1809070956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc413e54a0 con 0x55dc412ea4f0 2024-09-07T03:33:38.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.414+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413e4f40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f00f0025da0 tx=0x7f00f0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.414+0000 7effe7fff640 1 -- 172.21.15.120:0/1809070956 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f005a600 con 0x55dc412ea4f0 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.414+0000 7effe7fff640 1 -- 172.21.15.120:0/1809070956 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f0073070 con 0x55dc412ea4f0 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.414+0000 7effe7fff640 1 -- 172.21.15.120:0/1809070956 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f005a910 con 0x55dc412ea4f0 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.414+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc413e5730 con 0x55dc412ea4f0 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.414+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc413e6340 con 0x55dc412ea4f0 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.415+0000 7effe7fff640 1 -- 172.21.15.120:0/1809070956 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f00f0058070 con 0x55dc412ea4f0 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.415+0000 7effe7fff640 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effe803c780 0x7effe803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.415+0000 7effe7fff640 1 -- 172.21.15.120:0/1809070956 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f00f006b040 con 0x55dc412ea4f0 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.415+0000 7f00f7fff640 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effe803c780 0x7effe803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.415+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc412eae30 0x55dc413ec590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.415+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc413ecad0 con 0x55dc412eae30 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.415+0000 7f010060d640 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc412eae30 0x55dc413ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.416+0000 7f00f7fff640 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effe803c780 0x7effe803ec40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f00e8000c00 tx=0x7f00e80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.416+0000 7f010060d640 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc412eae30 0x55dc413ec590 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.416+0000 7f010060d640 1 -- 172.21.15.120:0/1809070956 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00f800a4d0 con 0x55dc412eae30 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.416+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc413ed3d0 0x55dc413ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.416+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc413effd0 con 0x55dc413ed3d0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.416+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc413ed3d0 0x55dc413ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.417+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc413ed3d0 0x55dc413ef860 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.417+0000 7f00ffe0c640 1 -- 172.21.15.120:0/1809070956 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00f0057030 con 0x55dc413ed3d0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.417+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc413f1880 con 0x55dc413ed3d0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.417+0000 7f00ffe0c640 1 -- 172.21.15.120:0/1809070956 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f00f0057030 con 0x55dc413ed3d0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.417+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc413f09c0 con 0x55dc413ed3d0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.418+0000 7f00ffe0c640 1 -- 172.21.15.120:0/1809070956 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00f0057030 con 0x55dc413ed3d0 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.418+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc413f0e20 con 0x55dc412eae30 2024-09-07T03:33:38.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.418+0000 7f010060d640 1 -- 172.21.15.120:0/1809070956 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f00f800a4d0 con 0x55dc412eae30 2024-09-07T03:33:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.418+0000 7f0104123800 1 Processor -- start 2024-09-07T03:33:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.418+0000 7f0104123800 1 -- start start 2024-09-07T03:33:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.418+0000 7f0104123800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc413ffd70 0x55dc41400190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7f0104123800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55dc411e2a00 con 0x55dc413ffd70 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7f010060d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc413ffd70 0x55dc41400190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7f010060d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc413ffd70 0x55dc41400190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36068/0 (socket says 172.21.15.120:36068) 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7f010060d640 1 -- 172.21.15.120:0/2251475214 learned_addr learned my addr 172.21.15.120:0/2251475214 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7f010060d640 1 -- 172.21.15.120:0/2251475214 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc414007d0 con 0x55dc413ffd70 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7f010060d640 1 --2- 172.21.15.120:0/2251475214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc413ffd70 0x55dc41400190 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f00f8016d20 tx=0x7f00f800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7effe57fa640 1 -- 172.21.15.120:0/2251475214 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8017660 con 0x55dc413ffd70 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7effe57fa640 1 -- 172.21.15.120:0/2251475214 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f801b030 con 0x55dc413ffd70 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7f0104123800 1 -- 172.21.15.120:0/2251475214 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc41401000 con 0x55dc413ffd70 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.419+0000 7effe57fa640 1 -- 172.21.15.120:0/2251475214 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8017950 con 0x55dc413ffd70 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.420+0000 7f0104123800 1 -- 172.21.15.120:0/2251475214 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc414015a0 con 0x55dc413ffd70 2024-09-07T03:33:38.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.420+0000 7effe57fa640 1 -- 172.21.15.120:0/2251475214 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f00f8017b40 con 0x55dc413ffd70 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.421+0000 7effe57fa640 1 --2- 172.21.15.120:0/2251475214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effd803c730 0x7effd803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.421+0000 7effe57fa640 1 -- 172.21.15.120:0/2251475214 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f00f800e040 con 0x55dc413ffd70 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.421+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/2251475214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effd803c730 0x7effd803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.421+0000 7f0104123800 1 Processor -- start 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.421+0000 7f0104123800 1 -- start start 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.421+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/2251475214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effd803c730 0x7effd803ebf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55dc413e6740 tx=0x7f00f0084040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.421+0000 7f0104123800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc4140cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.421+0000 7f0104123800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55dc413ddf30 con 0x55dc4140c810 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.422+0000 7f010060d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc4140cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.422+0000 7f010060d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc4140cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36078/0 (socket says 172.21.15.120:36078) 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.422+0000 7f010060d640 1 -- 172.21.15.120:0/2623764214 learned_addr learned my addr 172.21.15.120:0/2623764214 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.422+0000 7f010060d640 1 -- 172.21.15.120:0/2623764214 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc4140d200 con 0x55dc4140c810 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.422+0000 7f010060d640 1 --2- 172.21.15.120:0/2623764214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc4140cc10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f00f8013450 tx=0x7f00f8053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fea93710342782c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.422+0000 7effdeffd640 1 -- 172.21.15.120:0/2623764214 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8014a00 con 0x55dc4140c810 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.422+0000 7effdeffd640 1 -- 172.21.15.120:0/2623764214 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f8051070 con 0x55dc4140c810 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.422+0000 7effdeffd640 1 -- 172.21.15.120:0/2623764214 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8028350 con 0x55dc4140c810 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 -- 172.21.15.120:0/2623764214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 msgr2=0x55dc4140cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 --2- 172.21.15.120:0/2623764214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc4140cc10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f00f8013450 tx=0x7f00f8053f40 comp rx=0 tx=0).stop 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 -- 172.21.15.120:0/2623764214 shutdown_connections 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 --2- 172.21.15.120:0/2623764214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc4140cc10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 -- 172.21.15.120:0/2623764214 >> 172.21.15.120:0/2623764214 conn(0x55dc41408c30 msgr2=0x55dc41406e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 -- 172.21.15.120:0/2623764214 shutdown_connections 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 -- 172.21.15.120:0/2623764214 wait complete. 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 Processor -- start 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 -- start start 2024-09-07T03:33:38.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc41413e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f0104123800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55dc4140d820 con 0x55dc4140c810 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f010060d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc41413e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f010060d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc41413e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36092/0 (socket says 172.21.15.120:36092) 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.423+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 learned_addr learned my addr 172.21.15.120:0/2659498594 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.424+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc41414380 con 0x55dc4140c810 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.424+0000 7f010060d640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc41413e20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f00f8013450 tx=0x7f00f8053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.424+0000 7effdd7fa640 1 -- 172.21.15.120:0/2659498594 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8005030 con 0x55dc4140c810 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.424+0000 7effdd7fa640 1 -- 172.21.15.120:0/2659498594 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f80051d0 con 0x55dc4140c810 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.424+0000 7effdd7fa640 1 -- 172.21.15.120:0/2659498594 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f80054b0 con 0x55dc4140c810 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.424+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc41414610 con 0x55dc4140c810 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.424+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc41414f90 con 0x55dc4140c810 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.425+0000 7effdd7fa640 1 -- 172.21.15.120:0/2659498594 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f00f80127a0 con 0x55dc4140c810 2024-09-07T03:33:38.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.425+0000 7effdd7fa640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effc803c730 0x7effc803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.425+0000 7effdd7fa640 1 -- 172.21.15.120:0/2659498594 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f00f8030030 con 0x55dc4140c810 2024-09-07T03:33:38.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.425+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effc803c730 0x7effc803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.426+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effc803c730 0x7effc803ebf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00f0097830 tx=0x7f00f008a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.426+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.426+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc4141f8e0 0x55dc41421da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.426+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc414224f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.426+0000 7f00f7fff640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc4141f8e0 0x55dc41421da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.426+0000 7f00f7fff640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc4141f8e0 0x55dc41421da0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 20 realm 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc4141ec30 con 0x55dc4141f8e0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc41422fe0 con 0x55dc4141f8e0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc41423dc0 0x55dc414261b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc41426880 con 0x55dc41423dc0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.427+0000 7f010060d640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc41423dc0 0x55dc414261b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.428+0000 7f010060d640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc41423dc0 0x55dc414261b0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.428+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.428+0000 7f0104123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.428+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.428+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc414270d0 con 0x55dc41423dc0 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.429+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.429+0000 7f0104123800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.429+0000 7f0104123800 20 searching for the correct realm 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.429+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55dc41428e40 0x55dc4142b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.429+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41428e40 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.429+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55dc41428e40 0x55dc4142b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.429+0000 7f00ffe0c640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55dc41428e40 0x55dc4142b270 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.429+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.429+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41423dc0 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.430+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.430+0000 7f010060d640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f00f8004b10 0x7f00f8012a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.430+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x7f00f8004b10 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.430+0000 7f00f7fff640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f00f8004b10 0x7f00f8012a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.430+0000 7f00f7fff640 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f00f8004b10 0x7f00f8012a90 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.430+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x7f00f8004b10 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.430+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc4141f8e0 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.430+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.430+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc4141f8e0 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.431+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.431+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41428e40 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.431+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.431+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc4141f8e0 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.431+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.431+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41423dc0 2024-09-07T03:33:38.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.432+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.432+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41423dc0 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.432+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.432+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc4141f8e0 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.432+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.432+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x7f00f8004b10 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.432+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x7f00f8004b10 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.432+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc4141f8e0 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.433+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.433+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x7f00f8004b10 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.433+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f00e800f5f0 con 0x7f00f8004b10 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.433+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41423dc0 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.433+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.433+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41428e40 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.433+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.433+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc4141f8e0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.434+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.434+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41423dc0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.434+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.434+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41428e40 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.434+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.434+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc4141f8e0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc4141f8e0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc4141f8e0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x55dc4141f8e0 2024-09-07T03:33:38.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41428e40 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x7f00f8004b10 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x7f00f8004b10 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.435+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x7f00f8004b10 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.436+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x7f00f8004b10 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.436+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x7f00f8004b10 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.436+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x7f00f8004b10 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.436+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41428e40 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.436+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.436+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x7f00f8004b10 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.436+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00e800f5f0 con 0x7f00f8004b10 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.436+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41423dc0 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.437+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.437+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41423dc0 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.437+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.437+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41428e40 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.437+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.437+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41423dc0 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.437+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.437+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142b940 con 0x55dc41423dc0 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:38.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc41427a20 con 0x55dc4141f8e0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x55dc4141f8e0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc41427630 con 0x55dc41423dc0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.438+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc41428390 con 0x55dc4141f8e0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f00e803c040 con 0x55dc4141f8e0 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 20 zone default found 2024-09-07T03:33:38.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 4 Realm: () 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 20 zonegroup default 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142c270 con 0x7f00f8004b10 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x7f00f8004b10 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142e4b0 con 0x55dc41428e40 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142e850 con 0x55dc41428e40 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.439+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.440+0000 7f0104123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.440+0000 7f0104123800 20 started sync module instance, tier type = 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.440+0000 7f0104123800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.440+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142d8f0 con 0x55dc41423dc0 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.441+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.441+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94404476067312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142d8f0 con 0x55dc41423dc0 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.441+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142f210 con 0x55dc4141f8e0 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.442+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x55dc4141f8e0 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.442+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94404476071264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142fa60 con 0x55dc4141f8e0 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.442+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41430520 con 0x55dc41423dc0 2024-09-07T03:33:38.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.442+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94404476067312] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.443+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94404476071264] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x55dc4141f8e0 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.443+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.443+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94404476076016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc4142f5b0 con 0x55dc41423dc0 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.443+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41430dc0 con 0x7f00f8004b10 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.444+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x7f00f8004b10 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.444+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94404476078352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc414311e0 con 0x7f00f8004b10 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.444+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41431a30 con 0x55dc41423dc0 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.445+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94404476076016] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.446+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94404476078352] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x7f00f8004b10 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.446+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.446+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94404476079408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41431600 con 0x55dc41423dc0 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.446+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41431600 con 0x55dc41428e40 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.447+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.447+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94404476083744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc414326f0 con 0x55dc41428e40 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.447+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc414331d0 con 0x55dc41428e40 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.447+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94404476079408] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.448+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94404476083744] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.449+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.449+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94404476084800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41431150 con 0x55dc41428e40 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.449+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc414336c0 con 0x7f00f8004b10 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x7f00f8004b10 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94404476084800] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94404476088784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41433690 con 0x7f00f8004b10 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f0104123800 20 add_watcher() i=0 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f0104123800 20 add_watcher() i=1 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f0104123800 20 add_watcher() i=2 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f0104123800 20 add_watcher() i=3 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f0104123800 20 add_watcher() i=4 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f0104123800 20 add_watcher() i=5 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.450+0000 7f0104123800 20 add_watcher() i=6 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.451+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94404476088784] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x7f00f8004b10 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.451+0000 7f0104123800 20 add_watcher() i=7 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.451+0000 7f0104123800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.451+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc41432dd0 con 0x55dc4141f8e0 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.451+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f00e803c040 con 0x55dc4141f8e0 2024-09-07T03:33:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.451+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94404476091024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41434490 con 0x55dc4141f8e0 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.452+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94404476091024] v36'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x55dc4141f8e0 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7effb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7f0104123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7f0104123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7f0104123800 5 note: GC not initialized 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7effb4fe1640 20 reqs_thread_entry: start 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7f0104123800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7f0104123800 20 Filter name: none 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7eff2e7fc640 20 reqs_thread_entry: start 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7f0104123800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc41469ce0 con 0x7f00f8004b10 2024-09-07T03:33:38.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.453+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x7f00f8004b10 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc41468380 con 0x55dc41428e40 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.454+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41468c50 con 0x7f00f8004b10 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v36'8 uv8 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x7f00f8004b10 2024-09-07T03:33:38.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7f0104123800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7f0104123800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7f0104123800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94404476307360 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc4146d620 con 0x55dc41428e40 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== watch-notify(notify (1) cookie 94404476083744 notify 154618822683 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7f00f00ac040 con 0x55dc41428e40 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7effdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822683 cookie 94404476083744 notifier 4736 bl.length()=556 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7effdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7effdeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7effdeffd640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7effc4003ea0 con 0x55dc41428e40 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.455+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(65 notify.5 [notify cookie 94404476307360 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.456+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.456+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== watch-notify(notify_complete (2) cookie 94404476307360 notify 154618822683 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dc413e6340 con 0x55dc41428e40 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.456+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc414687a0 con 0x55dc41428e40 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.457+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v36'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.457+0000 7f0104123800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.457+0000 7f0104123800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.457+0000 7f0104123800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.457+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94404476322144 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dc4146da40 con 0x55dc41423dc0 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.458+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94404476076016 notify 154618822686 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55dc41414f90 con 0x55dc41423dc0 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.458+0000 7effde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822686 cookie 94404476076016 notifier 4736 bl.length()=177 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.458+0000 7effde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.458+0000 7effde7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.458+0000 7effde7fc640 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7eff34003400 con 0x55dc41423dc0 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.458+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(68 notify.2 [notify cookie 94404476322144 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.458+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.458+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94404476322144 notify 154618822686 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f00f8071020 con 0x55dc41423dc0 2024-09-07T03:33:38.468 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-07T03:33:38.455245Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:33:38.455225Z","tags":[],"group_ids":[]} 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.459+0000 7effb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.459+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94404476091024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41467ad0 con 0x55dc4141f8e0 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.460+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94404476091024] v36'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x55dc4141f8e0 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.460+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94404476067312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41467ad0 con 0x55dc41423dc0 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.462+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94404476067312] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.462+0000 7f0104123800 20 remove_watcher() i=0 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.462+0000 7f0104123800 2 removed watcher, disabling cache 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.462+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94404476071264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41467ad0 con 0x55dc4141f8e0 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.463+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94404476071264] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x55dc4141f8e0 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.463+0000 7f0104123800 20 remove_watcher() i=1 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.463+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94404476076016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41467ad0 con 0x55dc41423dc0 2024-09-07T03:33:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.464+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94404476076016] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.464+0000 7f0104123800 20 remove_watcher() i=2 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.464+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94404476078352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41467ad0 con 0x7f00f8004b10 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.465+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94404476078352] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x7f00f8004b10 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.465+0000 7f0104123800 20 remove_watcher() i=3 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.465+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94404476079408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41467ad0 con 0x55dc41423dc0 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.467+0000 7f010060d640 1 -- 172.21.15.120:0/2659498594 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94404476079408] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f8027070 con 0x55dc41423dc0 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.467+0000 7f0104123800 20 remove_watcher() i=4 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.467+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94404476083744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41467ad0 con 0x55dc41428e40 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.468+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94404476083744] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.468+0000 7f0104123800 20 remove_watcher() i=5 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.468+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94404476084800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41467ad0 con 0x55dc41428e40 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.469+0000 7f00ffe0c640 1 -- 172.21.15.120:0/2659498594 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94404476084800] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00f00a0030 con 0x55dc41428e40 2024-09-07T03:33:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.469+0000 7f0104123800 20 remove_watcher() i=6 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.469+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94404476088784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dc41467ad0 con 0x7f00f8004b10 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94404476088784] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00e803c040 con 0x7f00f8004b10 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 20 remove_watcher() i=7 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc41423dc0 msgr2=0x55dc414261b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc41423dc0 0x55dc414261b0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc4141f8e0 msgr2=0x55dc41421da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc4141f8e0 0x55dc41421da0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f00f8004b10 msgr2=0x7f00f8012a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f00f8004b10 0x7f00f8012a90 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55dc41428e40 msgr2=0x55dc4142b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55dc41428e40 0x55dc4142b270 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effc803c730 msgr2=0x7effc803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effc803c730 0x7effc803ebf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00f0097830 tx=0x7f00f008a000 comp rx=0 tx=0).stop 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f00f7fff640 1 -- 172.21.15.120:0/2659498594 reap_dead start 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 msgr2=0x55dc41413e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc41413e20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f00f8013450 tx=0x7f00f8053d90 comp rx=0 tx=0).stop 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 shutdown_connections 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2659498594 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc4140c810 0x55dc41413e20 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 >> 172.21.15.120:0/2659498594 conn(0x55dc41408c30 msgr2=0x55dc41406e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 shutdown_connections 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2659498594 wait complete. 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2251475214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effd803c730 msgr2=0x7effd803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2251475214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effd803c730 0x7effd803ebf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55dc413e6740 tx=0x7f00f0084040 comp rx=0 tx=0).stop 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2251475214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc413ffd70 msgr2=0x55dc41400190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2251475214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc413ffd70 0x55dc41400190 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f00f8016d20 tx=0x7f00f800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2251475214 shutdown_connections 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2251475214 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effd803c730 0x7effd803ebf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 --2- 172.21.15.120:0/2251475214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc413ffd70 0x55dc41400190 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2251475214 >> 172.21.15.120:0/2251475214 conn(0x55dc413f4120 msgr2=0x55dc413f4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2251475214 shutdown_connections 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.470+0000 7f0104123800 1 -- 172.21.15.120:0/2251475214 wait complete. 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc413ed3d0 msgr2=0x55dc413ef860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc413ed3d0 0x55dc413ef860 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc412eae30 msgr2=0x55dc413ec590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc412eae30 0x55dc413ec590 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effe803c780 msgr2=0x7effe803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effe803c780 0x7effe803ec40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f00e8000c00 tx=0x7f00e80013b0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 msgr2=0x55dc413e4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413e4f40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f00f0025da0 tx=0x7f00f0002fb0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 shutdown_connections 2024-09-07T03:33:38.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55dc413ed3d0 0x55dc413ef860 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55dc412eae30 0x55dc413ec590 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7effe803c780 0x7effe803ec40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 --2- 172.21.15.120:0/1809070956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55dc412ea4f0 0x55dc413e4f40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 >> 172.21.15.120:0/1809070956 conn(0x55dc412e6200 msgr2=0x55dc413d7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 shutdown_connections 2024-09-07T03:33:38.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.471+0000 7f0104123800 1 -- 172.21.15.120:0/1809070956 wait complete. 2024-09-07T03:33:38.482 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-07T03:33:38.455245Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:33:38.455225Z', 'tags': [], 'group_ids': []} 2024-09-07T03:33:38.501 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:33:38.506 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-07T03:33:38.507 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-07T03:33:38.507 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-07T03:33:38.507 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-07T03:33:38.553 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:38.554 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:38.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.553+0000 7f1e07740800 1 Processor -- start 2024-09-07T03:33:38.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.553+0000 7f1e07740800 1 -- start start 2024-09-07T03:33:38.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.553+0000 7f1e07740800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560c9f56b4a0 0x560c9f56b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.553+0000 7f1e07740800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c9f416e40 con 0x560c9f56bde0 2024-09-07T03:33:38.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.553+0000 7f1e07740800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560c9f3e1680 con 0x560c9f56b4a0 2024-09-07T03:33:38.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.553+0000 7f1e034c0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560c9f56b4a0 0x560c9f56b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.553+0000 7f1dfbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x560c9f56bde0 0x560c9f56c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:57276/0 (socket says 172.21.15.120:57276) 2024-09-07T03:33:38.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.553+0000 7f1e034c0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x560c9f56b4a0 0x560c9f56b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36098/0 (socket says 172.21.15.120:36098) 2024-09-07T03:33:38.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.553+0000 7f1dfbfff640 1 -- 172.21.15.120:0/1325731525 learned_addr learned my addr 172.21.15.120:0/1325731525 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:33:38.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.554+0000 7f1e034c0640 1 -- 172.21.15.120:0/1325731525 >> v1:172.21.15.104:6789/0 conn(0x560c9f56bde0 legacy=0x560c9f56c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.554+0000 7f1e034c0640 1 -- 172.21.15.120:0/1325731525 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9f3fd6b0 con 0x560c9f56b4a0 2024-09-07T03:33:38.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e034c0640 1 --2- 172.21.15.120:0/1325731525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f56b8a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1df400a470 tx=0x7f1df4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598e6d71452e19c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e02cbf640 1 -- 172.21.15.120:0/1325731525 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df4053570 con 0x560c9f56b4a0 2024-09-07T03:33:38.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e02cbf640 1 -- 172.21.15.120:0/1325731525 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df4058070 con 0x560c9f56b4a0 2024-09-07T03:33:38.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e02cbf640 1 -- 172.21.15.120:0/1325731525 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df4053880 con 0x560c9f56b4a0 2024-09-07T03:33:38.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e07740800 1 -- 172.21.15.120:0/1325731525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 msgr2=0x560c9f56b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e07740800 1 --2- 172.21.15.120:0/1325731525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f56b8a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1df400a470 tx=0x7f1df4045a20 comp rx=0 tx=0).stop 2024-09-07T03:33:38.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e07740800 1 -- 172.21.15.120:0/1325731525 shutdown_connections 2024-09-07T03:33:38.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e07740800 1 --2- 172.21.15.120:0/1325731525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f56b8a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e07740800 1 -- 172.21.15.120:0/1325731525 >> 172.21.15.120:0/1325731525 conn(0x560c9f5671d0 msgr2=0x560c9f569630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e07740800 1 -- 172.21.15.120:0/1325731525 shutdown_connections 2024-09-07T03:33:38.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.556+0000 7f1e07740800 1 -- 172.21.15.120:0/1325731525 wait complete. 2024-09-07T03:33:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.570+0000 7f1e07740800 1 Processor -- start 2024-09-07T03:33:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.570+0000 7f1e07740800 1 -- start start 2024-09-07T03:33:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.570+0000 7f1e07740800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f65e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.570+0000 7f1e07740800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c9f405dd0 con 0x560c9f56b4a0 2024-09-07T03:33:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.570+0000 7f1e034c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f65e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.570+0000 7f1e034c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f65e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36114/0 (socket says 172.21.15.120:36114) 2024-09-07T03:33:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.570+0000 7f1e034c0640 1 -- 172.21.15.120:0/1992582933 learned_addr learned my addr 172.21.15.120:0/1992582933 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.571+0000 7f1e034c0640 1 -- 172.21.15.120:0/1992582933 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9f41ee10 con 0x560c9f56b4a0 2024-09-07T03:33:38.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.571+0000 7f1e034c0640 1 --2- 172.21.15.120:0/1992582933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f65e870 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1df4025c20 tx=0x7f1df4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cad0e8bf89b283 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.571+0000 7f1cf160a640 1 -- 172.21.15.120:0/1992582933 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df4053570 con 0x560c9f56b4a0 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.571+0000 7f1cf160a640 1 -- 172.21.15.120:0/1992582933 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df4063070 con 0x560c9f56b4a0 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.571+0000 7f1cf160a640 1 -- 172.21.15.120:0/1992582933 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df4053840 con 0x560c9f56b4a0 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 -- 172.21.15.120:0/1992582933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 msgr2=0x560c9f65e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 --2- 172.21.15.120:0/1992582933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f65e870 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1df4025c20 tx=0x7f1df4051000 comp rx=0 tx=0).stop 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 -- 172.21.15.120:0/1992582933 shutdown_connections 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 --2- 172.21.15.120:0/1992582933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f65e870 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 -- 172.21.15.120:0/1992582933 >> 172.21.15.120:0/1992582933 conn(0x560c9f5671d0 msgr2=0x560c9f65a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 -- 172.21.15.120:0/1992582933 shutdown_connections 2024-09-07T03:33:38.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 -- 172.21.15.120:0/1992582933 wait complete. 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 Processor -- start 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 -- start start 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f666090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.572+0000 7f1e07740800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c9f56cd60 con 0x560c9f56b4a0 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1e034c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f666090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1e034c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f666090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36118/0 (socket says 172.21.15.120:36118) 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1e034c0640 1 -- 172.21.15.120:0/2768839596 learned_addr learned my addr 172.21.15.120:0/2768839596 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1e034c0640 1 -- 172.21.15.120:0/2768839596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9f6665f0 con 0x560c9f56b4a0 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1e034c0640 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f666090 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1df4053d60 tx=0x7f1df4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1cefe07640 1 -- 172.21.15.120:0/2768839596 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df4068470 con 0x560c9f56b4a0 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1cefe07640 1 -- 172.21.15.120:0/2768839596 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df4068610 con 0x560c9f56b4a0 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c9f666880 con 0x560c9f56b4a0 2024-09-07T03:33:38.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1cefe07640 1 -- 172.21.15.120:0/2768839596 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1df40688f0 con 0x560c9f56b4a0 2024-09-07T03:33:38.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.573+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9f667280 con 0x560c9f56b4a0 2024-09-07T03:33:38.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.574+0000 7f1cefe07640 1 -- 172.21.15.120:0/2768839596 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1df4068a90 con 0x560c9f56b4a0 2024-09-07T03:33:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.574+0000 7f1cefe07640 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ce803c730 0x7f1ce803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.574+0000 7f1cefe07640 1 -- 172.21.15.120:0/2768839596 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f1df4097f20 con 0x560c9f56b4a0 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.574+0000 7f1dfbfff640 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ce803c730 0x7f1ce803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.574+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f56bde0 0x560c9f66d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.574+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f667e30 con 0x560c9f56bde0 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.575+0000 7f1e03cc1640 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f56bde0 0x560c9f66d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.575+0000 7f1dfbfff640 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ce803c730 0x7f1ce803ebf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001d70 tx=0x7f1dec0012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.575+0000 7f1e03cc1640 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f56bde0 0x560c9f66d6e0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.575+0000 7f1e03cc1640 1 -- 172.21.15.120:0/2768839596 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1dfc00a4d0 con 0x560c9f56bde0 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.575+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f66e610 0x560c9f670a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.575+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f671060 con 0x560c9f66e610 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.575+0000 7f1e034c0640 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f66e610 0x560c9f670a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.576+0000 7f1e034c0640 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f66e610 0x560c9f670a00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.576+0000 7f1e034c0640 1 -- 172.21.15.120:0/2768839596 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1df4079020 con 0x560c9f66e610 2024-09-07T03:33:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.576+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f672910 con 0x560c9f66e610 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.576+0000 7f1e034c0640 1 -- 172.21.15.120:0/2768839596 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1df4079020 con 0x560c9f66e610 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.576+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6719c0 con 0x560c9f66e610 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.576+0000 7f1e034c0640 1 -- 172.21.15.120:0/2768839596 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1df4079020 con 0x560c9f66e610 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.576+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f671e20 con 0x560c9f56bde0 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.577+0000 7f1e03cc1640 1 -- 172.21.15.120:0/2768839596 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1dfc00a4d0 con 0x560c9f56bde0 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.577+0000 7f1e07740800 1 Processor -- start 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.577+0000 7f1e07740800 1 -- start start 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.577+0000 7f1e07740800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f680d40 0x560c9f681160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.577+0000 7f1e07740800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c9f463a00 con 0x560c9f680d40 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.577+0000 7f1e03cc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f680d40 0x560c9f681160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.577+0000 7f1e03cc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f680d40 0x560c9f681160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36124/0 (socket says 172.21.15.120:36124) 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.577+0000 7f1e03cc1640 1 -- 172.21.15.120:0/3715763232 learned_addr learned my addr 172.21.15.120:0/3715763232 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.578+0000 7f1e03cc1640 1 -- 172.21.15.120:0/3715763232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9f6817a0 con 0x560c9f680d40 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.578+0000 7f1e03cc1640 1 --2- 172.21.15.120:0/3715763232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f680d40 0x560c9f681160 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc016d20 tx=0x7f1dfc00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.578+0000 7f1ced602640 1 -- 172.21.15.120:0/3715763232 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc017660 con 0x560c9f680d40 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.578+0000 7f1ced602640 1 -- 172.21.15.120:0/3715763232 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dfc01b030 con 0x560c9f680d40 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.578+0000 7f1ced602640 1 -- 172.21.15.120:0/3715763232 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc017950 con 0x560c9f680d40 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.578+0000 7f1e07740800 1 -- 172.21.15.120:0/3715763232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c9f681fd0 con 0x560c9f680d40 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.578+0000 7f1e07740800 1 -- 172.21.15.120:0/3715763232 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9f682570 con 0x560c9f680d40 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.579+0000 7f1ced602640 1 -- 172.21.15.120:0/3715763232 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1dfc017b40 con 0x560c9f680d40 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.579+0000 7f1ced602640 1 --2- 172.21.15.120:0/3715763232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c730 0x7f1cdc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.579+0000 7f1ced602640 1 -- 172.21.15.120:0/3715763232 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f1dfc00e040 con 0x560c9f680d40 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.579+0000 7f1e034c0640 1 --2- 172.21.15.120:0/3715763232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c730 0x7f1cdc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.579+0000 7f1e07740800 1 Processor -- start 2024-09-07T03:33:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.579+0000 7f1e034c0640 1 --2- 172.21.15.120:0/3715763232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c730 0x7f1cdc03ebf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x560c9f66ddd0 tx=0x7f1df4096200 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1e07740800 1 -- start start 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1e07740800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f68dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1e07740800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c9f65f060 con 0x560c9f68d7e0 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1e03cc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f68dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1e03cc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f68dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36140/0 (socket says 172.21.15.120:36140) 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1e03cc1640 1 -- 172.21.15.120:0/1986033136 learned_addr learned my addr 172.21.15.120:0/1986033136 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1e03cc1640 1 -- 172.21.15.120:0/1986033136 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9f68e1d0 con 0x560c9f68d7e0 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1e03cc1640 1 --2- 172.21.15.120:0/1986033136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f68dbe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc013450 tx=0x7f1dfc053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2885d6b833947d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1ce6ffd640 1 -- 172.21.15.120:0/1986033136 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc014a00 con 0x560c9f68d7e0 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1ce6ffd640 1 -- 172.21.15.120:0/1986033136 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dfc051070 con 0x560c9f68d7e0 2024-09-07T03:33:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.580+0000 7f1ce6ffd640 1 -- 172.21.15.120:0/1986033136 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc028350 con 0x560c9f68d7e0 2024-09-07T03:33:38.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 -- 172.21.15.120:0/1986033136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 msgr2=0x560c9f68dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 --2- 172.21.15.120:0/1986033136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f68dbe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc013450 tx=0x7f1dfc053f40 comp rx=0 tx=0).stop 2024-09-07T03:33:38.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 -- 172.21.15.120:0/1986033136 shutdown_connections 2024-09-07T03:33:38.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 --2- 172.21.15.120:0/1986033136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f68dbe0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 -- 172.21.15.120:0/1986033136 >> 172.21.15.120:0/1986033136 conn(0x560c9f689be0 msgr2=0x560c9f687e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 -- 172.21.15.120:0/1986033136 shutdown_connections 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 -- 172.21.15.120:0/1986033136 wait complete. 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 Processor -- start 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 -- start start 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f694e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.581+0000 7f1e07740800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560c9f68e7f0 con 0x560c9f68d7e0 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1e03cc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f694e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1e03cc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f694e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36152/0 (socket says 172.21.15.120:36152) 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 learned_addr learned my addr 172.21.15.120:0/179659163 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9f6953e0 con 0x560c9f68d7e0 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1e03cc1640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f694e80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00dd00 tx=0x7f1dfc053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1ce57fa640 1 -- 172.21.15.120:0/179659163 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc005030 con 0x560c9f68d7e0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1ce57fa640 1 -- 172.21.15.120:0/179659163 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dfc0051d0 con 0x560c9f68d7e0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c9f695670 con 0x560c9f68d7e0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1ce57fa640 1 -- 172.21.15.120:0/179659163 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dfc0054d0 con 0x560c9f68d7e0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.582+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9f695ff0 con 0x560c9f68d7e0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.583+0000 7f1ce57fa640 1 -- 172.21.15.120:0/179659163 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1dfc0127a0 con 0x560c9f68d7e0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.583+0000 7f1ce57fa640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ccc03c6e0 0x7f1ccc03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.583+0000 7f1ce57fa640 1 -- 172.21.15.120:0/179659163 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f1dfc035d10 con 0x560c9f68d7e0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.583+0000 7f1e034c0640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ccc03c6e0 0x7f1ccc03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1e034c0640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ccc03c6e0 0x7f1ccc03eba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1df4052fd0 tx=0x7f1df405df50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f6a08e0 0x560c9f6a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6a34f0 con 0x560c9f6a08e0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1dfbfff640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f6a08e0 0x560c9f6a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1dfbfff640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f6a08e0 0x560c9f6a2da0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1dec009050 con 0x560c9f6a08e0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1e07740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1e07740800 20 realm 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.584+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f69fc30 con 0x560c9f6a08e0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1dec009050 con 0x560c9f6a08e0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1e07740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1e07740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6a3fe0 con 0x560c9f6a08e0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1dec009050 con 0x560c9f6a08e0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1e07740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f6a4dc0 0x560c9f6a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6a7880 con 0x560c9f6a4dc0 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.585+0000 7f1e03cc1640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f6a4dc0 0x560c9f6a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e03cc1640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f6a4dc0 0x560c9f6a71b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e07740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6a80d0 con 0x560c9f6a4dc0 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e07740800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e07740800 20 searching for the correct realm 2024-09-07T03:33:38.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c9f6a9e40 0x560c9f6ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a9e40 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.586+0000 7f1e034c0640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c9f6a9e40 0x560c9f6ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.587+0000 7f1e034c0640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c9f6a9e40 0x560c9f6ac270 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.587+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.587+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.587+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.587+0000 7f1e03cc1640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1dfc0049a0 0x7f1dfc020880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.587+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x7f1dfc0049a0 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.587+0000 7f1dfbfff640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1dfc0049a0 0x7f1dfc020880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.588+0000 7f1dfbfff640 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1dfc0049a0 0x7f1dfc020880 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.588+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec009050 con 0x7f1dfc0049a0 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.588+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a08e0 2024-09-07T03:33:38.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.588+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec009050 con 0x560c9f6a08e0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.588+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a08e0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.588+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.588+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a9e40 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.588+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.588+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a08e0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.589+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.589+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.589+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.589+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.589+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.589+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a08e0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.589+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.589+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x7f1dfc0049a0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.590+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.590+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a08e0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.590+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.590+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x7f1dfc0049a0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.590+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.590+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.590+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.590+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a9e40 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.591+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.591+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a08e0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.591+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.591+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.591+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.591+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a9e40 2024-09-07T03:33:38.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.591+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.591+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a08e0 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.592+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.592+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a08e0 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.592+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.592+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a08e0 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.592+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.592+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a9e40 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.592+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.592+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x7f1dfc0049a0 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.593+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.593+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x7f1dfc0049a0 2024-09-07T03:33:38.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.593+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.593+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x7f1dfc0049a0 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.593+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.593+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a9e40 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.593+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.593+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x7f1dfc0049a0 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.594+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.594+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.594+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.594+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a9e40 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ac940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e07740800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e07740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e07740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e07740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e07740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e07740800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.595+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6a8a50 con 0x560c9f6a08e0 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6a8690 con 0x560c9f6a4dc0 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6a8e90 con 0x560c9f6a08e0 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 zone default found 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 4 Realm: () 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 zonegroup default 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ad270 con 0x7f1dfc0049a0 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.596+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6af4b0 con 0x560c9f6a9e40 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.597+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.597+0000 7f1e07740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.597+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.597+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6af850 con 0x560c9f6a9e40 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.597+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.597+0000 7f1e07740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.597+0000 7f1e07740800 20 started sync module instance, tier type = 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.597+0000 7f1e07740800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.597+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ae940 con 0x560c9f6a4dc0 2024-09-07T03:33:38.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.598+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.598+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94612214181168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6afd00 con 0x560c9f6a4dc0 2024-09-07T03:33:38.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.598+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b0550 con 0x560c9f6a08e0 2024-09-07T03:33:38.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.599+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94612214181168] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.599+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.599+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94612214184016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b0280 con 0x560c9f6a08e0 2024-09-07T03:33:38.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.599+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b0d70 con 0x560c9f6a4dc0 2024-09-07T03:33:38.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.600+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94612214184016] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.601+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.601+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94612214188096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b0d30 con 0x560c9f6a4dc0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.601+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b1820 con 0x7f1dfc0049a0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.602+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.602+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94612214190896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b1820 con 0x7f1dfc0049a0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.602+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b27e0 con 0x560c9f6a4dc0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.602+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94612214188096] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.603+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94612214190896] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.603+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.603+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94612214193168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b27a0 con 0x560c9f6a4dc0 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.603+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b3080 con 0x560c9f6a9e40 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.604+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.604+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94612214197200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b27a0 con 0x560c9f6a9e40 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.604+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b3be0 con 0x560c9f6a9e40 2024-09-07T03:33:38.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.604+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94612214193168] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.605+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94612214197200] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.605+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.605+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94612214198256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b3be0 con 0x560c9f6a9e40 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.605+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b4480 con 0x7f1dfc0049a0 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.606+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94612214198256] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.606+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.606+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94612214200048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b3be0 con 0x7f1dfc0049a0 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 20 add_watcher() i=0 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 20 add_watcher() i=1 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 20 add_watcher() i=2 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 20 add_watcher() i=3 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 20 add_watcher() i=4 2024-09-07T03:33:38.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 20 add_watcher() i=5 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 20 add_watcher() i=6 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94612214200048] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 20 add_watcher() i=7 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.607+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b75d0 con 0x560c9f6a08e0 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.608+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.608+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94612214202320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6b4af0 con 0x560c9f6a08e0 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.609+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94612214202320] v36'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.609+0000 7f1cb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.609+0000 7f1e07740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.609+0000 7f1e07740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.609+0000 7f1e07740800 5 note: GC not initialized 2024-09-07T03:33:38.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.609+0000 7f1cb8fe1640 20 reqs_thread_entry: start 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.609+0000 7f1e07740800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1e07740800 20 Filter name: none 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1c327fc640 20 reqs_thread_entry: start 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1e07740800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1e07740800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ea6c0 con 0x7f1dfc0049a0 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1e07740800 20 rados_obj.operate() r=0 bl.length=380 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1e07740800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1e07740800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1e07740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.610+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6ee830 con 0x7f1dfc0049a0 2024-09-07T03:33:38.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.611+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v36'9 uv8 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.612+0000 7f1cb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.612+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94612214202320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6e8560 con 0x560c9f6a08e0 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.614+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94612214202320] v36'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.614+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94612214181168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6e8560 con 0x560c9f6a4dc0 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.615+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94612214181168] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.615+0000 7f1e07740800 20 remove_watcher() i=0 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.615+0000 7f1e07740800 2 removed watcher, disabling cache 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.615+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94612214184016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6e8560 con 0x560c9f6a08e0 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.616+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94612214184016] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x560c9f6a08e0 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.616+0000 7f1e07740800 20 remove_watcher() i=1 2024-09-07T03:33:38.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.616+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94612214188096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6e8560 con 0x560c9f6a4dc0 2024-09-07T03:33:38.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.617+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94612214188096] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.617+0000 7f1e07740800 20 remove_watcher() i=2 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.617+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94612214190896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6e8560 con 0x7f1dfc0049a0 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.618+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94612214190896] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.618+0000 7f1e07740800 20 remove_watcher() i=3 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.618+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94612214193168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6e8560 con 0x560c9f6a4dc0 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.619+0000 7f1e03cc1640 1 -- 172.21.15.120:0/179659163 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94612214193168] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dfc03b070 con 0x560c9f6a4dc0 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.619+0000 7f1e07740800 20 remove_watcher() i=4 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.619+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94612214197200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6e8560 con 0x560c9f6a9e40 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.621+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94612214197200] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.621+0000 7f1e07740800 20 remove_watcher() i=5 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.621+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94612214198256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6e8560 con 0x560c9f6a9e40 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.622+0000 7f1e034c0640 1 -- 172.21.15.120:0/179659163 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94612214198256] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1df4091030 con 0x560c9f6a9e40 2024-09-07T03:33:38.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.622+0000 7f1e07740800 20 remove_watcher() i=6 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.622+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94612214200048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560c9f6e8560 con 0x7f1dfc0049a0 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.622+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94612214200048] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dec028040 con 0x7f1dfc0049a0 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.622+0000 7f1e07740800 20 remove_watcher() i=7 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f6a4dc0 msgr2=0x560c9f6a71b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f6a4dc0 0x560c9f6a71b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f6a08e0 msgr2=0x560c9f6a2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f6a08e0 0x560c9f6a2da0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1dfc0049a0 msgr2=0x7f1dfc020880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f1dfc0049a0 0x7f1dfc020880 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c9f6a9e40 msgr2=0x560c9f6ac270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x560c9f6a9e40 0x560c9f6ac270 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ccc03c6e0 msgr2=0x7f1ccc03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ccc03c6e0 0x7f1ccc03eba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1df4052fd0 tx=0x7f1df405df50 comp rx=0 tx=0).stop 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 msgr2=0x560c9f694e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1dfbfff640 1 -- 172.21.15.120:0/179659163 reap_dead start 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f694e80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00dd00 tx=0x7f1dfc053d90 comp rx=0 tx=0).stop 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 shutdown_connections 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/179659163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f68d7e0 0x560c9f694e80 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 >> 172.21.15.120:0/179659163 conn(0x560c9f689be0 msgr2=0x560c9f687df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 shutdown_connections 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/179659163 wait complete. 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/3715763232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c730 msgr2=0x7f1cdc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/3715763232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c730 0x7f1cdc03ebf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x560c9f66ddd0 tx=0x7f1df4096200 comp rx=0 tx=0).stop 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/3715763232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f680d40 msgr2=0x560c9f681160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/3715763232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f680d40 0x560c9f681160 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc016d20 tx=0x7f1dfc00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/3715763232 shutdown_connections 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/3715763232 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1cdc03c730 0x7f1cdc03ebf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 --2- 172.21.15.120:0/3715763232 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f680d40 0x560c9f681160 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/3715763232 >> 172.21.15.120:0/3715763232 conn(0x560c9f6750f0 msgr2=0x560c9f6754d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/3715763232 shutdown_connections 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.623+0000 7f1e07740800 1 -- 172.21.15.120:0/3715763232 wait complete. 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f66e610 msgr2=0x560c9f670a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f66e610 0x560c9f670a00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f56bde0 msgr2=0x560c9f66d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f56bde0 0x560c9f66d6e0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ce803c730 msgr2=0x7f1ce803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ce803c730 0x7f1ce803ebf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001d70 tx=0x7f1dec0012d0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 msgr2=0x560c9f666090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f666090 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1df4053d60 tx=0x7f1df4002fb0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 shutdown_connections 2024-09-07T03:33:38.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x560c9f66e610 0x560c9f670a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x560c9f56bde0 0x560c9f66d6e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f1ce803c730 0x7f1ce803ebf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 --2- 172.21.15.120:0/2768839596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x560c9f56b4a0 0x560c9f666090 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 >> 172.21.15.120:0/2768839596 conn(0x560c9f5671d0 msgr2=0x560c9f6589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 shutdown_connections 2024-09-07T03:33:38.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.624+0000 7f1e07740800 1 -- 172.21.15.120:0/2768839596 wait complete. 2024-09-07T03:33:38.633 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-07T03:33:38.638 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:33:38.639 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-07T03:33:38.643 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-07T03:33:38.643 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-07T03:33:38.643 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-07T03:33:38.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-07T03:33:38.643 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-07T03:33:38.688 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:38.689 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.688+0000 7f7420337800 1 Processor -- start 2024-09-07T03:33:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.688+0000 7f7420337800 1 -- start start 2024-09-07T03:33:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.688+0000 7f7420337800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b5c563e4f0 0x55b5c563e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.688+0000 7f7420337800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b5c54e9e40 con 0x55b5c563ee30 2024-09-07T03:33:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.688+0000 7f7420337800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b5c54b4680 con 0x55b5c563e4f0 2024-09-07T03:33:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.688+0000 7f741c021640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b5c563e4f0 0x55b5c563e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.688+0000 7f741c021640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b5c563e4f0 0x55b5c563e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36162/0 (socket says 172.21.15.120:36162) 2024-09-07T03:33:38.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.688+0000 7f741c021640 1 -- 172.21.15.120:0/2864792359 learned_addr learned my addr 172.21.15.120:0/2864792359 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.688+0000 7f7413fff640 1 --1- 172.21.15.120:0/2864792359 >> v1:172.21.15.104:6789/0 conn(0x55b5c563ee30 0x55b5c563f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:57284/0 (socket says 172.21.15.120:57284) 2024-09-07T03:33:38.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.689+0000 7f741c021640 1 -- 172.21.15.120:0/2864792359 >> v1:172.21.15.104:6789/0 conn(0x55b5c563ee30 legacy=0x55b5c563f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.689+0000 7f741c021640 1 -- 172.21.15.120:0/2864792359 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c54d06b0 con 0x55b5c563e4f0 2024-09-07T03:33:38.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.690+0000 7f741c021640 1 --2- 172.21.15.120:0/2864792359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563e4f0 0x55b5c563e8f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f740c00a520 tx=0x7f740c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8eeca8486ac18de server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f741b820640 1 -- 172.21.15.120:0/2864792359 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f740c055070 con 0x55b5c563e4f0 2024-09-07T03:33:38.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f741b820640 1 -- 172.21.15.120:0/2864792359 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c0515b0 con 0x55b5c563e4f0 2024-09-07T03:33:38.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f741b820640 1 -- 172.21.15.120:0/2864792359 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f740c0518d0 con 0x55b5c563e4f0 2024-09-07T03:33:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f7420337800 1 -- 172.21.15.120:0/2864792359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563e4f0 msgr2=0x55b5c563e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f7420337800 1 --2- 172.21.15.120:0/2864792359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563e4f0 0x55b5c563e8f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f740c00a520 tx=0x7f740c045ba0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f7420337800 1 -- 172.21.15.120:0/2864792359 shutdown_connections 2024-09-07T03:33:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f7420337800 1 --2- 172.21.15.120:0/2864792359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563e4f0 0x55b5c563e8f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f7420337800 1 -- 172.21.15.120:0/2864792359 >> 172.21.15.120:0/2864792359 conn(0x55b5c563a200 msgr2=0x55b5c563c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f7420337800 1 -- 172.21.15.120:0/2864792359 shutdown_connections 2024-09-07T03:33:38.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.691+0000 7f7420337800 1 -- 172.21.15.120:0/2864792359 wait complete. 2024-09-07T03:33:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.705+0000 7f7420337800 1 Processor -- start 2024-09-07T03:33:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.705+0000 7f7420337800 1 -- start start 2024-09-07T03:33:38.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.705+0000 7f7420337800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c5731980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.705+0000 7f7420337800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b5c54d8dd0 con 0x55b5c563ee30 2024-09-07T03:33:38.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.705+0000 7f741c021640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c5731980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.705+0000 7f741c021640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c5731980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36174/0 (socket says 172.21.15.120:36174) 2024-09-07T03:33:38.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.705+0000 7f741c021640 1 -- 172.21.15.120:0/2479972203 learned_addr learned my addr 172.21.15.120:0/2479972203 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.706+0000 7f741c021640 1 -- 172.21.15.120:0/2479972203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c54f1e10 con 0x55b5c563ee30 2024-09-07T03:33:38.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.706+0000 7f741c021640 1 --2- 172.21.15.120:0/2479972203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c5731980 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f740c046050 tx=0x7f740c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d44756dfde3a8a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.706+0000 7f730a60c640 1 -- 172.21.15.120:0/2479972203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f740c051910 con 0x55b5c563ee30 2024-09-07T03:33:38.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.706+0000 7f730a60c640 1 -- 172.21.15.120:0/2479972203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c051ab0 con 0x55b5c563ee30 2024-09-07T03:33:38.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.706+0000 7f730a60c640 1 -- 172.21.15.120:0/2479972203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f740c051db0 con 0x55b5c563ee30 2024-09-07T03:33:38.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 -- 172.21.15.120:0/2479972203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 msgr2=0x55b5c5731980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 --2- 172.21.15.120:0/2479972203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c5731980 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f740c046050 tx=0x7f740c051000 comp rx=0 tx=0).stop 2024-09-07T03:33:38.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 -- 172.21.15.120:0/2479972203 shutdown_connections 2024-09-07T03:33:38.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 --2- 172.21.15.120:0/2479972203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c5731980 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 -- 172.21.15.120:0/2479972203 >> 172.21.15.120:0/2479972203 conn(0x55b5c563a200 msgr2=0x55b5c572d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 -- 172.21.15.120:0/2479972203 shutdown_connections 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 -- 172.21.15.120:0/2479972203 wait complete. 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 Processor -- start 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 -- start start 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c57390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f7420337800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b5c563fd50 con 0x55b5c563ee30 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f741c021640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c57390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f741c021640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c57390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36190/0 (socket says 172.21.15.120:36190) 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.707+0000 7f741c021640 1 -- 172.21.15.120:0/2991135904 learned_addr learned my addr 172.21.15.120:0/2991135904 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.708+0000 7f741c021640 1 -- 172.21.15.120:0/2991135904 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c5739600 con 0x55b5c563ee30 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.708+0000 7f741c021640 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c57390a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f740c046050 tx=0x7f740c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.708+0000 7f7308e09640 1 -- 172.21.15.120:0/2991135904 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f740c073020 con 0x55b5c563ee30 2024-09-07T03:33:38.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.708+0000 7f7308e09640 1 -- 172.21.15.120:0/2991135904 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c06f450 con 0x55b5c563ee30 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.708+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5c5739890 con 0x55b5c563ee30 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.708+0000 7f7308e09640 1 -- 172.21.15.120:0/2991135904 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f740c06f730 con 0x55b5c563ee30 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.708+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5c573a4a0 con 0x55b5c563ee30 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.709+0000 7f7308e09640 1 -- 172.21.15.120:0/2991135904 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f740c076020 con 0x55b5c563ee30 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.709+0000 7f7308e09640 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f730403c730 0x7f730403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.709+0000 7f7308e09640 1 -- 172.21.15.120:0/2991135904 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f740c06b040 con 0x55b5c563ee30 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.709+0000 7f7413fff640 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f730403c730 0x7f730403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.709+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c573e6e0 0x55b5c5740ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.709+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5741010 con 0x55b5c573e6e0 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.709+0000 7f741c822640 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c573e6e0 0x55b5c5740ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.709+0000 7f7413fff640 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f730403c730 0x7f730403ebf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7404001e30 tx=0x7f7404001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.710+0000 7f741c822640 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c573e6e0 0x55b5c5740ad0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.710+0000 7f741c822640 1 -- 172.21.15.120:0/2991135904 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f741400a4d0 con 0x55b5c573e6e0 2024-09-07T03:33:38.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.710+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c57418c0 0x55b5c5743d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.710+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57444c0 con 0x55b5c57418c0 2024-09-07T03:33:38.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.710+0000 7f741c021640 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c57418c0 0x55b5c5743d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.710+0000 7f741c021640 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c57418c0 0x55b5c5743d50 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.711+0000 7f741c021640 1 -- 172.21.15.120:0/2991135904 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f740c057030 con 0x55b5c57418c0 2024-09-07T03:33:38.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.711+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5745d70 con 0x55b5c57418c0 2024-09-07T03:33:38.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.711+0000 7f741c021640 1 -- 172.21.15.120:0/2991135904 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f740c057030 con 0x55b5c57418c0 2024-09-07T03:33:38.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.711+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5744e80 con 0x55b5c57418c0 2024-09-07T03:33:38.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.711+0000 7f741c021640 1 -- 172.21.15.120:0/2991135904 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f740c057030 con 0x55b5c57418c0 2024-09-07T03:33:38.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.711+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57452a0 con 0x55b5c573e6e0 2024-09-07T03:33:38.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.712+0000 7f741c822640 1 -- 172.21.15.120:0/2991135904 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f741400a4d0 con 0x55b5c573e6e0 2024-09-07T03:33:38.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.712+0000 7f7420337800 1 Processor -- start 2024-09-07T03:33:38.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.712+0000 7f7420337800 1 -- start start 2024-09-07T03:33:38.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.712+0000 7f7420337800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5754220 0x55b5c5754640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.712+0000 7f7420337800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b5c5536a00 con 0x55b5c5754220 2024-09-07T03:33:38.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.712+0000 7f741c822640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5754220 0x55b5c5754640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.712+0000 7f741c822640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5754220 0x55b5c5754640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36204/0 (socket says 172.21.15.120:36204) 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.712+0000 7f741c822640 1 -- 172.21.15.120:0/2537927797 learned_addr learned my addr 172.21.15.120:0/2537927797 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.713+0000 7f741c822640 1 -- 172.21.15.120:0/2537927797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c5754c80 con 0x55b5c5754220 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.713+0000 7f741c822640 1 --2- 172.21.15.120:0/2537927797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5754220 0x55b5c5754640 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7414016d20 tx=0x7f741400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.713+0000 7f7301ffb640 1 -- 172.21.15.120:0/2537927797 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7414017660 con 0x55b5c5754220 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.713+0000 7f7301ffb640 1 -- 172.21.15.120:0/2537927797 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741401b030 con 0x55b5c5754220 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.713+0000 7f7420337800 1 -- 172.21.15.120:0/2537927797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5c57554b0 con 0x55b5c5754220 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.713+0000 7f7301ffb640 1 -- 172.21.15.120:0/2537927797 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7414017950 con 0x55b5c5754220 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.713+0000 7f7420337800 1 -- 172.21.15.120:0/2537927797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5c5755a50 con 0x55b5c5754220 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.714+0000 7f7301ffb640 1 -- 172.21.15.120:0/2537927797 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7414017af0 con 0x55b5c5754220 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.714+0000 7f7301ffb640 1 --2- 172.21.15.120:0/2537927797 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72f403c840 0x7f72f403ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.714+0000 7f7301ffb640 1 -- 172.21.15.120:0/2537927797 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f741400e040 con 0x55b5c5754220 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.714+0000 7f741c021640 1 --2- 172.21.15.120:0/2537927797 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72f403c840 0x7f72f403ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.714+0000 7f7420337800 1 Processor -- start 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.714+0000 7f7420337800 1 -- start start 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f741c021640 1 --2- 172.21.15.120:0/2537927797 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72f403c840 0x7f72f403ed00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55b5c57449a0 tx=0x7f740c05af90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f7420337800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f7420337800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b5c5732110 con 0x55b5c5760ce0 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f741c822640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f741c822640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36208/0 (socket says 172.21.15.120:36208) 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f741c822640 1 -- 172.21.15.120:0/2585275388 learned_addr learned my addr 172.21.15.120:0/2585275388 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f741c822640 1 -- 172.21.15.120:0/2585275388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c57616d0 con 0x55b5c5760ce0 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f741c822640 1 --2- 172.21.15.120:0/2585275388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57610e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7414054030 tx=0x7f7414054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fb4f2232259de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f72fb7fe640 1 -- 172.21.15.120:0/2585275388 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7414014e70 con 0x55b5c5760ce0 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f72fb7fe640 1 -- 172.21.15.120:0/2585275388 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74140149b0 con 0x55b5c5760ce0 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.715+0000 7f72fb7fe640 1 -- 172.21.15.120:0/2585275388 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7414028350 con 0x55b5c5760ce0 2024-09-07T03:33:38.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 -- 172.21.15.120:0/2585275388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 msgr2=0x55b5c57610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 --2- 172.21.15.120:0/2585275388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57610e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7414054030 tx=0x7f7414054060 comp rx=0 tx=0).stop 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 -- 172.21.15.120:0/2585275388 shutdown_connections 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 --2- 172.21.15.120:0/2585275388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57610e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 -- 172.21.15.120:0/2585275388 >> 172.21.15.120:0/2585275388 conn(0x55b5c575d0e0 msgr2=0x55b5c575b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 -- 172.21.15.120:0/2585275388 shutdown_connections 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 -- 172.21.15.120:0/2585275388 wait complete. 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 Processor -- start 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 -- start start 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57682b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f7420337800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b5c5761cc0 con 0x55b5c5760ce0 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f741c822640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f741c822640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36210/0 (socket says 172.21.15.120:36210) 2024-09-07T03:33:38.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.716+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 learned_addr learned my addr 172.21.15.120:0/431581936 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.717+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c5768810 con 0x55b5c5760ce0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.717+0000 7f741c822640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57682b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7414013550 tx=0x7f7414053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.717+0000 7f72f9ffb640 1 -- 172.21.15.120:0/431581936 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7414012570 con 0x55b5c5760ce0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.717+0000 7f72f9ffb640 1 -- 172.21.15.120:0/431581936 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74140129b0 con 0x55b5c5760ce0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.717+0000 7f72f9ffb640 1 -- 172.21.15.120:0/431581936 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7414028be0 con 0x55b5c5760ce0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.717+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5c5768aa0 con 0x55b5c5760ce0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.717+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5c5769630 con 0x55b5c5760ce0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.718+0000 7f72f9ffb640 1 -- 172.21.15.120:0/431581936 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7414012c90 con 0x55b5c5760ce0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.718+0000 7f72f9ffb640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72ec03c780 0x7f72ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.718+0000 7f72f9ffb640 1 -- 172.21.15.120:0/431581936 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f74140489a0 con 0x55b5c5760ce0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.718+0000 7f741c021640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72ec03c780 0x7f72ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.718+0000 7f741c021640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72ec03c780 0x7f72ec03ec40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f740c097b60 tx=0x7f740c088000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c5773db0 0x55b5c5776270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57769c0 con 0x55b5c5773db0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7413fff640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c5773db0 0x55b5c5776270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7413fff640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c5773db0 0x55b5c5776270 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7420337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7420337800 20 realm 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.719+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5773100 con 0x55b5c5773db0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7420337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7420337800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:38.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57774b0 con 0x55b5c5773db0 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7420337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c5778290 0x55b5c577a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577ad50 con 0x55b5c5778290 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f741c822640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c5778290 0x55b5c577a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.720+0000 7f741c822640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c5778290 0x55b5c577a680 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f7420337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577b5a0 con 0x55b5c5778290 2024-09-07T03:33:38.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f7420337800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f7420337800 20 searching for the correct realm 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b5c577d310 0x55b5c577f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c577d310 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f741c021640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b5c577d310 0x55b5c577f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.721+0000 7f741c021640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b5c577d310 0x55b5c577f740 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.722+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.722+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5778290 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.722+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.722+0000 7f741c822640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7414014440 0x7f7414055410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.722+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x7f7414014440 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.722+0000 7f7413fff640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7414014440 0x7f7414055410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.722+0000 7f7413fff640 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7414014440 0x7f7414055410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x7f7414014440 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5773db0 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5773db0 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c577d310 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5773db0 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.723+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5778290 2024-09-07T03:33:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.724+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.724+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5778290 2024-09-07T03:33:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.724+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.724+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5773db0 2024-09-07T03:33:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.724+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.724+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x7f7414014440 2024-09-07T03:33:38.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.725+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x7f7414014440 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.725+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5773db0 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.725+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.725+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x7f7414014440 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.725+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f740400f610 con 0x7f7414014440 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.725+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5778290 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.725+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.725+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c577d310 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.726+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.726+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5773db0 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.726+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.726+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5778290 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.726+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.726+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c577d310 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.726+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.727+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5773db0 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.727+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.727+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5773db0 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.727+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.727+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5773db0 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.727+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x55b5c5773db0 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.727+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c577d310 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.727+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.727+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x7f7414014440 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x7f7414014440 2024-09-07T03:33:38.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x7f7414014440 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x7f7414014440 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x7f7414014440 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x7f7414014440 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c577d310 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x7f7414014440 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740400f610 con 0x7f7414014440 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.728+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5778290 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.729+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.729+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5778290 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.729+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.729+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c577d310 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.729+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.729+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5778290 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577fe10 con 0x55b5c5778290 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577bef0 con 0x55b5c5773db0 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577bb30 con 0x55b5c5778290 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.730+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c577c330 con 0x55b5c5773db0 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 zone default found 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 4 Realm: () 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:38.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 zonegroup default 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5780740 con 0x7f7414014440 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5782980 con 0x55b5c577d310 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5782d20 con 0x55b5c577d310 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 started sync module instance, tier type = 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.731+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5781dc0 con 0x55b5c5778290 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.733+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.733+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94239190426384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5781dc0 con 0x55b5c5778290 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.733+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57836e0 con 0x55b5c5773db0 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.734+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.734+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94239190430256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5783fc0 con 0x55b5c5773db0 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.734+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94239190426384] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.734+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5784ab0 con 0x55b5c5778290 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.735+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94239190430256] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.735+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.735+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94239190435200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5784a70 con 0x55b5c5778290 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.735+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5785350 con 0x7f7414014440 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.736+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94239190435200] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.736+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.736+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94239190423824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5784a70 con 0x7f7414014440 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.736+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57859b0 con 0x55b5c5778290 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.737+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94239190423824] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.737+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.737+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94239190437456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5785970 con 0x55b5c5778290 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.737+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57863c0 con 0x55b5c577d310 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.738+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.738+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94239190441744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5786c10 con 0x55b5c577d310 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.738+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5787690 con 0x55b5c577d310 2024-09-07T03:33:38.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.739+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94239190437456] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.739+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94239190441744] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.740+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.740+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94239190446464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5786760 con 0x55b5c577d310 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.740+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5787f60 con 0x7f7414014440 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94239190446464] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94239190439104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5786760 con 0x7f7414014440 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f7420337800 20 add_watcher() i=0 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f7420337800 20 add_watcher() i=1 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f7420337800 20 add_watcher() i=2 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f7420337800 20 add_watcher() i=3 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f7420337800 20 add_watcher() i=4 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f7420337800 20 add_watcher() i=5 2024-09-07T03:33:38.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.741+0000 7f7420337800 20 add_watcher() i=6 2024-09-07T03:33:38.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.742+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94239190439104] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.742+0000 7f7420337800 20 add_watcher() i=7 2024-09-07T03:33:38.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.742+0000 7f7420337800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:38.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.742+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c578b050 con 0x55b5c5773db0 2024-09-07T03:33:38.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.743+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.743+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94239190448816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57885a0 con 0x55b5c5773db0 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.744+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94239190448816] v36'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.744+0000 7f72d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.744+0000 7f7420337800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.744+0000 7f7420337800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.744+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5793a20 con 0x55b5c5778290 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.746+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.746+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5793a20 con 0x7f7414014440 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.746+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.746+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5793a20 con 0x55b5c577d310 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.748+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.748+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794440 con 0x55b5c5773db0 2024-09-07T03:33:38.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.749+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'225 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.749+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57948c0 con 0x55b5c5778290 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.750+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'74 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.750+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57947f0 con 0x55b5c577d310 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.751+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'57 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.751+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794700 con 0x55b5c5778290 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.752+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'35 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.752+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57947c0 con 0x55b5c5773db0 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.753+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.753+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794be0 con 0x55b5c5778290 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.754+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.754+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794bc0 con 0x55b5c5778290 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.755+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.755+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794c70 con 0x55b5c5778290 2024-09-07T03:33:38.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.756+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'75 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.756+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794c40 con 0x55b5c577d310 2024-09-07T03:33:38.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.757+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.757+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794c40 con 0x55b5c5778290 2024-09-07T03:33:38.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.758+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.758+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794c40 con 0x55b5c5773db0 2024-09-07T03:33:38.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.759+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.759+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794c40 con 0x55b5c5773db0 2024-09-07T03:33:38.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.760+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'226 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.760+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794c40 con 0x55b5c5778290 2024-09-07T03:33:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.762+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.762+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794c40 con 0x55b5c5778290 2024-09-07T03:33:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.763+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'76 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.763+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794c40 con 0x55b5c577d310 2024-09-07T03:33:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.764+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.764+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c5778290 2024-09-07T03:33:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.765+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.765+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c5773db0 2024-09-07T03:33:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.766+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'227 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.766+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c5778290 2024-09-07T03:33:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.767+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.767+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c5778290 2024-09-07T03:33:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.768+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.768+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c577d310 2024-09-07T03:33:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.769+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.769+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c5778290 2024-09-07T03:33:38.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.770+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'44 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.770+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c577d310 2024-09-07T03:33:38.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.771+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.771+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c577d310 2024-09-07T03:33:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.772+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'58 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.772+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c577d310 2024-09-07T03:33:38.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.773+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.773+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794db0 con 0x55b5c5778290 2024-09-07T03:33:38.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.775+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.775+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c5773db0 2024-09-07T03:33:38.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.776+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.776+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794db0 con 0x55b5c5778290 2024-09-07T03:33:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.777+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'72 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.777+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794d70 con 0x55b5c5773db0 2024-09-07T03:33:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.780+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.780+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5794db0 con 0x7f7414014440 2024-09-07T03:33:38.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.781+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.781+0000 7f72d17e2640 20 reqs_thread_entry: start 2024-09-07T03:33:38.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.781+0000 7f7420337800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:38.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.781+0000 7f7420337800 20 Filter name: none 2024-09-07T03:33:38.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.781+0000 7f7242ffd640 20 reqs_thread_entry: start 2024-09-07T03:33:38.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.781+0000 7f7420337800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-07T03:33:38.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.781+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.781+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57bfcd0 con 0x7f7414014440 2024-09-07T03:33:38.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f7420337800 20 rados_obj.operate() r=0 bl.length=380 2024-09-07T03:33:38.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f7420337800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-07T03:33:38.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f7420337800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-07T03:33:38.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f7420337800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:33:38.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c22c0 con 0x55b5c5778290 2024-09-07T03:33:38.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f7420337800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 : miss 2024-09-07T03:33:38.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.782+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:96 8.e 8:77f8e929:root::.bucket.meta.myfoo6%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c26e0 con 0x7f7414014440 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(96 .bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv6 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7420337800 20 rados_obj.operate() r=0 bl.length=388 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7420337800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 info.flags=0x17 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7420337800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 to cache LRU end 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7420337800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7420337800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7420337800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:97 4.1b 4:da40954c:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f8a0 con 0x7f7414014440 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(97 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.783+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:98 4.29 4:972561a8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f8a0 con 0x55b5c577d310 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.784+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(98 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.784+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:99 4.13 4:cba80643:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f8a0 con 0x7f7414014440 2024-09-07T03:33:38.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.784+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(99 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.784+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:100 4.2c 4:34339c66:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f900 con 0x55b5c5773db0 2024-09-07T03:33:38.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.784+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(100 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.784+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:101 4.28 4:1626f919:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f900 con 0x55b5c5778290 2024-09-07T03:33:38.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.785+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(101 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.785+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:102 4.12 4:4b87693e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f900 con 0x55b5c5773db0 2024-09-07T03:33:38.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.785+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(102 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.785+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:103 4.12 4:49013094:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f900 con 0x55b5c5773db0 2024-09-07T03:33:38.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.785+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(103 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.785+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:104 4.2f 4:f4518968:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f8c0 con 0x55b5c5773db0 2024-09-07T03:33:38.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.785+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(104 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.786+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:105 4.16 4:693b3a84:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f8c0 con 0x55b5c577d310 2024-09-07T03:33:38.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.786+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(105 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.786+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:106 4.1b 4:d90d13aa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f8c0 con 0x7f7414014440 2024-09-07T03:33:38.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.786+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(106 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 [call out=349b] v0'0 uv8 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.786+0000 7f7420337800 10 cls_bucket_list_unordered: got thirteen 2024-09-07T03:33:38.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.786+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:107 4.32 4:4d937eb2:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c583f8c0 con 0x55b5c5778290 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(107 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f7420337800 20 get_obj_state: octx=0x7f740400f590 obj=myfoo6:thirteen state=0x55b5c57c3318 s->prefetch_data=0 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 3.14s0 3:2b63b4d3:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c4140 con 0x55b5c5778290 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(108 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f7420337800 10 manifest: total_size = 8 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f7420337800 20 get_obj_state: setting s->obj_tag to _uTs05fOPDSRbzEzWYeDv7a4rTg1Gd0w 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f7420337800 20 get_obj_state: octx=0x7f740400f590 obj=myfoo6:thirteen state=0x55b5c57c3318 s->prefetch_data=0 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f7420337800 20 prepare_atomic_modification: state is not atomic. state=0x55b5c57c3318 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f7420337800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.787+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:109 4.1b 4:d90d13aa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8a40 con 0x7f7414014440 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.788+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(109 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 [stat,call,call] v36'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.788+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:110 3.14s0 3:2b63b4d3:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c6a20 con 0x55b5c5778290 2024-09-07T03:33:38.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.789+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(110 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9_thirteen [call] v36'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.789+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:111 4.1b 4:d90d13aa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8980 con 0x7f7414014440 2024-09-07T03:33:38.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.789+0000 7f7420337800 20 list_objects_ordered: starting attempt 1 2024-09-07T03:33:38.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.789+0000 7f7420337800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-07T03:33:38.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.789+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:112 4.1b 4:da40954c:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8980 con 0x7f7414014440 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:113 4.29 4:972561a8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8980 con 0x55b5c577d310 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:114 4.13 4:cba80643:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8980 con 0x7f7414014440 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:115 4.2c 4:34339c66:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57d1d80 con 0x55b5c5773db0 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:116 4.28 4:1626f919:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57d4690 con 0x55b5c5778290 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:117 4.12 4:4b87693e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57d6ff0 con 0x55b5c5773db0 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:118 4.12 4:49013094:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57d9950 con 0x55b5c5773db0 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:119 4.2f 4:f4518968:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57dc2e0 con 0x55b5c5773db0 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(113 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(116 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(115 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:120 4.16 4:693b3a84:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57caf10 con 0x55b5c577d310 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:121 4.1b 4:d90d13aa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cc7b0 con 0x7f7414014440 2024-09-07T03:33:38.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.790+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:122 4.32 4:4d937eb2:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57de7c0 con 0x55b5c5778290 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(120 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(117 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 32 ==== osd_op_reply(118 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 33 ==== osd_op_reply(119 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(122 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7414027070 con 0x55b5c5778290 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(112 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 22 ==== osd_op_reply(114 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 23 ==== osd_op_reply(111 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 [stat,call,call] v36'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f72faffd640 20 handle_completion(): completion ok for obj=thirteen 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 24 ==== osd_op_reply(121 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 [call out=128b] v0'0 uv11 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-07T03:33:38.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9])"; uploads.size()=0; is_truncated=0 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:123 4.1b 4:da40954c:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57caa60 con 0x7f7414014440 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:124 4.29 4:972561a8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cc300 con 0x55b5c577d310 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:125 4.13 4:cba80643:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57de7c0 con 0x7f7414014440 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:126 4.2c 4:34339c66:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cc730 con 0x55b5c5773db0 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:127 4.28 4:1626f919:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cc300 con 0x55b5c5778290 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:128 4.12 4:4b87693e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57dac20 con 0x55b5c5773db0 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:129 4.12 4:49013094:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57de7c0 con 0x55b5c5773db0 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:130 4.2f 4:f4518968:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57dbfd0 con 0x55b5c5773db0 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:131 4.16 4:693b3a84:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cc300 con 0x55b5c577d310 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:132 4.1b 4:d90d13aa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57d17e0 con 0x7f7414014440 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:133 4.32 4:4d937eb2:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57e11a0 con 0x55b5c5778290 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.791+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 25 ==== osd_op_reply(123 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== osd_op_reply(127 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(124 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(131 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 26 ==== osd_op_reply(125 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(133 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 34 ==== osd_op_reply(126 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 35 ==== osd_op_reply(128 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 27 ==== osd_op_reply(132 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 [call out=128b] v0'0 uv11 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 36 ==== osd_op_reply(129 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 37 ==== osd_op_reply(130 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.792+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c9a50 con 0x55b5c5778290 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.793+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(134 bud.buckets [call] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.793+0000 7f7420337800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-07T03:33:38.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.793+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.793+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cb2b0 con 0x55b5c5773db0 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.793+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 38 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.793+0000 7f7420337800 20 rados_obj.operate() r=0 bl.length=166 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.793+0000 7f7420337800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.793+0000 7f7420337800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.793+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57de7a0 con 0x55b5c5773db0 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.794+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 39 ==== osd_op_reply(136 myfoo6 [call,call,delete] v36'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.794+0000 7f7420337800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.794+0000 7f7420337800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.794+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94239190715584 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c9f00 con 0x7f7414014440 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.795+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 28 ==== watch-notify(notify (1) cookie 94239190423824 notify 154618822687 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55b5c57c1560 con 0x7f7414014440 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.795+0000 7f72fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822687 cookie 94239190423824 notifier 4750 bl.length()=150 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.795+0000 7f72fb7fe640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f72e0003d60 con 0x7f7414014440 2024-09-07T03:33:38.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.795+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 29 ==== osd_op_reply(137 notify.3 [notify cookie 94239190715584 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.795+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.795+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 31 ==== watch-notify(notify_complete (2) cookie 94239190715584 notify 154618822687 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b5c5793dc0 con 0x7f7414014440 2024-09-07T03:33:38.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.795+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:139 8.e 8:77f8e929:root::.bucket.meta.myfoo6%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8cc0 con 0x7f7414014440 2024-09-07T03:33:38.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 32 ==== osd_op_reply(139 .bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 [call,call,delete] v36'10 uv10 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7420337800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 from cache 2024-09-07T03:33:38.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7420337800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9, ofs0, ns] 2024-09-07T03:33:38.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94239190725296 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8cc0 con 0x55b5c577d310 2024-09-07T03:33:38.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== watch-notify(notify (1) cookie 94239190446464 notify 154618822684 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55b5c578d330 con 0x55b5c577d310 2024-09-07T03:33:38.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f72faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 94239190446464 notifier 4750 bl.length()=207 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f72faffd640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f72500032c0 con 0x55b5c577d310 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(140 notify.6 [notify cookie 94239190725296 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== watch-notify(notify_complete (2) cookie 94239190725296 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b5c578d160 con 0x55b5c577d310 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:142 4.1b 4:da40954c:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8cc0 con 0x7f7414014440 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:143 4.29 4:972561a8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c0d50 con 0x55b5c577d310 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:144 4.13 4:cba80643:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cb760 con 0x7f7414014440 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:145 4.2c 4:34339c66:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8cc0 con 0x55b5c5773db0 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:146 4.28 4:1626f919:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c0d50 con 0x55b5c5778290 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.797+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:147 4.12 4:4b87693e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cbff0 con 0x55b5c5773db0 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.798+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:148 4.12 4:49013094:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cb760 con 0x55b5c5773db0 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.798+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:149 4.2f 4:f4518968:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cbff0 con 0x55b5c5773db0 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.798+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:150 4.16 4:693b3a84:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c0d50 con 0x55b5c577d310 2024-09-07T03:33:38.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.798+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:151 4.1b 4:d90d13aa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c8cc0 con 0x7f7414014440 2024-09-07T03:33:38.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.798+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:152 4.32 4:4d937eb2:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cb760 con 0x55b5c5778290 2024-09-07T03:33:38.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.799+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 33 ==== osd_op_reply(144 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.2 [delete] v36'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.799+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 40 ==== osd_op_reply(145 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.3 [delete] v36'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.799+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(146 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.4 [delete] v36'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.799+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== osd_op_reply(143 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.1 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.799+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 34 ==== osd_op_reply(142 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.0 [delete] v36'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.800+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 41 ==== osd_op_reply(147 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.5 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 42 ==== osd_op_reply(148 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.6 [delete] v36'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 35 ==== osd_op_reply(151 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.9 [delete] v36'13 uv13 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 45 ==== osd_op_reply(152 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.10 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 43 ==== osd_op_reply(149 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.7 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 33 ==== osd_op_reply(150 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9.8 [delete] v36'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7420337800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 : miss 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7420337800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:153 6.0 6:06bd5b2e:::pubsub..bucket.myfoo6%2fcf0fab6f-a978-4ce5-bacd-166891c31743.4225.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cbff0 con 0x55b5c5773db0 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 44 ==== osd_op_reply(153 pubsub..bucket.myfoo6/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7420337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7420337800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 info.flags=0x0 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7420337800 10 adding default.rgw.log++pubsub..bucket.myfoo6/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 to cache LRU end 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.801+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:154 6.0 6:06bd5b2e:::pubsub..bucket.myfoo6%2fcf0fab6f-a978-4ce5-bacd-166891c31743.4225.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c03f0 con 0x55b5c5773db0 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.802+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 45 ==== osd_op_reply(154 pubsub..bucket.myfoo6/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.9 [delete] v36'65 uv54 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.802+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c9a50 con 0x55b5c5778290 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.803+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 46 ==== osd_op_reply(155 bud.buckets [call] v36'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.803+0000 7f7420337800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.803+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cb260 con 0x55b5c5773db0 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 46 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v36'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f7420337800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94239190715584 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c26e0 con 0x55b5c577d310 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 34 ==== watch-notify(notify (1) cookie 94239190441744 notify 154618822685 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b5c578d160 con 0x55b5c577d310 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f72fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94239190441744 notifier 4750 bl.length()=170 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f72fb7fe640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f72e0003d60 con 0x55b5c577d310 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 35 ==== osd_op_reply(157 notify.5 [notify cookie 94239190715584 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 36 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 37 ==== watch-notify(notify_complete (2) cookie 94239190715584 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b5c573a4a0 con 0x55b5c577d310 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f7420337800 10 removing email index: 2024-09-07T03:33:38.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f7420337800 10 removing user buckets index 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.805+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57cb260 con 0x55b5c5778290 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.806+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 47 ==== osd_op_reply(159 bud.buckets [delete] v36'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.806+0000 7f7420337800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.806+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94239190715584 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57bfd80 con 0x55b5c577d310 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.807+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 38 ==== watch-notify(notify (1) cookie 94239190446464 notify 154618822686 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55b5c573a4a0 con 0x55b5c577d310 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.807+0000 7f72faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822686 cookie 94239190446464 notifier 4750 bl.length()=160 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.807+0000 7f72faffd640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f72500032c0 con 0x55b5c577d310 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.807+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 39 ==== osd_op_reply(160 notify.6 [notify cookie 94239190715584 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.807+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 40 ==== watch-notify(notify_complete (2) cookie 94239190715584 notify 154618822686 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b5c5739890 con 0x55b5c577d310 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.807+0000 7f7420337800 10 removing user index: bud 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.807+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 41 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.807+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c0d90 con 0x7f7414014440 2024-09-07T03:33:38.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.808+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 36 ==== osd_op_reply(162 bud [call,call,delete] v36'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.808+0000 7f7420337800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.808+0000 7f7420337800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.808+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94239190715584 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57c9f00 con 0x55b5c577d310 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.808+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 42 ==== watch-notify(notify (1) cookie 94239190441744 notify 154618822687 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55b5c5739890 con 0x55b5c577d310 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.808+0000 7f72fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822687 cookie 94239190441744 notifier 4750 bl.length()=152 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.808+0000 7f72fb7fe640 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f72e0003d60 con 0x55b5c577d310 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.808+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 43 ==== osd_op_reply(163 notify.5 [notify cookie 94239190715584 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.809+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 44 ==== watch-notify(notify_complete (2) cookie 94239190715584 notify 154618822687 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b5c5739600 con 0x55b5c577d310 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.809+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.809+0000 7f72d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.810+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94239190448816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5792e90 con 0x55b5c5773db0 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.811+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 47 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94239190448816] v36'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.811+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94239190426384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5787ab0 con 0x55b5c5778290 2024-09-07T03:33:38.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.812+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 48 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94239190426384] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.812+0000 7f7420337800 20 remove_watcher() i=0 2024-09-07T03:33:38.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.812+0000 7f7420337800 2 removed watcher, disabling cache 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.812+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94239190430256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5782310 con 0x55b5c5773db0 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.813+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.1 v2:172.21.15.120:6808/3372043485 48 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94239190430256] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x55b5c5773db0 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.813+0000 7f7420337800 20 remove_watcher() i=1 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.813+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94239190435200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c57822f0 con 0x55b5c5778290 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.814+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 49 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94239190435200] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.814+0000 7f7420337800 20 remove_watcher() i=2 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.814+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94239190423824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5784580 con 0x7f7414014440 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.815+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 37 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94239190423824] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.815+0000 7f7420337800 20 remove_watcher() i=3 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.815+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94239190437456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5784580 con 0x55b5c5778290 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.816+0000 7f741c822640 1 -- 172.21.15.120:0/431581936 <== osd.0 v2:172.21.15.104:6800/182397107 50 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94239190437456] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741407b070 con 0x55b5c5778290 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.816+0000 7f7420337800 20 remove_watcher() i=4 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.816+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94239190441744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5784580 con 0x55b5c577d310 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.817+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 46 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94239190441744] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.817+0000 7f7420337800 20 remove_watcher() i=5 2024-09-07T03:33:38.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.817+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94239190446464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5784580 con 0x55b5c577d310 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.818+0000 7f741c021640 1 -- 172.21.15.120:0/431581936 <== osd.3 v2:172.21.15.120:6800/1193158925 47 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94239190446464] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740c089030 con 0x55b5c577d310 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.818+0000 7f7420337800 20 remove_watcher() i=6 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.818+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94239190439104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b5c5784580 con 0x7f7414014440 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 <== osd.2 v2:172.21.15.120:6809/3781833098 38 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94239190439104] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f740403c040 con 0x7f7414014440 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 20 remove_watcher() i=7 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c5778290 msgr2=0x55b5c577a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c5778290 0x55b5c577a680 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c5773db0 msgr2=0x55b5c5776270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c5773db0 0x55b5c5776270 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7414014440 msgr2=0x7f7414055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f7414014440 0x7f7414055410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b5c577d310 msgr2=0x55b5c577f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b5c577d310 0x55b5c577f740 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72ec03c780 msgr2=0x7f72ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72ec03c780 0x7f72ec03ec40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f740c097b60 tx=0x7f740c088000 comp rx=0 tx=0).stop 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 msgr2=0x55b5c57682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7413fff640 1 -- 172.21.15.120:0/431581936 reap_dead start 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57682b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7414013550 tx=0x7f7414053d40 comp rx=0 tx=0).stop 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 shutdown_connections 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 --2- 172.21.15.120:0/431581936 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5760ce0 0x55b5c57682b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 >> 172.21.15.120:0/431581936 conn(0x55b5c575d0e0 msgr2=0x55b5c575b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 shutdown_connections 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.819+0000 7f7420337800 1 -- 172.21.15.120:0/431581936 wait complete. 2024-09-07T03:33:38.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2537927797 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72f403c840 msgr2=0x7f72f403ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2537927797 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72f403c840 0x7f72f403ed00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55b5c57449a0 tx=0x7f740c05af90 comp rx=0 tx=0).stop 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2537927797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5754220 msgr2=0x55b5c5754640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2537927797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5754220 0x55b5c5754640 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7414016d20 tx=0x7f741400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2537927797 shutdown_connections 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2537927797 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f72f403c840 0x7f72f403ed00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2537927797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c5754220 0x55b5c5754640 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2537927797 >> 172.21.15.120:0/2537927797 conn(0x55b5c57485d0 msgr2=0x55b5c57489b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2537927797 shutdown_connections 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2537927797 wait complete. 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c57418c0 msgr2=0x55b5c5743d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c57418c0 0x55b5c5743d50 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c573e6e0 msgr2=0x55b5c5740ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c573e6e0 0x55b5c5740ad0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f730403c730 msgr2=0x7f730403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f730403c730 0x7f730403ebf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7404001e30 tx=0x7f7404001390 comp rx=0 tx=0).stop 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 msgr2=0x55b5c57390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c57390a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f740c046050 tx=0x7f740c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 shutdown_connections 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b5c57418c0 0x55b5c5743d50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b5c573e6e0 0x55b5c5740ad0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f730403c730 0x7f730403ebf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 --2- 172.21.15.120:0/2991135904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b5c563ee30 0x55b5c57390a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 >> 172.21.15.120:0/2991135904 conn(0x55b5c563a200 msgr2=0x55b5c572ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 shutdown_connections 2024-09-07T03:33:38.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.820+0000 7f7420337800 1 -- 172.21.15.120:0/2991135904 wait complete. 2024-09-07T03:33:38.830 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-07T03:33:38.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-07T03:33:38.830 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-07T03:33:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:33:38.876 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:33:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.875+0000 7f3101519800 1 Processor -- start 2024-09-07T03:33:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.875+0000 7f3101519800 1 -- start start 2024-09-07T03:33:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.876+0000 7f3101519800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d46b1be240 0x55d46b1c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.876+0000 7f3101519800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d46b063e40 con 0x55d46b1ba730 2024-09-07T03:33:38.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.876+0000 7f3101519800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d46b02e680 con 0x55d46b1be240 2024-09-07T03:33:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.876+0000 7f30f6802640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d46b1be240 0x55d46b1c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.876+0000 7f30f6802640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d46b1be240 0x55d46b1c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36220/0 (socket says 172.21.15.120:36220) 2024-09-07T03:33:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.876+0000 7f30f6802640 1 -- 172.21.15.120:0/2874599852 learned_addr learned my addr 172.21.15.120:0/2874599852 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.876+0000 7f30ff003640 1 --1- 172.21.15.120:0/2874599852 >> v1:172.21.15.104:6789/0 conn(0x55d46b1ba730 0x55d46b1bcb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:57294/0 (socket says 172.21.15.120:57294) 2024-09-07T03:33:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.876+0000 7f30f6802640 1 -- 172.21.15.120:0/2874599852 >> v1:172.21.15.104:6789/0 conn(0x55d46b1ba730 legacy=0x55d46b1bcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.876+0000 7f30f6802640 1 -- 172.21.15.120:0/2874599852 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b04a6b0 con 0x55d46b1be240 2024-09-07T03:33:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.878+0000 7f30f6802640 1 --2- 172.21.15.120:0/2874599852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1be240 0x55d46b1c06d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f30e800a520 tx=0x7f30e8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae6c1ae9bd3567e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.878+0000 7f30fe802640 1 -- 172.21.15.120:0/2874599852 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30e8055070 con 0x55d46b1be240 2024-09-07T03:33:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.878+0000 7f30fe802640 1 -- 172.21.15.120:0/2874599852 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e80515b0 con 0x55d46b1be240 2024-09-07T03:33:38.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.878+0000 7f30fe802640 1 -- 172.21.15.120:0/2874599852 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30e80518d0 con 0x55d46b1be240 2024-09-07T03:33:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.879+0000 7f3101519800 1 -- 172.21.15.120:0/2874599852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1be240 msgr2=0x55d46b1c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.879+0000 7f3101519800 1 --2- 172.21.15.120:0/2874599852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1be240 0x55d46b1c06d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f30e800a520 tx=0x7f30e8045ba0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.879+0000 7f3101519800 1 -- 172.21.15.120:0/2874599852 shutdown_connections 2024-09-07T03:33:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.879+0000 7f3101519800 1 --2- 172.21.15.120:0/2874599852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1be240 0x55d46b1c06d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.879+0000 7f3101519800 1 -- 172.21.15.120:0/2874599852 >> 172.21.15.120:0/2874599852 conn(0x55d46b1b41d0 msgr2=0x55d46b1b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.879+0000 7f3101519800 1 -- 172.21.15.120:0/2874599852 shutdown_connections 2024-09-07T03:33:38.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.879+0000 7f3101519800 1 -- 172.21.15.120:0/2874599852 wait complete. 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.892+0000 7f3101519800 1 Processor -- start 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.893+0000 7f3101519800 1 -- start start 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.893+0000 7f3101519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b1b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.893+0000 7f3101519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d46b052dd0 con 0x55d46b1ba730 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.893+0000 7f30ff003640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b1b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.893+0000 7f30ff003640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b1b9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36234/0 (socket says 172.21.15.120:36234) 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.893+0000 7f30ff003640 1 -- 172.21.15.120:0/3809164243 learned_addr learned my addr 172.21.15.120:0/3809164243 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.893+0000 7f30ff003640 1 -- 172.21.15.120:0/3809164243 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b06be10 con 0x55d46b1ba730 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.893+0000 7f30ff003640 1 --2- 172.21.15.120:0/3809164243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b1b9ea0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001eb0 tx=0x7f30f000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8882c2c85f7b3f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.893+0000 7f2fec608640 1 -- 172.21.15.120:0/3809164243 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f000e5c0 con 0x55d46b1ba730 2024-09-07T03:33:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.894+0000 7f2fec608640 1 -- 172.21.15.120:0/3809164243 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0006070 con 0x55d46b1ba730 2024-09-07T03:33:38.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.894+0000 7f2fec608640 1 -- 172.21.15.120:0/3809164243 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f000e8b0 con 0x55d46b1ba730 2024-09-07T03:33:38.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.894+0000 7f3101519800 1 -- 172.21.15.120:0/3809164243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 msgr2=0x55d46b1b9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.894+0000 7f3101519800 1 --2- 172.21.15.120:0/3809164243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b1b9ea0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001eb0 tx=0x7f30f000b6c0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.894+0000 7f3101519800 1 -- 172.21.15.120:0/3809164243 shutdown_connections 2024-09-07T03:33:38.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.894+0000 7f3101519800 1 --2- 172.21.15.120:0/3809164243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b1b9ea0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.894+0000 7f3101519800 1 -- 172.21.15.120:0/3809164243 >> 172.21.15.120:0/3809164243 conn(0x55d46b1b41d0 msgr2=0x55d46b2a5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.894+0000 7f3101519800 1 -- 172.21.15.120:0/3809164243 shutdown_connections 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.894+0000 7f3101519800 1 -- 172.21.15.120:0/3809164243 wait complete. 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f3101519800 1 Processor -- start 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f3101519800 1 -- start start 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f3101519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b2b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f3101519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d46b1c1050 con 0x55d46b1ba730 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f30ff003640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b2b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f30ff003640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b2b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36240/0 (socket says 172.21.15.120:36240) 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f30ff003640 1 -- 172.21.15.120:0/3322888067 learned_addr learned my addr 172.21.15.120:0/3322888067 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f30ff003640 1 -- 172.21.15.120:0/3322888067 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b2b3750 con 0x55d46b1ba730 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f30ff003640 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b2b31f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x55d46b1b99d0 tx=0x7f30f0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f2feae05640 1 -- 172.21.15.120:0/3322888067 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f001a7c0 con 0x55d46b1ba730 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f2feae05640 1 -- 172.21.15.120:0/3322888067 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f001a960 con 0x55d46b1ba730 2024-09-07T03:33:38.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d46b2b39e0 con 0x55d46b1ba730 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.895+0000 7f2feae05640 1 -- 172.21.15.120:0/3322888067 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f001ac40 con 0x55d46b1ba730 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.896+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d46b2b43e0 con 0x55d46b1ba730 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.896+0000 7f2feae05640 1 -- 172.21.15.120:0/3322888067 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f30f0017070 con 0x55d46b1ba730 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.897+0000 7f2feae05640 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fe403c730 0x7f2fe403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.897+0000 7f2feae05640 1 -- 172.21.15.120:0/3322888067 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f30f0015020 con 0x55d46b1ba730 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.897+0000 7f30f6802640 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fe403c730 0x7f2fe403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.897+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b1be240 0x55d46b2ba840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.897+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2bad80 con 0x55d46b1be240 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.897+0000 7f30ff804640 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b1be240 0x55d46b2ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.897+0000 7f30f6802640 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fe403c730 0x7f2fe403ebf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f30e8057000 tx=0x7f30e8052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.897+0000 7f30ff804640 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b1be240 0x55d46b2ba840 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.898+0000 7f30ff804640 1 -- 172.21.15.120:0/3322888067 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30f800a4d0 con 0x55d46b1be240 2024-09-07T03:33:38.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.898+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2bb680 0x55d46b2bdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.898+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2be290 con 0x55d46b2bb680 2024-09-07T03:33:38.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.898+0000 7f30ff003640 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2bb680 0x55d46b2bdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.898+0000 7f30ff003640 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2bb680 0x55d46b2bdb20 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.898+0000 7f30ff003640 1 -- 172.21.15.120:0/3322888067 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2bb680 2024-09-07T03:33:38.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.898+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2bfb40 con 0x55d46b2bb680 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.899+0000 7f30ff003640 1 -- 172.21.15.120:0/3322888067 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2bb680 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.899+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2bec80 con 0x55d46b2bb680 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.899+0000 7f30ff003640 1 -- 172.21.15.120:0/3322888067 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2bb680 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.899+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2bf0e0 con 0x55d46b1be240 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.900+0000 7f30ff804640 1 -- 172.21.15.120:0/3322888067 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f30f800a4d0 con 0x55d46b1be240 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.900+0000 7f3101519800 1 Processor -- start 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.900+0000 7f3101519800 1 -- start start 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.900+0000 7f3101519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2ce030 0x55d46b2ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.900+0000 7f3101519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d46b0b0a00 con 0x55d46b2ce030 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.900+0000 7f30ff804640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2ce030 0x55d46b2ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.900+0000 7f30ff804640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2ce030 0x55d46b2ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36246/0 (socket says 172.21.15.120:36246) 2024-09-07T03:33:38.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.900+0000 7f30ff804640 1 -- 172.21.15.120:0/2516652442 learned_addr learned my addr 172.21.15.120:0/2516652442 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.901+0000 7f30ff804640 1 -- 172.21.15.120:0/2516652442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b2cea90 con 0x55d46b2ce030 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.901+0000 7f30ff804640 1 --2- 172.21.15.120:0/2516652442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2ce030 0x55d46b2ce450 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f30f8016d20 tx=0x7f30f800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.901+0000 7f2fe3fff640 1 -- 172.21.15.120:0/2516652442 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8017660 con 0x55d46b2ce030 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.901+0000 7f2fe3fff640 1 -- 172.21.15.120:0/2516652442 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f801b030 con 0x55d46b2ce030 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.901+0000 7f2fe3fff640 1 -- 172.21.15.120:0/2516652442 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8017950 con 0x55d46b2ce030 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.901+0000 7f3101519800 1 -- 172.21.15.120:0/2516652442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d46b2cf2c0 con 0x55d46b2ce030 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.901+0000 7f3101519800 1 -- 172.21.15.120:0/2516652442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d46b2cf860 con 0x55d46b2ce030 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.902+0000 7f2fe3fff640 1 -- 172.21.15.120:0/2516652442 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f30f8017b40 con 0x55d46b2ce030 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.902+0000 7f2fe3fff640 1 --2- 172.21.15.120:0/2516652442 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fd803c730 0x7f2fd803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.902+0000 7f2fe3fff640 1 -- 172.21.15.120:0/2516652442 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f30f800e040 con 0x55d46b2ce030 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.902+0000 7f30ff003640 1 --2- 172.21.15.120:0/2516652442 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fd803c730 0x7f2fd803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.902+0000 7f3101519800 1 Processor -- start 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.902+0000 7f30ff003640 1 --2- 172.21.15.120:0/2516652442 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fd803c730 0x7f2fd803ebf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55d46b2b4930 tx=0x7f30f0046040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.902+0000 7f3101519800 1 -- start start 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f3101519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f3101519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d46b1b8740 con 0x55d46b2daab0 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f30ff804640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f30ff804640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2daeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36250/0 (socket says 172.21.15.120:36250) 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f30ff804640 1 -- 172.21.15.120:0/2039737941 learned_addr learned my addr 172.21.15.120:0/2039737941 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f30ff804640 1 -- 172.21.15.120:0/2039737941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b2db4a0 con 0x55d46b2daab0 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f30ff804640 1 --2- 172.21.15.120:0/2039737941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2daeb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f30f8013450 tx=0x7f30f8053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c97c5190dcf344 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f2fe1ffb640 1 -- 172.21.15.120:0/2039737941 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8014a00 con 0x55d46b2daab0 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f2fe1ffb640 1 -- 172.21.15.120:0/2039737941 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f8051070 con 0x55d46b2daab0 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.903+0000 7f2fe1ffb640 1 -- 172.21.15.120:0/2039737941 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8028350 con 0x55d46b2daab0 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 -- 172.21.15.120:0/2039737941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 msgr2=0x55d46b2daeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 --2- 172.21.15.120:0/2039737941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2daeb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f30f8013450 tx=0x7f30f8053f40 comp rx=0 tx=0).stop 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 -- 172.21.15.120:0/2039737941 shutdown_connections 2024-09-07T03:33:38.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 --2- 172.21.15.120:0/2039737941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2daeb0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 -- 172.21.15.120:0/2039737941 >> 172.21.15.120:0/2039737941 conn(0x55d46b2d6eb0 msgr2=0x55d46b2d50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 -- 172.21.15.120:0/2039737941 shutdown_connections 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 -- 172.21.15.120:0/2039737941 wait complete. 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 Processor -- start 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 -- start start 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2e2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f3101519800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d46b2dbac0 con 0x55d46b2daab0 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f30ff804640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2e2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f30ff804640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2e2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:36266/0 (socket says 172.21.15.120:36266) 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.904+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 learned_addr learned my addr 172.21.15.120:0/1167552166 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.905+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46b2e26b0 con 0x55d46b2daab0 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.905+0000 7f30ff804640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2e2150 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f30f800dd00 tx=0x7f30f8053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.905+0000 7f2fcffff640 1 -- 172.21.15.120:0/1167552166 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8005030 con 0x55d46b2daab0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.905+0000 7f2fcffff640 1 -- 172.21.15.120:0/1167552166 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f80051d0 con 0x55d46b2daab0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.905+0000 7f2fcffff640 1 -- 172.21.15.120:0/1167552166 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f80054d0 con 0x55d46b2daab0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.905+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d46b2e2940 con 0x55d46b2daab0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.905+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d46b2e32c0 con 0x55d46b2daab0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.905+0000 7f2fcffff640 1 -- 172.21.15.120:0/1167552166 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f30f80127a0 con 0x55d46b2daab0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.906+0000 7f2fcffff640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fc803c730 0x7f2fc803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.906+0000 7f2fcffff640 1 -- 172.21.15.120:0/1167552166 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f30f8035d10 con 0x55d46b2daab0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.906+0000 7f30ff003640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fc803c730 0x7f2fc803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.906+0000 7f30ff003640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fc803c730 0x7f2fc803ebf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30f001af70 tx=0x7f30f0032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.906+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.906+0000 7f3101519800 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b2edbc0 0x55d46b2f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.906+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f07d0 con 0x55d46b2edbc0 2024-09-07T03:33:38.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f30f6802640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b2edbc0 0x55d46b2f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f30f6802640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b2edbc0 0x55d46b2f0080 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f3101519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f3101519800 20 realm 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f0c00 con 0x55d46b2edbc0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f3101519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f3101519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.907+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f14d0 con 0x55d46b2edbc0 2024-09-07T03:33:38.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f3101519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f3101519800 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2f1ef0 0x55d46b2f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f4a90 con 0x55d46b2f1ef0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f30ff804640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2f1ef0 0x55d46b2f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f30ff804640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2f1ef0 0x55d46b2f4320 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f3101519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.908+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f52e0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.909+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.909+0000 7f3101519800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.909+0000 7f3101519800 20 searching for the correct realm 2024-09-07T03:33:38.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.909+0000 7f3101519800 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d46b2f7050 0x55d46b2f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.909+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f7050 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.909+0000 7f30ff003640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d46b2f7050 0x55d46b2f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.909+0000 7f30ff003640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d46b2f7050 0x55d46b2f94a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.909+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.909+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f1ef0 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.910+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.910+0000 7f30ff804640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f30f802ab60 0x7f30f804e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.910+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x7f30f802ab60 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.910+0000 7f30f6802640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f30f802ab60 0x7f30f804e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.910+0000 7f30f6802640 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f30f802ab60 0x7f30f804e440 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.910+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.910+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2edbc0 2024-09-07T03:33:38.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.910+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.910+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2edbc0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.911+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.911+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f7050 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.911+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.911+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2edbc0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.911+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.911+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f1ef0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.911+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.911+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f1ef0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2edbc0 2024-09-07T03:33:38.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x7f30f802ab60 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2edbc0 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x7f30f802ab60 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.912+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f1ef0 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.913+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.913+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f7050 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.913+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.913+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2edbc0 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.913+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.913+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f1ef0 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.913+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.913+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f7050 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.914+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.914+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2edbc0 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.914+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.914+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2edbc0 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.914+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.914+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2edbc0 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.914+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.914+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f7050 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x7f30f802ab60 2024-09-07T03:33:38.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x7f30f802ab60 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x7f30f802ab60 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f7050 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.915+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x7f30f802ab60 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.916+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.916+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f1ef0 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.916+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.916+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f1ef0 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.916+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.916+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f7050 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f1ef0 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f9b70 con 0x55d46b2f1ef0 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f5c60 con 0x55d46b2edbc0 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.917+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f58a0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2f60a0 con 0x55d46b2edbc0 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 zone default found 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 4 Realm: () 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:33:38.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 zonegroup default 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fa4a0 con 0x7f30f802ab60 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fc6e0 con 0x55d46b2f7050 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.918+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fca80 con 0x55d46b2f7050 2024-09-07T03:33:38.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.919+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.919+0000 7f3101519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.919+0000 7f3101519800 20 started sync module instance, tier type = 2024-09-07T03:33:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.919+0000 7f3101519800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:33:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.919+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fbb20 con 0x55d46b2f1ef0 2024-09-07T03:33:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.920+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.920+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94370819718928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fc330 con 0x55d46b2f1ef0 2024-09-07T03:33:38.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.920+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fd8f0 con 0x55d46b2edbc0 2024-09-07T03:33:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.921+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94370819718928] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.921+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.921+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94370819722784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fe140 con 0x55d46b2edbc0 2024-09-07T03:33:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.921+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fe9f0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.922+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94370819722784] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.923+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.923+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94370819726480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fe560 con 0x55d46b2f1ef0 2024-09-07T03:33:38.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.923+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2ff4a0 con 0x7f30f802ab60 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.924+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94370819726480] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.924+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.924+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94370819731376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fe560 con 0x7f30f802ab60 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.924+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fff20 con 0x55d46b2f1ef0 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.925+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94370819731376] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.925+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.925+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94370819734064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fe560 con 0x55d46b2f1ef0 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.925+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b300930 con 0x55d46b2f7050 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.926+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.926+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94370819736704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3011d0 con 0x55d46b2f7050 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.926+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b301ca0 con 0x55d46b2f7050 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.926+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94370819734064] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.927+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94370819736704] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.927+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.927+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94370819738912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b2fe0b0 con 0x55d46b2f7050 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.927+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b302580 con 0x7f30f802ab60 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94370819738912] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94370819741584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b302540 con 0x7f30f802ab60 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f3101519800 20 add_watcher() i=0 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f3101519800 20 add_watcher() i=1 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f3101519800 20 add_watcher() i=2 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f3101519800 20 add_watcher() i=3 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f3101519800 20 add_watcher() i=4 2024-09-07T03:33:38.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f3101519800 20 add_watcher() i=5 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.928+0000 7f3101519800 20 add_watcher() i=6 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.929+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94370819741584] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.929+0000 7f3101519800 20 add_watcher() i=7 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.929+0000 7f3101519800 2 all 8 watchers are set, enabling cache 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.929+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3059a0 con 0x55d46b2edbc0 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.930+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.930+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94370819744352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b302ee0 con 0x55d46b2edbc0 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.931+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94370819744352] v36'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.931+0000 7f2fb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.931+0000 7f3101519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.931+0000 7f3101519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.931+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30e200 con 0x55d46b2f1ef0 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.932+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'58 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.932+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30e310 con 0x7f30f802ab60 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.933+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.933+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30ea00 con 0x55d46b2f7050 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.934+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.934+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30ea90 con 0x55d46b2edbc0 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.935+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'230 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.935+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f000 con 0x55d46b2f1ef0 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.937+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'77 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.937+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f000 con 0x55d46b2f7050 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.938+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'59 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.938+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f090 con 0x55d46b2f1ef0 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.939+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'36 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.939+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f090 con 0x55d46b2edbc0 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.940+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.940+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f6c0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.941+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.941+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fb40 con 0x55d46b2f1ef0 2024-09-07T03:33:38.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.942+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.942+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f850 con 0x55d46b2f1ef0 2024-09-07T03:33:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.942+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'78 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.942+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f800 con 0x55d46b2f7050 2024-09-07T03:33:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.943+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.943+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f7d0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.945+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.945+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f7d0 con 0x55d46b2edbc0 2024-09-07T03:33:38.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.945+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'66 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.946+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f7d0 con 0x55d46b2edbc0 2024-09-07T03:33:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.947+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'231 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.947+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30f8e0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.948+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.948+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fcc0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.949+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'79 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.949+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fab0 con 0x55d46b2f7050 2024-09-07T03:33:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.950+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.950+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fab0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.951+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.951+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2edbc0 2024-09-07T03:33:38.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.952+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'232 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.952+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2f1ef0 2024-09-07T03:33:38.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.953+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'74 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.953+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2f1ef0 2024-09-07T03:33:38.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.954+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.954+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2f7050 2024-09-07T03:33:38.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.955+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.955+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2f1ef0 2024-09-07T03:33:38.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.956+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'45 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.956+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2f7050 2024-09-07T03:33:38.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.958+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.958+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2f7050 2024-09-07T03:33:38.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.959+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'60 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.959+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2f7050 2024-09-07T03:33:38.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.960+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.960+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2f1ef0 2024-09-07T03:33:38.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.961+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.961+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2edbc0 2024-09-07T03:33:38.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.962+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.962+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2f1ef0 2024-09-07T03:33:38.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.963+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'75 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.963+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x55d46b2edbc0 2024-09-07T03:33:38.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.964+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'67 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.964+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b30fd90 con 0x7f30f802ab60 2024-09-07T03:33:38.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.965+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.965+0000 7f2f2f7fe640 20 reqs_thread_entry: start 2024-09-07T03:33:38.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.965+0000 7f3101519800 20 init_complete bucket index max shards: 11 2024-09-07T03:33:38.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f3101519800 20 Filter name: none 2024-09-07T03:33:38.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f2f2d7fa640 20 reqs_thread_entry: start 2024-09-07T03:33:38.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f3101519800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-07T03:33:38.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b33a8a0 con 0x7f30f802ab60 2024-09-07T03:33:38.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f3101519800 20 rados_obj.operate() r=0 bl.length=380 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f3101519800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f3101519800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f3101519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.966+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b33d1d0 con 0x55d46b2edbc0 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 : miss 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:96 8.19 8:9d55c355:root::.bucket.meta.myfoo7%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b33d0d0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(96 .bucket.meta.myfoo7:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 20 rados_obj.operate() r=0 bl.length=390 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 info.flags=0x17 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 to cache LRU end 2024-09-07T03:33:38.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:33:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:33:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 2024-09-07T03:33:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.967+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:97 4.21 4:87d650b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba640 con 0x55d46b2f7050 2024-09-07T03:33:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.968+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(97 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.0 [call out=89b] v0'0 uv12 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.968+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:98 4.22 4:4508d51a:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba680 con 0x55d46b2edbc0 2024-09-07T03:33:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.968+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(98 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.968+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:99 4.3f 4:fdf7ebf7:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba680 con 0x7f30f802ab60 2024-09-07T03:33:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.968+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(99 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.968+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:100 4.23 4:c6b03f80:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba680 con 0x7f30f802ab60 2024-09-07T03:33:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.969+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(100 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.969+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:101 4.2 4:42b16fd6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba680 con 0x7f30f802ab60 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.969+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(101 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.969+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:102 4.2c 4:35b4107b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba620 con 0x55d46b2edbc0 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.969+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(102 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5 [call out=381b] v0'0 uv10 ondisk = 0) ==== 195+0+381 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.969+0000 7f3101519800 10 cls_bucket_list_unordered: got fourteen 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.969+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:103 4.25 4:a5fa85c6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba620 con 0x55d46b2f1ef0 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.970+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(103 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.6 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.970+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:104 4.12 4:4b1b24b7:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba660 con 0x55d46b2edbc0 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.970+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(104 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.970+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:105 4.38 4:1f9ebbd2:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba6a0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.971+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(105 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.971+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:106 4.1b 4:d9263c79:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba6a0 con 0x7f30f802ab60 2024-09-07T03:33:38.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.971+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(106 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.9 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.971+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:107 4.16 4:6bcbd1b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3ba6a0 con 0x55d46b2f7050 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.971+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(107 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.10 [call out=89b] v0'0 uv10 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.971+0000 7f3101519800 20 get_obj_state: octx=0x7f30e8051b60 obj=myfoo7:fourteen state=0x55d46b3b86c8 s->prefetch_data=0 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.971+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:108 3.0s0 3:01b53d90:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3b94f0 con 0x55d46b2edbc0 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.972+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(108 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.972+0000 7f3101519800 10 manifest: total_size = 8 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.972+0000 7f3101519800 20 get_obj_state: setting s->obj_tag to cf0fab6f-a978-4ce5-bacd-166891c31743.4225.3959020343612275373 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.972+0000 7f3101519800 20 get_obj_state: octx=0x7f30e8051b60 obj=myfoo7:fourteen state=0x55d46b3b86c8 s->prefetch_data=0 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.972+0000 7f3101519800 20 prepare_atomic_modification: state is not atomic. state=0x55d46b3b86c8 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.972+0000 7f3101519800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5 2024-09-07T03:33:38.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.972+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:109 4.2c 4:35b4107b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3b9db0 con 0x55d46b2edbc0 2024-09-07T03:33:38.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.973+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(109 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5 [stat,call,call] v36'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.973+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:110 3.0s0 3:01b53d90:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3b9db0 con 0x55d46b2edbc0 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.974+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 32 ==== osd_op_reply(110 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10_fourteen [call] v36'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.974+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:111 4.2c 4:35b4107b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b341c80 con 0x55d46b2edbc0 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.974+0000 7f3101519800 20 list_objects_ordered: starting attempt 1 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.974+0000 7f3101519800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.974+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:112 4.21 4:87d650b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b343540 con 0x55d46b2f7050 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.974+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:113 4.22 4:4508d51a:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b345e40 con 0x55d46b2edbc0 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.974+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:114 4.3f 4:fdf7ebf7:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b343540 con 0x7f30f802ab60 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(112 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.0 [call out=89b] v0'0 uv12 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 33 ==== osd_op_reply(113 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8057030 con 0x55d46b2edbc0 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(114 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8057030 con 0x7f30f802ab60 2024-09-07T03:33:38.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:115 4.23 4:c6b03f80:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b343540 con 0x7f30f802ab60 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:116 4.2 4:42b16fd6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b343540 con 0x7f30f802ab60 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:117 4.2c 4:35b4107b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b348740 con 0x55d46b2edbc0 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:118 4.25 4:a5fa85c6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b570 con 0x55d46b2f1ef0 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:119 4.12 4:4b1b24b7:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34df80 con 0x55d46b2edbc0 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:120 4.38 4:1f9ebbd2:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b348740 con 0x55d46b2f1ef0 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:121 4.1b 4:d9263c79:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b352f00 con 0x7f30f802ab60 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:122 4.16 4:6bcbd1b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b355870 con 0x55d46b2f7050 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(118 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.6 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.975+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(120 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(116 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(122 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.10 [call out=89b] v0'0 uv10 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 22 ==== osd_op_reply(115 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 23 ==== osd_op_reply(121 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.9 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 34 ==== osd_op_reply(111 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5 [stat,call,call] v36'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 35 ==== osd_op_reply(119 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f2fe17fa640 20 handle_completion(): completion ok for obj=fourteen 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 36 ==== osd_op_reply(117 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10])"; uploads.size()=0; is_truncated=0 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:123 4.21 4:87d650b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34af20 con 0x55d46b2f7050 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:124 4.22 4:4508d51a:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b347350 con 0x55d46b2edbc0 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:125 4.3f 4:fdf7ebf7:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3477c0 con 0x7f30f802ab60 2024-09-07T03:33:38.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:126 4.23 4:c6b03f80:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34af20 con 0x7f30f802ab60 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:127 4.2 4:42b16fd6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b347c10 con 0x7f30f802ab60 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:128 4.2c 4:35b4107b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b33fc60 con 0x55d46b2edbc0 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:129 4.25 4:a5fa85c6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b347350 con 0x55d46b2f1ef0 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:130 4.12 4:4b1b24b7:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b33fc60 con 0x55d46b2edbc0 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:131 4.38 4:1f9ebbd2:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34af20 con 0x55d46b2f1ef0 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:132 4.1b 4:d9263c79:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b357d40 con 0x7f30f802ab60 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:133 4.16 4:6bcbd1b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34af20 con 0x55d46b2f7050 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(123 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.0 [call out=89b] v0'0 uv12 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(129 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.6 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(131 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 37 ==== osd_op_reply(124 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 24 ==== osd_op_reply(125 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 25 ==== osd_op_reply(126 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 26 ==== osd_op_reply(127 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(133 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.10 [call out=89b] v0'0 uv10 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.976+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 38 ==== osd_op_reply(128 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.977+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 27 ==== osd_op_reply(132 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.9 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.977+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 39 ==== osd_op_reply(130 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.977+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b348130 con 0x55d46b2edbc0 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.978+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 40 ==== osd_op_reply(134 fud.buckets [call] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.978+0000 7f3101519800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.978+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.978+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b348130 con 0x7f30f802ab60 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.978+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 28 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.978+0000 7f3101519800 20 rados_obj.operate() r=0 bl.length=168 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.978+0000 7f3101519800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-07T03:33:38.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.978+0000 7f3101519800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.978+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b348130 con 0x7f30f802ab60 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.979+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 29 ==== osd_op_reply(136 myfoo7 [call,call,delete] v36'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.979+0000 7f3101519800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.979+0000 7f3101519800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.979+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94370820029424 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3488c0 con 0x7f30f802ab60 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.980+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 30 ==== watch-notify(notify (1) cookie 94370819731376 notify 154618822688 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55d46b30e2d0 con 0x7f30f802ab60 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.980+0000 7f2fe17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822688 cookie 94370819731376 notifier 4757 bl.length()=150 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.980+0000 7f2fe17fa640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2f340032c0 con 0x7f30f802ab60 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.980+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 31 ==== osd_op_reply(137 notify.3 [notify cookie 94370820029424 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.980+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 32 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.980+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 33 ==== watch-notify(notify_complete (2) cookie 94370820029424 notify 154618822688 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d46b30ea00 con 0x7f30f802ab60 2024-09-07T03:33:38.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.980+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:139 8.19 8:9d55c355:root::.bucket.meta.myfoo7%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3498a0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.981+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== osd_op_reply(139 .bucket.meta.myfoo7:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 [call,call,delete] v36'9 uv9 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.981+0000 7f3101519800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 from cache 2024-09-07T03:33:38.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.981+0000 7f3101519800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10, ofs0, ns] 2024-09-07T03:33:38.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.981+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94370820029424 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b348130 con 0x7f30f802ab60 2024-09-07T03:33:38.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.981+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 34 ==== watch-notify(notify (1) cookie 94370819731376 notify 154618822689 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55d46b30ea00 con 0x7f30f802ab60 2024-09-07T03:33:38.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.981+0000 7f2fe1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822689 cookie 94370819731376 notifier 4757 bl.length()=208 2024-09-07T03:33:38.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.981+0000 7f2fe1ffb640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2fc4003d60 con 0x7f30f802ab60 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.981+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 35 ==== osd_op_reply(140 notify.3 [notify cookie 94370820029424 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 36 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 37 ==== watch-notify(notify_complete (2) cookie 94370820029424 notify 154618822689 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d46b30ee30 con 0x7f30f802ab60 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:142 4.21 4:87d650b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b33d040 con 0x55d46b2f7050 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:143 4.22 4:4508d51a:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b342530 con 0x55d46b2edbc0 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:144 4.3f 4:fdf7ebf7:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b342d80 con 0x7f30f802ab60 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:145 4.23 4:c6b03f80:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b343160 con 0x7f30f802ab60 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:146 4.2 4:42b16fd6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34a200 con 0x7f30f802ab60 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:147 4.2c 4:35b4107b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b342530 con 0x55d46b2edbc0 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:148 4.25 4:a5fa85c6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b33b8b0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:149 4.12 4:4b1b24b7:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b342d80 con 0x55d46b2edbc0 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:150 4.38 4:1f9ebbd2:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b343160 con 0x55d46b2f1ef0 2024-09-07T03:33:38.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:151 4.1b 4:d9263c79:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b3491f0 con 0x7f30f802ab60 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.982+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:152 4.16 4:6bcbd1b8:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f7050 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.983+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== osd_op_reply(142 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.0 [delete] v36'13 uv13 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 38 ==== osd_op_reply(145 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.3 [delete] v36'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 39 ==== osd_op_reply(146 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.4 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 41 ==== osd_op_reply(143 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.1 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(152 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.10 [delete] v36'12 uv12 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 40 ==== osd_op_reply(144 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.2 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(148 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.6 [delete] v36'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(150 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.8 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 41 ==== osd_op_reply(151 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.9 [delete] v36'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 42 ==== osd_op_reply(147 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.5 [delete] v36'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 43 ==== osd_op_reply(149 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10.7 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f3101519800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 : miss 2024-09-07T03:33:38.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f3101519800 20 rados->read ofs=0 len=0 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:153 6.19 6:99ae87b5:::pubsub..bucket.myfoo7%2fcf0fab6f-a978-4ce5-bacd-166891c31743.4225.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(153 pubsub..bucket.myfoo7/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f3101519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f3101519800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 info.flags=0x0 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f3101519800 10 adding default.rgw.log++pubsub..bucket.myfoo7/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 to cache LRU end 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.984+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:154 6.19 6:99ae87b5:::pubsub..bucket.myfoo7%2fcf0fab6f-a978-4ce5-bacd-166891c31743.4225.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.985+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 45 ==== osd_op_reply(154 pubsub..bucket.myfoo7/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.10 [delete] v36'59 uv52 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.985+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2edbc0 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.986+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 44 ==== osd_op_reply(155 fud.buckets [call] v36'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.986+0000 7f3101519800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.986+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f7050 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.987+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v36'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.987+0000 7f3101519800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.987+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94370819985472 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f1ef0 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.988+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 46 ==== watch-notify(notify (1) cookie 94370819726480 notify 154618822687 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d46b33c670 con 0x55d46b2f1ef0 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.988+0000 7f2fe1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822687 cookie 94370819726480 notifier 4757 bl.length()=170 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.988+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 47 ==== osd_op_reply(157 notify.2 [notify cookie 94370819985472 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.988+0000 7f2fe1ffb640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2fc4003d60 con 0x55d46b2f1ef0 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.988+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 48 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.988+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 49 ==== watch-notify(notify_complete (2) cookie 94370819985472 notify 154618822687 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d46b2e2940 con 0x55d46b2f1ef0 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.988+0000 7f3101519800 10 removing email index: 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.988+0000 7f3101519800 10 removing user buckets index 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.988+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2edbc0 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.989+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 45 ==== osd_op_reply(159 fud.buckets [delete] v36'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.989+0000 7f3101519800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-07T03:33:38.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.989+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94370819985472 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f7050 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.989+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== watch-notify(notify (1) cookie 94370819738912 notify 154618822688 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d46b30f090 con 0x55d46b2f7050 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.989+0000 7f2fe1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822688 cookie 94370819738912 notifier 4757 bl.length()=160 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.989+0000 7f2fe1ffb640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2fc4003d60 con 0x55d46b2f7050 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.990+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== osd_op_reply(160 notify.6 [notify cookie 94370819985472 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.990+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 33 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.990+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 34 ==== watch-notify(notify_complete (2) cookie 94370819985472 notify 154618822688 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f30f005a040 con 0x55d46b2f7050 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.990+0000 7f3101519800 10 removing user index: fud 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.990+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x7f30f802ab60 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.991+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 42 ==== osd_op_reply(162 fud [call,call,delete] v36'11 uv11 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.991+0000 7f3101519800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.991+0000 7f3101519800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.991+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94370820030768 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f7050 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.991+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 35 ==== watch-notify(notify (1) cookie 94370819736704 notify 154618822689 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f30f005a040 con 0x55d46b2f7050 2024-09-07T03:33:38.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.991+0000 7f2fe17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822689 cookie 94370819736704 notifier 4757 bl.length()=152 2024-09-07T03:33:39.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.991+0000 7f2fe17fa640 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2f340032c0 con 0x55d46b2f7050 2024-09-07T03:33:39.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.991+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 36 ==== osd_op_reply(163 notify.5 [notify cookie 94370820030768 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:39.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.992+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 37 ==== watch-notify(notify_complete (2) cookie 94370820030768 notify 154618822689 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d46b2b43e0 con 0x55d46b2f7050 2024-09-07T03:33:39.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.992+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 38 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:39.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.993+0000 7f2fb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:33:39.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.993+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94370819744352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2edbc0 2024-09-07T03:33:39.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.994+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 46 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94370819744352] v36'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:39.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.994+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94370819718928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f1ef0 2024-09-07T03:33:39.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.995+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 50 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94370819718928] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:39.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.995+0000 7f3101519800 20 remove_watcher() i=0 2024-09-07T03:33:39.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.995+0000 7f3101519800 2 removed watcher, disabling cache 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.995+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94370819722784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2edbc0 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.996+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.1 v2:172.21.15.120:6808/3372043485 47 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94370819722784] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x55d46b2edbc0 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.996+0000 7f3101519800 20 remove_watcher() i=1 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.996+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94370819726480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f1ef0 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.997+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 51 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94370819726480] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.997+0000 7f3101519800 20 remove_watcher() i=2 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.997+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94370819731376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x7f30f802ab60 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.998+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 43 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94370819731376] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.998+0000 7f3101519800 20 remove_watcher() i=3 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.998+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94370819734064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f1ef0 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.999+0000 7f30ff804640 1 -- 172.21.15.120:0/1167552166 <== osd.0 v2:172.21.15.104:6800/182397107 52 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94370819734064] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f803b070 con 0x55d46b2f1ef0 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.999+0000 7f3101519800 20 remove_watcher() i=4 2024-09-07T03:33:39.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:38.999+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94370819736704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f7050 2024-09-07T03:33:39.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.000+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 39 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94370819736704] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:39.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.000+0000 7f3101519800 20 remove_watcher() i=5 2024-09-07T03:33:39.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.000+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94370819738912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x55d46b2f7050 2024-09-07T03:33:39.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.001+0000 7f30ff003640 1 -- 172.21.15.120:0/1167552166 <== osd.3 v2:172.21.15.120:6800/1193158925 40 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94370819738912] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f002e070 con 0x55d46b2f7050 2024-09-07T03:33:39.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.001+0000 7f3101519800 20 remove_watcher() i=6 2024-09-07T03:33:39.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.001+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94370819741584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d46b34b9c0 con 0x7f30f802ab60 2024-09-07T03:33:39.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.002+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 <== osd.2 v2:172.21.15.120:6809/3781833098 44 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94370819741584] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30e8096040 con 0x7f30f802ab60 2024-09-07T03:33:39.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.002+0000 7f3101519800 20 remove_watcher() i=7 2024-09-07T03:33:39.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2f1ef0 msgr2=0x55d46b2f4320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2f1ef0 0x55d46b2f4320 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b2edbc0 msgr2=0x55d46b2f0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b2edbc0 0x55d46b2f0080 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f30f802ab60 msgr2=0x7f30f804e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f30f802ab60 0x7f30f804e440 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d46b2f7050 msgr2=0x55d46b2f94a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d46b2f7050 0x55d46b2f94a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fc803c730 msgr2=0x7f2fc803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fc803c730 0x7f2fc803ebf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30f001af70 tx=0x7f30f0032000 comp rx=0 tx=0).stop 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 msgr2=0x55d46b2e2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/1167552166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2daab0 0x55d46b2e2150 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f30f800dd00 tx=0x7f30f8053d90 comp rx=0 tx=0).stop 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 reap_dead start 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f30f6802640 1 -- 172.21.15.120:0/1167552166 reap_dead start 2024-09-07T03:33:39.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 shutdown_connections 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 >> 172.21.15.120:0/1167552166 conn(0x55d46b2d6eb0 msgr2=0x55d46b2d50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 shutdown_connections 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/1167552166 wait complete. 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/2516652442 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fd803c730 msgr2=0x7f2fd803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/2516652442 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fd803c730 0x7f2fd803ebf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55d46b2b4930 tx=0x7f30f0046040 comp rx=0 tx=0).stop 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/2516652442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2ce030 msgr2=0x55d46b2ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/2516652442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2ce030 0x55d46b2ce450 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f30f8016d20 tx=0x7f30f800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/2516652442 shutdown_connections 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/2516652442 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fd803c730 0x7f2fd803ebf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/2516652442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b2ce030 0x55d46b2ce450 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/2516652442 >> 172.21.15.120:0/2516652442 conn(0x55d46b2c23e0 msgr2=0x55d46b2c27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/2516652442 shutdown_connections 2024-09-07T03:33:39.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/2516652442 wait complete. 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2bb680 msgr2=0x55d46b2bdb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.003+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2bb680 0x55d46b2bdb20 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b1be240 msgr2=0x55d46b2ba840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b1be240 0x55d46b2ba840 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fe403c730 msgr2=0x7f2fe403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fe403c730 0x7f2fe403ebf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f30e8057000 tx=0x7f30e8052000 comp rx=0 tx=0).stop 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 msgr2=0x55d46b2b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b2b31f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x55d46b1b99d0 tx=0x7f30f0000bc0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 shutdown_connections 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d46b2bb680 0x55d46b2bdb20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d46b1be240 0x55d46b2ba840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f2fe403c730 0x7f2fe403ebf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 --2- 172.21.15.120:0/3322888067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d46b1ba730 0x55d46b2b31f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:33:39.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 >> 172.21.15.120:0/3322888067 conn(0x55d46b1b41d0 msgr2=0x55d46b2a4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:33:39.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 shutdown_connections 2024-09-07T03:33:39.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:33:39.004+0000 7f3101519800 1 -- 172.21.15.120:0/3322888067 wait complete. 2024-09-07T03:34:19.014 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-07T03:34:19.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-07T03:34:19.015 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-07T03:34:19.068 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:19.068 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:19.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.067+0000 7fc6b612e800 1 Processor -- start 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.067+0000 7fc6b612e800 1 -- start start 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.067+0000 7fc6b612e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55589e557300 0x55589e557700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.067+0000 7fc6b612e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55589e401e40 con 0x55589e557d30 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.067+0000 7fc6b612e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55589e3cc680 con 0x55589e557300 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.068+0000 7fc6b1edd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55589e557300 0x55589e557700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.068+0000 7fc6b16dc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55589e557d30 0x55589e5581e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43772/0 (socket says 172.21.15.120:43772) 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.068+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2150228718 learned_addr learned my addr 172.21.15.120:0/2150228718 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.068+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/2150228718 >> v2:172.21.15.104:3300/0 conn(0x55589e557300 0x55589e557700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39682/0 (socket says 172.21.15.120:39682) 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.068+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2150228718 >> v1:172.21.15.104:6789/0 conn(0x55589e557d30 legacy=0x55589e5581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.068+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2150228718 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589e3e86b0 con 0x55589e557300 2024-09-07T03:34:19.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.070+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/2150228718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e557700 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400a600 tx=0x7fc6a4047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1719f6bf76c5ab34 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.070+0000 7fc6b0edb640 1 -- 172.21.15.120:0/2150228718 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6a4056070 con 0x55589e557300 2024-09-07T03:34:19.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.070+0000 7fc6b0edb640 1 -- 172.21.15.120:0/2150228718 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a400a200 con 0x55589e557300 2024-09-07T03:34:19.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.070+0000 7fc6b0edb640 1 -- 172.21.15.120:0/2150228718 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6a4008590 con 0x55589e557300 2024-09-07T03:34:19.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.071+0000 7fc6b612e800 1 -- 172.21.15.120:0/2150228718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 msgr2=0x55589e557700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.071+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2150228718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e557700 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400a600 tx=0x7fc6a4047cb0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.071+0000 7fc6b612e800 1 -- 172.21.15.120:0/2150228718 shutdown_connections 2024-09-07T03:34:19.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.071+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2150228718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e557700 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.071+0000 7fc6b612e800 1 -- 172.21.15.120:0/2150228718 >> 172.21.15.120:0/2150228718 conn(0x55589e551920 msgr2=0x55589e553da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.071+0000 7fc6b612e800 1 -- 172.21.15.120:0/2150228718 shutdown_connections 2024-09-07T03:34:19.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.071+0000 7fc6b612e800 1 -- 172.21.15.120:0/2150228718 wait complete. 2024-09-07T03:34:19.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.087+0000 7fc6b612e800 1 Processor -- start 2024-09-07T03:34:19.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.087+0000 7fc6b612e800 1 -- start start 2024-09-07T03:34:19.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.087+0000 7fc6b612e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e645450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.087+0000 7fc6b612e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55589e3f0dd0 con 0x55589e557300 2024-09-07T03:34:19.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.087+0000 7fc6b1edd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e645450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.087+0000 7fc6b1edd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e645450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39688/0 (socket says 172.21.15.120:39688) 2024-09-07T03:34:19.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.087+0000 7fc6b1edd640 1 -- 172.21.15.120:0/70288543 learned_addr learned my addr 172.21.15.120:0/70288543 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.088+0000 7fc6b1edd640 1 -- 172.21.15.120:0/70288543 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589e409e10 con 0x55589e557300 2024-09-07T03:34:19.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.088+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/70288543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e645450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4027ae0 tx=0x7fc6a4053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f730aa975d1208 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.088+0000 7fc59fe07640 1 -- 172.21.15.120:0/70288543 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6a4009810 con 0x55589e557300 2024-09-07T03:34:19.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.088+0000 7fc59fe07640 1 -- 172.21.15.120:0/70288543 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a40099b0 con 0x55589e557300 2024-09-07T03:34:19.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.088+0000 7fc59fe07640 1 -- 172.21.15.120:0/70288543 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6a4009cb0 con 0x55589e557300 2024-09-07T03:34:19.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 -- 172.21.15.120:0/70288543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 msgr2=0x55589e645450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 --2- 172.21.15.120:0/70288543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e645450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4027ae0 tx=0x7fc6a4053000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 -- 172.21.15.120:0/70288543 shutdown_connections 2024-09-07T03:34:19.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 --2- 172.21.15.120:0/70288543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e645450 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 -- 172.21.15.120:0/70288543 >> 172.21.15.120:0/70288543 conn(0x55589e551920 msgr2=0x55589e640dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 -- 172.21.15.120:0/70288543 shutdown_connections 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 -- 172.21.15.120:0/70288543 wait complete. 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 Processor -- start 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 -- start start 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e64cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.089+0000 7fc6b612e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55589e555d70 con 0x55589e557300 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc6b1edd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e64cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc6b1edd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e64cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39690/0 (socket says 172.21.15.120:39690) 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2962854310 learned_addr learned my addr 172.21.15.120:0/2962854310 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2962854310 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589e64d2c0 con 0x55589e557300 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e64cd60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4027ae0 tx=0x7fc6a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc59e604640 1 -- 172.21.15.120:0/2962854310 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6a40516e0 con 0x55589e557300 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc59e604640 1 -- 172.21.15.120:0/2962854310 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a40518a0 con 0x55589e557300 2024-09-07T03:34:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55589e64d550 con 0x55589e557300 2024-09-07T03:34:19.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc59e604640 1 -- 172.21.15.120:0/2962854310 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6a4051bc0 con 0x55589e557300 2024-09-07T03:34:19.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.090+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55589e64df50 con 0x55589e557300 2024-09-07T03:34:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.091+0000 7fc59e604640 1 -- 172.21.15.120:0/2962854310 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc6a4075060 con 0x55589e557300 2024-09-07T03:34:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.092+0000 7fc59e604640 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc59803c730 0x7fc59803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.092+0000 7fc59e604640 1 -- 172.21.15.120:0/2962854310 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc6a406a040 con 0x55589e557300 2024-09-07T03:34:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.092+0000 7fc6b16dc640 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc59803c730 0x7fc59803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.092+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e557d30 0x55589e6543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.092+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e6548f0 con 0x55589e557d30 2024-09-07T03:34:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.092+0000 7fc6b26de640 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e557d30 0x55589e6543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.092+0000 7fc6b16dc640 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc59803c730 0x7fc59803ebf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8001d70 tx=0x7fc6a80012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.092+0000 7fc6b26de640 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e557d30 0x55589e6543b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.093+0000 7fc6b26de640 1 -- 172.21.15.120:0/2962854310 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6ac00a4d0 con 0x55589e557d30 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.093+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e6551f0 0x55589e657680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.093+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e657df0 con 0x55589e6551f0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.093+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e6551f0 0x55589e657680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.093+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e6551f0 0x55589e657680 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.094+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2962854310 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e6551f0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.094+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e6596a0 con 0x55589e6551f0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.094+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2962854310 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e6551f0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.094+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e658720 con 0x55589e6551f0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.094+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2962854310 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e6551f0 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.094+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e658b40 con 0x55589e557d30 2024-09-07T03:34:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.095+0000 7fc6b26de640 1 -- 172.21.15.120:0/2962854310 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc6ac00a4d0 con 0x55589e557d30 2024-09-07T03:34:19.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.095+0000 7fc6b612e800 1 Processor -- start 2024-09-07T03:34:19.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.095+0000 7fc6b612e800 1 -- start start 2024-09-07T03:34:19.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.095+0000 7fc6b612e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e66be80 0x55589e66c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.095+0000 7fc6b612e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55589e44ea00 con 0x55589e66be80 2024-09-07T03:34:19.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.095+0000 7fc6b26de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e66be80 0x55589e66c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.095+0000 7fc6b26de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e66be80 0x55589e66c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39706/0 (socket says 172.21.15.120:39706) 2024-09-07T03:34:19.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.096+0000 7fc6b26de640 1 -- 172.21.15.120:0/1574103824 learned_addr learned my addr 172.21.15.120:0/1574103824 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.096+0000 7fc6b26de640 1 -- 172.21.15.120:0/1574103824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589e66c8e0 con 0x55589e66be80 2024-09-07T03:34:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.096+0000 7fc6b26de640 1 --2- 172.21.15.120:0/1574103824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e66be80 0x55589e66c2a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac016d20 tx=0x7fc6ac00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.096+0000 7fc5977fe640 1 -- 172.21.15.120:0/1574103824 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6ac017660 con 0x55589e66be80 2024-09-07T03:34:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.096+0000 7fc5977fe640 1 -- 172.21.15.120:0/1574103824 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac01b030 con 0x55589e66be80 2024-09-07T03:34:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.096+0000 7fc6b612e800 1 -- 172.21.15.120:0/1574103824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55589e66d110 con 0x55589e66be80 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.096+0000 7fc5977fe640 1 -- 172.21.15.120:0/1574103824 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6ac017950 con 0x55589e66be80 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.096+0000 7fc6b612e800 1 -- 172.21.15.120:0/1574103824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55589e66d6b0 con 0x55589e66be80 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.097+0000 7fc5977fe640 1 -- 172.21.15.120:0/1574103824 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc6ac017af0 con 0x55589e66be80 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.097+0000 7fc5977fe640 1 --2- 172.21.15.120:0/1574103824 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc58c03c780 0x7fc58c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.098+0000 7fc5977fe640 1 -- 172.21.15.120:0/1574103824 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc6ac00e040 con 0x55589e66be80 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.098+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/1574103824 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc58c03c780 0x7fc58c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.098+0000 7fc6b612e800 1 Processor -- start 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.098+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/1574103824 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc58c03c780 0x7fc58c03ec40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55589e658240 tx=0x7fc6a4088f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.098+0000 7fc6b612e800 1 -- start start 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.098+0000 7fc6b612e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e678d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.098+0000 7fc6b612e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55589e645be0 con 0x55589e678960 2024-09-07T03:34:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.098+0000 7fc6b26de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e678d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.099+0000 7fc6b26de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e678d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39712/0 (socket says 172.21.15.120:39712) 2024-09-07T03:34:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.099+0000 7fc6b26de640 1 -- 172.21.15.120:0/2111063986 learned_addr learned my addr 172.21.15.120:0/2111063986 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.099+0000 7fc6b26de640 1 -- 172.21.15.120:0/2111063986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589e679350 con 0x55589e678960 2024-09-07T03:34:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.099+0000 7fc6b26de640 1 --2- 172.21.15.120:0/2111063986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e678d60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac053e00 tx=0x7fc6ac017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d4eedb53cac4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.099+0000 7fc5957fa640 1 -- 172.21.15.120:0/2111063986 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6ac014d40 con 0x55589e678960 2024-09-07T03:34:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.099+0000 7fc5957fa640 1 -- 172.21.15.120:0/2111063986 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac051070 con 0x55589e678960 2024-09-07T03:34:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.099+0000 7fc5957fa640 1 -- 172.21.15.120:0/2111063986 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6ac0149b0 con 0x55589e678960 2024-09-07T03:34:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 -- 172.21.15.120:0/2111063986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 msgr2=0x55589e678d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2111063986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e678d60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac053e00 tx=0x7fc6ac017de0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 -- 172.21.15.120:0/2111063986 shutdown_connections 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2111063986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e678d60 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 -- 172.21.15.120:0/2111063986 >> 172.21.15.120:0/2111063986 conn(0x55589e674d60 msgr2=0x55589e672fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 -- 172.21.15.120:0/2111063986 shutdown_connections 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 -- 172.21.15.120:0/2111063986 wait complete. 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 Processor -- start 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 -- start start 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e67ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.100+0000 7fc6b612e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55589e679970 con 0x55589e678960 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc6b26de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e67ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc6b26de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e67ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39718/0 (socket says 172.21.15.120:39718) 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 learned_addr learned my addr 172.21.15.120:0/2252807311 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589e680530 con 0x55589e678960 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc6b26de640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e67ffd0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac017fd0 tx=0x7fc6ac053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc5837fe640 1 -- 172.21.15.120:0/2252807311 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6ac028990 con 0x55589e678960 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc5837fe640 1 -- 172.21.15.120:0/2252807311 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac02e070 con 0x55589e678960 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55589e6807c0 con 0x55589e678960 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc5837fe640 1 -- 172.21.15.120:0/2252807311 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6ac012e00 con 0x55589e678960 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.101+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55589e681140 con 0x55589e678960 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.102+0000 7fc5837fe640 1 -- 172.21.15.120:0/2252807311 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc6ac039060 con 0x55589e678960 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.102+0000 7fc5837fe640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc57c03c730 0x7fc57c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.102+0000 7fc5837fe640 1 -- 172.21.15.120:0/2252807311 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc6ac03d9d0 con 0x55589e678960 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.102+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc57c03c730 0x7fc57c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.103+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc57c03c730 0x7fc57c03ebf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4005c40 tx=0x7fc6a4079000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.103+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.103+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e68bac0 0x55589e68df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.103+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e68e6d0 con 0x55589e68bac0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.103+0000 7fc6b16dc640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e68bac0 0x55589e68df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.103+0000 7fc6b16dc640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e68bac0 0x55589e68df80 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6a8009050 con 0x55589e68bac0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 20 realm 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e68ae10 con 0x55589e68bac0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6a8009050 con 0x55589e68bac0 2024-09-07T03:34:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e68f1c0 con 0x55589e68bac0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6a8009050 con 0x55589e68bac0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e68ffa0 0x55589e692390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e692a60 con 0x55589e68ffa0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.104+0000 7fc6b26de640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e68ffa0 0x55589e692390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b26de640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e68ffa0 0x55589e692390 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b612e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e6932b0 con 0x55589e68ffa0 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b612e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b612e800 20 searching for the correct realm 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55589e695020 0x55589e697450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.105+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e695020 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.106+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55589e695020 0x55589e697450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.106+0000 7fc6b1edd640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55589e695020 0x55589e697450 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.106+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.106+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68ffa0 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.107+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.107+0000 7fc6b26de640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc6ac04e050 0x7fc6ac04e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.107+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x7fc6ac04e050 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.107+0000 7fc6b16dc640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc6ac04e050 0x7fc6ac04e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.107+0000 7fc6b16dc640 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc6ac04e050 0x7fc6ac04e8b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.107+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8009050 con 0x7fc6ac04e050 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.107+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68bac0 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.108+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8009050 con 0x55589e68bac0 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.108+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68bac0 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.108+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.108+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e695020 2024-09-07T03:34:19.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.108+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.108+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68bac0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.108+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.108+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68ffa0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.109+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.109+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68ffa0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.109+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.109+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68bac0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.109+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.109+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x7fc6ac04e050 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.110+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.110+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68bac0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.110+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.110+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x7fc6ac04e050 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.110+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.110+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68ffa0 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.110+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.110+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e695020 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.111+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.111+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68bac0 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.111+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.111+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68ffa0 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.111+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.111+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e695020 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.112+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.112+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68bac0 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.112+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.112+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68bac0 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.112+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.112+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68bac0 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.112+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.112+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e695020 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x7fc6ac04e050 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x7fc6ac04e050 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x7fc6ac04e050 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e695020 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.113+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x7fc6ac04e050 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.114+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.114+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68ffa0 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.114+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.114+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68ffa0 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.114+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.114+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e695020 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68ffa0 2024-09-07T03:34:19.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55589e697b20 con 0x55589e68ffa0 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e693c30 con 0x55589e68bac0 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.115+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e693870 con 0x55589e68ffa0 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e694070 con 0x55589e68bac0 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 20 zone default found 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 4 Realm: () 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:19.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 20 zonegroup default 2024-09-07T03:34:19.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e698450 con 0x7fc6ac04e050 2024-09-07T03:34:19.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.116+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e69a690 con 0x55589e695020 2024-09-07T03:34:19.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.117+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.117+0000 7fc6b612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.117+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.117+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e69aa30 con 0x55589e695020 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.117+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.117+0000 7fc6b612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.117+0000 7fc6b612e800 20 started sync module instance, tier type = 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.117+0000 7fc6b612e800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.117+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e699b20 con 0x55589e68ffa0 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.118+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.118+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93839103205136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69b2d0 con 0x55589e68ffa0 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.118+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69bb20 con 0x55589e68bac0 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.119+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93839103205136] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.119+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.119+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93839103209264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69b8a0 con 0x55589e68bac0 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.119+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69c3c0 con 0x55589e68ffa0 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.120+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93839103209264] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.120+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.120+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93839103213200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69c380 con 0x55589e68ffa0 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.120+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69ce40 con 0x7fc6ac04e050 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.122+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93839103213200] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.122+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.122+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93839103215952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69ce40 con 0x7fc6ac04e050 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.122+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69d890 con 0x55589e68ffa0 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.123+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93839103215952] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.123+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.123+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93839103210320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69d850 con 0x55589e68ffa0 2024-09-07T03:34:19.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.123+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69e2a0 con 0x55589e695020 2024-09-07T03:34:19.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.124+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.124+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93839103221232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69eb40 con 0x55589e695020 2024-09-07T03:34:19.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.124+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69f5e0 con 0x55589e695020 2024-09-07T03:34:19.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.124+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93839103210320] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.125+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93839103221232] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.125+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.125+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93839103223440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69d3a0 con 0x55589e695020 2024-09-07T03:34:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.125+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69fe80 con 0x7fc6ac04e050 2024-09-07T03:34:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93839103223440] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93839103226032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69fe80 con 0x7fc6ac04e050 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b612e800 20 add_watcher() i=0 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b612e800 20 add_watcher() i=1 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b612e800 20 add_watcher() i=2 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b612e800 20 add_watcher() i=3 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b612e800 20 add_watcher() i=4 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b612e800 20 add_watcher() i=5 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.127+0000 7fc6b612e800 20 add_watcher() i=6 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.128+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93839103226032] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.128+0000 7fc6b612e800 20 add_watcher() i=7 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.128+0000 7fc6b612e800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.128+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e6a3330 con 0x55589e68bac0 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.128+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.128+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93839103228832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e6a0880 con 0x55589e68bac0 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93839103228832] v36'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc567fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc6b612e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc6b612e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc6b612e800 5 note: GC not initialized 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc566fe5640 20 reqs_thread_entry: start 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc6b612e800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc6b612e800 20 Filter name: none 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc564fe1640 20 reqs_thread_entry: start 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc6b612e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc6b612e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.130+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55589e6d6460 con 0x55589e68bac0 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.131+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.131+0000 7fc6b612e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.131+0000 7fc6b612e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.131+0000 7fc6b612e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.131+0000 7fc6b612e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.131+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e6d8d90 con 0x55589e695020 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.132+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 usage.10 [call] v36'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.132+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e6d8d90 con 0x55589e695020 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.133+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(64 usage.10 [call] v36'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.133+0000 7fc567fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.133+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93839103228832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e6a25e0 con 0x55589e68bac0 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.135+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93839103228832] v36'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.135+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93839103205136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69fb70 con 0x55589e68ffa0 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.136+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93839103205136] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.136+0000 7fc6b612e800 20 remove_watcher() i=0 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.136+0000 7fc6b612e800 2 removed watcher, disabling cache 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.136+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93839103209264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e699f10 con 0x55589e68bac0 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.137+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93839103209264] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x55589e68bac0 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.137+0000 7fc6b612e800 20 remove_watcher() i=1 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.137+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93839103213200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e699f10 con 0x55589e68ffa0 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.138+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93839103213200] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.138+0000 7fc6b612e800 20 remove_watcher() i=2 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.138+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93839103215952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e69be90 con 0x7fc6ac04e050 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.139+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93839103215952] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.139+0000 7fc6b612e800 20 remove_watcher() i=3 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.139+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93839103210320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e699f10 con 0x55589e68ffa0 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.141+0000 7fc6b26de640 1 -- 172.21.15.120:0/2252807311 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93839103210320] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6ac027070 con 0x55589e68ffa0 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.141+0000 7fc6b612e800 20 remove_watcher() i=4 2024-09-07T03:34:19.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.141+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93839103221232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e699f10 con 0x55589e695020 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.141+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93839103221232] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.141+0000 7fc6b612e800 20 remove_watcher() i=5 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.141+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93839103223440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e699f10 con 0x55589e695020 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.142+0000 7fc6b1edd640 1 -- 172.21.15.120:0/2252807311 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93839103223440] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a4058030 con 0x55589e695020 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.142+0000 7fc6b612e800 20 remove_watcher() i=6 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.142+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93839103226032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55589e699f10 con 0x7fc6ac04e050 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.143+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93839103226032] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6a8028040 con 0x7fc6ac04e050 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.143+0000 7fc6b612e800 20 remove_watcher() i=7 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e68ffa0 msgr2=0x55589e692390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e68ffa0 0x55589e692390 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e68bac0 msgr2=0x55589e68df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e68bac0 0x55589e68df80 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc6ac04e050 msgr2=0x7fc6ac04e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc6ac04e050 0x7fc6ac04e8b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55589e695020 msgr2=0x55589e697450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55589e695020 0x55589e697450 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc57c03c730 msgr2=0x7fc57c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc57c03c730 0x7fc57c03ebf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4005c40 tx=0x7fc6a4079000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 msgr2=0x55589e67ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b16dc640 1 -- 172.21.15.120:0/2252807311 reap_dead start 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e67ffd0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac017fd0 tx=0x7fc6ac053d60 comp rx=0 tx=0).stop 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 shutdown_connections 2024-09-07T03:34:19.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2252807311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e678960 0x55589e67ffd0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 >> 172.21.15.120:0/2252807311 conn(0x55589e674d60 msgr2=0x55589e672f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 shutdown_connections 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/2252807311 wait complete. 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/1574103824 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc58c03c780 msgr2=0x7fc58c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/1574103824 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc58c03c780 0x7fc58c03ec40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55589e658240 tx=0x7fc6a4088f90 comp rx=0 tx=0).stop 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/1574103824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e66be80 msgr2=0x55589e66c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/1574103824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e66be80 0x55589e66c2a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac016d20 tx=0x7fc6ac00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/1574103824 shutdown_connections 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/1574103824 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc58c03c780 0x7fc58c03ec40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 --2- 172.21.15.120:0/1574103824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e66be80 0x55589e66c2a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/1574103824 >> 172.21.15.120:0/1574103824 conn(0x55589e65be20 msgr2=0x55589e65c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/1574103824 shutdown_connections 2024-09-07T03:34:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.144+0000 7fc6b612e800 1 -- 172.21.15.120:0/1574103824 wait complete. 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e6551f0 msgr2=0x55589e657680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e6551f0 0x55589e657680 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e557d30 msgr2=0x55589e6543b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e557d30 0x55589e6543b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc59803c730 msgr2=0x7fc59803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc59803c730 0x7fc59803ebf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8001d70 tx=0x7fc6a80012d0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 msgr2=0x55589e64cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e64cd60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4027ae0 tx=0x7fc6a4002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 shutdown_connections 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55589e6551f0 0x55589e657680 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55589e557d30 0x55589e6543b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc59803c730 0x7fc59803ebf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 --2- 172.21.15.120:0/2962854310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55589e557300 0x55589e64cd60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 >> 172.21.15.120:0/2962854310 conn(0x55589e551920 msgr2=0x55589e646610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 shutdown_connections 2024-09-07T03:34:19.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.145+0000 7fc6b612e800 1 -- 172.21.15.120:0/2962854310 wait complete. 2024-09-07T03:34:19.155 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-07T03:34:19.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-07T03:34:19.155 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-07T03:34:19.200 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:19.200 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:19.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.199+0000 7f90d0d2c800 1 Processor -- start 2024-09-07T03:34:19.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.199+0000 7f90d0d2c800 1 -- start start 2024-09-07T03:34:19.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.199+0000 7f90d0d2c800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5637667e9600 0x5637667eb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.199+0000 7f90d0d2c800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563766692e40 con 0x5637667ec020 2024-09-07T03:34:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.200+0000 7f90d0d2c800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x56376665d680 con 0x5637667e9600 2024-09-07T03:34:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.200+0000 7f90ccaad640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5637667e9600 0x5637667eb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.200+0000 7f90c7fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5637667ec020 0x5637667ee4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43774/0 (socket says 172.21.15.120:43774) 2024-09-07T03:34:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.200+0000 7f90c7fff640 1 -- 172.21.15.120:0/882999838 learned_addr learned my addr 172.21.15.120:0/882999838 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.200+0000 7f90ccaad640 1 -- 172.21.15.120:0/882999838 >> v1:172.21.15.104:6789/0 conn(0x5637667ec020 legacy=0x5637667ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.200+0000 7f90ccaad640 1 -- 172.21.15.120:0/882999838 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637666796b0 con 0x5637667e9600 2024-09-07T03:34:19.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.202+0000 7f90ccaad640 1 --2- 172.21.15.120:0/882999838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637667eb9f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f90c000a470 tx=0x7f90c0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72cecc9d02b4e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.202+0000 7f90c77fe640 1 -- 172.21.15.120:0/882999838 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c0053570 con 0x5637667e9600 2024-09-07T03:34:19.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.202+0000 7f90c77fe640 1 -- 172.21.15.120:0/882999838 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0058070 con 0x5637667e9600 2024-09-07T03:34:19.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.202+0000 7f90c77fe640 1 -- 172.21.15.120:0/882999838 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c0053880 con 0x5637667e9600 2024-09-07T03:34:19.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.203+0000 7f90d0d2c800 1 -- 172.21.15.120:0/882999838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 msgr2=0x5637667eb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.203+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/882999838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637667eb9f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f90c000a470 tx=0x7f90c0045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.203+0000 7f90d0d2c800 1 -- 172.21.15.120:0/882999838 shutdown_connections 2024-09-07T03:34:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.203+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/882999838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637667eb9f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.203+0000 7f90d0d2c800 1 -- 172.21.15.120:0/882999838 >> 172.21.15.120:0/882999838 conn(0x5637667e31c0 msgr2=0x5637667e5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.203+0000 7f90d0d2c800 1 -- 172.21.15.120:0/882999838 shutdown_connections 2024-09-07T03:34:19.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.203+0000 7f90d0d2c800 1 -- 172.21.15.120:0/882999838 wait complete. 2024-09-07T03:34:19.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.217+0000 7f90d0d2c800 1 Processor -- start 2024-09-07T03:34:19.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.217+0000 7f90d0d2c800 1 -- start start 2024-09-07T03:34:19.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.217+0000 7f90d0d2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668d86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.217+0000 7f90d0d2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563766681dd0 con 0x5637667e9600 2024-09-07T03:34:19.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.217+0000 7f90ccaad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668d86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.217+0000 7f90ccaad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668d86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39736/0 (socket says 172.21.15.120:39736) 2024-09-07T03:34:19.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.217+0000 7f90ccaad640 1 -- 172.21.15.120:0/3342601706 learned_addr learned my addr 172.21.15.120:0/3342601706 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.218+0000 7f90ccaad640 1 -- 172.21.15.120:0/3342601706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56376669ae10 con 0x5637667e9600 2024-09-07T03:34:19.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.218+0000 7f90ccaad640 1 --2- 172.21.15.120:0/3342601706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668d86a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f90c0025c20 tx=0x7f90c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40397cc07b7597f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.218+0000 7f8fbae05640 1 -- 172.21.15.120:0/3342601706 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c0053a20 con 0x5637667e9600 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.218+0000 7f8fbae05640 1 -- 172.21.15.120:0/3342601706 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0063070 con 0x5637667e9600 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.218+0000 7f8fbae05640 1 -- 172.21.15.120:0/3342601706 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c0053cf0 con 0x5637667e9600 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3342601706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 msgr2=0x5637668d86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3342601706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668d86a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f90c0025c20 tx=0x7f90c0051000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3342601706 shutdown_connections 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3342601706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668d86a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3342601706 >> 172.21.15.120:0/3342601706 conn(0x5637667e31c0 msgr2=0x5637668d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3342601706 shutdown_connections 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3342601706 wait complete. 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 Processor -- start 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 -- start start 2024-09-07T03:34:19.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668dff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.219+0000 7f90d0d2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5637667f0040 con 0x5637667e9600 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f90ccaad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668dff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f90ccaad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668dff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39750/0 (socket says 172.21.15.120:39750) 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f90ccaad640 1 -- 172.21.15.120:0/1594636486 learned_addr learned my addr 172.21.15.120:0/1594636486 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f90ccaad640 1 -- 172.21.15.120:0/1594636486 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637668e04f0 con 0x5637667e9600 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f90ccaad640 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668dff90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f90c0025c20 tx=0x7f90c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f8fb9602640 1 -- 172.21.15.120:0/1594636486 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c0068660 con 0x5637667e9600 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f8fb9602640 1 -- 172.21.15.120:0/1594636486 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0068800 con 0x5637667e9600 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f8fb9602640 1 -- 172.21.15.120:0/1594636486 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c0068ae0 con 0x5637667e9600 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637668e0780 con 0x5637667e9600 2024-09-07T03:34:19.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.220+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637668e1390 con 0x5637667e9600 2024-09-07T03:34:19.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.221+0000 7f8fb9602640 1 -- 172.21.15.120:0/1594636486 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f90c0068c80 con 0x5637667e9600 2024-09-07T03:34:19.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.221+0000 7f8fb9602640 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fb403c730 0x7f8fb403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.221+0000 7f8fb9602640 1 -- 172.21.15.120:0/1594636486 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f90c0098390 con 0x5637667e9600 2024-09-07T03:34:19.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.221+0000 7f90c7fff640 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fb403c730 0x7f8fb403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.221+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5637667ec020 0x5637668e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.222+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637668e7b20 con 0x5637667ec020 2024-09-07T03:34:19.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.222+0000 7f90cd2ae640 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5637667ec020 0x5637668e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.222+0000 7f90c7fff640 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fb403c730 0x7f8fb403ebf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f90b8001d70 tx=0x7f90b80012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.222+0000 7f90cd2ae640 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5637667ec020 0x5637668e75e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.222+0000 7f90cd2ae640 1 -- 172.21.15.120:0/1594636486 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90c800a4d0 con 0x5637667ec020 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.222+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5637668e83d0 0x5637668ea870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.222+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637668eafe0 con 0x5637668e83d0 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.223+0000 7f90ccaad640 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5637668e83d0 0x5637668ea870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.223+0000 7f90ccaad640 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5637668e83d0 0x5637668ea870 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.223+0000 7f90ccaad640 1 -- 172.21.15.120:0/1594636486 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90c0051070 con 0x5637668e83d0 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.223+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637668ec890 con 0x5637668e83d0 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.224+0000 7f90ccaad640 1 -- 172.21.15.120:0/1594636486 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90c0051070 con 0x5637668e83d0 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.224+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637668eb9a0 con 0x5637668e83d0 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.224+0000 7f90ccaad640 1 -- 172.21.15.120:0/1594636486 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90c0051070 con 0x5637668e83d0 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.224+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637668ebdc0 con 0x5637667ec020 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.224+0000 7f90cd2ae640 1 -- 172.21.15.120:0/1594636486 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90c800a4d0 con 0x5637667ec020 2024-09-07T03:34:19.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.224+0000 7f90d0d2c800 1 Processor -- start 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.225+0000 7f90d0d2c800 1 -- start start 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.225+0000 7f90d0d2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e8da0 0x5637667e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.225+0000 7f90d0d2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5637666dfa00 con 0x5637667e8da0 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.225+0000 7f90cd2ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e8da0 0x5637667e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.225+0000 7f90cd2ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e8da0 0x5637667e7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39760/0 (socket says 172.21.15.120:39760) 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.225+0000 7f90cd2ae640 1 -- 172.21.15.120:0/2645554629 learned_addr learned my addr 172.21.15.120:0/2645554629 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.225+0000 7f90cd2ae640 1 -- 172.21.15.120:0/2645554629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637667e92c0 con 0x5637667e8da0 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.225+0000 7f90cd2ae640 1 --2- 172.21.15.120:0/2645554629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e8da0 0x5637667e7610 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f90c8016d20 tx=0x7f90c800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.226+0000 7f8fb27fc640 1 -- 172.21.15.120:0/2645554629 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8017660 con 0x5637667e8da0 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.226+0000 7f8fb27fc640 1 -- 172.21.15.120:0/2645554629 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c801b030 con 0x5637667e8da0 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.226+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2645554629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637667e7b50 con 0x5637667e8da0 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.226+0000 7f8fb27fc640 1 -- 172.21.15.120:0/2645554629 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8017950 con 0x5637667e8da0 2024-09-07T03:34:19.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.226+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2645554629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637667e80a0 con 0x5637667e8da0 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.226+0000 7f8fb27fc640 1 -- 172.21.15.120:0/2645554629 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f90c8017b40 con 0x5637667e8da0 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.227+0000 7f8fb27fc640 1 --2- 172.21.15.120:0/2645554629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fa403c7f0 0x7f8fa403ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.227+0000 7f8fb27fc640 1 -- 172.21.15.120:0/2645554629 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f90c800e040 con 0x5637667e8da0 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.227+0000 7f90ccaad640 1 --2- 172.21.15.120:0/2645554629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fa403c7f0 0x7f8fa403ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.227+0000 7f90d0d2c800 1 Processor -- start 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.227+0000 7f90d0d2c800 1 -- start start 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.227+0000 7f90ccaad640 1 --2- 172.21.15.120:0/2645554629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fa403c7f0 0x7f8fa403ecb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5637668eb4c0 tx=0x7f90c0045e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.227+0000 7f90d0d2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x563766909df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.227+0000 7f90d0d2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5637668d8e90 con 0x5637669099f0 2024-09-07T03:34:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f90cd2ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x563766909df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f90cd2ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x563766909df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39762/0 (socket says 172.21.15.120:39762) 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f90cd2ae640 1 -- 172.21.15.120:0/2736008786 learned_addr learned my addr 172.21.15.120:0/2736008786 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f90cd2ae640 1 -- 172.21.15.120:0/2736008786 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56376690a3e0 con 0x5637669099f0 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f90cd2ae640 1 --2- 172.21.15.120:0/2736008786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x563766909df0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f90c8013450 tx=0x7f90c8053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cab4a6310a7932 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f8fa3fff640 1 -- 172.21.15.120:0/2736008786 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8014a00 con 0x5637669099f0 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f8fa3fff640 1 -- 172.21.15.120:0/2736008786 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8051070 con 0x5637669099f0 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f8fa3fff640 1 -- 172.21.15.120:0/2736008786 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8028350 con 0x5637669099f0 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2736008786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 msgr2=0x563766909df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.228+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/2736008786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x563766909df0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f90c8013450 tx=0x7f90c8053f40 comp rx=0 tx=0).stop 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2736008786 shutdown_connections 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/2736008786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x563766909df0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2736008786 >> 172.21.15.120:0/2736008786 conn(0x563766905df0 msgr2=0x563766904030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2736008786 shutdown_connections 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2736008786 wait complete. 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90d0d2c800 1 Processor -- start 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90d0d2c800 1 -- start start 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90d0d2c800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x5637669110a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90d0d2c800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56376690aa00 con 0x5637669099f0 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90cd2ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x5637669110a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90cd2ae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x5637669110a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39776/0 (socket says 172.21.15.120:39776) 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.229+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 learned_addr learned my addr 172.21.15.120:0/3785500585 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.230+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563766911600 con 0x5637669099f0 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.230+0000 7f90cd2ae640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x5637669110a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f90c800dd00 tx=0x7f90c8053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.230+0000 7f8fa27fc640 1 -- 172.21.15.120:0/3785500585 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8005030 con 0x5637669099f0 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.230+0000 7f8fa27fc640 1 -- 172.21.15.120:0/3785500585 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c80051d0 con 0x5637669099f0 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.230+0000 7f8fa27fc640 1 -- 172.21.15.120:0/3785500585 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c80054d0 con 0x5637669099f0 2024-09-07T03:34:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.230+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563766911890 con 0x5637669099f0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.230+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563766912210 con 0x5637669099f0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.231+0000 7f8fa27fc640 1 -- 172.21.15.120:0/3785500585 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f90c80127a0 con 0x5637669099f0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.231+0000 7f8fa27fc640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f9803c730 0x7f8f9803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.231+0000 7f8fa27fc640 1 -- 172.21.15.120:0/3785500585 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f90c8035d10 con 0x5637669099f0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.231+0000 7f90ccaad640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f9803c730 0x7f8f9803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.231+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.231+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56376691cab0 0x56376691ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.231+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56376691f6c0 con 0x56376691cab0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.231+0000 7f90c7fff640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56376691cab0 0x56376691ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.231+0000 7f90ccaad640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f9803c730 0x7f8f9803ebf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f90c0096580 tx=0x7f90c0088000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90c7fff640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56376691cab0 0x56376691ef70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b8009050 con 0x56376691cab0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 20 realm 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56376691be00 con 0x56376691cab0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b8009050 con 0x56376691cab0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637669201a0 con 0x56376691cab0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b8009050 con 0x56376691cab0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563766920f80 0x563766923370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563766923a40 con 0x563766920f80 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.232+0000 7f90cd2ae640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563766920f80 0x563766923370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90cd2ae640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563766920f80 0x563766923370 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90d0d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637669242e0 con 0x563766920f80 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90d0d2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90d0d2c800 20 searching for the correct realm 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563766926050 0x563766928480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766926050 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.233+0000 7f90ccaad640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563766926050 0x563766928480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.234+0000 7f90ccaad640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563766926050 0x563766928480 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.234+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.234+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766920f80 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.235+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.235+0000 7f90cd2ae640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f90c802ab60 0x7f90c804e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.235+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x7f90c802ab60 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.235+0000 7f90c7fff640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f90c802ab60 0x7f90c804e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.235+0000 7f90c7fff640 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f90c802ab60 0x7f90c804e440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.235+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8009050 con 0x7f90c802ab60 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.235+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x56376691cab0 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.235+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8009050 con 0x56376691cab0 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.236+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x56376691cab0 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.236+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.236+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766926050 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.236+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.236+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x56376691cab0 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.236+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.236+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766920f80 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.237+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.237+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766920f80 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.237+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.237+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x56376691cab0 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.237+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.237+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x7f90c802ab60 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.237+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.237+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x56376691cab0 2024-09-07T03:34:19.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.237+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.238+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x7f90c802ab60 2024-09-07T03:34:19.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.238+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.238+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766920f80 2024-09-07T03:34:19.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.238+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.238+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766926050 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.238+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.238+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x56376691cab0 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.239+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.239+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766920f80 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.239+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.239+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766926050 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.239+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.239+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x56376691cab0 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.239+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.239+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x56376691cab0 2024-09-07T03:34:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.240+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.240+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x56376691cab0 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.240+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.240+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766926050 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.240+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.240+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x7f90c802ab60 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.240+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.240+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x7f90c802ab60 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.241+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.241+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x7f90c802ab60 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.241+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.241+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766926050 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.241+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.241+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x7f90c802ab60 2024-09-07T03:34:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.241+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.241+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766920f80 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.242+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.242+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766920f80 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.242+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.242+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766926050 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.242+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.242+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766920f80 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.242+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.242+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563766928b50 con 0x563766920f80 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563766924c60 con 0x56376691cab0 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637669250b0 con 0x563766920f80 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563766925510 con 0x56376691cab0 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 zone default found 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 4 Realm: () 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 zonegroup default 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.243+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637669247e0 con 0x7f90c802ab60 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56376692b230 con 0x563766926050 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56376692b710 con 0x563766926050 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 20 started sync module instance, tier type = 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.244+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692a030 con 0x563766920f80 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.246+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.246+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94795944074112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692bb70 con 0x563766920f80 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.246+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692c3c0 con 0x56376691cab0 2024-09-07T03:34:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.247+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94795944074112] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.247+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.247+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94795944082288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692c440 con 0x56376691cab0 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.247+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692cd10 con 0x563766920f80 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.248+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94795944082288] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.248+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.248+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94795944083344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692c860 con 0x563766920f80 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.248+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692d810 con 0x7f90c802ab60 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.249+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.249+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94795944088304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692d810 con 0x7f90c802ab60 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.249+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692e7c0 con 0x563766920f80 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.249+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94795944083344] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.250+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94795944088304] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.250+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.251+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94795944090624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692e7c0 con 0x563766920f80 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.251+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692f060 con 0x563766926050 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.251+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.252+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94795944094640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692f480 con 0x563766926050 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.252+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692fcd0 con 0x563766926050 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.252+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94795944090624] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.252+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.253+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94795944096896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692fd50 con 0x563766926050 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.253+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563766930710 con 0x7f90c802ab60 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.253+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94795944094640] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.253+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94795944096896] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94795944097952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692fcc0 con 0x7f90c802ab60 2024-09-07T03:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 20 add_watcher() i=0 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 20 add_watcher() i=1 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 20 add_watcher() i=2 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 20 add_watcher() i=3 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 20 add_watcher() i=4 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 20 add_watcher() i=5 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 20 add_watcher() i=6 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94795944097952] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 20 add_watcher() i=7 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.254+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563766933740 con 0x56376691cab0 2024-09-07T03:34:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.255+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.255+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94795944100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563766930bd0 con 0x56376691cab0 2024-09-07T03:34:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.256+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94795944100448] v36'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.256+0000 7f8f82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.256+0000 7f90d0d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.256+0000 7f90d0d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.256+0000 7f90d0d2c800 5 note: GC not initialized 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.256+0000 7f8f81fe3640 20 reqs_thread_entry: start 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.257+0000 7f90d0d2c800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.257+0000 7f90d0d2c800 20 Filter name: none 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.257+0000 7f8ef37fe640 20 reqs_thread_entry: start 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.257+0000 7f90d0d2c800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.257+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5637669661e0 con 0x56376691cab0 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.257+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.257+0000 7f90d0d2c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.257+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563766967600 con 0x563766926050 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.257+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.258+0000 7f8f82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.258+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94795944100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563766930b60 con 0x56376691cab0 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.259+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94795944100448] v36'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.259+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94795944074112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563766930260 con 0x563766920f80 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.260+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94795944074112] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.260+0000 7f90d0d2c800 20 remove_watcher() i=0 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.260+0000 7f90d0d2c800 2 removed watcher, disabling cache 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.260+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94795944082288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563766930260 con 0x56376691cab0 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.261+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94795944082288] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x56376691cab0 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.261+0000 7f90d0d2c800 20 remove_watcher() i=1 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.261+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94795944083344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692bb70 con 0x563766920f80 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.262+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94795944083344] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.262+0000 7f90d0d2c800 20 remove_watcher() i=2 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.262+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94795944088304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563766930260 con 0x7f90c802ab60 2024-09-07T03:34:19.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.263+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94795944088304] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.263+0000 7f90d0d2c800 20 remove_watcher() i=3 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.263+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94795944090624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692d2f0 con 0x563766920f80 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.264+0000 7f90cd2ae640 1 -- 172.21.15.120:0/3785500585 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94795944090624] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c803b070 con 0x563766920f80 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.264+0000 7f90d0d2c800 20 remove_watcher() i=4 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.264+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94795944094640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563766930260 con 0x563766926050 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.265+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94795944094640] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.265+0000 7f90d0d2c800 20 remove_watcher() i=5 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.265+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94795944096896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692dc00 con 0x563766926050 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.266+0000 7f90ccaad640 1 -- 172.21.15.120:0/3785500585 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94795944096896] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0051070 con 0x563766926050 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.266+0000 7f90d0d2c800 20 remove_watcher() i=6 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.266+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94795944097952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56376692d2f0 con 0x7f90c802ab60 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94795944097952] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b8028040 con 0x7f90c802ab60 2024-09-07T03:34:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 20 remove_watcher() i=7 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563766920f80 msgr2=0x563766923370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563766920f80 0x563766923370 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56376691cab0 msgr2=0x56376691ef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56376691cab0 0x56376691ef70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f90c802ab60 msgr2=0x7f90c804e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f90c802ab60 0x7f90c804e440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563766926050 msgr2=0x563766928480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563766926050 0x563766928480 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f9803c730 msgr2=0x7f8f9803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8f9803c730 0x7f8f9803ebf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f90c0096580 tx=0x7f90c0088000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 msgr2=0x5637669110a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90c7fff640 1 -- 172.21.15.120:0/3785500585 reap_dead start 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x5637669110a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f90c800dd00 tx=0x7f90c8053d90 comp rx=0 tx=0).stop 2024-09-07T03:34:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 shutdown_connections 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/3785500585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637669099f0 0x5637669110a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.267+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 >> 172.21.15.120:0/3785500585 conn(0x563766905df0 msgr2=0x563766904000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 shutdown_connections 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/3785500585 wait complete. 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2645554629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fa403c7f0 msgr2=0x7f8fa403ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/2645554629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fa403c7f0 0x7f8fa403ecb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5637668eb4c0 tx=0x7f90c0045e60 comp rx=0 tx=0).stop 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2645554629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e8da0 msgr2=0x5637667e7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/2645554629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e8da0 0x5637667e7610 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f90c8016d20 tx=0x7f90c800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2645554629 shutdown_connections 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/2645554629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fa403c7f0 0x7f8fa403ecb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/2645554629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e8da0 0x5637667e7610 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2645554629 >> 172.21.15.120:0/2645554629 conn(0x5637668ef0f0 msgr2=0x5637668ef4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2645554629 shutdown_connections 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/2645554629 wait complete. 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5637668e83d0 msgr2=0x5637668ea870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5637668e83d0 0x5637668ea870 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5637667ec020 msgr2=0x5637668e75e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5637667ec020 0x5637668e75e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fb403c730 msgr2=0x7f8fb403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fb403c730 0x7f8fb403ebf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f90b8001d70 tx=0x7f90b80012d0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 msgr2=0x5637668dff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668dff90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f90c0025c20 tx=0x7f90c0002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 shutdown_connections 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5637668e83d0 0x5637668ea870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5637667ec020 0x5637668e75e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8fb403c730 0x7f8fb403ebf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 --2- 172.21.15.120:0/1594636486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5637667e9600 0x5637668dff90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.268+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 >> 172.21.15.120:0/1594636486 conn(0x5637667e31c0 msgr2=0x5637668d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.269+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 shutdown_connections 2024-09-07T03:34:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.269+0000 7f90d0d2c800 1 -- 172.21.15.120:0/1594636486 wait complete. 2024-09-07T03:34:19.281 INFO:teuthology.orchestra.run.smithi120.stdout:{"entries":[],"summary":[]} 2024-09-07T03:34:19.281 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-07T03:34:19.281 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-07T03:34:19.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-07T03:34:19.281 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-07T03:34:19.327 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:19.327 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:19.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.326+0000 7fd25b92f800 1 Processor -- start 2024-09-07T03:34:19.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.326+0000 7fd25b92f800 1 -- start start 2024-09-07T03:34:19.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.326+0000 7fd25b92f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5572d49f5000 0x5572d49f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.326+0000 7fd25b92f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572d489ee40 con 0x5572d49f6100 2024-09-07T03:34:19.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.326+0000 7fd25b92f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5572d4869680 con 0x5572d49f5000 2024-09-07T03:34:19.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.327+0000 7fd257676640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5572d49f5000 0x5572d49f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.327+0000 7fd24ee75640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5572d49f6100 0x5572d49fae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43780/0 (socket says 172.21.15.120:43780) 2024-09-07T03:34:19.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.327+0000 7fd24ee75640 1 -- 172.21.15.120:0/1623457551 learned_addr learned my addr 172.21.15.120:0/1623457551 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:19.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.327+0000 7fd257676640 1 -- 172.21.15.120:0/1623457551 >> v1:172.21.15.104:6789/0 conn(0x5572d49f6100 legacy=0x5572d49fae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.327+0000 7fd257676640 1 -- 172.21.15.120:0/1623457551 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d48856b0 con 0x5572d49f5000 2024-09-07T03:34:19.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd257676640 1 --2- 172.21.15.120:0/1623457551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d49f5bc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd24800a470 tx=0x7fd248045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b009691fb388924 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd256e75640 1 -- 172.21.15.120:0/1623457551 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd248053570 con 0x5572d49f5000 2024-09-07T03:34:19.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd256e75640 1 -- 172.21.15.120:0/1623457551 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd248058070 con 0x5572d49f5000 2024-09-07T03:34:19.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd256e75640 1 -- 172.21.15.120:0/1623457551 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd248053880 con 0x5572d49f5000 2024-09-07T03:34:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd25b92f800 1 -- 172.21.15.120:0/1623457551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 msgr2=0x5572d49f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1623457551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d49f5bc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd24800a470 tx=0x7fd248045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd25b92f800 1 -- 172.21.15.120:0/1623457551 shutdown_connections 2024-09-07T03:34:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1623457551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d49f5bc0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd25b92f800 1 -- 172.21.15.120:0/1623457551 >> 172.21.15.120:0/1623457551 conn(0x5572d49f03d0 msgr2=0x5572d49f2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd25b92f800 1 -- 172.21.15.120:0/1623457551 shutdown_connections 2024-09-07T03:34:19.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.329+0000 7fd25b92f800 1 -- 172.21.15.120:0/1623457551 wait complete. 2024-09-07T03:34:19.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.343+0000 7fd25b92f800 1 Processor -- start 2024-09-07T03:34:19.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.343+0000 7fd25b92f800 1 -- start start 2024-09-07T03:34:19.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.343+0000 7fd25b92f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d496a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.343+0000 7fd25b92f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5572d488ddd0 con 0x5572d49f5000 2024-09-07T03:34:19.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.344+0000 7fd257676640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d496a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.344+0000 7fd257676640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d496a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39800/0 (socket says 172.21.15.120:39800) 2024-09-07T03:34:19.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.344+0000 7fd257676640 1 -- 172.21.15.120:0/2919896281 learned_addr learned my addr 172.21.15.120:0/2919896281 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.344+0000 7fd257676640 1 -- 172.21.15.120:0/2919896281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d48a6e10 con 0x5572d49f5000 2024-09-07T03:34:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.344+0000 7fd257676640 1 --2- 172.21.15.120:0/2919896281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d496a6c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd248025c20 tx=0x7fd248051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28861b3856b2330d server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.344+0000 7fd14560a640 1 -- 172.21.15.120:0/2919896281 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd248053a20 con 0x5572d49f5000 2024-09-07T03:34:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.344+0000 7fd14560a640 1 -- 172.21.15.120:0/2919896281 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd248063070 con 0x5572d49f5000 2024-09-07T03:34:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.344+0000 7fd14560a640 1 -- 172.21.15.120:0/2919896281 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd248053cf0 con 0x5572d49f5000 2024-09-07T03:34:19.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.345+0000 7fd25b92f800 1 -- 172.21.15.120:0/2919896281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 msgr2=0x5572d496a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.345+0000 7fd25b92f800 1 --2- 172.21.15.120:0/2919896281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d496a6c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd248025c20 tx=0x7fd248051000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.345+0000 7fd25b92f800 1 -- 172.21.15.120:0/2919896281 shutdown_connections 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.345+0000 7fd25b92f800 1 --2- 172.21.15.120:0/2919896281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d496a6c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.345+0000 7fd25b92f800 1 -- 172.21.15.120:0/2919896281 >> 172.21.15.120:0/2919896281 conn(0x5572d49f03d0 msgr2=0x5572d4adff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.345+0000 7fd25b92f800 1 -- 172.21.15.120:0/2919896281 shutdown_connections 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.345+0000 7fd25b92f800 1 -- 172.21.15.120:0/2919896281 wait complete. 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.345+0000 7fd25b92f800 1 Processor -- start 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.346+0000 7fd25b92f800 1 -- start start 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.346+0000 7fd25b92f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d4aee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.346+0000 7fd25b92f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5572d49f67f0 con 0x5572d49f5000 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.346+0000 7fd257676640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d4aee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.346+0000 7fd257676640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d4aee0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39806/0 (socket says 172.21.15.120:39806) 2024-09-07T03:34:19.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.346+0000 7fd257676640 1 -- 172.21.15.120:0/196278133 learned_addr learned my addr 172.21.15.120:0/196278133 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.346+0000 7fd257676640 1 -- 172.21.15.120:0/196278133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d4aee630 con 0x5572d49f5000 2024-09-07T03:34:19.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.346+0000 7fd257676640 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d4aee0d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd248025c20 tx=0x7fd248002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.346+0000 7fd143e07640 1 -- 172.21.15.120:0/196278133 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd248068660 con 0x5572d49f5000 2024-09-07T03:34:19.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.347+0000 7fd143e07640 1 -- 172.21.15.120:0/196278133 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd248068800 con 0x5572d49f5000 2024-09-07T03:34:19.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.347+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572d4aee8c0 con 0x5572d49f5000 2024-09-07T03:34:19.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.347+0000 7fd143e07640 1 -- 172.21.15.120:0/196278133 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd248068ae0 con 0x5572d49f5000 2024-09-07T03:34:19.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.347+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572d4aef4d0 con 0x5572d49f5000 2024-09-07T03:34:19.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.347+0000 7fd143e07640 1 -- 172.21.15.120:0/196278133 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd248068c80 con 0x5572d49f5000 2024-09-07T03:34:19.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.348+0000 7fd143e07640 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13c03c730 0x7fd13c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.348+0000 7fd143e07640 1 -- 172.21.15.120:0/196278133 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd248098390 con 0x5572d49f5000 2024-09-07T03:34:19.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.348+0000 7fd24ee75640 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13c03c730 0x7fd13c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.348+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d49f6100 0x5572d4af5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.348+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4af5c60 con 0x5572d49f6100 2024-09-07T03:34:19.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.348+0000 7fd257e77640 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d49f6100 0x5572d4af5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.348+0000 7fd24ee75640 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13c03c730 0x7fd13c03ebf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd240001d70 tx=0x7fd2400012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.348+0000 7fd257e77640 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d49f6100 0x5572d4af5720 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.348+0000 7fd257e77640 1 -- 172.21.15.120:0/196278133 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd25000a4d0 con 0x5572d49f6100 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.349+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4af6560 0x5572d4af89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.349+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4af9160 con 0x5572d4af6560 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.349+0000 7fd257676640 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4af6560 0x5572d4af89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.349+0000 7fd257676640 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4af6560 0x5572d4af89f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.349+0000 7fd257676640 1 -- 172.21.15.120:0/196278133 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd248051070 con 0x5572d4af6560 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.349+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4afaa10 con 0x5572d4af6560 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.350+0000 7fd257676640 1 -- 172.21.15.120:0/196278133 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd248051070 con 0x5572d4af6560 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.350+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4af9b20 con 0x5572d4af6560 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.350+0000 7fd257676640 1 -- 172.21.15.120:0/196278133 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd248051070 con 0x5572d4af6560 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.350+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4af9f40 con 0x5572d49f6100 2024-09-07T03:34:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.350+0000 7fd257e77640 1 -- 172.21.15.120:0/196278133 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd25000a4d0 con 0x5572d49f6100 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.351+0000 7fd25b92f800 1 Processor -- start 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.351+0000 7fd25b92f800 1 -- start start 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.351+0000 7fd25b92f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4b08ec0 0x5572d4b092e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.351+0000 7fd25b92f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5572d48eba00 con 0x5572d4b08ec0 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.351+0000 7fd257e77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4b08ec0 0x5572d4b092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.351+0000 7fd257e77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4b08ec0 0x5572d4b092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39808/0 (socket says 172.21.15.120:39808) 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.351+0000 7fd257e77640 1 -- 172.21.15.120:0/2892295564 learned_addr learned my addr 172.21.15.120:0/2892295564 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.351+0000 7fd257e77640 1 -- 172.21.15.120:0/2892295564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d4b09920 con 0x5572d4b08ec0 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.351+0000 7fd257e77640 1 --2- 172.21.15.120:0/2892295564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4b08ec0 0x5572d4b092e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd250016d20 tx=0x7fd25000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.352+0000 7fd141602640 1 -- 172.21.15.120:0/2892295564 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd250017660 con 0x5572d4b08ec0 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.352+0000 7fd141602640 1 -- 172.21.15.120:0/2892295564 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25001b030 con 0x5572d4b08ec0 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.352+0000 7fd141602640 1 -- 172.21.15.120:0/2892295564 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd250017950 con 0x5572d4b08ec0 2024-09-07T03:34:19.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.352+0000 7fd25b92f800 1 -- 172.21.15.120:0/2892295564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572d4b0a150 con 0x5572d4b08ec0 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.352+0000 7fd25b92f800 1 -- 172.21.15.120:0/2892295564 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572d4b0a6f0 con 0x5572d4b08ec0 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.352+0000 7fd141602640 1 -- 172.21.15.120:0/2892295564 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd250017af0 con 0x5572d4b08ec0 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd141602640 1 --2- 172.21.15.120:0/2892295564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13003c840 0x7fd13003ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd141602640 1 -- 172.21.15.120:0/2892295564 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd25000e040 con 0x5572d4b08ec0 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd257676640 1 --2- 172.21.15.120:0/2892295564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13003c840 0x7fd13003ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd25b92f800 1 Processor -- start 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd257676640 1 --2- 172.21.15.120:0/2892295564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13003c840 0x7fd13003ed00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5572d4af9640 tx=0x7fd248045e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd25b92f800 1 -- start start 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd25b92f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4ae4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd25b92f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5572d4968f60 con 0x5572d4ae4330 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd257e77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4ae4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd257e77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4ae4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39818/0 (socket says 172.21.15.120:39818) 2024-09-07T03:34:19.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.353+0000 7fd257e77640 1 -- 172.21.15.120:0/2641937666 learned_addr learned my addr 172.21.15.120:0/2641937666 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd257e77640 1 -- 172.21.15.120:0/2641937666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d4ae4c70 con 0x5572d4ae4330 2024-09-07T03:34:19.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd257e77640 1 --2- 172.21.15.120:0/2641937666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4ae4730 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd250054030 tx=0x7fd250054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675a37738a75d425 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd13affd640 1 -- 172.21.15.120:0/2641937666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd250014e70 con 0x5572d4ae4330 2024-09-07T03:34:19.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd13affd640 1 -- 172.21.15.120:0/2641937666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2500149b0 con 0x5572d4ae4330 2024-09-07T03:34:19.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd13affd640 1 -- 172.21.15.120:0/2641937666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd250028350 con 0x5572d4ae4330 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd25b92f800 1 -- 172.21.15.120:0/2641937666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 msgr2=0x5572d4ae4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd25b92f800 1 --2- 172.21.15.120:0/2641937666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4ae4730 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd250054030 tx=0x7fd250054060 comp rx=0 tx=0).stop 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd25b92f800 1 -- 172.21.15.120:0/2641937666 shutdown_connections 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd25b92f800 1 --2- 172.21.15.120:0/2641937666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4ae4730 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd25b92f800 1 -- 172.21.15.120:0/2641937666 >> 172.21.15.120:0/2641937666 conn(0x5572d4b11d80 msgr2=0x5572d4b0ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd25b92f800 1 -- 172.21.15.120:0/2641937666 shutdown_connections 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.354+0000 7fd25b92f800 1 -- 172.21.15.120:0/2641937666 wait complete. 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.355+0000 7fd25b92f800 1 Processor -- start 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.355+0000 7fd25b92f800 1 -- start start 2024-09-07T03:34:19.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.355+0000 7fd25b92f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4b212e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.355+0000 7fd25b92f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5572d4ae5310 con 0x5572d4ae4330 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.355+0000 7fd257e77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4b212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.355+0000 7fd257e77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4b212e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39824/0 (socket says 172.21.15.120:39824) 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.355+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 learned_addr learned my addr 172.21.15.120:0/1677336910 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.355+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d4b21840 con 0x5572d4ae4330 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.355+0000 7fd257e77640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4b212e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd250013550 tx=0x7fd250053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.356+0000 7fd1397fa640 1 -- 172.21.15.120:0/1677336910 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd250012570 con 0x5572d4ae4330 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.356+0000 7fd1397fa640 1 -- 172.21.15.120:0/1677336910 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd250005500 con 0x5572d4ae4330 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.356+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572d4b21ad0 con 0x5572d4ae4330 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.356+0000 7fd1397fa640 1 -- 172.21.15.120:0/1677336910 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd250012ae0 con 0x5572d4ae4330 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.356+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572d4b22660 con 0x5572d4ae4330 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.356+0000 7fd1397fa640 1 -- 172.21.15.120:0/1677336910 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd250012c80 con 0x5572d4ae4330 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.357+0000 7fd1397fa640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd12003c780 0x7fd12003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.357+0000 7fd1397fa640 1 -- 172.21.15.120:0/1677336910 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd2500489e0 con 0x5572d4ae4330 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.357+0000 7fd257676640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd12003c780 0x7fd12003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.357+0000 7fd257676640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd12003c780 0x7fd12003ec40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd248096580 tx=0x7fd248088000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.357+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.357+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d4b2cde0 0x5572d4b2f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.357+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b2f9f0 con 0x5572d4b2cde0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.357+0000 7fd24ee75640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d4b2cde0 0x5572d4b2f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.357+0000 7fd24ee75640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d4b2cde0 0x5572d4b2f2a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd240009050 con 0x5572d4b2cde0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 20 realm 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b2c130 con 0x5572d4b2cde0 2024-09-07T03:34:19.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd240009050 con 0x5572d4b2cde0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b304e0 con 0x5572d4b2cde0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd240009050 con 0x5572d4b2cde0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4b312c0 0x5572d4b336b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b33d80 con 0x5572d4b312c0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.358+0000 7fd257e77640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4b312c0 0x5572d4b336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd257e77640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4b312c0 0x5572d4b336b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd25b92f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b345d0 con 0x5572d4b312c0 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd25b92f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd25b92f800 20 searching for the correct realm 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5572d4b36340 0x5572d4b38770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b36340 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.359+0000 7fd257676640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5572d4b36340 0x5572d4b38770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.360+0000 7fd257676640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5572d4b36340 0x5572d4b38770 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.360+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.360+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b312c0 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.360+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.360+0000 7fd257e77640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fd250014440 0x7fd2500439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.360+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x7fd250014440 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.360+0000 7fd24ee75640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fd250014440 0x7fd2500439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.361+0000 7fd24ee75640 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fd250014440 0x7fd2500439d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.361+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240009050 con 0x7fd250014440 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.361+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b2cde0 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.361+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240009050 con 0x5572d4b2cde0 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.361+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b2cde0 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.361+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.361+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b36340 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.362+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.362+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b2cde0 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.362+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.362+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b312c0 2024-09-07T03:34:19.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.362+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.362+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b312c0 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.362+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.362+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b2cde0 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.363+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.363+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x7fd250014440 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.363+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.363+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b2cde0 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.363+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.363+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x7fd250014440 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.363+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.363+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b312c0 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.364+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.364+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b36340 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.364+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.364+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b2cde0 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.364+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.364+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b312c0 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b36340 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b2cde0 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b2cde0 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b2cde0 2024-09-07T03:34:19.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.365+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b36340 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.366+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.366+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x7fd250014440 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.366+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.366+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x7fd250014440 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.366+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.366+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x7fd250014440 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.366+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.366+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b36340 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.367+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.367+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x7fd250014440 2024-09-07T03:34:19.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.367+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.367+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b312c0 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.367+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.367+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b312c0 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.367+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.367+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b36340 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b312c0 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b38e40 con 0x5572d4b312c0 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:19.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b34f50 con 0x5572d4b2cde0 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.368+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b34b90 con 0x5572d4b312c0 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b35390 con 0x5572d4b2cde0 2024-09-07T03:34:19.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:19.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 zone default found 2024-09-07T03:34:19.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 4 Realm: () 2024-09-07T03:34:19.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:19.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:19.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:19.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 zonegroup default 2024-09-07T03:34:19.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b39770 con 0x7fd250014440 2024-09-07T03:34:19.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3b9b0 con 0x5572d4b36340 2024-09-07T03:34:19.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.369+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3bd50 con 0x5572d4b36340 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.370+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.370+0000 7fd25b92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.370+0000 7fd25b92f800 20 started sync module instance, tier type = 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.370+0000 7fd25b92f800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.370+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3adf0 con 0x5572d4b312c0 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.371+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.371+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93951683179280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3adf0 con 0x5572d4b312c0 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.371+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3c3d0 con 0x5572d4b2cde0 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.372+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93951683179280] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.372+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.372+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93951683182272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3adf0 con 0x5572d4b2cde0 2024-09-07T03:34:19.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.372+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3ce20 con 0x5572d4b312c0 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.373+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93951683182272] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.373+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.373+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93951683184944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3adf0 con 0x5572d4b312c0 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.373+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3d8a0 con 0x7fd250014440 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.374+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93951683184944] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.374+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.374+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93951683187632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3adf0 con 0x7fd250014440 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.375+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3e310 con 0x5572d4b312c0 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.375+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93951683187632] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.376+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.376+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93951683190272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3adf0 con 0x5572d4b312c0 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.376+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3ed20 con 0x5572d4b36340 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.377+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93951683190272] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.377+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.377+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93951683177280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3ed20 con 0x5572d4b36340 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.377+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3f740 con 0x5572d4b36340 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.378+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93951683177280] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.378+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.378+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93951683195440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3ed20 con 0x5572d4b36340 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.378+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b40190 con 0x7fd250014440 2024-09-07T03:34:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93951683198112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b40690 con 0x7fd250014440 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd25b92f800 20 add_watcher() i=0 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd25b92f800 20 add_watcher() i=1 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd25b92f800 20 add_watcher() i=2 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd25b92f800 20 add_watcher() i=3 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd25b92f800 20 add_watcher() i=4 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd25b92f800 20 add_watcher() i=5 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93951683195440] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.379+0000 7fd25b92f800 20 add_watcher() i=6 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.380+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93951683198112] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.380+0000 7fd25b92f800 20 add_watcher() i=7 2024-09-07T03:34:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.380+0000 7fd25b92f800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.380+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3e870 con 0x5572d4b2cde0 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.380+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.380+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93951683199296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3e870 con 0x5572d4b2cde0 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.382+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93951683199296] v36'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.382+0000 7fd10dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.382+0000 7fd25b92f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.382+0000 7fd25b92f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.382+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b312c0 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.384+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'60 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.384+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0e0 con 0x7fd250014440 2024-09-07T03:34:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.384+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.384+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b36340 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.386+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.386+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b2cde0 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.387+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'239 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.387+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b312c0 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.388+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'80 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.388+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b36340 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.389+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'61 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.389+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b312c0 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.390+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'37 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.390+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b2cde0 2024-09-07T03:34:19.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.391+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.391+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b312c0 2024-09-07T03:34:19.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.392+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.392+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b312c0 2024-09-07T03:34:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.393+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.393+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b312c0 2024-09-07T03:34:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.394+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'81 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.394+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4c0a0 con 0x5572d4b36340 2024-09-07T03:34:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.395+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.395+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4da10 con 0x5572d4b312c0 2024-09-07T03:34:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.396+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.396+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4da10 con 0x5572d4b2cde0 2024-09-07T03:34:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.397+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'68 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.397+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d720 con 0x5572d4b2cde0 2024-09-07T03:34:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.398+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'240 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.398+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d7f0 con 0x5572d4b312c0 2024-09-07T03:34:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.399+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.399+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d7f0 con 0x5572d4b312c0 2024-09-07T03:34:19.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.400+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'82 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.400+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d7f0 con 0x5572d4b36340 2024-09-07T03:34:19.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.401+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'40 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.401+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d8d0 con 0x5572d4b312c0 2024-09-07T03:34:19.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.403+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.403+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d8d0 con 0x5572d4b2cde0 2024-09-07T03:34:19.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.404+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'241 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.404+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d8d0 con 0x5572d4b312c0 2024-09-07T03:34:19.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.405+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'77 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.405+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d8d0 con 0x5572d4b312c0 2024-09-07T03:34:19.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.406+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.406+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d910 con 0x5572d4b36340 2024-09-07T03:34:19.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.406+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.406+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d950 con 0x5572d4b312c0 2024-09-07T03:34:19.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.408+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'46 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.408+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d9a0 con 0x5572d4b36340 2024-09-07T03:34:19.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.409+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.409+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d9a0 con 0x5572d4b36340 2024-09-07T03:34:19.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.410+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'62 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.410+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4d9e0 con 0x5572d4b36340 2024-09-07T03:34:19.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.411+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.411+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4da20 con 0x5572d4b312c0 2024-09-07T03:34:19.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.412+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.412+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4da20 con 0x5572d4b2cde0 2024-09-07T03:34:19.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.413+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.413+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4da40 con 0x5572d4b312c0 2024-09-07T03:34:19.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.414+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'78 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.414+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4da70 con 0x5572d4b2cde0 2024-09-07T03:34:19.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.415+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'69 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.415+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b4da70 con 0x7fd250014440 2024-09-07T03:34:19.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.416+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.416+0000 7fd10cfe1640 20 reqs_thread_entry: start 2024-09-07T03:34:19.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.416+0000 7fd25b92f800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:19.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.416+0000 7fd25b92f800 20 Filter name: none 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd0867fc640 20 reqs_thread_entry: start 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b789c0 con 0x5572d4b2cde0 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7ac60 con 0x7fd250014440 2024-09-07T03:34:19.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 : miss 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.417+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:96 8.1c 8:3d083f68:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7a800 con 0x5572d4b36340 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(96 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd25b92f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd25b92f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 info.flags=0x17 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd25b92f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 to cache LRU end 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd25b92f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd25b92f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd25b92f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 2024-09-07T03:34:19.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:97 4.2d 4:b6a1929c:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf84a0 con 0x7fd250014440 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(97 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.418+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:98 4.13 4:ca3232e0:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf84a0 con 0x7fd250014440 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.419+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(98 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.419+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:99 4.39 4:9e2dd974:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf84a0 con 0x7fd250014440 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.419+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(99 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.2 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.419+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:100 4.37 4:efb37a66:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf84a0 con 0x7fd250014440 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.419+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(100 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.419+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:101 4.21 4:858c248e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf84a0 con 0x5572d4b36340 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.419+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(101 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4 [call out=430b] v0'0 uv11 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.419+0000 7fd25b92f800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-07T03:34:19.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.419+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:102 4.28 4:15091f63:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf84a0 con 0x5572d4b312c0 2024-09-07T03:34:19.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.420+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(102 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.420+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:103 4.1 4:83209b65:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf84a0 con 0x7fd250014440 2024-09-07T03:34:19.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.420+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(103 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.6 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.420+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:104 4.d 4:b2c2f2c6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf8920 con 0x5572d4b312c0 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.421+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(104 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.421+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:105 4.1c 4:3968801b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf8920 con 0x7fd250014440 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.421+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(105 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.421+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 4.25 4:a4d3cbee:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf8920 con 0x5572d4b312c0 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.421+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(106 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.421+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:107 4.24 4:24a7cbaa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4bf8660 con 0x5572d4b2cde0 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(107 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd25b92f800 20 get_obj_state: octx=0x5572d4ae4fb0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5572d4b7bf58 s->prefetch_data=0 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 3.16s0 3:6bf2f74e:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7cd80 con 0x5572d4b312c0 2024-09-07T03:34:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(108 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd25b92f800 10 manifest: total_size = 6 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd25b92f800 20 get_obj_state: setting s->obj_tag to cf0fab6f-a978-4ce5-bacd-166891c31743.4225.13877901417325007493 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd25b92f800 20 get_obj_state: octx=0x5572d4ae4fb0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5572d4b7bf58 s->prefetch_data=0 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd25b92f800 20 prepare_atomic_modification: state is not atomic. state=0x5572d4b7bf58 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd25b92f800 20 bucket index object: :.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.422+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:109 4.21 4:858c248e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b81800 con 0x5572d4b36340 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.423+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(109 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4 [stat,call,call] v36'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.423+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:110 3.16s0 3:6bf2f74e:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b81800 con 0x5572d4b312c0 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(110 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7_15f6f8dc036519d7fe15b39338f6e5db [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:111 4.21 4:858c248e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b80ba0 con 0x5572d4b36340 2024-09-07T03:34:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 20 list_objects_ordered: starting attempt 1 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:112 4.2d 4:b6a1929c:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b80ba0 con 0x7fd250014440 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:113 4.13 4:ca3232e0:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b86780 con 0x7fd250014440 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:114 4.39 4:9e2dd974:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b890e0 con 0x7fd250014440 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:115 4.37 4:efb37a66:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8bb40 con 0x7fd250014440 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:116 4.21 4:858c248e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8e890 con 0x5572d4b36340 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:117 4.28 4:15091f63:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x5572d4b312c0 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:118 4.1 4:83209b65:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b944b0 con 0x7fd250014440 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:119 4.d 4:b2c2f2c6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b97300 con 0x5572d4b312c0 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:120 4.1c 4:3968801b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b99fb0 con 0x7fd250014440 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:121 4.25 4:a4d3cbee:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b86780 con 0x5572d4b312c0 2024-09-07T03:34:19.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.425+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:122 4.24 4:24a7cbaa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8bb40 con 0x5572d4b2cde0 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(119 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(117 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== osd_op_reply(121 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(122 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(111 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4 [stat,call,call] v36'15 uv15 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd13a7fc640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 22 ==== osd_op_reply(112 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 23 ==== osd_op_reply(113 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 24 ==== osd_op_reply(114 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.2 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 25 ==== osd_op_reply(115 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 26 ==== osd_op_reply(118 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.6 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 27 ==== osd_op_reply(120 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.426+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(116 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4 [call out=128b] v0'0 uv15 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7])"; uploads.size()=0; is_truncated=0 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:123 4.2d 4:b6a1929c:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x7fd250014440 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:124 4.13 4:ca3232e0:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b97300 con 0x7fd250014440 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:125 4.39 4:9e2dd974:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x7fd250014440 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:126 4.37 4:efb37a66:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7e540 con 0x7fd250014440 2024-09-07T03:34:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:127 4.21 4:858c248e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x5572d4b36340 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:128 4.28 4:15091f63:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7e540 con 0x5572d4b312c0 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:129 4.1 4:83209b65:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x7fd250014440 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:130 4.d 4:b2c2f2c6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x5572d4b312c0 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:131 4.1c 4:3968801b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7e540 con 0x7fd250014440 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:132 4.25 4:a4d3cbee:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b944d0 con 0x5572d4b312c0 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:133 4.24 4:24a7cbaa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7edd0 con 0x5572d4b2cde0 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(127 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4 [call out=128b] v0'0 uv15 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(130 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(132 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(128 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 28 ==== osd_op_reply(123 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 29 ==== osd_op_reply(124 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 30 ==== osd_op_reply(125 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.2 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 31 ==== osd_op_reply(126 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 32 ==== osd_op_reply(129 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.6 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 33 ==== osd_op_reply(131 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(133 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.427+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x7fd250014440 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.428+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 34 ==== osd_op_reply(134 foo.buckets [call] v36'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.428+0000 7fd25b92f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-07T03:34:19.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.428+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.428+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x7fd250014440 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.429+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 35 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.429+0000 7fd25b92f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.429+0000 7fd25b92f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.429+0000 7fd25b92f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.429+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x7fd250014440 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.430+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 36 ==== osd_op_reply(136 myfoo [call,call,delete] v36'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.430+0000 7fd25b92f800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.430+0000 7fd25b92f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.430+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93951683530496 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x5572d4b36340 2024-09-07T03:34:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.430+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== watch-notify(notify (1) cookie 93951683195440 notify 154618822690 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5572d4b79dd0 con 0x5572d4b36340 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.430+0000 7fd13affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822690 cookie 93951683195440 notifier 4778 bl.length()=149 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.430+0000 7fd13affd640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd11c003d60 con 0x5572d4b36340 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.430+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(137 notify.6 [notify cookie 93951683530496 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.430+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.431+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== watch-notify(notify_complete (2) cookie 93951683530496 notify 154618822690 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd248095040 con 0x5572d4b36340 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.431+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:139 8.1c 8:3d083f68:root::.bucket.meta.myfoo%3acf0fab6f-a978-4ce5-bacd-166891c31743.4225.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x5572d4b36340 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== osd_op_reply(139 .bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 [call,call,delete] v36'6 uv6 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 from cache 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7, ofs0, ns] 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 93951683530496 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x7fd250014440 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 37 ==== watch-notify(notify (1) cookie 93951683187632 notify 154618822690 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5572d4b4cee0 con 0x7fd250014440 2024-09-07T03:34:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd13a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822690 cookie 93951683187632 notifier 4778 bl.length()=206 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd13a7fc640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd08c0032c0 con 0x7fd250014440 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 38 ==== osd_op_reply(140 notify.3 [notify cookie 93951683530496 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 39 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 40 ==== watch-notify(notify_complete (2) cookie 93951683530496 notify 154618822690 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5572d4b4c860 con 0x7fd250014440 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:142 4.2d 4:b6a1929c:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x7fd250014440 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:143 4.13 4:ca3232e0:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8f1e0 con 0x7fd250014440 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:144 4.39 4:9e2dd974:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b78dc0 con 0x7fd250014440 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:145 4.37 4:efb37a66:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b79690 con 0x7fd250014440 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:146 4.21 4:858c248e:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b90320 con 0x5572d4b36340 2024-09-07T03:34:19.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:147 4.28 4:15091f63:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x5572d4b312c0 2024-09-07T03:34:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:148 4.1 4:83209b65:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8f1e0 con 0x7fd250014440 2024-09-07T03:34:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:149 4.d 4:b2c2f2c6:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b952b0 con 0x5572d4b312c0 2024-09-07T03:34:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:150 4.1c 4:3968801b:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b78dc0 con 0x7fd250014440 2024-09-07T03:34:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:151 4.25 4:a4d3cbee:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b80470 con 0x5572d4b312c0 2024-09-07T03:34:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.432+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:152 4.24 4:24a7cbaa:::.dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b90320 con 0x5572d4b2cde0 2024-09-07T03:34:19.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.434+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 33 ==== osd_op_reply(146 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.4 [delete] v36'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.434+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 41 ==== osd_op_reply(143 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.1 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.434+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 45 ==== osd_op_reply(149 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.7 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.434+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 42 ==== osd_op_reply(148 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.6 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.434+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 43 ==== osd_op_reply(144 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.2 [delete] v36'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.434+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 46 ==== osd_op_reply(147 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.5 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 47 ==== osd_op_reply(151 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.9 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 44 ==== osd_op_reply(150 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.8 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 45 ==== osd_op_reply(145 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.3 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 46 ==== osd_op_reply(142 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.0 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(152 .dir.cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7.10 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd25b92f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 : miss 2024-09-07T03:34:19.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd25b92f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:153 6.19 6:9e061e21:::pubsub..bucket.myfoo%2fcf0fab6f-a978-4ce5-bacd-166891c31743.4225.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7f6e0 con 0x5572d4b312c0 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 48 ==== osd_op_reply(153 pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd25b92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd25b92f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 info.flags=0x0 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd25b92f800 10 adding default.rgw.log++pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 to cache LRU end 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.435+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:154 6.19 6:9e061e21:::pubsub..bucket.myfoo%2fcf0fab6f-a978-4ce5-bacd-166891c31743.4225.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b79270 con 0x5572d4b312c0 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.436+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 49 ==== osd_op_reply(154 pubsub..bucket.myfoo/cf0fab6f-a978-4ce5-bacd-166891c31743.4225.7 [delete] v36'61 uv52 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.436+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b7fb90 con 0x7fd250014440 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.437+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 47 ==== osd_op_reply(155 foo.buckets [call] v36'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.437+0000 7fd25b92f800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-07T03:34:19.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.437+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8f1e0 con 0x5572d4b2cde0 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.438+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v36'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.438+0000 7fd25b92f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.438+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 93951683458784 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8d510 con 0x7fd250014440 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.438+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 48 ==== watch-notify(notify (1) cookie 93951683187632 notify 154618822691 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5572d4b4c860 con 0x7fd250014440 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.438+0000 7fd13a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822691 cookie 93951683187632 notifier 4778 bl.length()=170 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.439+0000 7fd13a7fc640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd08c0032c0 con 0x7fd250014440 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.439+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 49 ==== osd_op_reply(157 notify.3 [notify cookie 93951683458784 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.439+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 50 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.439+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 51 ==== watch-notify(notify_complete (2) cookie 93951683458784 notify 154618822691 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5572d4b4cd10 con 0x7fd250014440 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.439+0000 7fd25b92f800 10 removing email index: foo@foo.com 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.439+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8f1e0 con 0x5572d4b2cde0 2024-09-07T03:34:19.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.440+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 32 ==== osd_op_reply(159 foo@foo.com [delete] v36'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.440+0000 7fd25b92f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.440+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 93951683458784 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8d510 con 0x7fd250014440 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.440+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 52 ==== watch-notify(notify (1) cookie 93951683187632 notify 154618822692 ret 0) ==== 204+0+0 (crc 0 0 0) 0x5572d4b4cd10 con 0x7fd250014440 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.440+0000 7fd13affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822692 cookie 93951683187632 notifier 4778 bl.length()=162 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.440+0000 7fd13affd640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd11c003d60 con 0x7fd250014440 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.440+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 53 ==== osd_op_reply(160 notify.3 [notify cookie 93951683458784 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.441+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 54 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.441+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 55 ==== watch-notify(notify_complete (2) cookie 93951683458784 notify 154618822692 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5572d4b459b0 con 0x7fd250014440 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.441+0000 7fd25b92f800 10 removing user buckets index 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.441+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8f1e0 con 0x7fd250014440 2024-09-07T03:34:19.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 56 ==== osd_op_reply(162 foo.buckets [delete] v36'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd25b92f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93951683458784 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8d510 con 0x5572d4b36340 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 34 ==== watch-notify(notify (1) cookie 93951683177280 notify 154618822691 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7fd248095040 con 0x5572d4b36340 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd13a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822691 cookie 93951683177280 notifier 4778 bl.length()=160 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 35 ==== osd_op_reply(163 notify.5 [notify cookie 93951683458784 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd13a7fc640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd08c0032c0 con 0x5572d4b36340 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 36 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 37 ==== watch-notify(notify_complete (2) cookie 93951683458784 notify 154618822691 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5572d4aef4d0 con 0x5572d4b36340 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd25b92f800 10 removing user index: foo 2024-09-07T03:34:19.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.442+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b8e070 con 0x5572d4b2cde0 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.443+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 33 ==== osd_op_reply(165 foo [call,call,delete] v36'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.443+0000 7fd25b92f800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.443+0000 7fd25b92f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.443+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 93951683425536 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b77920 con 0x5572d4b312c0 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.444+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 50 ==== watch-notify(notify (1) cookie 93951683190272 notify 154618822688 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5572d4b45550 con 0x5572d4b312c0 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.444+0000 7fd13affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822688 cookie 93951683190272 notifier 4778 bl.length()=152 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.444+0000 7fd13affd640 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd11c003d60 con 0x5572d4b312c0 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.444+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 51 ==== osd_op_reply(166 notify.4 [notify cookie 93951683425536 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.444+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 52 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.444+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 53 ==== watch-notify(notify_complete (2) cookie 93951683425536 notify 154618822688 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5572d4b21ad0 con 0x5572d4b312c0 2024-09-07T03:34:19.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.445+0000 7fd10dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.445+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93951683199296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x5572d4b2cde0 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.446+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 34 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 93951683199296] v36'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.446+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93951683179280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x5572d4b312c0 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.447+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 54 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 93951683179280] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.447+0000 7fd25b92f800 20 remove_watcher() i=0 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.447+0000 7fd25b92f800 2 removed watcher, disabling cache 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.447+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93951683182272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x5572d4b2cde0 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.448+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.1 v2:172.21.15.120:6808/3372043485 35 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 93951683182272] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x5572d4b2cde0 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.448+0000 7fd25b92f800 20 remove_watcher() i=1 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.448+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93951683184944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x5572d4b312c0 2024-09-07T03:34:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.449+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 55 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 93951683184944] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.449+0000 7fd25b92f800 20 remove_watcher() i=2 2024-09-07T03:34:19.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.449+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93951683187632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x7fd250014440 2024-09-07T03:34:19.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.450+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 57 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 93951683187632] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.450+0000 7fd25b92f800 20 remove_watcher() i=3 2024-09-07T03:34:19.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.450+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93951683190272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3c930 con 0x5572d4b312c0 2024-09-07T03:34:19.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.451+0000 7fd257e77640 1 -- 172.21.15.120:0/1677336910 <== osd.0 v2:172.21.15.104:6800/182397107 56 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 93951683190272] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd250027070 con 0x5572d4b312c0 2024-09-07T03:34:19.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.452+0000 7fd25b92f800 20 remove_watcher() i=4 2024-09-07T03:34:19.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.452+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93951683177280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3d3b0 con 0x5572d4b36340 2024-09-07T03:34:19.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.453+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 38 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 93951683177280] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.453+0000 7fd25b92f800 20 remove_watcher() i=5 2024-09-07T03:34:19.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.453+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93951683195440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b91660 con 0x5572d4b36340 2024-09-07T03:34:19.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.454+0000 7fd257676640 1 -- 172.21.15.120:0/1677336910 <== osd.3 v2:172.21.15.120:6800/1193158925 39 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 93951683195440] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248051070 con 0x5572d4b36340 2024-09-07T03:34:19.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.454+0000 7fd25b92f800 20 remove_watcher() i=6 2024-09-07T03:34:19.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.454+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93951683198112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5572d4b3c930 con 0x7fd250014440 2024-09-07T03:34:19.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.454+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 <== osd.2 v2:172.21.15.120:6809/3781833098 58 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 93951683198112] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd240028040 con 0x7fd250014440 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.454+0000 7fd25b92f800 20 remove_watcher() i=7 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4b312c0 msgr2=0x5572d4b336b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4b312c0 0x5572d4b336b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d4b2cde0 msgr2=0x5572d4b2f2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d4b2cde0 0x5572d4b2f2a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fd250014440 msgr2=0x7fd2500439d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fd250014440 0x7fd2500439d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5572d4b36340 msgr2=0x5572d4b38770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5572d4b36340 0x5572d4b38770 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd12003c780 msgr2=0x7fd12003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd12003c780 0x7fd12003ec40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd248096580 tx=0x7fd248088000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 msgr2=0x5572d4b212e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/1677336910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4ae4330 0x5572d4b212e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd250013550 tx=0x7fd250053d40 comp rx=0 tx=0).stop 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 reap_dead start 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd24ee75640 1 -- 172.21.15.120:0/1677336910 reap_dead start 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 shutdown_connections 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 >> 172.21.15.120:0/1677336910 conn(0x5572d4b11d80 msgr2=0x5572d4b0ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 shutdown_connections 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/1677336910 wait complete. 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/2892295564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13003c840 msgr2=0x7fd13003ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/2892295564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13003c840 0x7fd13003ed00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5572d4af9640 tx=0x7fd248045e60 comp rx=0 tx=0).stop 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/2892295564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4b08ec0 msgr2=0x5572d4b092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/2892295564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4b08ec0 0x5572d4b092e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd250016d20 tx=0x7fd25000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/2892295564 shutdown_connections 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/2892295564 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13003c840 0x7fd13003ed00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 --2- 172.21.15.120:0/2892295564 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d4b08ec0 0x5572d4b092e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/2892295564 >> 172.21.15.120:0/2892295564 conn(0x5572d4afd270 msgr2=0x5572d4afd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/2892295564 shutdown_connections 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.455+0000 7fd25b92f800 1 -- 172.21.15.120:0/2892295564 wait complete. 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4af6560 msgr2=0x5572d4af89f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4af6560 0x5572d4af89f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d49f6100 msgr2=0x5572d4af5720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d49f6100 0x5572d4af5720 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13c03c730 msgr2=0x7fd13c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13c03c730 0x7fd13c03ebf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd240001d70 tx=0x7fd2400012d0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 msgr2=0x5572d4aee0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d4aee0d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd248025c20 tx=0x7fd248002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 shutdown_connections 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5572d4af6560 0x5572d4af89f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5572d49f6100 0x5572d4af5720 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd13c03c730 0x7fd13c03ebf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 --2- 172.21.15.120:0/196278133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5572d49f5000 0x5572d4aee0d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 >> 172.21.15.120:0/196278133 conn(0x5572d49f03d0 msgr2=0x5572d4adfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 shutdown_connections 2024-09-07T03:34:19.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.456+0000 7fd25b92f800 1 -- 172.21.15.120:0/196278133 wait complete. 2024-09-07T03:34:19.471 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-07T03:34:19.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-07T03:34:19.471 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-07T03:34:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:19.515 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f2986735800 1 Processor -- start 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f2986735800 1 -- start start 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f2986735800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a4b6d87240 0x55a4b6d896d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f2986735800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4b6c2ce40 con 0x55a4b6d83730 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f2986735800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a4b6bf7680 con 0x55a4b6d87240 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f2981ce3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a4b6d87240 0x55a4b6d896d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f29824e4640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55a4b6d83730 0x55a4b6d85b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43796/0 (socket says 172.21.15.120:43796) 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f29824e4640 1 -- 172.21.15.120:0/2771969957 learned_addr learned my addr 172.21.15.120:0/2771969957 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f2981ce3640 1 -- 172.21.15.120:0/2771969957 >> v1:172.21.15.104:6789/0 conn(0x55a4b6d83730 legacy=0x55a4b6d85b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.515+0000 7f2981ce3640 1 -- 172.21.15.120:0/2771969957 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b6c136b0 con 0x55a4b6d87240 2024-09-07T03:34:19.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.517+0000 7f2981ce3640 1 --2- 172.21.15.120:0/2771969957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d87240 0x55a4b6d896d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f297800a470 tx=0x7f2978045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cf6ce1a8ad34ae server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.517+0000 7f29814e2640 1 -- 172.21.15.120:0/2771969957 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2978053570 con 0x55a4b6d87240 2024-09-07T03:34:19.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.517+0000 7f29814e2640 1 -- 172.21.15.120:0/2771969957 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2978058070 con 0x55a4b6d87240 2024-09-07T03:34:19.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.517+0000 7f29814e2640 1 -- 172.21.15.120:0/2771969957 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2978053880 con 0x55a4b6d87240 2024-09-07T03:34:19.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.518+0000 7f2986735800 1 -- 172.21.15.120:0/2771969957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d87240 msgr2=0x55a4b6d896d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.518+0000 7f2986735800 1 --2- 172.21.15.120:0/2771969957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d87240 0x55a4b6d896d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f297800a470 tx=0x7f2978045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:19.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.518+0000 7f2986735800 1 -- 172.21.15.120:0/2771969957 shutdown_connections 2024-09-07T03:34:19.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.518+0000 7f2986735800 1 --2- 172.21.15.120:0/2771969957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d87240 0x55a4b6d896d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.518+0000 7f2986735800 1 -- 172.21.15.120:0/2771969957 >> 172.21.15.120:0/2771969957 conn(0x55a4b6d7d1f0 msgr2=0x55a4b6d7f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.518+0000 7f2986735800 1 -- 172.21.15.120:0/2771969957 shutdown_connections 2024-09-07T03:34:19.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.518+0000 7f2986735800 1 -- 172.21.15.120:0/2771969957 wait complete. 2024-09-07T03:34:19.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.532+0000 7f2986735800 1 Processor -- start 2024-09-07T03:34:19.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.532+0000 7f2986735800 1 -- start start 2024-09-07T03:34:19.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.532+0000 7f2986735800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e72630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.532+0000 7f2986735800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a4b6c1bdd0 con 0x55a4b6d83730 2024-09-07T03:34:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.533+0000 7f29824e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e72630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.533+0000 7f29824e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e72630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39838/0 (socket says 172.21.15.120:39838) 2024-09-07T03:34:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.533+0000 7f29824e4640 1 -- 172.21.15.120:0/2019290621 learned_addr learned my addr 172.21.15.120:0/2019290621 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.533+0000 7f29824e4640 1 -- 172.21.15.120:0/2019290621 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b6c34e10 con 0x55a4b6d83730 2024-09-07T03:34:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.533+0000 7f29824e4640 1 --2- 172.21.15.120:0/2019290621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e72630 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2974001800 tx=0x7f2974001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391d644d8cd364c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.533+0000 7f2870608640 1 -- 172.21.15.120:0/2019290621 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2974004520 con 0x55a4b6d83730 2024-09-07T03:34:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.533+0000 7f2870608640 1 -- 172.21.15.120:0/2019290621 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29740046c0 con 0x55a4b6d83730 2024-09-07T03:34:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.533+0000 7f2870608640 1 -- 172.21.15.120:0/2019290621 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29740049e0 con 0x55a4b6d83730 2024-09-07T03:34:19.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 -- 172.21.15.120:0/2019290621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 msgr2=0x55a4b6e72630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 --2- 172.21.15.120:0/2019290621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e72630 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2974001800 tx=0x7f2974001cc0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 -- 172.21.15.120:0/2019290621 shutdown_connections 2024-09-07T03:34:19.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 --2- 172.21.15.120:0/2019290621 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e72630 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 -- 172.21.15.120:0/2019290621 >> 172.21.15.120:0/2019290621 conn(0x55a4b6d7d1f0 msgr2=0x55a4b6e6dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 -- 172.21.15.120:0/2019290621 shutdown_connections 2024-09-07T03:34:19.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 -- 172.21.15.120:0/2019290621 wait complete. 2024-09-07T03:34:19.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 Processor -- start 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 -- start start 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e79fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.534+0000 7f2986735800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a4b6d8a050 con 0x55a4b6d83730 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f29824e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e79fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f29824e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e79fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39842/0 (socket says 172.21.15.120:39842) 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f29824e4640 1 -- 172.21.15.120:0/2046773027 learned_addr learned my addr 172.21.15.120:0/2046773027 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f29824e4640 1 -- 172.21.15.120:0/2046773027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b6e7a540 con 0x55a4b6d83730 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f29824e4640 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e79fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2974000f80 tx=0x7f2974001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f286ee05640 1 -- 172.21.15.120:0/2046773027 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2974022020 con 0x55a4b6d83730 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f286ee05640 1 -- 172.21.15.120:0/2046773027 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2974014890 con 0x55a4b6d83730 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4b6e7a7d0 con 0x55a4b6d83730 2024-09-07T03:34:19.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f286ee05640 1 -- 172.21.15.120:0/2046773027 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2974014bb0 con 0x55a4b6d83730 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.535+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4b6e7b1d0 con 0x55a4b6d83730 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.536+0000 7f286ee05640 1 -- 172.21.15.120:0/2046773027 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2974025020 con 0x55a4b6d83730 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.536+0000 7f286ee05640 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f286803c780 0x7f286803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.536+0000 7f286ee05640 1 -- 172.21.15.120:0/2046773027 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f2974018030 con 0x55a4b6d83730 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.537+0000 7f2981ce3640 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f286803c780 0x7f286803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.537+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6d87240 0x55a4b6e81630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.537+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6e81b70 con 0x55a4b6d87240 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.537+0000 7f2982ce5640 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6d87240 0x55a4b6e81630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.537+0000 7f2981ce3640 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f286803c780 0x7f286803ec40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2978057000 tx=0x7f2978052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.537+0000 7f2982ce5640 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6d87240 0x55a4b6e81630 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.537+0000 7f2982ce5640 1 -- 172.21.15.120:0/2046773027 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6d87240 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.537+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6e82420 0x55a4b6e848e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.537+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6e85050 con 0x55a4b6e82420 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.538+0000 7f29824e4640 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6e82420 0x55a4b6e848e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.538+0000 7f29824e4640 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6e82420 0x55a4b6e848e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.538+0000 7f29824e4640 1 -- 172.21.15.120:0/2046773027 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6e82420 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.538+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6e86900 con 0x55a4b6e82420 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.538+0000 7f29824e4640 1 -- 172.21.15.120:0/2046773027 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6e82420 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.538+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6e85a10 con 0x55a4b6e82420 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.539+0000 7f29824e4640 1 -- 172.21.15.120:0/2046773027 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6e82420 2024-09-07T03:34:19.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.539+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6e85e30 con 0x55a4b6d87240 2024-09-07T03:34:19.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.539+0000 7f2982ce5640 1 -- 172.21.15.120:0/2046773027 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6d87240 2024-09-07T03:34:19.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.539+0000 7f2986735800 1 Processor -- start 2024-09-07T03:34:19.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.539+0000 7f2986735800 1 -- start start 2024-09-07T03:34:19.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2986735800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d82ef0 0x55a4b6d81760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2986735800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a4b6c79a00 con 0x55a4b6d82ef0 2024-09-07T03:34:19.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2982ce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d82ef0 0x55a4b6d81760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2982ce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d82ef0 0x55a4b6d81760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39856/0 (socket says 172.21.15.120:39856) 2024-09-07T03:34:19.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2982ce5640 1 -- 172.21.15.120:0/3749059600 learned_addr learned my addr 172.21.15.120:0/3749059600 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2982ce5640 1 -- 172.21.15.120:0/3749059600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b6d83410 con 0x55a4b6d82ef0 2024-09-07T03:34:19.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2982ce5640 1 --2- 172.21.15.120:0/3749059600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d82ef0 0x55a4b6d81760 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f297c00aa90 tx=0x7f297c00af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2867fff640 1 -- 172.21.15.120:0/3749059600 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c007d70 con 0x55a4b6d82ef0 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2867fff640 1 -- 172.21.15.120:0/3749059600 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c018430 con 0x55a4b6d82ef0 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2986735800 1 -- 172.21.15.120:0/3749059600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4b6d81ca0 con 0x55a4b6d82ef0 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2867fff640 1 -- 172.21.15.120:0/3749059600 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c018750 con 0x55a4b6d82ef0 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.540+0000 7f2986735800 1 -- 172.21.15.120:0/3749059600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4b6d82240 con 0x55a4b6d82ef0 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.541+0000 7f2867fff640 1 -- 172.21.15.120:0/3749059600 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f297c020020 con 0x55a4b6d82ef0 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.541+0000 7f2867fff640 1 --2- 172.21.15.120:0/3749059600 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f285c03c840 0x7f285c03ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.541+0000 7f2867fff640 1 -- 172.21.15.120:0/3749059600 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f297c01e020 con 0x55a4b6d82ef0 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.541+0000 7f29824e4640 1 --2- 172.21.15.120:0/3749059600 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f285c03c840 0x7f285c03ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f2986735800 1 Processor -- start 2024-09-07T03:34:19.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f29824e4640 1 --2- 172.21.15.120:0/3749059600 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f285c03c840 0x7f285c03ed00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55a4b6e85530 tx=0x7f2974051e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f2986735800 1 -- start start 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f2986735800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6ea3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f2986735800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a4b6e72e80 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f2982ce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6ea3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f2982ce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6ea3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39860/0 (socket says 172.21.15.120:39860) 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f2982ce5640 1 -- 172.21.15.120:0/4217574358 learned_addr learned my addr 172.21.15.120:0/4217574358 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f2982ce5640 1 -- 172.21.15.120:0/4217574358 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b6ea44d0 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.542+0000 7f2982ce5640 1 --2- 172.21.15.120:0/4217574358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6ea3ee0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f297c0531c0 tx=0x7f297c0206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b834549e08838 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2865ffb640 1 -- 172.21.15.120:0/4217574358 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c020b70 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2865ffb640 1 -- 172.21.15.120:0/4217574358 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c022410 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2865ffb640 1 -- 172.21.15.120:0/4217574358 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c04c590 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 -- 172.21.15.120:0/4217574358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 msgr2=0x55a4b6ea3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 --2- 172.21.15.120:0/4217574358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6ea3ee0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f297c0531c0 tx=0x7f297c0206e0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 -- 172.21.15.120:0/4217574358 shutdown_connections 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 --2- 172.21.15.120:0/4217574358 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6ea3ee0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 -- 172.21.15.120:0/4217574358 >> 172.21.15.120:0/4217574358 conn(0x55a4b6e9fee0 msgr2=0x55a4b6e9e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 -- 172.21.15.120:0/4217574358 shutdown_connections 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 -- 172.21.15.120:0/4217574358 wait complete. 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 Processor -- start 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 -- start start 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6eab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.543+0000 7f2986735800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a4b6ea4af0 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2982ce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6eab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2982ce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6eab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39868/0 (socket says 172.21.15.120:39868) 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 learned_addr learned my addr 172.21.15.120:0/345732494 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b6eab630 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2982ce5640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6eab0d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f297c053120 tx=0x7f297c053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2853fff640 1 -- 172.21.15.120:0/345732494 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c017e60 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2853fff640 1 -- 172.21.15.120:0/345732494 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c031020 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4b6eab8c0 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2853fff640 1 -- 172.21.15.120:0/345732494 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c020b70 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.544+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4b6eac450 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.545+0000 7f2853fff640 1 -- 172.21.15.120:0/345732494 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f297c016040 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.545+0000 7f2853fff640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f284c03c750 0x7f284c03ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.545+0000 7f2853fff640 1 -- 172.21.15.120:0/345732494 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f297c032030 con 0x55a4b6ea3ae0 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.545+0000 7f29824e4640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f284c03c750 0x7f284c03ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.545+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.545+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6eb6c10 0x55a4b6eb90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.545+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6eb9820 con 0x55a4b6eb6c10 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.545+0000 7f2981ce3640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6eb6c10 0x55a4b6eb90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f29824e4640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f284c03c750 0x7f284c03ec10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2974006680 tx=0x7f2974033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2981ce3640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6eb6c10 0x55a4b6eb90d0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2986735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2986735800 20 realm 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6eb9c50 con 0x55a4b6eb6c10 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2986735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2986735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6eba520 con 0x55a4b6eb6c10 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.546+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2986735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6ebaf40 0x55a4b6ebd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ebdaa0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2982ce5640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6ebaf40 0x55a4b6ebd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2982ce5640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6ebaf40 0x55a4b6ebd330 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2986735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.547+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ebe340 con 0x55a4b6ebaf40 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f2986735800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f2986735800 20 searching for the correct realm 2024-09-07T03:34:19.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a4b6ec00b0 0x55a4b6ec24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ec00b0 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f29824e4640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a4b6ec00b0 0x55a4b6ec24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f29824e4640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a4b6ec00b0 0x55a4b6ec24c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ebaf40 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.548+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.549+0000 7f2982ce5640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f297c00f870 0x7f297c0535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.549+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x7f297c00f870 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.549+0000 7f2981ce3640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f297c00f870 0x7f297c0535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.549+0000 7f2981ce3640 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f297c00f870 0x7f297c0535d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.549+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.549+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.549+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.549+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.550+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.550+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ec00b0 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.550+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.550+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.550+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.550+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ebaf40 2024-09-07T03:34:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.550+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.550+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ebaf40 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.551+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.551+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.551+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.551+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x7f297c00f870 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.551+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.551+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.551+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.551+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x7f297c00f870 2024-09-07T03:34:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.552+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.552+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ebaf40 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.552+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.552+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ec00b0 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.552+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.552+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.552+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.552+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ebaf40 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ec00b0 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.553+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ec00b0 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.554+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.554+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x7f297c00f870 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.554+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.554+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x7f297c00f870 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.554+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.554+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x7f297c00f870 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.554+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.554+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ec00b0 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.555+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.555+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x7f297c00f870 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.555+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.555+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec2b90 con 0x55a4b6ebaf40 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.555+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.555+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f297c069040 con 0x55a4b6ebaf40 2024-09-07T03:34:19.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f297c069040 con 0x55a4b6ec00b0 2024-09-07T03:34:19.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f297c069040 con 0x55a4b6ebaf40 2024-09-07T03:34:19.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f297c069040 con 0x55a4b6ebaf40 2024-09-07T03:34:19.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2986735800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2986735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2986735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2986735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2986735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2986735800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.556+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ebeb90 con 0x55a4b6eb6c10 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ebef80 con 0x55a4b6ebaf40 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ebef80 con 0x55a4b6eb6c10 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 20 zone default found 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 4 Realm: () 2024-09-07T03:34:19.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 20 zonegroup default 2024-09-07T03:34:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.557+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ebe7c0 con 0x7f297c00f870 2024-09-07T03:34:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec4b50 con 0x55a4b6ec00b0 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec4fd0 con 0x55a4b6ec00b0 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 20 started sync module instance, tier type = 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.558+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec3ef0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.559+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.559+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94165931934704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec3ef0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.559+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec5b50 con 0x55a4b6eb6c10 2024-09-07T03:34:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.561+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94165931934704] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.561+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.561+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94165931932224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec3e60 con 0x55a4b6eb6c10 2024-09-07T03:34:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.561+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec6a10 con 0x55a4b6ebaf40 2024-09-07T03:34:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.562+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94165931932224] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.562+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.562+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94165931941696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec6a10 con 0x55a4b6ebaf40 2024-09-07T03:34:19.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.562+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec7480 con 0x7f297c00f870 2024-09-07T03:34:19.593 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-07T03:34:19.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.563+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94165931941696] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.563+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.563+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94165931945840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec6a10 con 0x7f297c00f870 2024-09-07T03:34:19.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.563+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec7ed0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.564+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94165931945840] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.564+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.564+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94165931948512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec6a10 con 0x55a4b6ebaf40 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.564+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec88e0 con 0x55a4b6ec00b0 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.565+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94165931948512] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.565+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.565+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94165931943264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec6980 con 0x55a4b6ec00b0 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.565+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec97a0 con 0x55a4b6ec00b0 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.566+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94165931943264] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.566+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.566+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94165931953360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec97a0 con 0x55a4b6ec00b0 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.566+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6eca160 con 0x7f297c00f870 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.567+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.567+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94165931957424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6eca5e0 con 0x7f297c00f870 2024-09-07T03:34:19.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2986735800 20 add_watcher() i=0 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2986735800 20 add_watcher() i=1 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2986735800 20 add_watcher() i=2 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2986735800 20 add_watcher() i=3 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2986735800 20 add_watcher() i=4 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2986735800 20 add_watcher() i=5 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94165931953360] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2986735800 20 add_watcher() i=6 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94165931957424] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2986735800 20 add_watcher() i=7 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.568+0000 7f2986735800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.569+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec92f0 con 0x55a4b6eb6c10 2024-09-07T03:34:19.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.569+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.569+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94165931958480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6ec92f0 con 0x55a4b6eb6c10 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.570+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94165931958480] v36'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.570+0000 7f2838fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.570+0000 7f2986735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.570+0000 7f2986735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.570+0000 7f2986735800 5 note: GC not initialized 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.570+0000 7f27b37fe640 20 reqs_thread_entry: start 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.571+0000 7f2986735800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.571+0000 7f2986735800 20 Filter name: none 2024-09-07T03:34:19.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.571+0000 7f27b17fa640 20 reqs_thread_entry: start 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.571+0000 7f2986735800 20 rados->read ofs=0 len=0 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.571+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00240 con 0x55a4b6eb6c10 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.571+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.571+0000 7f2986735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:could not fetch user info: no user info saved 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.572+0000 7f2838fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.572+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94165931958480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00200 con 0x55a4b6eb6c10 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.573+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94165931958480] v36'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.573+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94165931934704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00200 con 0x55a4b6ebaf40 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.574+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94165931934704] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.574+0000 7f2986735800 20 remove_watcher() i=0 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.574+0000 7f2986735800 2 removed watcher, disabling cache 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.574+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94165931932224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00200 con 0x55a4b6eb6c10 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.575+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94165931932224] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x55a4b6eb6c10 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.575+0000 7f2986735800 20 remove_watcher() i=1 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.575+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94165931941696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00200 con 0x55a4b6ebaf40 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.576+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94165931941696] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.576+0000 7f2986735800 20 remove_watcher() i=2 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.576+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94165931945840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00200 con 0x7f297c00f870 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.577+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94165931945840] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.577+0000 7f2986735800 20 remove_watcher() i=3 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.577+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94165931948512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00200 con 0x55a4b6ebaf40 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.578+0000 7f2982ce5640 1 -- 172.21.15.120:0/345732494 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94165931948512] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c0083e0 con 0x55a4b6ebaf40 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.578+0000 7f2986735800 20 remove_watcher() i=4 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.578+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94165931943264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00200 con 0x55a4b6ec00b0 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.579+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94165931943264] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.579+0000 7f2986735800 20 remove_watcher() i=5 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.579+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94165931953360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00200 con 0x55a4b6ec00b0 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.580+0000 7f29824e4640 1 -- 172.21.15.120:0/345732494 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94165931953360] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297401b070 con 0x55a4b6ec00b0 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.580+0000 7f2986735800 20 remove_watcher() i=6 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.580+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94165931957424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a4b6f00200 con 0x7f297c00f870 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94165931957424] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2978051070 con 0x7f297c00f870 2024-09-07T03:34:19.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 20 remove_watcher() i=7 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6ebaf40 msgr2=0x55a4b6ebd330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6ebaf40 0x55a4b6ebd330 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6eb6c10 msgr2=0x55a4b6eb90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6eb6c10 0x55a4b6eb90d0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f297c00f870 msgr2=0x7f297c0535d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f297c00f870 0x7f297c0535d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a4b6ec00b0 msgr2=0x55a4b6ec24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a4b6ec00b0 0x55a4b6ec24c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f284c03c750 msgr2=0x7f284c03ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f284c03c750 0x7f284c03ec10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2974006680 tx=0x7f2974033000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 msgr2=0x55a4b6eab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2981ce3640 1 -- 172.21.15.120:0/345732494 reap_dead start 2024-09-07T03:34:19.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6eab0d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f297c053120 tx=0x7f297c053150 comp rx=0 tx=0).stop 2024-09-07T03:34:19.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 shutdown_connections 2024-09-07T03:34:19.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 --2- 172.21.15.120:0/345732494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6ea3ae0 0x55a4b6eab0d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 >> 172.21.15.120:0/345732494 conn(0x55a4b6e9fee0 msgr2=0x55a4b6e9e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 shutdown_connections 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.581+0000 7f2986735800 1 -- 172.21.15.120:0/345732494 wait complete. 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/3749059600 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f285c03c840 msgr2=0x7f285c03ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/3749059600 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f285c03c840 0x7f285c03ed00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55a4b6e85530 tx=0x7f2974051e70 comp rx=0 tx=0).stop 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/3749059600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d82ef0 msgr2=0x55a4b6d81760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/3749059600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d82ef0 0x55a4b6d81760 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f297c00aa90 tx=0x7f297c00af50 comp rx=0 tx=0).stop 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/3749059600 shutdown_connections 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/3749059600 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f285c03c840 0x7f285c03ed00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/3749059600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d82ef0 0x55a4b6d81760 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/3749059600 >> 172.21.15.120:0/3749059600 conn(0x55a4b6e89160 msgr2=0x55a4b6e89540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/3749059600 shutdown_connections 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/3749059600 wait complete. 2024-09-07T03:34:19.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6e82420 msgr2=0x55a4b6e848e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6e82420 0x55a4b6e848e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6d87240 msgr2=0x55a4b6e81630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6d87240 0x55a4b6e81630 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f286803c780 msgr2=0x7f286803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f286803c780 0x7f286803ec40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2978057000 tx=0x7f2978052000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 msgr2=0x55a4b6e79fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e79fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2974000f80 tx=0x7f2974001250 comp rx=0 tx=0).stop 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 shutdown_connections 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a4b6e82420 0x55a4b6e848e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a4b6d87240 0x55a4b6e81630 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f286803c780 0x7f286803ec40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 --2- 172.21.15.120:0/2046773027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a4b6d83730 0x55a4b6e79fe0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 >> 172.21.15.120:0/2046773027 conn(0x55a4b6d7d1f0 msgr2=0x55a4b6e73910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 shutdown_connections 2024-09-07T03:34:19.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.582+0000 7f2986735800 1 -- 172.21.15.120:0/2046773027 wait complete. 2024-09-07T03:34:19.605 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-07T03:34:19.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-07T03:34:19.605 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-07T03:34:19.649 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:19.649 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:19.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.648+0000 7fd173b23800 1 Processor -- start 2024-09-07T03:34:19.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.648+0000 7fd173b23800 1 -- start start 2024-09-07T03:34:19.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.648+0000 7fd173b23800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55ab6aece0e0 0x55ab6aed6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.648+0000 7fd173b23800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab6ad77e40 con 0x55ab6aecc5c0 2024-09-07T03:34:19.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.648+0000 7fd173b23800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55ab6ad42680 con 0x55ab6aece0e0 2024-09-07T03:34:19.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.649+0000 7fd167fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55ab6aece0e0 0x55ab6aed6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.649+0000 7fd16f80c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55ab6aecc5c0 0x55ab6aecc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43800/0 (socket says 172.21.15.120:43800) 2024-09-07T03:34:19.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.649+0000 7fd16f80c640 1 -- 172.21.15.120:0/3278204504 learned_addr learned my addr 172.21.15.120:0/3278204504 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:19.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.649+0000 7fd167fff640 1 -- 172.21.15.120:0/3278204504 >> v1:172.21.15.104:6789/0 conn(0x55ab6aecc5c0 legacy=0x55ab6aecc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.649+0000 7fd16f00b640 1 -- 172.21.15.120:0/3278204504 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1830228334 0 0) 0x55ab6ad77e40 con 0x55ab6aecc5c0 2024-09-07T03:34:19.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.649+0000 7fd167fff640 1 -- 172.21.15.120:0/3278204504 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6ad5e6b0 con 0x55ab6aece0e0 2024-09-07T03:34:19.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd167fff640 1 --2- 172.21.15.120:0/3278204504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aece0e0 0x55ab6aed6c00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd15800a470 tx=0x7fd158045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c3077ae3362b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd16f00b640 1 -- 172.21.15.120:0/3278204504 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd158053570 con 0x55ab6aece0e0 2024-09-07T03:34:19.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd16f00b640 1 -- 172.21.15.120:0/3278204504 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd158058070 con 0x55ab6aece0e0 2024-09-07T03:34:19.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd16f00b640 1 -- 172.21.15.120:0/3278204504 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd158053880 con 0x55ab6aece0e0 2024-09-07T03:34:19.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd173b23800 1 -- 172.21.15.120:0/3278204504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aece0e0 msgr2=0x55ab6aed6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd173b23800 1 --2- 172.21.15.120:0/3278204504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aece0e0 0x55ab6aed6c00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd15800a470 tx=0x7fd158045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:19.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd173b23800 1 -- 172.21.15.120:0/3278204504 shutdown_connections 2024-09-07T03:34:19.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd173b23800 1 --2- 172.21.15.120:0/3278204504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aece0e0 0x55ab6aed6c00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd173b23800 1 -- 172.21.15.120:0/3278204504 >> 172.21.15.120:0/3278204504 conn(0x55ab6aec8310 msgr2=0x55ab6aeca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd173b23800 1 -- 172.21.15.120:0/3278204504 shutdown_connections 2024-09-07T03:34:19.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.651+0000 7fd173b23800 1 -- 172.21.15.120:0/3278204504 wait complete. 2024-09-07T03:34:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.665+0000 7fd173b23800 1 Processor -- start 2024-09-07T03:34:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.665+0000 7fd173b23800 1 -- start start 2024-09-07T03:34:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.665+0000 7fd173b23800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afbf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.665+0000 7fd173b23800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ab6ad66dd0 con 0x55ab6aecc5c0 2024-09-07T03:34:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.665+0000 7fd16f80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afbf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.666+0000 7fd16f80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afbf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39890/0 (socket says 172.21.15.120:39890) 2024-09-07T03:34:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.666+0000 7fd16f80c640 1 -- 172.21.15.120:0/3052189558 learned_addr learned my addr 172.21.15.120:0/3052189558 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.666+0000 7fd16f80c640 1 -- 172.21.15.120:0/3052189558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6ad7fe10 con 0x55ab6aecc5c0 2024-09-07T03:34:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.666+0000 7fd16f80c640 1 --2- 172.21.15.120:0/3052189558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afbf720 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd160001ea0 tx=0x7fd16000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c253adb8ffac5a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.666+0000 7fd05de0b640 1 -- 172.21.15.120:0/3052189558 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160008070 con 0x55ab6aecc5c0 2024-09-07T03:34:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.666+0000 7fd05de0b640 1 -- 172.21.15.120:0/3052189558 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16000d500 con 0x55ab6aecc5c0 2024-09-07T03:34:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.666+0000 7fd05de0b640 1 -- 172.21.15.120:0/3052189558 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd16000d880 con 0x55ab6aecc5c0 2024-09-07T03:34:19.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.667+0000 7fd173b23800 1 -- 172.21.15.120:0/3052189558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 msgr2=0x55ab6afbf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.667+0000 7fd173b23800 1 --2- 172.21.15.120:0/3052189558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afbf720 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd160001ea0 tx=0x7fd16000b6a0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.667+0000 7fd173b23800 1 -- 172.21.15.120:0/3052189558 shutdown_connections 2024-09-07T03:34:19.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.667+0000 7fd173b23800 1 --2- 172.21.15.120:0/3052189558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afbf720 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.667+0000 7fd173b23800 1 -- 172.21.15.120:0/3052189558 >> 172.21.15.120:0/3052189558 conn(0x55ab6aec8310 msgr2=0x55ab6afbb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.667+0000 7fd173b23800 1 -- 172.21.15.120:0/3052189558 shutdown_connections 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.667+0000 7fd173b23800 1 -- 172.21.15.120:0/3052189558 wait complete. 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.667+0000 7fd173b23800 1 Processor -- start 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.667+0000 7fd173b23800 1 -- start start 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd173b23800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afc7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd173b23800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ab6aed7410 con 0x55ab6aecc5c0 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd16f80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afc7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd16f80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afc7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39896/0 (socket says 172.21.15.120:39896) 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd16f80c640 1 -- 172.21.15.120:0/131528030 learned_addr learned my addr 172.21.15.120:0/131528030 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd16f80c640 1 -- 172.21.15.120:0/131528030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6afc75e0 con 0x55ab6aecc5c0 2024-09-07T03:34:19.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd16f80c640 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afc7080 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd1600012f0 tx=0x7fd160000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd057fff640 1 -- 172.21.15.120:0/131528030 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd16000f9d0 con 0x55ab6aecc5c0 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd057fff640 1 -- 172.21.15.120:0/131528030 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16000fb70 con 0x55ab6aecc5c0 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab6afc7870 con 0x55ab6aecc5c0 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd057fff640 1 -- 172.21.15.120:0/131528030 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd16000fe50 con 0x55ab6aecc5c0 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.668+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab6afc8270 con 0x55ab6aecc5c0 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd173b23800 1 Processor -- start 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd173b23800 1 -- start start 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd173b23800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afd6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd173b23800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ab6adc4a00 con 0x55ab6afd4570 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd057fff640 1 -- 172.21.15.120:0/131528030 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd160017040 con 0x55ab6aecc5c0 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd17000d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afd6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd057fff640 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd05803c920 0x7fd05803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd17000d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afd6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39910/0 (socket says 172.21.15.120:39910) 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd17000d640 1 -- 172.21.15.120:0/3548926501 learned_addr learned my addr 172.21.15.120:0/3548926501 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.669+0000 7fd057fff640 1 -- 172.21.15.120:0/131528030 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd160015020 con 0x55ab6aecc5c0 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd16f80c640 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd05803c920 0x7fd05803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd17000d640 1 -- 172.21.15.120:0/3548926501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6afd6f30 con 0x55ab6afd4570 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd17000d640 1 --2- 172.21.15.120:0/3548926501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afd6960 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd16800a3e0 tx=0x7fd16800a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dc12053ad7940 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd16f80c640 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd05803c920 0x7fd05803ede0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c010 tx=0x7fd160006f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd055ffb640 1 -- 172.21.15.120:0/3548926501 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168015070 con 0x55ab6afd4570 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd055ffb640 1 -- 172.21.15.120:0/3548926501 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd168001670 con 0x55ab6afd4570 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd055ffb640 1 -- 172.21.15.120:0/3548926501 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168001990 con 0x55ab6afd4570 2024-09-07T03:34:19.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd173b23800 1 -- 172.21.15.120:0/3548926501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 msgr2=0x55ab6afd6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd173b23800 1 --2- 172.21.15.120:0/3548926501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afd6960 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd16800a3e0 tx=0x7fd16800a8a0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd173b23800 1 -- 172.21.15.120:0/3548926501 shutdown_connections 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd173b23800 1 --2- 172.21.15.120:0/3548926501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afd6960 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd173b23800 1 -- 172.21.15.120:0/3548926501 >> 172.21.15.120:0/3548926501 conn(0x55ab6aece0e0 msgr2=0x55ab6afcee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd173b23800 1 -- 172.21.15.120:0/3548926501 shutdown_connections 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.670+0000 7fd173b23800 1 -- 172.21.15.120:0/3548926501 wait complete. 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.671+0000 7fd173b23800 1 Processor -- start 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.671+0000 7fd173b23800 1 -- start start 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.671+0000 7fd173b23800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afdb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.671+0000 7fd173b23800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ab6afd7280 con 0x55ab6afd4570 2024-09-07T03:34:19.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.671+0000 7fd17000d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afdb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.671+0000 7fd17000d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afdb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39918/0 (socket says 172.21.15.120:39918) 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.671+0000 7fd17000d640 1 -- 172.21.15.120:0/359344986 learned_addr learned my addr 172.21.15.120:0/359344986 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.671+0000 7fd17000d640 1 -- 172.21.15.120:0/359344986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6afdba90 con 0x55ab6afd4570 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.671+0000 7fd17000d640 1 --2- 172.21.15.120:0/359344986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afdb530 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd168013040 tx=0x7fd168003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.672+0000 7fd04ffff640 1 -- 172.21.15.120:0/359344986 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168020020 con 0x55ab6afd4570 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.672+0000 7fd04ffff640 1 -- 172.21.15.120:0/359344986 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd168010780 con 0x55ab6afd4570 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.672+0000 7fd173b23800 1 -- 172.21.15.120:0/359344986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab6afdbd20 con 0x55ab6afd4570 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.672+0000 7fd04ffff640 1 -- 172.21.15.120:0/359344986 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168015040 con 0x55ab6afd4570 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.672+0000 7fd173b23800 1 -- 172.21.15.120:0/359344986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab6afdc6a0 con 0x55ab6afd4570 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.672+0000 7fd04ffff640 1 -- 172.21.15.120:0/359344986 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd168023020 con 0x55ab6afd4570 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd04ffff640 1 --2- 172.21.15.120:0/359344986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd04803c780 0x7fd04803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd04ffff640 1 -- 172.21.15.120:0/359344986 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd168053370 con 0x55ab6afd4570 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd167fff640 1 --2- 172.21.15.120:0/359344986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd04803c780 0x7fd04803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd173b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd173b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd173b23800 1 Processor -- start 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd167fff640 1 --2- 172.21.15.120:0/359344986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd04803c780 0x7fd04803ec40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd158057000 tx=0x7fd158052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd173b23800 1 -- start start 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd173b23800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aff53c0 0x55ab6aff57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.673+0000 7fd173b23800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ab6afbff70 con 0x55ab6aff53c0 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fd16f80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aff53c0 0x55ab6aff57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fd16f80c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aff53c0 0x55ab6aff57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39932/0 (socket says 172.21.15.120:39932) 2024-09-07T03:34:19.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fd16f80c640 1 -- 172.21.15.120:0/2941293433 learned_addr learned my addr 172.21.15.120:0/2941293433 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fd16f80c640 1 -- 172.21.15.120:0/2941293433 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6aff5e20 con 0x55ab6aff53c0 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fd16f80c640 1 --2- 172.21.15.120:0/2941293433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aff53c0 0x55ab6aff57e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd1600526b0 tx=0x7fd160019f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fcfe7fff640 1 -- 172.21.15.120:0/2941293433 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd160009e00 con 0x55ab6aff53c0 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fcfe7fff640 1 -- 172.21.15.120:0/2941293433 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1600092b0 con 0x55ab6aff53c0 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fcfe7fff640 1 -- 172.21.15.120:0/2941293433 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd16001a3c0 con 0x55ab6aff53c0 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fd173b23800 1 -- 172.21.15.120:0/2941293433 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab6aff6650 con 0x55ab6aff53c0 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.674+0000 7fd173b23800 1 -- 172.21.15.120:0/2941293433 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab6aff6bf0 con 0x55ab6aff53c0 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.675+0000 7fcfe7fff640 1 -- 172.21.15.120:0/2941293433 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd160016b00 con 0x55ab6aff53c0 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.675+0000 7fcfe7fff640 1 --2- 172.21.15.120:0/2941293433 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcfb003c730 0x7fcfb003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.675+0000 7fcfe7fff640 1 -- 172.21.15.120:0/2941293433 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd16004ad20 con 0x55ab6aff53c0 2024-09-07T03:34:19.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.675+0000 7fd167fff640 1 --2- 172.21.15.120:0/2941293433 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcfb003c730 0x7fcfb003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.676+0000 7fcfe5ffb640 20 reqs_thread_entry: start 2024-09-07T03:34:19.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.676+0000 7fd173b23800 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ab6b002eb0 0x55ab6b005370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.676+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ab6b005a40 con 0x55ab6b002eb0 2024-09-07T03:34:19.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.676+0000 7fd167fff640 1 --2- 172.21.15.120:0/2941293433 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcfb003c730 0x7fcfb003ebf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd158045a60 tx=0x7fd158005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.676+0000 7fd17000d640 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ab6b002eb0 0x55ab6b005370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.676+0000 7fd17000d640 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ab6b002eb0 0x55ab6b005370 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.676+0000 7fd17000d640 1 -- 172.21.15.120:0/131528030 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd16800e070 con 0x55ab6b002eb0 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.676+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ab6b007300 con 0x55ab6b002eb0 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.677+0000 7fd17000d640 1 -- 172.21.15.120:0/131528030 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(2 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd16800e070 con 0x55ab6b002eb0 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.677+0000 7fd173b23800 1 -- 172.21.15.120:0/359344986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd04803c780 msgr2=0x7fd04803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.677+0000 7fd173b23800 1 --2- 172.21.15.120:0/359344986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd04803c780 0x7fd04803ec40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd158057000 tx=0x7fd158052000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.677+0000 7fd173b23800 1 -- 172.21.15.120:0/359344986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 msgr2=0x55ab6afdb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.677+0000 7fd173b23800 1 --2- 172.21.15.120:0/359344986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afdb530 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd168013040 tx=0x7fd168003370 comp rx=0 tx=0).stop 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/359344986 shutdown_connections 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/359344986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd04803c780 0x7fd04803ec40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/359344986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6afd4570 0x55ab6afdb530 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/359344986 >> 172.21.15.120:0/359344986 conn(0x55ab6aece0e0 msgr2=0x55ab6afcee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/359344986 shutdown_connections 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/359344986 wait complete. 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/2941293433 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcfb003c730 msgr2=0x7fcfb003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/2941293433 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcfb003c730 0x7fcfb003ebf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd158045a60 tx=0x7fd158005a00 comp rx=0 tx=0).stop 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/2941293433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aff53c0 msgr2=0x55ab6aff57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/2941293433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aff53c0 0x55ab6aff57e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd1600526b0 tx=0x7fd160019f20 comp rx=0 tx=0).stop 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/2941293433 shutdown_connections 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/2941293433 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcfb003c730 0x7fcfb003ebf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/2941293433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aff53c0 0x55ab6aff57e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/2941293433 >> 172.21.15.120:0/2941293433 conn(0x55ab6afea920 msgr2=0x55ab6afead00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/2941293433 shutdown_connections 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/2941293433 wait complete. 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ab6b002eb0 msgr2=0x55ab6b005370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ab6b002eb0 0x55ab6b005370 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd05803c920 msgr2=0x7fd05803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd05803c920 0x7fd05803ede0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c010 tx=0x7fd160006f10 comp rx=0 tx=0).stop 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 msgr2=0x55ab6afc7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afc7080 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd1600012f0 tx=0x7fd160000ed0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 shutdown_connections 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55ab6b002eb0 0x55ab6b005370 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd05803c920 0x7fd05803ede0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 --2- 172.21.15.120:0/131528030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ab6aecc5c0 0x55ab6afc7080 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 >> 172.21.15.120:0/131528030 conn(0x55ab6aec8310 msgr2=0x55ab6afc0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 shutdown_connections 2024-09-07T03:34:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.678+0000 7fd173b23800 1 -- 172.21.15.120:0/131528030 wait complete. 2024-09-07T03:34:19.692 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"cf0fab6f-a978-4ce5-bacd-166891c31743","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-07T03:34:19.692 DEBUG:tasks.util.rgw: json result: {'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-07T03:34:19.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-07T03:34:19.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-07T03:34:19.693 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-07T03:34:19.774 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:19.775 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:19.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f709ec13800 1 Processor -- start 2024-09-07T03:34:19.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f709ec13800 1 -- start start 2024-09-07T03:34:19.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f709ec13800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563bb9582710 0x563bb9584b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f709ec13800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563bb942be40 con 0x563bb9585040 2024-09-07T03:34:19.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f709ec13800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x563bb93f6680 con 0x563bb9582710 2024-09-07T03:34:19.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f709a322640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563bb9582710 0x563bb9584b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f7099b21640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x563bb9585040 0x563bb95874d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43810/0 (socket says 172.21.15.120:43810) 2024-09-07T03:34:19.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f7099b21640 1 -- 172.21.15.120:0/1730073498 learned_addr learned my addr 172.21.15.120:0/1730073498 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:19.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f709a322640 1 -- 172.21.15.120:0/1730073498 >> v1:172.21.15.104:6789/0 conn(0x563bb9585040 legacy=0x563bb95874d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.774+0000 7f709a322640 1 -- 172.21.15.120:0/1730073498 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bb94126b0 con 0x563bb9582710 2024-09-07T03:34:19.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.776+0000 7f709a322640 1 --2- 172.21.15.120:0/1730073498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb9584b00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f708c00a470 tx=0x7f708c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b63e547e96087b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.776+0000 7f7099320640 1 -- 172.21.15.120:0/1730073498 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c053570 con 0x563bb9582710 2024-09-07T03:34:19.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.776+0000 7f7099320640 1 -- 172.21.15.120:0/1730073498 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708c058070 con 0x563bb9582710 2024-09-07T03:34:19.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.776+0000 7f7099320640 1 -- 172.21.15.120:0/1730073498 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c053880 con 0x563bb9582710 2024-09-07T03:34:19.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.777+0000 7f709ec13800 1 -- 172.21.15.120:0/1730073498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 msgr2=0x563bb9584b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.777+0000 7f709ec13800 1 --2- 172.21.15.120:0/1730073498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb9584b00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f708c00a470 tx=0x7f708c045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:19.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.777+0000 7f709ec13800 1 -- 172.21.15.120:0/1730073498 shutdown_connections 2024-09-07T03:34:19.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.777+0000 7f709ec13800 1 --2- 172.21.15.120:0/1730073498 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb9584b00 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.777+0000 7f709ec13800 1 -- 172.21.15.120:0/1730073498 >> 172.21.15.120:0/1730073498 conn(0x563bb957c1b0 msgr2=0x563bb957e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.777+0000 7f709ec13800 1 -- 172.21.15.120:0/1730073498 shutdown_connections 2024-09-07T03:34:19.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.777+0000 7f709ec13800 1 -- 172.21.15.120:0/1730073498 wait complete. 2024-09-07T03:34:19.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.791+0000 7f709ec13800 1 Processor -- start 2024-09-07T03:34:19.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.791+0000 7f709ec13800 1 -- start start 2024-09-07T03:34:19.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.791+0000 7f709ec13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb9581e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.791+0000 7f709ec13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563bb941add0 con 0x563bb9582710 2024-09-07T03:34:19.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.791+0000 7f709a322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb9581e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.791+0000 7f709a322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb9581e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39956/0 (socket says 172.21.15.120:39956) 2024-09-07T03:34:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.791+0000 7f709a322640 1 -- 172.21.15.120:0/3410506667 learned_addr learned my addr 172.21.15.120:0/3410506667 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.791+0000 7f709a322640 1 -- 172.21.15.120:0/3410506667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bb9433e10 con 0x563bb9582710 2024-09-07T03:34:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.791+0000 7f709a322640 1 --2- 172.21.15.120:0/3410506667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb9581e80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f708c025c20 tx=0x7f708c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1c9d2e1ab6b601 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.792+0000 7f6f88608640 1 -- 172.21.15.120:0/3410506667 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c053a20 con 0x563bb9582710 2024-09-07T03:34:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.792+0000 7f6f88608640 1 -- 172.21.15.120:0/3410506667 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708c063070 con 0x563bb9582710 2024-09-07T03:34:19.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.792+0000 7f6f88608640 1 -- 172.21.15.120:0/3410506667 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c053cf0 con 0x563bb9582710 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.792+0000 7f709ec13800 1 -- 172.21.15.120:0/3410506667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 msgr2=0x563bb9581e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.792+0000 7f709ec13800 1 --2- 172.21.15.120:0/3410506667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb9581e80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f708c025c20 tx=0x7f708c051000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.792+0000 7f709ec13800 1 -- 172.21.15.120:0/3410506667 shutdown_connections 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.792+0000 7f709ec13800 1 --2- 172.21.15.120:0/3410506667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb9581e80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.792+0000 7f709ec13800 1 -- 172.21.15.120:0/3410506667 >> 172.21.15.120:0/3410506667 conn(0x563bb957c1b0 msgr2=0x563bb966cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.792+0000 7f709ec13800 1 -- 172.21.15.120:0/3410506667 shutdown_connections 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.793+0000 7f709ec13800 1 -- 172.21.15.120:0/3410506667 wait complete. 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.793+0000 7f709ec13800 1 Processor -- start 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.793+0000 7f709ec13800 1 -- start start 2024-09-07T03:34:19.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.793+0000 7f709ec13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb967b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.793+0000 7f709ec13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563bb9589030 con 0x563bb9582710 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.793+0000 7f709a322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb967b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.793+0000 7f709a322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb967b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39958/0 (socket says 172.21.15.120:39958) 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.793+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 learned_addr learned my addr 172.21.15.120:0/1883684066 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.793+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bb967b5f0 con 0x563bb9582710 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.794+0000 7f709a322640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb967b090 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f708c025c20 tx=0x7f708c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.794+0000 7f6f86e05640 1 -- 172.21.15.120:0/1883684066 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c06c030 con 0x563bb9582710 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.794+0000 7f6f86e05640 1 -- 172.21.15.120:0/1883684066 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708c068660 con 0x563bb9582710 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.794+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bb967b880 con 0x563bb9582710 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.794+0000 7f6f86e05640 1 -- 172.21.15.120:0/1883684066 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c068940 con 0x563bb9582710 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.794+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bb967c280 con 0x563bb9582710 2024-09-07T03:34:19.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.794+0000 7f709ec13800 1 Processor -- start 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.794+0000 7f709ec13800 1 -- start start 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f6f86e05640 1 -- 172.21.15.120:0/1883684066 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f708c068ae0 con 0x563bb9582710 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f709ec13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f709ec13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563bb9478a00 con 0x563bb9688560 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f709ab23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f6f86e05640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f8003c780 0x7f6f8003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f709ab23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39968/0 (socket says 172.21.15.120:39968) 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f709ab23640 1 -- 172.21.15.120:0/2726231356 learned_addr learned my addr 172.21.15.120:0/2726231356 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f6f86e05640 1 -- 172.21.15.120:0/1883684066 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f708c097fa0 con 0x563bb9582710 2024-09-07T03:34:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f709a322640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f8003c780 0x7f6f8003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f709ab23640 1 -- 172.21.15.120:0/2726231356 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bb968af20 con 0x563bb9688560 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f709ab23640 1 --2- 172.21.15.120:0/2726231356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968a950 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f709400a3e0 tx=0x7f709400a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76750967a1a6702b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f709a322640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f8003c780 0x7f6f8003ec40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f708c053cf0 tx=0x7f708c07c3f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f6f84e01640 1 -- 172.21.15.120:0/2726231356 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7094015070 con 0x563bb9688560 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f6f84e01640 1 -- 172.21.15.120:0/2726231356 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7094001670 con 0x563bb9688560 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.795+0000 7f6f84e01640 1 -- 172.21.15.120:0/2726231356 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7094001990 con 0x563bb9688560 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 -- 172.21.15.120:0/2726231356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 msgr2=0x563bb968a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 --2- 172.21.15.120:0/2726231356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968a950 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f709400a3e0 tx=0x7f709400a8a0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 -- 172.21.15.120:0/2726231356 shutdown_connections 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 --2- 172.21.15.120:0/2726231356 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968a950 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 -- 172.21.15.120:0/2726231356 >> 172.21.15.120:0/2726231356 conn(0x563bb9585040 msgr2=0x563bb9682e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 -- 172.21.15.120:0/2726231356 shutdown_connections 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 -- 172.21.15.120:0/2726231356 wait complete. 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 Processor -- start 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 -- start start 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ec13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563bb968b270 con 0x563bb9688560 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ab23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ab23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39982/0 (socket says 172.21.15.120:39982) 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.796+0000 7f709ab23640 1 -- 172.21.15.120:0/227979116 learned_addr learned my addr 172.21.15.120:0/227979116 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.797+0000 7f709ab23640 1 -- 172.21.15.120:0/227979116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bb968f910 con 0x563bb9688560 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.797+0000 7f709ab23640 1 --2- 172.21.15.120:0/227979116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968f3b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x563bb9683860 tx=0x7f7094003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.797+0000 7f6f7effd640 1 -- 172.21.15.120:0/227979116 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7094020020 con 0x563bb9688560 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.797+0000 7f6f7effd640 1 -- 172.21.15.120:0/227979116 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7094010780 con 0x563bb9688560 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.797+0000 7f6f7effd640 1 -- 172.21.15.120:0/227979116 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7094015040 con 0x563bb9688560 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.797+0000 7f709ec13800 1 -- 172.21.15.120:0/227979116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bb968fba0 con 0x563bb9688560 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.797+0000 7f709ec13800 1 -- 172.21.15.120:0/227979116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bb9690520 con 0x563bb9688560 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.798+0000 7f6f7effd640 1 -- 172.21.15.120:0/227979116 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7094023020 con 0x563bb9688560 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.798+0000 7f6f7effd640 1 --2- 172.21.15.120:0/227979116 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f7403c780 0x7f6f7403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.798+0000 7f6f7effd640 1 -- 172.21.15.120:0/227979116 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f7094053370 con 0x563bb9688560 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.798+0000 7f7099b21640 1 --2- 172.21.15.120:0/227979116 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f7403c780 0x7f6f7403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.798+0000 7f709ec13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.798+0000 7f709ec13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:19.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.799+0000 7f7099b21640 1 --2- 172.21.15.120:0/227979116 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f7403c780 0x7f6f7403ec40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7090001cf0 tx=0x7f7090001250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.799+0000 7f709ec13800 1 Processor -- start 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.799+0000 7f709ec13800 1 -- start start 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.799+0000 7f709ec13800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb96a9240 0x563bb96a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.799+0000 7f709ec13800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563bb9580720 con 0x563bb96a9240 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.799+0000 7f709a322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb96a9240 0x563bb96a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.799+0000 7f709a322640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb96a9240 0x563bb96a9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:39986/0 (socket says 172.21.15.120:39986) 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.799+0000 7f709a322640 1 -- 172.21.15.120:0/3384540897 learned_addr learned my addr 172.21.15.120:0/3384540897 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.799+0000 7f709a322640 1 -- 172.21.15.120:0/3384540897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bb96a9ca0 con 0x563bb96a9240 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.800+0000 7f709a322640 1 --2- 172.21.15.120:0/3384540897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb96a9240 0x563bb96a9660 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f708c096320 tx=0x7f708c05fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.800+0000 7f6f5efe5640 1 -- 172.21.15.120:0/3384540897 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c070c70 con 0x563bb96a9240 2024-09-07T03:34:19.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.800+0000 7f6f5efe5640 1 -- 172.21.15.120:0/3384540897 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708c070e10 con 0x563bb96a9240 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.800+0000 7f6f5efe5640 1 -- 172.21.15.120:0/3384540897 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c0523a0 con 0x563bb96a9240 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.800+0000 7f709ec13800 1 -- 172.21.15.120:0/3384540897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bb96aa4d0 con 0x563bb96a9240 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.800+0000 7f709ec13800 1 -- 172.21.15.120:0/3384540897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bb96aaa70 con 0x563bb96a9240 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.801+0000 7f6f5efe5640 1 -- 172.21.15.120:0/3384540897 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f708c084070 con 0x563bb96a9240 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.801+0000 7f6f5efe5640 1 --2- 172.21.15.120:0/3384540897 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6edc03c730 0x7f6edc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.801+0000 7f6f5efe5640 1 -- 172.21.15.120:0/3384540897 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f708c08f070 con 0x563bb96a9240 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.801+0000 7f7099b21640 1 --2- 172.21.15.120:0/3384540897 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6edc03c730 0x7f6edc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.801+0000 7f6f5cfe1640 20 reqs_thread_entry: start 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.801+0000 7f7099b21640 1 --2- 172.21.15.120:0/3384540897 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6edc03c730 0x7f6edc03ebf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7090000f60 tx=0x7f709000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.801+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563bb96b6b60 0x563bb96b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.801+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563bb96b9610 con 0x563bb96b6b60 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.801+0000 7f709ab23640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563bb96b6b60 0x563bb96b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.802+0000 7f709ab23640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563bb96b6b60 0x563bb96b8f90 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.802+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.802+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563bb96ba400 0x563bb96bc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.802+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563bb96bce70 con 0x563bb96ba400 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.802+0000 7f709a322640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563bb96ba400 0x563bb96bc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.802+0000 7f709a322640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563bb96ba400 0x563bb96bc7f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.803+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.803+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563bb96be720 con 0x563bb96ba400 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.803+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.803+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563bb96cb4e0 con 0x563bb96b6b60 2024-09-07T03:34:19.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.803+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:NOTICE: set zone's realm_id= 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.803+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563bb96c28a0 0x563bb96c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.803+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96c28a0 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.803+0000 7f7099b21640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563bb96c28a0 0x563bb96c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.804+0000 7f7099b21640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563bb96c28a0 0x563bb96c57d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.804+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(5 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7090009050 con 0x563bb96c28a0 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.804+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96ba400 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.804+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.804+0000 7f709a322640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f708c087040 0x7f708c0978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.804+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x7f708c087040 2024-09-07T03:34:19.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.804+0000 7f709ab23640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f708c087040 0x7f708c0978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.805+0000 7f709ab23640 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f708c087040 0x7f708c0978c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.805+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x7f708c087040 2024-09-07T03:34:19.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.805+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96b6b60 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.805+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.805+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96b6b60 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.805+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.805+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96c28a0 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.806+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7090009050 con 0x563bb96c28a0 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.806+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96b6b60 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.806+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.806+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96ba400 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.806+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.806+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96ba400 2024-09-07T03:34:19.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.806+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.806+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96b6b60 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.806+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.807+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x7f708c087040 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.807+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x7f708c087040 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.807+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96b6b60 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.807+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.807+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x7f708c087040 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.807+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(17 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f709400e070 con 0x7f708c087040 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.807+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96ba400 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.808+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(18 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.808+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96c28a0 2024-09-07T03:34:19.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.808+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7090009050 con 0x563bb96c28a0 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.808+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96b6b60 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.808+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.808+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96ba400 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.808+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.808+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96c28a0 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7090009050 con 0x563bb96c28a0 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96b6b60 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96b6b60 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96b6b60 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96c28a0 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7090009050 con 0x563bb96c28a0 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.809+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x7f708c087040 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x7f708c087040 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x7f708c087040 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x7f708c087040 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x7f708c087040 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x7f708c087040 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96c28a0 2024-09-07T03:34:19.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7090009050 con 0x563bb96c28a0 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x7f708c087040 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f709400e070 con 0x7f708c087040 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.810+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96ba400 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.811+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.811+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96ba400 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.811+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.811+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96c28a0 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.812+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7090009050 con 0x563bb96c28a0 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.812+0000 7f7099b21640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96ba400 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.812+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=173b] v34'4 uv4 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.812+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c5350 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.812+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(36 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.812+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563bb96c93b0 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.812+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.812+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:38 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563bb96bf040 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.813+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(38 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.813+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563bb96bf040 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.814+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(39 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [create,call,writefull 0~1155] v36'5 uv5 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.814+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563bb96bf040 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.815+0000 7f709a322640 1 -- 172.21.15.120:0/1883684066 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v36'6 uv6 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f708c083030 con 0x563bb96ba400 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.815+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563bb96bf040 con 0x563bb96b6b60 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.816+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v36'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f709400e070 con 0x563bb96b6b60 2024-09-07T03:34:19.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/227979116 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f7403c780 msgr2=0x7f6f7403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 --2- 172.21.15.120:0/227979116 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f7403c780 0x7f6f7403ec40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7090001cf0 tx=0x7f7090001250 comp rx=0 tx=0).stop 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/227979116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 msgr2=0x563bb968f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 --2- 172.21.15.120:0/227979116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968f3b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x563bb9683860 tx=0x7f7094003370 comp rx=0 tx=0).stop 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/227979116 shutdown_connections 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 --2- 172.21.15.120:0/227979116 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f7403c780 0x7f6f7403ec40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 --2- 172.21.15.120:0/227979116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9688560 0x563bb968f3b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/227979116 >> 172.21.15.120:0/227979116 conn(0x563bb9585040 msgr2=0x563bb9682e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/227979116 shutdown_connections 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/227979116 wait complete. 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/3384540897 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6edc03c730 msgr2=0x7f6edc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 --2- 172.21.15.120:0/3384540897 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6edc03c730 0x7f6edc03ebf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7090000f60 tx=0x7f709000f000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/3384540897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb96a9240 msgr2=0x563bb96a9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 --2- 172.21.15.120:0/3384540897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb96a9240 0x563bb96a9660 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f708c096320 tx=0x7f708c05fc20 comp rx=0 tx=0).stop 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/3384540897 shutdown_connections 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 --2- 172.21.15.120:0/3384540897 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6edc03c730 0x7f6edc03ebf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 --2- 172.21.15.120:0/3384540897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb96a9240 0x563bb96a9660 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/3384540897 >> 172.21.15.120:0/3384540897 conn(0x563bb969e780 msgr2=0x563bb969eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/3384540897 shutdown_connections 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.817+0000 7f709ec13800 1 -- 172.21.15.120:0/3384540897 wait complete. 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563bb96ba400 msgr2=0x563bb96bc7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563bb96ba400 0x563bb96bc7f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563bb96b6b60 msgr2=0x563bb96b8f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563bb96b6b60 0x563bb96b8f90 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f708c087040 msgr2=0x7f708c0978c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f708c087040 0x7f708c0978c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563bb96c28a0 msgr2=0x563bb96c57d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563bb96c28a0 0x563bb96c57d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f8003c780 msgr2=0x7f6f8003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6f8003c780 0x7f6f8003ec40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f708c053cf0 tx=0x7f708c07c3f0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ab23640 1 -- 172.21.15.120:0/1883684066 reap_dead start 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 msgr2=0x563bb967b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb967b090 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f708c025c20 tx=0x7f708c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 shutdown_connections 2024-09-07T03:34:19.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 --2- 172.21.15.120:0/1883684066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563bb9582710 0x563bb967b090 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 >> 172.21.15.120:0/1883684066 conn(0x563bb957c1b0 msgr2=0x563bb966cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 shutdown_connections 2024-09-07T03:34:19.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.818+0000 7f709ec13800 1 -- 172.21.15.120:0/1883684066 wait complete. 2024-09-07T03:34:19.836 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"cf0fab6f-a978-4ce5-bacd-166891c31743","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-07T03:34:19.836 DEBUG:tasks.util.rgw: json result: {'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-07T03:34:19.836 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-07T03:34:19.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-07T03:34:19.837 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-07T03:34:19.919 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:19.919 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:19.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.918+0000 7f263e71f800 1 Processor -- start 2024-09-07T03:34:19.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.918+0000 7f263e71f800 1 -- start start 2024-09-07T03:34:19.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.918+0000 7f263e71f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b9c24e6430 0x55b9c24e6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.918+0000 7f263e71f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b9c2390e40 con 0x55b9c24e8f20 2024-09-07T03:34:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.918+0000 7f263e71f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b9c235b680 con 0x55b9c24e6430 2024-09-07T03:34:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.918+0000 7f263a4a9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b9c24e6430 0x55b9c24e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.918+0000 7f2633fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b9c24e8f20 0x55b9c24eb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43824/0 (socket says 172.21.15.120:43824) 2024-09-07T03:34:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.919+0000 7f2633fff640 1 -- 172.21.15.120:0/1434636610 learned_addr learned my addr 172.21.15.120:0/1434636610 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.919+0000 7f263a4a9640 1 -- 172.21.15.120:0/1434636610 >> v1:172.21.15.104:6789/0 conn(0x55b9c24e8f20 legacy=0x55b9c24eb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.919+0000 7f2639ca8640 1 -- 172.21.15.120:0/1434636610 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715037293 0 0) 0x55b9c2390e40 con 0x55b9c24e8f20 2024-09-07T03:34:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.919+0000 7f263a4a9640 1 -- 172.21.15.120:0/1434636610 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c23776b0 con 0x55b9c24e6430 2024-09-07T03:34:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f263a4a9640 1 --2- 172.21.15.120:0/1434636610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c24e6830 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f262c00a470 tx=0x7f262c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51108246e1715746 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f2639ca8640 1 -- 172.21.15.120:0/1434636610 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c053570 con 0x55b9c24e6430 2024-09-07T03:34:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f2639ca8640 1 -- 172.21.15.120:0/1434636610 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c058070 con 0x55b9c24e6430 2024-09-07T03:34:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f2639ca8640 1 -- 172.21.15.120:0/1434636610 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c053880 con 0x55b9c24e6430 2024-09-07T03:34:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f263e71f800 1 -- 172.21.15.120:0/1434636610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 msgr2=0x55b9c24e6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f263e71f800 1 --2- 172.21.15.120:0/1434636610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c24e6830 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f262c00a470 tx=0x7f262c045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f263e71f800 1 -- 172.21.15.120:0/1434636610 shutdown_connections 2024-09-07T03:34:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f263e71f800 1 --2- 172.21.15.120:0/1434636610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c24e6830 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f263e71f800 1 -- 172.21.15.120:0/1434636610 >> 172.21.15.120:0/1434636610 conn(0x55b9c24e0910 msgr2=0x55b9c24e2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f263e71f800 1 -- 172.21.15.120:0/1434636610 shutdown_connections 2024-09-07T03:34:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.921+0000 7f263e71f800 1 -- 172.21.15.120:0/1434636610 wait complete. 2024-09-07T03:34:19.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.935+0000 7f263e71f800 1 Processor -- start 2024-09-07T03:34:19.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.935+0000 7f263e71f800 1 -- start start 2024-09-07T03:34:19.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.935+0000 7f263e71f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c24e5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.935+0000 7f263e71f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b9c237fdd0 con 0x55b9c24e6430 2024-09-07T03:34:19.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.936+0000 7f263a4a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c24e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.936+0000 7f263a4a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c24e5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40004/0 (socket says 172.21.15.120:40004) 2024-09-07T03:34:19.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.936+0000 7f263a4a9640 1 -- 172.21.15.120:0/903295154 learned_addr learned my addr 172.21.15.120:0/903295154 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.936+0000 7f263a4a9640 1 -- 172.21.15.120:0/903295154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c2398e10 con 0x55b9c24e6430 2024-09-07T03:34:19.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.936+0000 7f263a4a9640 1 --2- 172.21.15.120:0/903295154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c24e5550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f262c00a470 tx=0x7f262c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4afad222074a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.936+0000 7f2528608640 1 -- 172.21.15.120:0/903295154 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c053570 con 0x55b9c24e6430 2024-09-07T03:34:19.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.937+0000 7f2528608640 1 -- 172.21.15.120:0/903295154 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c063030 con 0x55b9c24e6430 2024-09-07T03:34:19.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.937+0000 7f2528608640 1 -- 172.21.15.120:0/903295154 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c053840 con 0x55b9c24e6430 2024-09-07T03:34:19.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.937+0000 7f263e71f800 1 -- 172.21.15.120:0/903295154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 msgr2=0x55b9c24e5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.937+0000 7f263e71f800 1 --2- 172.21.15.120:0/903295154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c24e5550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f262c00a470 tx=0x7f262c051000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.937+0000 7f263e71f800 1 -- 172.21.15.120:0/903295154 shutdown_connections 2024-09-07T03:34:19.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.937+0000 7f263e71f800 1 --2- 172.21.15.120:0/903295154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c24e5550 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.937+0000 7f263e71f800 1 -- 172.21.15.120:0/903295154 >> 172.21.15.120:0/903295154 conn(0x55b9c24e0910 msgr2=0x55b9c25d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.937+0000 7f263e71f800 1 -- 172.21.15.120:0/903295154 shutdown_connections 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.937+0000 7f263e71f800 1 -- 172.21.15.120:0/903295154 wait complete. 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.938+0000 7f263e71f800 1 Processor -- start 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.938+0000 7f263e71f800 1 -- start start 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.938+0000 7f263e71f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c25dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.938+0000 7f263e71f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b9c24ecf40 con 0x55b9c24e6430 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.938+0000 7f263a4a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c25dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.938+0000 7f263a4a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c25dfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40016/0 (socket says 172.21.15.120:40016) 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.938+0000 7f263a4a9640 1 -- 172.21.15.120:0/2929536030 learned_addr learned my addr 172.21.15.120:0/2929536030 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.938+0000 7f263a4a9640 1 -- 172.21.15.120:0/2929536030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c25e03e0 con 0x55b9c24e6430 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.939+0000 7f263a4a9640 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c25dfe80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f262c00a470 tx=0x7f262c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.939+0000 7f2526e05640 1 -- 172.21.15.120:0/2929536030 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c078070 con 0x55b9c24e6430 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.939+0000 7f2526e05640 1 -- 172.21.15.120:0/2929536030 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c068420 con 0x55b9c24e6430 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.939+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9c25e0670 con 0x55b9c24e6430 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.939+0000 7f2526e05640 1 -- 172.21.15.120:0/2929536030 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c068700 con 0x55b9c24e6430 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.939+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9c25e1280 con 0x55b9c24e6430 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.939+0000 7f263e71f800 1 Processor -- start 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.939+0000 7f263e71f800 1 -- start start 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f2526e05640 1 -- 172.21.15.120:0/2929536030 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f262c07b070 con 0x55b9c24e6430 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f263e71f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25ef720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f263e71f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b9c23dda00 con 0x55b9c25ed330 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f2526e05640 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f252003c780 0x7f252003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f263acaa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f263acaa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25ef720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40024/0 (socket says 172.21.15.120:40024) 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f263acaa640 1 -- 172.21.15.120:0/1312123537 learned_addr learned my addr 172.21.15.120:0/1312123537 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f2526e05640 1 -- 172.21.15.120:0/2929536030 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f262c097960 con 0x55b9c24e6430 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f263a4a9640 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f252003c780 0x7f252003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f263acaa640 1 -- 172.21.15.120:0/1312123537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c25efcf0 con 0x55b9c25ed330 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f263acaa640 1 --2- 172.21.15.120:0/1312123537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25ef720 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f263400a3e0 tx=0x7f263400a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9643dca4a9889c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f263a4a9640 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f252003c780 0x7f252003ec40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f262c05e780 tx=0x7f262c07f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f2524e01640 1 -- 172.21.15.120:0/1312123537 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2634015070 con 0x55b9c25ed330 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f2524e01640 1 -- 172.21.15.120:0/1312123537 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2634001670 con 0x55b9c25ed330 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.940+0000 7f2524e01640 1 -- 172.21.15.120:0/1312123537 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2634001990 con 0x55b9c25ed330 2024-09-07T03:34:19.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 -- 172.21.15.120:0/1312123537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 msgr2=0x55b9c25ef720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 --2- 172.21.15.120:0/1312123537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25ef720 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f263400a3e0 tx=0x7f263400a8a0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 -- 172.21.15.120:0/1312123537 shutdown_connections 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 --2- 172.21.15.120:0/1312123537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25ef720 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 -- 172.21.15.120:0/1312123537 >> 172.21.15.120:0/1312123537 conn(0x55b9c24e8f20 msgr2=0x55b9c25e7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 -- 172.21.15.120:0/1312123537 shutdown_connections 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 -- 172.21.15.120:0/1312123537 wait complete. 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 Processor -- start 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 -- start start 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.941+0000 7f263e71f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b9c25eff80 con 0x55b9c25ed330 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f263acaa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f263acaa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25f40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40028/0 (socket says 172.21.15.120:40028) 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f263acaa640 1 -- 172.21.15.120:0/1338530489 learned_addr learned my addr 172.21.15.120:0/1338530489 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f263acaa640 1 -- 172.21.15.120:0/1338530489 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c25f4650 con 0x55b9c25ed330 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f263acaa640 1 --2- 172.21.15.120:0/1338530489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25f40f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x55b9c25e8630 tx=0x7f2634003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f251effd640 1 -- 172.21.15.120:0/1338530489 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2634020020 con 0x55b9c25ed330 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f251effd640 1 -- 172.21.15.120:0/1338530489 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2634010780 con 0x55b9c25ed330 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f251effd640 1 -- 172.21.15.120:0/1338530489 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2634015040 con 0x55b9c25ed330 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f263e71f800 1 -- 172.21.15.120:0/1338530489 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9c25f48e0 con 0x55b9c25ed330 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.942+0000 7f263e71f800 1 -- 172.21.15.120:0/1338530489 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9c25f5260 con 0x55b9c25ed330 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.943+0000 7f251effd640 1 -- 172.21.15.120:0/1338530489 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2634023020 con 0x55b9c25ed330 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.943+0000 7f251effd640 1 --2- 172.21.15.120:0/1338530489 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f251403c780 0x7f251403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.943+0000 7f251effd640 1 -- 172.21.15.120:0/1338530489 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f2634053370 con 0x55b9c25ed330 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.943+0000 7f2633fff640 1 --2- 172.21.15.120:0/1338530489 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f251403c780 0x7f251403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.944+0000 7f263e71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.944+0000 7f263e71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.944+0000 7f2633fff640 1 --2- 172.21.15.120:0/1338530489 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f251403c780 0x7f251403ec40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2624000c00 tx=0x7f2624001330 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.944+0000 7f263e71f800 1 Processor -- start 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.944+0000 7f263e71f800 1 -- start start 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.944+0000 7f263e71f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c260df60 0x55b9c260e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.944+0000 7f263e71f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b9c25db440 con 0x55b9c260df60 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f263a4a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c260df60 0x55b9c260e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f263a4a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c260df60 0x55b9c260e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40030/0 (socket says 172.21.15.120:40030) 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f263a4a9640 1 -- 172.21.15.120:0/1402553910 learned_addr learned my addr 172.21.15.120:0/1402553910 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:19.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f263a4a9640 1 -- 172.21.15.120:0/1402553910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c260e9c0 con 0x55b9c260df60 2024-09-07T03:34:19.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f263a4a9640 1 --2- 172.21.15.120:0/1402553910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c260df60 0x55b9c260e380 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f262c095ce0 tx=0x7f262c067980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f24fefe5640 1 -- 172.21.15.120:0/1402553910 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c085030 con 0x55b9c260df60 2024-09-07T03:34:19.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f24fefe5640 1 -- 172.21.15.120:0/1402553910 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c092070 con 0x55b9c260df60 2024-09-07T03:34:19.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f263e71f800 1 -- 172.21.15.120:0/1402553910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9c260f1f0 con 0x55b9c260df60 2024-09-07T03:34:19.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f24fefe5640 1 -- 172.21.15.120:0/1402553910 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c097e10 con 0x55b9c260df60 2024-09-07T03:34:19.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.945+0000 7f263e71f800 1 -- 172.21.15.120:0/1402553910 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9c260f790 con 0x55b9c260df60 2024-09-07T03:34:19.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.946+0000 7f24fefe5640 1 -- 172.21.15.120:0/1402553910 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f262c089040 con 0x55b9c260df60 2024-09-07T03:34:19.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.946+0000 7f24fefe5640 1 --2- 172.21.15.120:0/1402553910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247c03c730 0x7f247c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.946+0000 7f24fefe5640 1 -- 172.21.15.120:0/1402553910 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f262c086070 con 0x55b9c260df60 2024-09-07T03:34:19.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.946+0000 7f2633fff640 1 --2- 172.21.15.120:0/1402553910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247c03c730 0x7f247c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.946+0000 7f24fcfe1640 20 reqs_thread_entry: start 2024-09-07T03:34:19.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.947+0000 7f2633fff640 1 --2- 172.21.15.120:0/1402553910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247c03c730 0x7f247c03ebf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2624000f60 tx=0x7f2624006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.947+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b9c261b8d0 0x55b9c261dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.947+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b9c261e3a0 con 0x55b9c261b8d0 2024-09-07T03:34:19.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.947+0000 7f263acaa640 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b9c261b8d0 0x55b9c261dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.947+0000 7f263acaa640 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b9c261b8d0 0x55b9c261dd20 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.947+0000 7f263acaa640 1 -- 172.21.15.120:0/2929536030 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263400e070 con 0x55b9c261b8d0 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.947+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b9c261f190 0x55b9c2621580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.947+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b9c2621c30 con 0x55b9c261f190 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.947+0000 7f263a4a9640 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b9c261f190 0x55b9c2621580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.948+0000 7f263a4a9640 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b9c261f190 0x55b9c2621580 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.948+0000 7f263a4a9640 1 -- 172.21.15.120:0/2929536030 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f262c07a030 con 0x55b9c261f190 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.948+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b9c26234e0 con 0x55b9c261f190 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.948+0000 7f263a4a9640 1 -- 172.21.15.120:0/2929536030 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~1155 out=1155b] v0'0 uv5 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f262c07a030 con 0x55b9c261f190 2024-09-07T03:34:19.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 -- 172.21.15.120:0/1338530489 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f251403c780 msgr2=0x7f251403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 --2- 172.21.15.120:0/1338530489 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f251403c780 0x7f251403ec40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2624000c00 tx=0x7f2624001330 comp rx=0 tx=0).stop 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 -- 172.21.15.120:0/1338530489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 msgr2=0x55b9c25f40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 --2- 172.21.15.120:0/1338530489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25f40f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x55b9c25e8630 tx=0x7f2634003370 comp rx=0 tx=0).stop 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 -- 172.21.15.120:0/1338530489 shutdown_connections 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 --2- 172.21.15.120:0/1338530489 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f251403c780 0x7f251403ec40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 --2- 172.21.15.120:0/1338530489 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c25ed330 0x55b9c25f40f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 -- 172.21.15.120:0/1338530489 >> 172.21.15.120:0/1338530489 conn(0x55b9c24e8f20 msgr2=0x55b9c25e7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 -- 172.21.15.120:0/1338530489 shutdown_connections 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.949+0000 7f263e71f800 1 -- 172.21.15.120:0/1338530489 wait complete. 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/1402553910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247c03c730 msgr2=0x7f247c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/1402553910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247c03c730 0x7f247c03ebf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2624000f60 tx=0x7f2624006000 comp rx=0 tx=0).stop 2024-09-07T03:34:19.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/1402553910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c260df60 msgr2=0x55b9c260e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/1402553910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c260df60 0x55b9c260e380 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f262c095ce0 tx=0x7f262c067980 comp rx=0 tx=0).stop 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/1402553910 shutdown_connections 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/1402553910 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247c03c730 0x7f247c03ebf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/1402553910 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c260df60 0x55b9c260e380 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/1402553910 >> 172.21.15.120:0/1402553910 conn(0x55b9c26034e0 msgr2=0x55b9c26038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/1402553910 shutdown_connections 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/1402553910 wait complete. 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b9c261f190 msgr2=0x55b9c2621580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b9c261f190 0x55b9c2621580 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b9c261b8d0 msgr2=0x55b9c261dd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b9c261b8d0 0x55b9c261dd20 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f252003c780 msgr2=0x7f252003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f252003c780 0x7f252003ec40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f262c05e780 tx=0x7f262c07f040 comp rx=0 tx=0).stop 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 msgr2=0x55b9c25dfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c25dfe80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f262c00a470 tx=0x7f262c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 shutdown_connections 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b9c261f190 0x55b9c2621580 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b9c261b8d0 0x55b9c261dd20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f252003c780 0x7f252003ec40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 --2- 172.21.15.120:0/2929536030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b9c24e6430 0x55b9c25dfe80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 >> 172.21.15.120:0/2929536030 conn(0x55b9c24e0910 msgr2=0x55b9c25cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:19.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 shutdown_connections 2024-09-07T03:34:19.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:19.950+0000 7f263e71f800 1 -- 172.21.15.120:0/2929536030 wait complete. 2024-09-07T03:34:19.964 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"cf0fab6f-a978-4ce5-bacd-166891c31743","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-07T03:34:19.965 DEBUG:tasks.util.rgw: json result: {'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-07T03:34:19.965 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-07T03:34:19.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-07T03:34:19.965 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-07T03:34:20.052 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:20.052 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:20.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.051+0000 7f44d5b35800 1 Processor -- start 2024-09-07T03:34:20.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.051+0000 7f44d5b35800 1 -- start start 2024-09-07T03:34:20.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.052+0000 7f44d5b35800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b1c799b370 0x55b1c799d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.052+0000 7f44d5b35800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1c7840e40 con 0x55b1c7997860 2024-09-07T03:34:20.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.052+0000 7f44d5b35800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b1c780b680 con 0x55b1c799b370 2024-09-07T03:34:20.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.052+0000 7f44d10e3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b1c799b370 0x55b1c799d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.052+0000 7f44d18e4640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b1c7997860 0x55b1c7999c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43836/0 (socket says 172.21.15.120:43836) 2024-09-07T03:34:20.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.052+0000 7f44d18e4640 1 -- 172.21.15.120:0/1383869359 learned_addr learned my addr 172.21.15.120:0/1383869359 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:20.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.052+0000 7f44d10e3640 1 -- 172.21.15.120:0/1383869359 >> v1:172.21.15.104:6789/0 conn(0x55b1c7997860 legacy=0x55b1c7999c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.052+0000 7f44d10e3640 1 -- 172.21.15.120:0/1383869359 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c78276b0 con 0x55b1c799b370 2024-09-07T03:34:20.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.054+0000 7f44d10e3640 1 --2- 172.21.15.120:0/1383869359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c799b370 0x55b1c799d800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f44c800a470 tx=0x7f44c8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28579aae7da70bd server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.054+0000 7f44d08e2640 1 -- 172.21.15.120:0/1383869359 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c8053570 con 0x55b1c799b370 2024-09-07T03:34:20.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.054+0000 7f44d08e2640 1 -- 172.21.15.120:0/1383869359 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c8058070 con 0x55b1c799b370 2024-09-07T03:34:20.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.054+0000 7f44d08e2640 1 -- 172.21.15.120:0/1383869359 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c8053880 con 0x55b1c799b370 2024-09-07T03:34:20.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.055+0000 7f44d5b35800 1 -- 172.21.15.120:0/1383869359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c799b370 msgr2=0x55b1c799d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.055+0000 7f44d5b35800 1 --2- 172.21.15.120:0/1383869359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c799b370 0x55b1c799d800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f44c800a470 tx=0x7f44c8045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:20.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.055+0000 7f44d5b35800 1 -- 172.21.15.120:0/1383869359 shutdown_connections 2024-09-07T03:34:20.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.055+0000 7f44d5b35800 1 --2- 172.21.15.120:0/1383869359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c799b370 0x55b1c799d800 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.055+0000 7f44d5b35800 1 -- 172.21.15.120:0/1383869359 >> 172.21.15.120:0/1383869359 conn(0x55b1c7991320 msgr2=0x55b1c7993760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.055+0000 7f44d5b35800 1 -- 172.21.15.120:0/1383869359 shutdown_connections 2024-09-07T03:34:20.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.055+0000 7f44d5b35800 1 -- 172.21.15.120:0/1383869359 wait complete. 2024-09-07T03:34:20.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.069+0000 7f44d5b35800 1 Processor -- start 2024-09-07T03:34:20.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.069+0000 7f44d5b35800 1 -- start start 2024-09-07T03:34:20.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.069+0000 7f44d5b35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a86750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.069+0000 7f44d5b35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b1c782fdd0 con 0x55b1c7997860 2024-09-07T03:34:20.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.069+0000 7f44d18e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a86750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.069+0000 7f44d18e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a86750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40048/0 (socket says 172.21.15.120:40048) 2024-09-07T03:34:20.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.069+0000 7f44d18e4640 1 -- 172.21.15.120:0/1323307640 learned_addr learned my addr 172.21.15.120:0/1323307640 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.069+0000 7f44d18e4640 1 -- 172.21.15.120:0/1323307640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c7848e10 con 0x55b1c7997860 2024-09-07T03:34:20.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.070+0000 7f44d18e4640 1 --2- 172.21.15.120:0/1323307640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a86750 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f44c4001800 tx=0x7f44c4001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a03991a7c9d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.070+0000 7f43bfe07640 1 -- 172.21.15.120:0/1323307640 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4004520 con 0x55b1c7997860 2024-09-07T03:34:20.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.070+0000 7f43bfe07640 1 -- 172.21.15.120:0/1323307640 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c40046c0 con 0x55b1c7997860 2024-09-07T03:34:20.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.070+0000 7f43bfe07640 1 -- 172.21.15.120:0/1323307640 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c40049e0 con 0x55b1c7997860 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.070+0000 7f44d5b35800 1 -- 172.21.15.120:0/1323307640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 msgr2=0x55b1c7a86750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.070+0000 7f44d5b35800 1 --2- 172.21.15.120:0/1323307640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a86750 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f44c4001800 tx=0x7f44c4001cc0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.070+0000 7f44d5b35800 1 -- 172.21.15.120:0/1323307640 shutdown_connections 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.070+0000 7f44d5b35800 1 --2- 172.21.15.120:0/1323307640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a86750 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.070+0000 7f44d5b35800 1 -- 172.21.15.120:0/1323307640 >> 172.21.15.120:0/1323307640 conn(0x55b1c7991320 msgr2=0x55b1c7a820d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.071+0000 7f44d5b35800 1 -- 172.21.15.120:0/1323307640 shutdown_connections 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.071+0000 7f44d5b35800 1 -- 172.21.15.120:0/1323307640 wait complete. 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.071+0000 7f44d5b35800 1 Processor -- start 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.071+0000 7f44d5b35800 1 -- start start 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.071+0000 7f44d5b35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a8e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.071+0000 7f44d5b35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b1c799e180 con 0x55b1c7997860 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.071+0000 7f44d18e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a8e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.071+0000 7f44d18e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a8e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40050/0 (socket says 172.21.15.120:40050) 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.071+0000 7f44d18e4640 1 -- 172.21.15.120:0/3315033763 learned_addr learned my addr 172.21.15.120:0/3315033763 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.072+0000 7f44d18e4640 1 -- 172.21.15.120:0/3315033763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c7a8e660 con 0x55b1c7997860 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.072+0000 7f44d18e4640 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a8e100 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f44c4000f80 tx=0x7f44c4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.072+0000 7f43be604640 1 -- 172.21.15.120:0/3315033763 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4022020 con 0x55b1c7997860 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.072+0000 7f43be604640 1 -- 172.21.15.120:0/3315033763 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4014890 con 0x55b1c7997860 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.072+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1c7a8e8f0 con 0x55b1c7997860 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.072+0000 7f43be604640 1 -- 172.21.15.120:0/3315033763 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4014bb0 con 0x55b1c7997860 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.072+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1c7a8f2f0 con 0x55b1c7997860 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f44d5b35800 1 Processor -- start 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f44d5b35800 1 -- start start 2024-09-07T03:34:20.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f43be604640 1 -- 172.21.15.120:0/3315033763 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f44c4025020 con 0x55b1c7997860 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f44d5b35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7995c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f44d5b35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b1c788da00 con 0x55b1c7995860 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f44d20e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7995c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f44d20e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7995c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40066/0 (socket says 172.21.15.120:40066) 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f44d20e5640 1 -- 172.21.15.120:0/822134895 learned_addr learned my addr 172.21.15.120:0/822134895 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f43be604640 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43b803c730 0x7f43b803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f43be604640 1 -- 172.21.15.120:0/3315033763 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f44c4018030 con 0x55b1c7997860 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f44d18e4640 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43b803c730 0x7f43b803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.073+0000 7f44d20e5640 1 -- 172.21.15.120:0/822134895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c79961a0 con 0x55b1c7995860 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d20e5640 1 --2- 172.21.15.120:0/822134895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7995c60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00a430 tx=0x7f44cc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547ee2455a78979 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d18e4640 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43b803c730 0x7f43b803ebf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f44c4011ff0 tx=0x7f44c4011f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f43b7fff640 1 -- 172.21.15.120:0/822134895 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44cc008840 con 0x55b1c7995860 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f43b7fff640 1 -- 172.21.15.120:0/822134895 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc008a00 con 0x55b1c7995860 2024-09-07T03:34:20.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f43b7fff640 1 -- 172.21.15.120:0/822134895 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44cc008d20 con 0x55b1c7995860 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d5b35800 1 -- 172.21.15.120:0/822134895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 msgr2=0x55b1c7995c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d5b35800 1 --2- 172.21.15.120:0/822134895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7995c60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00a430 tx=0x7f44cc00a8f0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d5b35800 1 -- 172.21.15.120:0/822134895 shutdown_connections 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d5b35800 1 --2- 172.21.15.120:0/822134895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7995c60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d5b35800 1 -- 172.21.15.120:0/822134895 >> 172.21.15.120:0/822134895 conn(0x55b1c799b370 msgr2=0x55b1c7a95f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d5b35800 1 -- 172.21.15.120:0/822134895 shutdown_connections 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d5b35800 1 -- 172.21.15.120:0/822134895 wait complete. 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.074+0000 7f44d5b35800 1 Processor -- start 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d5b35800 1 -- start start 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d5b35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7aa4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d5b35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b1c7996520 con 0x55b1c7995860 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d20e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7aa4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d20e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7aa4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40080/0 (socket says 172.21.15.120:40080) 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d20e5640 1 -- 172.21.15.120:0/2135433425 learned_addr learned my addr 172.21.15.120:0/2135433425 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d20e5640 1 -- 172.21.15.120:0/2135433425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c7aa4da0 con 0x55b1c7995860 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d20e5640 1 --2- 172.21.15.120:0/2135433425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7aa4840 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00adf0 tx=0x7f44cc002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f43b67fc640 1 -- 172.21.15.120:0/2135433425 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44cc022030 con 0x55b1c7995860 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f43b67fc640 1 -- 172.21.15.120:0/2135433425 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc019040 con 0x55b1c7995860 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f43b67fc640 1 -- 172.21.15.120:0/2135433425 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44cc013970 con 0x55b1c7995860 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d5b35800 1 -- 172.21.15.120:0/2135433425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1c7aa5030 con 0x55b1c7995860 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.075+0000 7f44d5b35800 1 -- 172.21.15.120:0/2135433425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1c7aa59b0 con 0x55b1c7995860 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.076+0000 7f43b67fc640 1 -- 172.21.15.120:0/2135433425 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f44cc025070 con 0x55b1c7995860 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.076+0000 7f43b67fc640 1 --2- 172.21.15.120:0/2135433425 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43ac03c780 0x7f43ac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.076+0000 7f43b67fc640 1 -- 172.21.15.120:0/2135433425 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f44cc023070 con 0x55b1c7995860 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.077+0000 7f44d10e3640 1 --2- 172.21.15.120:0/2135433425 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43ac03c780 0x7f43ac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.077+0000 7f44d5b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:20.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.077+0000 7f44d5b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:20.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.077+0000 7f44d10e3640 1 --2- 172.21.15.120:0/2135433425 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43ac03c780 0x7f43ac03ec40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f44c8057000 tx=0x7f44c8052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.077+0000 7f44d5b35800 1 Processor -- start 2024-09-07T03:34:20.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.077+0000 7f44d5b35800 1 -- start start 2024-09-07T03:34:20.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.077+0000 7f44d5b35800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7abe5c0 0x55b1c7abe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.077+0000 7f44d5b35800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b1c7a86fa0 con 0x55b1c7abe5c0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f44d18e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7abe5c0 0x55b1c7abe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f44d18e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7abe5c0 0x55b1c7abe9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40086/0 (socket says 172.21.15.120:40086) 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f44d18e4640 1 -- 172.21.15.120:0/3461652761 learned_addr learned my addr 172.21.15.120:0/3461652761 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f44d18e4640 1 -- 172.21.15.120:0/3461652761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c7abf020 con 0x55b1c7abe5c0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f44d18e4640 1 --2- 172.21.15.120:0/3461652761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7abe5c0 0x55b1c7abe9e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f44c4018fd0 tx=0x7f44c401ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f43967e4640 1 -- 172.21.15.120:0/3461652761 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4041070 con 0x55b1c7abe5c0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f43967e4640 1 -- 172.21.15.120:0/3461652761 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4026830 con 0x55b1c7abe5c0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f43967e4640 1 -- 172.21.15.120:0/3461652761 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4026b30 con 0x55b1c7abe5c0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f44d5b35800 1 -- 172.21.15.120:0/3461652761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1c7abf850 con 0x55b1c7abe5c0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.078+0000 7f44d5b35800 1 -- 172.21.15.120:0/3461652761 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1c7abfdf0 con 0x55b1c7abe5c0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.079+0000 7f43967e4640 1 -- 172.21.15.120:0/3461652761 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f44c4044070 con 0x55b1c7abe5c0 2024-09-07T03:34:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.079+0000 7f43967e4640 1 --2- 172.21.15.120:0/3461652761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f431403c730 0x7f431403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.079+0000 7f43967e4640 1 -- 172.21.15.120:0/3461652761 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f44c4047d60 con 0x55b1c7abe5c0 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.079+0000 7f44d10e3640 1 --2- 172.21.15.120:0/3461652761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f431403c730 0x7f431403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.079+0000 7f4307fff640 20 reqs_thread_entry: start 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.080+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b1c7acbf90 0x55b1c7ace450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.080+0000 7f44d10e3640 1 --2- 172.21.15.120:0/3461652761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f431403c730 0x7f431403ebf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f44c8045a60 tx=0x7f44c8005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.080+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b1c7aceb20 con 0x55b1c7acbf90 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.080+0000 7f44d20e5640 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b1c7acbf90 0x55b1c7ace450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.080+0000 7f44d20e5640 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b1c7acbf90 0x55b1c7ace450 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.080+0000 7f44d20e5640 1 -- 172.21.15.120:0/3315033763 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f44cc01e940 con 0x55b1c7acbf90 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.080+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b1c7ad03e0 con 0x55b1c7acbf90 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.081+0000 7f44d20e5640 1 -- 172.21.15.120:0/3315033763 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(2 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~1155 out=1155b] v0'0 uv5 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f44cc01e940 con 0x55b1c7acbf90 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.081+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b1c7acfd60 con 0x55b1c7acbf90 2024-09-07T03:34:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.082+0000 7f44d20e5640 1 -- 172.21.15.120:0/3315033763 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [stat,call,call,writefull 0~993] v36'7 uv7 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f44cc01e940 con 0x55b1c7acbf90 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/2135433425 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43ac03c780 msgr2=0x7f43ac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 --2- 172.21.15.120:0/2135433425 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43ac03c780 0x7f43ac03ec40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f44c8057000 tx=0x7f44c8052000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/2135433425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 msgr2=0x55b1c7aa4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 --2- 172.21.15.120:0/2135433425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7aa4840 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00adf0 tx=0x7f44cc002ff0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/2135433425 shutdown_connections 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 --2- 172.21.15.120:0/2135433425 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43ac03c780 0x7f43ac03ec40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 --2- 172.21.15.120:0/2135433425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7995860 0x55b1c7aa4840 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/2135433425 >> 172.21.15.120:0/2135433425 conn(0x55b1c799b370 msgr2=0x55b1c7a95f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/2135433425 shutdown_connections 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/2135433425 wait complete. 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/3461652761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f431403c730 msgr2=0x7f431403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3461652761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f431403c730 0x7f431403ebf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f44c8045a60 tx=0x7f44c8005a00 comp rx=0 tx=0).stop 2024-09-07T03:34:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/3461652761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7abe5c0 msgr2=0x55b1c7abe9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3461652761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7abe5c0 0x55b1c7abe9e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f44c4018fd0 tx=0x7f44c401ef90 comp rx=0 tx=0).stop 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/3461652761 shutdown_connections 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3461652761 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f431403c730 0x7f431403ebf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3461652761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7abe5c0 0x55b1c7abe9e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/3461652761 >> 172.21.15.120:0/3461652761 conn(0x55b1c7ab3b20 msgr2=0x55b1c7ab3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/3461652761 shutdown_connections 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.083+0000 7f44d5b35800 1 -- 172.21.15.120:0/3461652761 wait complete. 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b1c7acbf90 msgr2=0x55b1c7ace450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b1c7acbf90 0x55b1c7ace450 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43b803c730 msgr2=0x7f43b803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43b803c730 0x7f43b803ebf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f44c4011ff0 tx=0x7f44c4011f40 comp rx=0 tx=0).stop 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 msgr2=0x55b1c7a8e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a8e100 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f44c4000f80 tx=0x7f44c4001250 comp rx=0 tx=0).stop 2024-09-07T03:34:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 shutdown_connections 2024-09-07T03:34:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b1c7acbf90 0x55b1c7ace450 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f43b803c730 0x7f43b803ebf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 --2- 172.21.15.120:0/3315033763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b1c7997860 0x55b1c7a8e100 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 >> 172.21.15.120:0/3315033763 conn(0x55b1c7991320 msgr2=0x55b1c7a87a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 shutdown_connections 2024-09-07T03:34:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.084+0000 7f44d5b35800 1 -- 172.21.15.120:0/3315033763 wait complete. 2024-09-07T03:34:20.093 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"cf0fab6f-a978-4ce5-bacd-166891c31743","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-07T03:34:20.094 DEBUG:tasks.util.rgw: json result: {'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-07T03:34:20.094 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-07T03:34:20.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-07T03:34:20.094 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-07T03:34:20.138 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:20.138 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:20.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.138+0000 7fd018b2a800 1 Processor -- start 2024-09-07T03:34:20.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.138+0000 7fd018b2a800 1 -- start start 2024-09-07T03:34:20.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.138+0000 7fd018b2a800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b7c1f9c280 0x55b7c1fa1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.138+0000 7fd018b2a800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b7c1e44e40 con 0x55b7c1f9afb0 2024-09-07T03:34:20.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.138+0000 7fd018b2a800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b7c1e0f680 con 0x55b7c1f9c280 2024-09-07T03:34:20.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.138+0000 7fd00ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b7c1f9c280 0x55b7c1fa1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.138+0000 7fd00ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b7c1f9c280 0x55b7c1fa1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40090/0 (socket says 172.21.15.120:40090) 2024-09-07T03:34:20.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.138+0000 7fd00ffff640 1 -- 172.21.15.120:0/1354420048 learned_addr learned my addr 172.21.15.120:0/1354420048 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.138+0000 7fd0148ad640 1 --1- 172.21.15.120:0/1354420048 >> v1:172.21.15.104:6789/0 conn(0x55b7c1f9afb0 0x55b7c1f9bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43850/0 (socket says 172.21.15.120:43850) 2024-09-07T03:34:20.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.139+0000 7fd00ffff640 1 -- 172.21.15.120:0/1354420048 >> v1:172.21.15.104:6789/0 conn(0x55b7c1f9afb0 legacy=0x55b7c1f9bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.139+0000 7fd00f7fe640 1 -- 172.21.15.120:0/1354420048 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403458682 0 0) 0x55b7c1e44e40 con 0x55b7c1f9afb0 2024-09-07T03:34:20.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.139+0000 7fd00ffff640 1 -- 172.21.15.120:0/1354420048 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c1e2b6b0 con 0x55b7c1f9c280 2024-09-07T03:34:20.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.141+0000 7fd00ffff640 1 --2- 172.21.15.120:0/1354420048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9c280 0x55b7c1fa1e20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd00000a520 tx=0x7fd000045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cc9adac066a292 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.142+0000 7fd00f7fe640 1 -- 172.21.15.120:0/1354420048 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd000055070 con 0x55b7c1f9c280 2024-09-07T03:34:20.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.142+0000 7fd00f7fe640 1 -- 172.21.15.120:0/1354420048 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0000515b0 con 0x55b7c1f9c280 2024-09-07T03:34:20.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.142+0000 7fd00f7fe640 1 -- 172.21.15.120:0/1354420048 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0000518d0 con 0x55b7c1f9c280 2024-09-07T03:34:20.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.142+0000 7fd018b2a800 1 -- 172.21.15.120:0/1354420048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9c280 msgr2=0x55b7c1fa1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.142+0000 7fd018b2a800 1 --2- 172.21.15.120:0/1354420048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9c280 0x55b7c1fa1e20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd00000a520 tx=0x7fd000045ba0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.142+0000 7fd018b2a800 1 -- 172.21.15.120:0/1354420048 shutdown_connections 2024-09-07T03:34:20.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.142+0000 7fd018b2a800 1 --2- 172.21.15.120:0/1354420048 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9c280 0x55b7c1fa1e20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.142+0000 7fd018b2a800 1 -- 172.21.15.120:0/1354420048 >> 172.21.15.120:0/1354420048 conn(0x55b7c1f963c0 msgr2=0x55b7c1f987e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.142+0000 7fd018b2a800 1 -- 172.21.15.120:0/1354420048 shutdown_connections 2024-09-07T03:34:20.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.143+0000 7fd018b2a800 1 -- 172.21.15.120:0/1354420048 wait complete. 2024-09-07T03:34:20.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.157+0000 7fd018b2a800 1 Processor -- start 2024-09-07T03:34:20.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.157+0000 7fd018b2a800 1 -- start start 2024-09-07T03:34:20.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.158+0000 7fd018b2a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c208a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.158+0000 7fd018b2a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7c1e33dd0 con 0x55b7c1f9afb0 2024-09-07T03:34:20.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.158+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c208a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.158+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c208a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40100/0 (socket says 172.21.15.120:40100) 2024-09-07T03:34:20.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.158+0000 7fd0148ad640 1 -- 172.21.15.120:0/1739196137 learned_addr learned my addr 172.21.15.120:0/1739196137 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.158+0000 7fd0148ad640 1 -- 172.21.15.120:0/1739196137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c1e4ce10 con 0x55b7c1f9afb0 2024-09-07T03:34:20.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.158+0000 7fd0148ad640 1 --2- 172.21.15.120:0/1739196137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c208a400 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd008001ea0 tx=0x7fd00800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d713776ea1c17e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.158+0000 7fcf02e05640 1 -- 172.21.15.120:0/1739196137 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd008008070 con 0x55b7c1f9afb0 2024-09-07T03:34:20.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.159+0000 7fcf02e05640 1 -- 172.21.15.120:0/1739196137 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00800d500 con 0x55b7c1f9afb0 2024-09-07T03:34:20.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.159+0000 7fcf02e05640 1 -- 172.21.15.120:0/1739196137 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00800d880 con 0x55b7c1f9afb0 2024-09-07T03:34:20.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.159+0000 7fd018b2a800 1 -- 172.21.15.120:0/1739196137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 msgr2=0x55b7c208a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.159+0000 7fd018b2a800 1 --2- 172.21.15.120:0/1739196137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c208a400 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd008001ea0 tx=0x7fd00800b6a0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.159+0000 7fd018b2a800 1 -- 172.21.15.120:0/1739196137 shutdown_connections 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.159+0000 7fd018b2a800 1 --2- 172.21.15.120:0/1739196137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c208a400 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.159+0000 7fd018b2a800 1 -- 172.21.15.120:0/1739196137 >> 172.21.15.120:0/1739196137 conn(0x55b7c1f963c0 msgr2=0x55b7c2085d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.159+0000 7fd018b2a800 1 -- 172.21.15.120:0/1739196137 shutdown_connections 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.159+0000 7fd018b2a800 1 -- 172.21.15.120:0/1739196137 wait complete. 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.160+0000 7fd018b2a800 1 Processor -- start 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.160+0000 7fd018b2a800 1 -- start start 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.160+0000 7fd018b2a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c2091d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.160+0000 7fd018b2a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7c1f9c970 con 0x55b7c1f9afb0 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.160+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c2091d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.160+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c2091d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40102/0 (socket says 172.21.15.120:40102) 2024-09-07T03:34:20.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.160+0000 7fd0148ad640 1 -- 172.21.15.120:0/4084919629 learned_addr learned my addr 172.21.15.120:0/4084919629 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.160+0000 7fd0148ad640 1 -- 172.21.15.120:0/4084919629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c2092280 con 0x55b7c1f9afb0 2024-09-07T03:34:20.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.160+0000 7fd0148ad640 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c2091d20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd0080012f0 tx=0x7fd008000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.161+0000 7fcf01602640 1 -- 172.21.15.120:0/4084919629 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00800f9d0 con 0x55b7c1f9afb0 2024-09-07T03:34:20.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.161+0000 7fcf01602640 1 -- 172.21.15.120:0/4084919629 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00800fb70 con 0x55b7c1f9afb0 2024-09-07T03:34:20.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.161+0000 7fcf01602640 1 -- 172.21.15.120:0/4084919629 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00800fe50 con 0x55b7c1f9afb0 2024-09-07T03:34:20.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.161+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7c2092510 con 0x55b7c1f9afb0 2024-09-07T03:34:20.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.161+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c2092e90 con 0x55b7c1f9afb0 2024-09-07T03:34:20.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.161+0000 7fd018b2a800 1 Processor -- start 2024-09-07T03:34:20.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fd018b2a800 1 -- start start 2024-09-07T03:34:20.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fcf01602640 1 -- 172.21.15.120:0/4084919629 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd008017040 con 0x55b7c1f9afb0 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fcf01602640 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcefc03c920 0x7fcefc03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fd018b2a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fd018b2a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7c1e91a00 con 0x55b7c209f210 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fcf01602640 1 -- 172.21.15.120:0/4084919629 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd008015020 con 0x55b7c1f9afb0 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fd0150ae640 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcefc03c920 0x7fcefc03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40108/0 (socket says 172.21.15.120:40108) 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fd0148ad640 1 -- 172.21.15.120:0/3936092897 learned_addr learned my addr 172.21.15.120:0/3936092897 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.162+0000 7fd0150ae640 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcefc03c920 0x7fcefc03ede0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd01000a370 tx=0x7fd010005840 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fd0148ad640 1 -- 172.21.15.120:0/3936092897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c20a1bd0 con 0x55b7c209f210 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fd0148ad640 1 --2- 172.21.15.120:0/3936092897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a1600 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd00800ea40 tx=0x7fd00801ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec2aa5901723086 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fcefaffd640 1 -- 172.21.15.120:0/3936092897 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd008043070 con 0x55b7c209f210 2024-09-07T03:34:20.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fcefaffd640 1 -- 172.21.15.120:0/3936092897 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00804f070 con 0x55b7c209f210 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fcefaffd640 1 -- 172.21.15.120:0/3936092897 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00801ae10 con 0x55b7c209f210 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fd018b2a800 1 -- 172.21.15.120:0/3936092897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 msgr2=0x55b7c20a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fd018b2a800 1 --2- 172.21.15.120:0/3936092897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a1600 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd00800ea40 tx=0x7fd00801ab20 comp rx=0 tx=0).stop 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fd018b2a800 1 -- 172.21.15.120:0/3936092897 shutdown_connections 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fd018b2a800 1 --2- 172.21.15.120:0/3936092897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a1600 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fd018b2a800 1 -- 172.21.15.120:0/3936092897 >> 172.21.15.120:0/3936092897 conn(0x55b7c1f9c280 msgr2=0x55b7c2099b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fd018b2a800 1 -- 172.21.15.120:0/3936092897 shutdown_connections 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.163+0000 7fd018b2a800 1 -- 172.21.15.120:0/3936092897 wait complete. 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.164+0000 7fd018b2a800 1 Processor -- start 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.164+0000 7fd018b2a800 1 -- start start 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.164+0000 7fd018b2a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.164+0000 7fd018b2a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7c20a1f20 con 0x55b7c209f210 2024-09-07T03:34:20.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.164+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.164+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40124/0 (socket says 172.21.15.120:40124) 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.164+0000 7fd0148ad640 1 -- 172.21.15.120:0/249228561 learned_addr learned my addr 172.21.15.120:0/249228561 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.165+0000 7fd0148ad640 1 -- 172.21.15.120:0/249228561 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c20a6720 con 0x55b7c209f210 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.165+0000 7fd0148ad640 1 --2- 172.21.15.120:0/249228561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a61c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd00800ea40 tx=0x7fd008052620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.165+0000 7fcef97fa640 1 -- 172.21.15.120:0/249228561 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd008036070 con 0x55b7c209f210 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.165+0000 7fcef97fa640 1 -- 172.21.15.120:0/249228561 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00801a3c0 con 0x55b7c209f210 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.165+0000 7fd018b2a800 1 -- 172.21.15.120:0/249228561 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7c20a69b0 con 0x55b7c209f210 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.165+0000 7fcef97fa640 1 -- 172.21.15.120:0/249228561 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd008043050 con 0x55b7c209f210 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.165+0000 7fd018b2a800 1 -- 172.21.15.120:0/249228561 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c20a7330 con 0x55b7c209f210 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.166+0000 7fcef97fa640 1 -- 172.21.15.120:0/249228561 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd008054070 con 0x55b7c209f210 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.166+0000 7fcef97fa640 1 --2- 172.21.15.120:0/249228561 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fceec03c6e0 0x7fceec03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.166+0000 7fcef97fa640 1 -- 172.21.15.120:0/249228561 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd008031d60 con 0x55b7c209f210 2024-09-07T03:34:20.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.166+0000 7fd00ffff640 1 --2- 172.21.15.120:0/249228561 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fceec03c6e0 0x7fceec03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.166+0000 7fd018b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.166+0000 7fd018b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.166+0000 7fd00ffff640 1 --2- 172.21.15.120:0/249228561 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fceec03c6e0 0x7fceec03eba0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd000057000 tx=0x7fd000052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.166+0000 7fd018b2a800 1 Processor -- start 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.167+0000 7fd018b2a800 1 -- start start 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.167+0000 7fd018b2a800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f10760 0x55b7c1f0efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.167+0000 7fd018b2a800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b7c208ac50 con 0x55b7c1f10760 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.167+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f10760 0x55b7c1f0efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.167+0000 7fd0148ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f10760 0x55b7c1f0efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40140/0 (socket says 172.21.15.120:40140) 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.167+0000 7fd0148ad640 1 -- 172.21.15.120:0/3438073130 learned_addr learned my addr 172.21.15.120:0/3438073130 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.167+0000 7fd0148ad640 1 -- 172.21.15.120:0/3438073130 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c1f10c80 con 0x55b7c1f10760 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.167+0000 7fd0148ad640 1 --2- 172.21.15.120:0/3438073130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f10760 0x55b7c1f0efd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd008018600 tx=0x7fd00801cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.167+0000 7fced97e2640 1 -- 172.21.15.120:0/3438073130 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd008058070 con 0x55b7c1f10760 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.168+0000 7fced97e2640 1 -- 172.21.15.120:0/3438073130 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00802f3e0 con 0x55b7c1f10760 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.168+0000 7fd018b2a800 1 -- 172.21.15.120:0/3438073130 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7c1f10c80 con 0x55b7c1f10760 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.168+0000 7fced97e2640 1 -- 172.21.15.120:0/3438073130 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd008026c80 con 0x55b7c1f10760 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.168+0000 7fd018b2a800 1 -- 172.21.15.120:0/3438073130 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c1f0f8e0 con 0x55b7c1f10760 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.168+0000 7fced97e2640 1 -- 172.21.15.120:0/3438073130 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd008026430 con 0x55b7c1f10760 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.168+0000 7fced97e2640 1 --2- 172.21.15.120:0/3438073130 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fce5403c780 0x7fce5403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.168+0000 7fced97e2640 1 -- 172.21.15.120:0/3438073130 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd00805b020 con 0x55b7c1f10760 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.169+0000 7fd00ffff640 1 --2- 172.21.15.120:0/3438073130 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fce5403c780 0x7fce5403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.169+0000 7fce62ffd640 20 reqs_thread_entry: start 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.169+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b7c20cf650 0x55b7c20d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.169+0000 7fd00ffff640 1 --2- 172.21.15.120:0/3438073130 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fce5403c780 0x7fce5403ec40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd000045be0 tx=0x7fd000005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.169+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b7c20d2120 con 0x55b7c20cf650 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.169+0000 7fd0150ae640 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b7c20cf650 0x55b7c20d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.169+0000 7fd0150ae640 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b7c20cf650 0x55b7c20d1aa0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.170+0000 7fd0150ae640 1 -- 172.21.15.120:0/4084919629 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd01000e070 con 0x55b7c20cf650 2024-09-07T03:34:20.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.170+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b7c20d2ee0 0x55b7c20d52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.170+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b7c20d5a00 con 0x55b7c20d2ee0 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.170+0000 7fd0148ad640 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b7c20d2ee0 0x55b7c20d52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.170+0000 7fd0148ad640 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b7c20d2ee0 0x55b7c20d52d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.170+0000 7fd0148ad640 1 -- 172.21.15.120:0/4084919629 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd008066070 con 0x55b7c20d2ee0 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.170+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b7c20d7260 con 0x55b7c20cf650 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.171+0000 7fd0150ae640 1 -- 172.21.15.120:0/4084919629 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(3 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd01000e070 con 0x55b7c20cf650 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.171+0000 7fd018b2a800 1 -- 172.21.15.120:0/249228561 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fceec03c6e0 msgr2=0x7fceec03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.171+0000 7fd018b2a800 1 --2- 172.21.15.120:0/249228561 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fceec03c6e0 0x7fceec03eba0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd000057000 tx=0x7fd000052000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.171+0000 7fd018b2a800 1 -- 172.21.15.120:0/249228561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 msgr2=0x55b7c20a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.171+0000 7fd018b2a800 1 --2- 172.21.15.120:0/249228561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a61c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd00800ea40 tx=0x7fd008052620 comp rx=0 tx=0).stop 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.171+0000 7fd018b2a800 1 -- 172.21.15.120:0/249228561 shutdown_connections 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.171+0000 7fd018b2a800 1 --2- 172.21.15.120:0/249228561 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fceec03c6e0 0x7fceec03eba0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.171+0000 7fd018b2a800 1 --2- 172.21.15.120:0/249228561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c209f210 0x55b7c20a61c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.171+0000 7fd018b2a800 1 -- 172.21.15.120:0/249228561 >> 172.21.15.120:0/249228561 conn(0x55b7c1f9c280 msgr2=0x55b7c2099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/249228561 shutdown_connections 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/249228561 wait complete. 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/3438073130 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fce5403c780 msgr2=0x7fce5403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/3438073130 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fce5403c780 0x7fce5403ec40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd000045be0 tx=0x7fd000005ac0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/3438073130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f10760 msgr2=0x55b7c1f0efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/3438073130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f10760 0x55b7c1f0efd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd008018600 tx=0x7fd00801cbb0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/3438073130 shutdown_connections 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/3438073130 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fce5403c780 0x7fce5403ec40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/3438073130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f10760 0x55b7c1f0efd0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/3438073130 >> 172.21.15.120:0/3438073130 conn(0x55b7c20b5400 msgr2=0x55b7c20b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/3438073130 shutdown_connections 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/3438073130 wait complete. 2024-09-07T03:34:20.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b7c20d2ee0 msgr2=0x55b7c20d52d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b7c20d2ee0 0x55b7c20d52d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b7c20cf650 msgr2=0x55b7c20d1aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b7c20cf650 0x55b7c20d1aa0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcefc03c920 msgr2=0x7fcefc03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcefc03c920 0x7fcefc03ede0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd01000a370 tx=0x7fd010005840 comp rx=0 tx=0).stop 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 msgr2=0x55b7c2091d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c2091d20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd0080012f0 tx=0x7fd008000ed0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 shutdown_connections 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b7c20d2ee0 0x55b7c20d52d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b7c20cf650 0x55b7c20d1aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fcefc03c920 0x7fcefc03ede0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 --2- 172.21.15.120:0/4084919629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b7c1f9afb0 0x55b7c2091d20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.172+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 >> 172.21.15.120:0/4084919629 conn(0x55b7c1f963c0 msgr2=0x55b7c208b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.173+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 shutdown_connections 2024-09-07T03:34:20.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.173+0000 7fd018b2a800 1 -- 172.21.15.120:0/4084919629 wait complete. 2024-09-07T03:34:20.183 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"1445b2f9-7226-49a1-ba30-52d0fcf4c719","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"cf0fab6f-a978-4ce5-bacd-166891c31743","zones":[{"id":"cf0fab6f-a978-4ce5-bacd-166891c31743","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-07T03:34:20.183 DEBUG:tasks.util.rgw: json result: {'id': '1445b2f9-7226-49a1-ba30-52d0fcf4c719', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'cf0fab6f-a978-4ce5-bacd-166891c31743', 'zones': [{'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-07T03:34:20.186 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-07T03:34:20.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-07T03:34:20.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-07T03:34:20.206 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-07T03:34:20.261 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:20.261 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:20.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.260+0000 7f9dc9611800 1 Processor -- start 2024-09-07T03:34:20.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.260+0000 7f9dc9611800 1 -- start start 2024-09-07T03:34:20.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.260+0000 7f9dc9611800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559a25e4ce50 0x559a25e4db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.260+0000 7f9dc9611800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559a25cf7e40 con 0x559a25e4e090 2024-09-07T03:34:20.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.260+0000 7f9dc9611800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x559a25cc2680 con 0x559a25e4ce50 2024-09-07T03:34:20.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.261+0000 7f9dc4d92640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559a25e4ce50 0x559a25e4db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.261+0000 7f9dc4d92640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x559a25e4ce50 0x559a25e4db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40156/0 (socket says 172.21.15.120:40156) 2024-09-07T03:34:20.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.261+0000 7f9dc4d92640 1 -- 172.21.15.120:0/3426699346 learned_addr learned my addr 172.21.15.120:0/3426699346 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.261+0000 7f9dbffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x559a25e4e090 0x559a25e52df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43858/0 (socket says 172.21.15.120:43858) 2024-09-07T03:34:20.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.261+0000 7f9dc4d92640 1 -- 172.21.15.120:0/3426699346 >> v1:172.21.15.104:6789/0 conn(0x559a25e4e090 legacy=0x559a25e52df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.261+0000 7f9dc4d92640 1 -- 172.21.15.120:0/3426699346 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a25cde6b0 con 0x559a25e4ce50 2024-09-07T03:34:20.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.263+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/3426699346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25e4db50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9db800a6b0 tx=0x7f9db8047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2e73f2bec5ad83 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.263+0000 7f9dbf7fe640 1 -- 172.21.15.120:0/3426699346 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db800a200 con 0x559a25e4ce50 2024-09-07T03:34:20.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.263+0000 7f9dbf7fe640 1 -- 172.21.15.120:0/3426699346 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db800a3a0 con 0x559a25e4ce50 2024-09-07T03:34:20.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.263+0000 7f9dbf7fe640 1 -- 172.21.15.120:0/3426699346 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db8008700 con 0x559a25e4ce50 2024-09-07T03:34:20.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.263+0000 7f9dc9611800 1 -- 172.21.15.120:0/3426699346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 msgr2=0x559a25e4db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.263+0000 7f9dc9611800 1 --2- 172.21.15.120:0/3426699346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25e4db50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9db800a6b0 tx=0x7f9db8047e30 comp rx=0 tx=0).stop 2024-09-07T03:34:20.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.263+0000 7f9dc9611800 1 -- 172.21.15.120:0/3426699346 shutdown_connections 2024-09-07T03:34:20.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.263+0000 7f9dc9611800 1 --2- 172.21.15.120:0/3426699346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25e4db50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.263+0000 7f9dc9611800 1 -- 172.21.15.120:0/3426699346 >> 172.21.15.120:0/3426699346 conn(0x559a25e48220 msgr2=0x559a25e4a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.264+0000 7f9dc9611800 1 -- 172.21.15.120:0/3426699346 shutdown_connections 2024-09-07T03:34:20.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.264+0000 7f9dc9611800 1 -- 172.21.15.120:0/3426699346 wait complete. 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.277+0000 7f9dc9611800 1 Processor -- start 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.277+0000 7f9dc9611800 1 -- start start 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.277+0000 7f9dc9611800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f3b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.277+0000 7f9dc9611800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559a25ce6dd0 con 0x559a25e4ce50 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.278+0000 7f9dc4d92640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f3b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.278+0000 7f9dc4d92640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f3b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40160/0 (socket says 172.21.15.120:40160) 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.278+0000 7f9dc4d92640 1 -- 172.21.15.120:0/666051698 learned_addr learned my addr 172.21.15.120:0/666051698 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.278+0000 7f9dc4d92640 1 -- 172.21.15.120:0/666051698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a25cffe10 con 0x559a25e4ce50 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.278+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/666051698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f3b5f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9db8027c60 tx=0x7f9db8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3941ee8b4b6e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.278+0000 7f9cb2e05640 1 -- 172.21.15.120:0/666051698 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db80086c0 con 0x559a25e4ce50 2024-09-07T03:34:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.279+0000 7f9cb2e05640 1 -- 172.21.15.120:0/666051698 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db8008880 con 0x559a25e4ce50 2024-09-07T03:34:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.279+0000 7f9cb2e05640 1 -- 172.21.15.120:0/666051698 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db8008ba0 con 0x559a25e4ce50 2024-09-07T03:34:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.279+0000 7f9dc9611800 1 -- 172.21.15.120:0/666051698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 msgr2=0x559a25f3b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.279+0000 7f9dc9611800 1 --2- 172.21.15.120:0/666051698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f3b5f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9db8027c60 tx=0x7f9db8051000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.279+0000 7f9dc9611800 1 -- 172.21.15.120:0/666051698 shutdown_connections 2024-09-07T03:34:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.279+0000 7f9dc9611800 1 --2- 172.21.15.120:0/666051698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f3b5f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.279+0000 7f9dc9611800 1 -- 172.21.15.120:0/666051698 >> 172.21.15.120:0/666051698 conn(0x559a25e48220 msgr2=0x559a25f36f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.279+0000 7f9dc9611800 1 -- 172.21.15.120:0/666051698 shutdown_connections 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.279+0000 7f9dc9611800 1 -- 172.21.15.120:0/666051698 wait complete. 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.280+0000 7f9dc9611800 1 Processor -- start 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.280+0000 7f9dc9611800 1 -- start start 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.280+0000 7f9dc9611800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f42e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.280+0000 7f9dc9611800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559a25e4e780 con 0x559a25e4ce50 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.280+0000 7f9dc4d92640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f42e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.280+0000 7f9dc4d92640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f42e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40168/0 (socket says 172.21.15.120:40168) 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.280+0000 7f9dc4d92640 1 -- 172.21.15.120:0/973472061 learned_addr learned my addr 172.21.15.120:0/973472061 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.280+0000 7f9dc4d92640 1 -- 172.21.15.120:0/973472061 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a25f433c0 con 0x559a25e4ce50 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.280+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f42e60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9db8062040 tx=0x7f9db8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.281+0000 7f9cb1602640 1 -- 172.21.15.120:0/973472061 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db804f4c0 con 0x559a25e4ce50 2024-09-07T03:34:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.281+0000 7f9cb1602640 1 -- 172.21.15.120:0/973472061 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db804f660 con 0x559a25e4ce50 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.281+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a25f43650 con 0x559a25e4ce50 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.281+0000 7f9cb1602640 1 -- 172.21.15.120:0/973472061 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db804f940 con 0x559a25e4ce50 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.281+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a25f44260 con 0x559a25e4ce50 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.281+0000 7f9cb1602640 1 -- 172.21.15.120:0/973472061 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9db8067030 con 0x559a25e4ce50 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.282+0000 7f9cb1602640 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9cac03c730 0x7f9cac03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.282+0000 7f9cb1602640 1 -- 172.21.15.120:0/973472061 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9db8065020 con 0x559a25e4ce50 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.282+0000 7f9dbffff640 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9cac03c730 0x7f9cac03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.282+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25e4e090 0x559a25f4a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.282+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f4a9f0 con 0x559a25e4e090 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.282+0000 7f9dc5593640 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25e4e090 0x559a25f4a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.282+0000 7f9dbffff640 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9cac03c730 0x7f9cac03ebf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9db0001e30 tx=0x7f9db0001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.282+0000 7f9dc5593640 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25e4e090 0x559a25f4a4b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.282+0000 7f9dc5593640 1 -- 172.21.15.120:0/973472061 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dc000a4d0 con 0x559a25e4e090 2024-09-07T03:34:20.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.283+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f4b2a0 0x559a25f4d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.283+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f4deb0 con 0x559a25f4b2a0 2024-09-07T03:34:20.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.283+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f4b2a0 0x559a25f4d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.283+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f4b2a0 0x559a25f4d740 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.283+0000 7f9dc4d92640 1 -- 172.21.15.120:0/973472061 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9db806b950 con 0x559a25f4b2a0 2024-09-07T03:34:20.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.283+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f4f760 con 0x559a25f4b2a0 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.284+0000 7f9dc4d92640 1 -- 172.21.15.120:0/973472061 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9db806b950 con 0x559a25f4b2a0 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.284+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f4e8a0 con 0x559a25f4b2a0 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.284+0000 7f9dc4d92640 1 -- 172.21.15.120:0/973472061 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9db806b950 con 0x559a25f4b2a0 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.284+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f4ed00 con 0x559a25e4e090 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.284+0000 7f9dc5593640 1 -- 172.21.15.120:0/973472061 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9dc000a4d0 con 0x559a25e4e090 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.285+0000 7f9dc9611800 1 Processor -- start 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.285+0000 7f9dc9611800 1 -- start start 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.285+0000 7f9dc9611800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f5dc90 0x559a25f5e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.285+0000 7f9dc9611800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559a25d44a00 con 0x559a25f5dc90 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.285+0000 7f9dc5593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f5dc90 0x559a25f5e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.285+0000 7f9dc5593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f5dc90 0x559a25f5e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40180/0 (socket says 172.21.15.120:40180) 2024-09-07T03:34:20.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.285+0000 7f9dc5593640 1 -- 172.21.15.120:0/4269432638 learned_addr learned my addr 172.21.15.120:0/4269432638 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.285+0000 7f9dc5593640 1 -- 172.21.15.120:0/4269432638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a25f5e6f0 con 0x559a25f5dc90 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.286+0000 7f9dc5593640 1 --2- 172.21.15.120:0/4269432638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f5dc90 0x559a25f5e0b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0016d20 tx=0x7f9dc000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.286+0000 7f9caa7fc640 1 -- 172.21.15.120:0/4269432638 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0017660 con 0x559a25f5dc90 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.286+0000 7f9caa7fc640 1 -- 172.21.15.120:0/4269432638 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc001b030 con 0x559a25f5dc90 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.286+0000 7f9dc9611800 1 -- 172.21.15.120:0/4269432638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a25f5ef20 con 0x559a25f5dc90 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.286+0000 7f9caa7fc640 1 -- 172.21.15.120:0/4269432638 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0017950 con 0x559a25f5dc90 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.286+0000 7f9dc9611800 1 -- 172.21.15.120:0/4269432638 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a25f5f4c0 con 0x559a25f5dc90 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.287+0000 7f9caa7fc640 1 -- 172.21.15.120:0/4269432638 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9dc0017b40 con 0x559a25f5dc90 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.287+0000 7f9caa7fc640 1 --2- 172.21.15.120:0/4269432638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9c03c730 0x7f9c9c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.287+0000 7f9caa7fc640 1 -- 172.21.15.120:0/4269432638 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9dc000e040 con 0x559a25f5dc90 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.287+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/4269432638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9c03c730 0x7f9c9c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.287+0000 7f9dc9611800 1 Processor -- start 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.287+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/4269432638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9c03c730 0x7f9c9c03ebf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x559a25f44660 tx=0x7f9db80052e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.287+0000 7f9dc9611800 1 -- start start 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.287+0000 7f9dc9611800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f6ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.287+0000 7f9dc9611800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559a25f3bd80 con 0x559a25f6a790 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.288+0000 7f9dc5593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f6ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.288+0000 7f9dc5593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f6ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40190/0 (socket says 172.21.15.120:40190) 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.288+0000 7f9dc5593640 1 -- 172.21.15.120:0/4254461645 learned_addr learned my addr 172.21.15.120:0/4254461645 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.288+0000 7f9dc5593640 1 -- 172.21.15.120:0/4254461645 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a25f6b180 con 0x559a25f6a790 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.288+0000 7f9dc5593640 1 --2- 172.21.15.120:0/4254461645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f6ab90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0005cf0 tx=0x7f9dc0028e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52deb4e06af085ff server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.288+0000 7f9c9bfff640 1 -- 172.21.15.120:0/4254461645 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00149b0 con 0x559a25f6a790 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.288+0000 7f9c9bfff640 1 -- 172.21.15.120:0/4254461645 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc0005030 con 0x559a25f6a790 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.288+0000 7f9c9bfff640 1 -- 172.21.15.120:0/4254461645 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0014b50 con 0x559a25f6a790 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 -- 172.21.15.120:0/4254461645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 msgr2=0x559a25f6ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 --2- 172.21.15.120:0/4254461645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f6ab90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0005cf0 tx=0x7f9dc0028e40 comp rx=0 tx=0).stop 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 -- 172.21.15.120:0/4254461645 shutdown_connections 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 --2- 172.21.15.120:0/4254461645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f6ab90 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 -- 172.21.15.120:0/4254461645 >> 172.21.15.120:0/4254461645 conn(0x559a25f66bb0 msgr2=0x559a25f64df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 -- 172.21.15.120:0/4254461645 shutdown_connections 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 -- 172.21.15.120:0/4254461645 wait complete. 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 Processor -- start 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 -- start start 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f71d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc9611800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559a25f6b7a0 con 0x559a25f6a790 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc5593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f71d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc5593640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f71d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40202/0 (socket says 172.21.15.120:40202) 2024-09-07T03:34:20.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 learned_addr learned my addr 172.21.15.120:0/1188229219 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.289+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a25f722b0 con 0x559a25f6a790 2024-09-07T03:34:20.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.290+0000 7f9dc5593640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f71d50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0028e80 tx=0x7f9dc0053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.290+0000 7f9c9a7fc640 1 -- 172.21.15.120:0/1188229219 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0012ae0 con 0x559a25f6a790 2024-09-07T03:34:20.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.290+0000 7f9c9a7fc640 1 -- 172.21.15.120:0/1188229219 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc002e070 con 0x559a25f6a790 2024-09-07T03:34:20.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.290+0000 7f9c9a7fc640 1 -- 172.21.15.120:0/1188229219 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0012df0 con 0x559a25f6a790 2024-09-07T03:34:20.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.290+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a25f72540 con 0x559a25f6a790 2024-09-07T03:34:20.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.290+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a25f72ec0 con 0x559a25f6a790 2024-09-07T03:34:20.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.290+0000 7f9c9a7fc640 1 -- 172.21.15.120:0/1188229219 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9dc00135c0 con 0x559a25f6a790 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.291+0000 7f9c9a7fc640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9003c780 0x7f9c9003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.291+0000 7f9c9a7fc640 1 -- 172.21.15.120:0/1188229219 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9dc00153d0 con 0x559a25f6a790 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.291+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9003c780 0x7f9c9003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.291+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9003c780 0x7f9c9003ec40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9db80568e0 tx=0x7f9db808a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.291+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.291+0000 7f9dc9611800 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25f7d7f0 0x559a25f7fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.291+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f80400 con 0x559a25f7d7f0 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dbffff640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25f7d7f0 0x559a25f7fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dbffff640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25f7d7f0 0x559a25f7fcb0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 20 realm 2024-09-07T03:34:20.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f7cb40 con 0x559a25f7d7f0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f80ef0 con 0x559a25f7d7f0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.292+0000 7f9dc9611800 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f81cd0 0x559a25f840c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.293+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f84790 con 0x559a25f81cd0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.293+0000 7f9dc5593640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f81cd0 0x559a25f840c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.293+0000 7f9dc5593640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f81cd0 0x559a25f840c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.293+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.293+0000 7f9dc9611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.293+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.293+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f84fe0 con 0x559a25f81cd0 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.294+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.294+0000 7f9dc9611800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.294+0000 7f9dc9611800 20 searching for the correct realm 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.294+0000 7f9dc9611800 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559a25f86d50 0x559a25f891c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.294+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f86d50 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.294+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559a25f86d50 0x559a25f891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.294+0000 7f9dc4d92640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559a25f86d50 0x559a25f891c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.294+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.294+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f81cd0 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.295+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.295+0000 7f9dc5593640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9dc0055c20 0x7f9dc003c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.295+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x7f9dc0055c20 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.295+0000 7f9dbffff640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9dc0055c20 0x7f9dc003c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.295+0000 7f9dbffff640 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9dc0055c20 0x7f9dc003c3f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.295+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x7f9dc0055c20 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.295+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f7d7f0 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.296+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.296+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f7d7f0 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.296+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.296+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f86d50 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.296+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.296+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f7d7f0 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.296+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.296+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f81cd0 2024-09-07T03:34:20.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f81cd0 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f7d7f0 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x7f9dc0055c20 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x7f9dc0055c20 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f7d7f0 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.297+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x7f9dc0055c20 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.298+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9db000f610 con 0x7f9dc0055c20 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.298+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f81cd0 2024-09-07T03:34:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.298+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.298+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f86d50 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.298+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.298+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f7d7f0 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.299+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.299+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f81cd0 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.299+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.299+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f86d50 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.299+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.299+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f7d7f0 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.299+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.299+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f7d7f0 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.300+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.300+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f7d7f0 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.300+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x559a25f7d7f0 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.300+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f86d50 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.300+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.300+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x7f9dc0055c20 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.300+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x7f9dc0055c20 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.300+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x7f9dc0055c20 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.301+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x7f9dc0055c20 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.301+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x7f9dc0055c20 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.301+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x7f9dc0055c20 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.301+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f86d50 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.301+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.301+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x7f9dc0055c20 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.301+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db000f610 con 0x7f9dc0055c20 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.301+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f81cd0 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.302+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.302+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f81cd0 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.302+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.302+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f86d50 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.302+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.302+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f81cd0 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.302+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.302+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89890 con 0x559a25f81cd0 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:20.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f85960 con 0x559a25f7d7f0 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f85570 con 0x559a25f81cd0 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9dc0027070 con 0x559a25f81cd0 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f86250 con 0x559a25f7d7f0 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 zone default found 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 4 Realm: () 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 zonegroup default 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.303+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f89d10 con 0x7f9dc0055c20 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x7f9dc0055c20 2024-09-07T03:34:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8bf50 con 0x559a25f86d50 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8c2f0 con 0x559a25f86d50 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 20 started sync module instance, tier type = 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.304+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8b3e0 con 0x559a25f81cd0 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.305+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.305+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94120550381824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8b3e0 con 0x559a25f81cd0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.306+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8cd90 con 0x559a25f7d7f0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.307+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.307+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94120550381824] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.307+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94120550385824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8d660 con 0x559a25f7d7f0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.307+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8dc50 con 0x559a25f81cd0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.308+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94120550385824] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.308+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.308+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94120550379312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8d660 con 0x559a25f81cd0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.308+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8e660 con 0x7f9dc0055c20 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.309+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94120550379312] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.309+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x7f9dc0055c20 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.309+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94120550392720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8d660 con 0x7f9dc0055c20 2024-09-07T03:34:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.309+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8f0d0 con 0x559a25f81cd0 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.310+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94120550392720] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x7f9dc0055c20 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.310+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.310+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94120550394816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8d660 con 0x559a25f81cd0 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.310+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8fae0 con 0x559a25f86d50 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.311+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94120550394816] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.311+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.311+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94120550388144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f8d5d0 con 0x559a25f86d50 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.311+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f90870 con 0x559a25f86d50 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.312+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94120550388144] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.313+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.313+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94120550399696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f90c60 con 0x559a25f86d50 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.313+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f91660 con 0x7f9dc0055c20 2024-09-07T03:34:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x7f9dc0055c20 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94120550404464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f91630 con 0x7f9dc0055c20 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dc9611800 20 add_watcher() i=0 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dc9611800 20 add_watcher() i=1 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dc9611800 20 add_watcher() i=2 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dc9611800 20 add_watcher() i=3 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dc9611800 20 add_watcher() i=4 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dc9611800 20 add_watcher() i=5 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94120550399696] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.314+0000 7f9dc9611800 20 add_watcher() i=6 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.315+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94120550404464] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x7f9dc0055c20 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.315+0000 7f9dc9611800 20 add_watcher() i=7 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.315+0000 7f9dc9611800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.315+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25f902f0 con 0x559a25f7d7f0 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.315+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.315+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94120550406704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25f902f0 con 0x559a25f7d7f0 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.316+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94120550406704] v36'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.316+0000 7f9c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.316+0000 7f9dc9611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.316+0000 7f9dc9611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.316+0000 7f9dc9611800 5 note: GC not initialized 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9c7a7e4640 20 reqs_thread_entry: start 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 20 Filter name: none 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9c737fe640 20 reqs_thread_entry: start 2024-09-07T03:34:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc7cf0 con 0x559a25f7d7f0 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc6390 con 0x559a25f7d7f0 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.317+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc6c60 con 0x559a25f7d7f0 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v36'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9dc9611800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9dc9611800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9dc9611800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94120550623152 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25fcb630 con 0x559a25f81cd0 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94120550394816 notify 154618822689 ret 0) ==== 691+0+0 (crc 0 0 0) 0x559a25f72ec0 con 0x559a25f81cd0 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9c9bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822689 cookie 94120550394816 notifier 4827 bl.length()=649 2024-09-07T03:34:20.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9c9bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9c9bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(65 notify.4 [notify cookie 94120550623152 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9c9bfff640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9c88003ea0 con 0x559a25f81cd0 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.319+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.320+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94120550623152 notify 154618822689 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559a25f72540 con 0x559a25f81cd0 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.320+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc67b0 con 0x559a25f7d7f0 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v36'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9dc9611800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9dc9611800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9dc9611800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94120550623072 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559a25fcb6b0 con 0x559a25f81cd0 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== watch-notify(notify (1) cookie 94120550379312 notify 154618822690 ret 0) ==== 219+0+0 (crc 0 0 0) 0x559a25f72540 con 0x559a25f81cd0 2024-09-07T03:34:20.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9c9b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822690 cookie 94120550379312 notifier 4827 bl.length()=177 2024-09-07T03:34:20.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9c9b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-07T03:34:20.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9c9b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-07T03:34:20.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(68 notify.2 [notify cookie 94120550623072 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9c9b7fe640 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9bec003400 con 0x559a25f81cd0 2024-09-07T03:34:20.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== watch-notify(notify_complete (2) cookie 94120550623072 notify 154618822690 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559a25f722b0 con 0x559a25f81cd0 2024-09-07T03:34:20.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.321+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.338 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:20.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.322+0000 7f9c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:20.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.322+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94120550406704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc5ac0 con 0x559a25f7d7f0 2024-09-07T03:34:20.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.323+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94120550406704] v36'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.323+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94120550381824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc5ac0 con 0x559a25f81cd0 2024-09-07T03:34:20.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.324+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94120550381824] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.324+0000 7f9dc9611800 20 remove_watcher() i=0 2024-09-07T03:34:20.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.324+0000 7f9dc9611800 2 removed watcher, disabling cache 2024-09-07T03:34:20.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.324+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94120550385824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc5ac0 con 0x559a25f7d7f0 2024-09-07T03:34:20.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.325+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94120550385824] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x559a25f7d7f0 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.325+0000 7f9dc9611800 20 remove_watcher() i=1 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.325+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94120550379312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc5ac0 con 0x559a25f81cd0 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.326+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94120550379312] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.326+0000 7f9dc9611800 20 remove_watcher() i=2 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.326+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94120550392720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc5ac0 con 0x7f9dc0055c20 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.327+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94120550392720] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x7f9dc0055c20 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.327+0000 7f9dc9611800 20 remove_watcher() i=3 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.327+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94120550394816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc5ac0 con 0x559a25f81cd0 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.328+0000 7f9dc5593640 1 -- 172.21.15.120:0/1188229219 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94120550394816] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc0074040 con 0x559a25f81cd0 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.328+0000 7f9dc9611800 20 remove_watcher() i=4 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.328+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94120550388144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc5ac0 con 0x559a25f86d50 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.329+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94120550388144] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.329+0000 7f9dc9611800 20 remove_watcher() i=5 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.329+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94120550399696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc5ac0 con 0x559a25f86d50 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.331+0000 7f9dc4d92640 1 -- 172.21.15.120:0/1188229219 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94120550399696] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8088030 con 0x559a25f86d50 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.331+0000 7f9dc9611800 20 remove_watcher() i=6 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.331+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94120550404464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559a25fc5ac0 con 0x7f9dc0055c20 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94120550404464] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db003c040 con 0x7f9dc0055c20 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 20 remove_watcher() i=7 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f81cd0 msgr2=0x559a25f840c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f81cd0 0x559a25f840c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25f7d7f0 msgr2=0x559a25f7fcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25f7d7f0 0x559a25f7fcb0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9dc0055c20 msgr2=0x7f9dc003c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9dc0055c20 0x7f9dc003c3f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559a25f86d50 msgr2=0x559a25f891c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x559a25f86d50 0x559a25f891c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9003c780 msgr2=0x7f9c9003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9003c780 0x7f9c9003ec40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9db80568e0 tx=0x7f9db808a000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 msgr2=0x559a25f71d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/1188229219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f6a790 0x559a25f71d50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0028e80 tx=0x7f9dc0053d60 comp rx=0 tx=0).stop 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 reap_dead start 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dbffff640 1 -- 172.21.15.120:0/1188229219 reap_dead start 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 shutdown_connections 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 >> 172.21.15.120:0/1188229219 conn(0x559a25f66bb0 msgr2=0x559a25f64dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 shutdown_connections 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/1188229219 wait complete. 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/4269432638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9c03c730 msgr2=0x7f9c9c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/4269432638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9c03c730 0x7f9c9c03ebf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x559a25f44660 tx=0x7f9db80052e0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/4269432638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f5dc90 msgr2=0x559a25f5e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/4269432638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f5dc90 0x559a25f5e0b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0016d20 tx=0x7f9dc000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/4269432638 shutdown_connections 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/4269432638 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9c9c03c730 0x7f9c9c03ebf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 --2- 172.21.15.120:0/4269432638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25f5dc90 0x559a25f5e0b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/4269432638 >> 172.21.15.120:0/4269432638 conn(0x559a25f52040 msgr2=0x559a25f52420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/4269432638 shutdown_connections 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.332+0000 7f9dc9611800 1 -- 172.21.15.120:0/4269432638 wait complete. 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f4b2a0 msgr2=0x559a25f4d740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f4b2a0 0x559a25f4d740 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25e4e090 msgr2=0x559a25f4a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25e4e090 0x559a25f4a4b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9cac03c730 msgr2=0x7f9cac03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9cac03c730 0x7f9cac03ebf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9db0001e30 tx=0x7f9db0001390 comp rx=0 tx=0).stop 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 msgr2=0x559a25f42e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f42e60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9db8062040 tx=0x7f9db8002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 shutdown_connections 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x559a25f4b2a0 0x559a25f4d740 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x559a25e4e090 0x559a25f4a4b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9cac03c730 0x7f9cac03ebf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 --2- 172.21.15.120:0/973472061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a25e4ce50 0x559a25f42e60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 >> 172.21.15.120:0/973472061 conn(0x559a25e48220 msgr2=0x559a25f3c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 shutdown_connections 2024-09-07T03:34:20.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.333+0000 7f9dc9611800 1 -- 172.21.15.120:0/973472061 wait complete. 2024-09-07T03:34:20.349 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:20.350 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:20.350 ERROR:root:0 2024-09-07T03:34:20.351 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:20.365 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000043927160f85ab4f2-0066dbc9bc-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:34:20.366 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-07T03:34:20.384 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:20.384 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-07T03:34:20.404 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-07T03:34:20.405 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-07T03:34:20.427 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-07T03:34:20.427 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-07T03:34:20.443 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-07T03:34:20.444 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:20.455 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:20.456 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-07T03:34:20.467 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:20.468 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-07T03:34:20.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-07T03:34:20.468 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-07T03:34:20.515 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:20.515 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:20.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.514+0000 7fa9e840e800 1 Processor -- start 2024-09-07T03:34:20.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.514+0000 7fa9e840e800 1 -- start start 2024-09-07T03:34:20.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.514+0000 7fa9e840e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bd38611e00 0x55bd38612b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.514+0000 7fa9e840e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd384bce40 con 0x55bd38613040 2024-09-07T03:34:20.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.514+0000 7fa9e840e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55bd38487680 con 0x55bd38611e00 2024-09-07T03:34:20.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.515+0000 7fa9e3b6b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bd38611e00 0x55bd38612b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.515+0000 7fa9e3b6b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55bd38611e00 0x55bd38612b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40212/0 (socket says 172.21.15.120:40212) 2024-09-07T03:34:20.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.515+0000 7fa9dbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55bd38613040 0x55bd38617da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43874/0 (socket says 172.21.15.120:43874) 2024-09-07T03:34:20.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.515+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/2099396810 learned_addr learned my addr 172.21.15.120:0/2099396810 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.515+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/2099396810 >> v1:172.21.15.104:6789/0 conn(0x55bd38613040 legacy=0x55bd38617da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.515+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/2099396810 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd384a36b0 con 0x55bd38611e00 2024-09-07T03:34:20.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.515+0000 7fa9e336a640 1 -- 172.21.15.120:0/2099396810 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1639960578 0 0) 0x55bd384bce40 con 0x55bd38613040 2024-09-07T03:34:20.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/2099396810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38612b00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400a520 tx=0x7fa9d4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6c459adeeb3115 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e336a640 1 -- 172.21.15.120:0/2099396810 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d4055070 con 0x55bd38611e00 2024-09-07T03:34:20.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e336a640 1 -- 172.21.15.120:0/2099396810 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d40515b0 con 0x55bd38611e00 2024-09-07T03:34:20.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e336a640 1 -- 172.21.15.120:0/2099396810 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d40518d0 con 0x55bd38611e00 2024-09-07T03:34:20.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e840e800 1 -- 172.21.15.120:0/2099396810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 msgr2=0x55bd38612b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2099396810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38612b00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400a520 tx=0x7fa9d4045ba0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e840e800 1 -- 172.21.15.120:0/2099396810 shutdown_connections 2024-09-07T03:34:20.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2099396810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38612b00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e840e800 1 -- 172.21.15.120:0/2099396810 >> 172.21.15.120:0/2099396810 conn(0x55bd3860d1d0 msgr2=0x55bd3860f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e840e800 1 -- 172.21.15.120:0/2099396810 shutdown_connections 2024-09-07T03:34:20.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.517+0000 7fa9e840e800 1 -- 172.21.15.120:0/2099396810 wait complete. 2024-09-07T03:34:20.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.531+0000 7fa9e840e800 1 Processor -- start 2024-09-07T03:34:20.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.531+0000 7fa9e840e800 1 -- start start 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.531+0000 7fa9e840e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38585d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.531+0000 7fa9e840e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bd384abdd0 con 0x55bd38611e00 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.532+0000 7fa9e3b6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38585d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.532+0000 7fa9e3b6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38585d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40224/0 (socket says 172.21.15.120:40224) 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.532+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3224753848 learned_addr learned my addr 172.21.15.120:0/3224753848 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.532+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3224753848 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd384c4e10 con 0x55bd38611e00 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.532+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/3224753848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38585d80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4025da0 tx=0x7fa9d4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577069f64cb9250b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.532+0000 7fa8d1e0b640 1 -- 172.21.15.120:0/3224753848 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d4051950 con 0x55bd38611e00 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.532+0000 7fa8d1e0b640 1 -- 172.21.15.120:0/3224753848 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d4051af0 con 0x55bd38611e00 2024-09-07T03:34:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.532+0000 7fa8d1e0b640 1 -- 172.21.15.120:0/3224753848 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d4051dd0 con 0x55bd38611e00 2024-09-07T03:34:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 -- 172.21.15.120:0/3224753848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 msgr2=0x55bd38585d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3224753848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38585d80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4025da0 tx=0x7fa9d4051000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 -- 172.21.15.120:0/3224753848 shutdown_connections 2024-09-07T03:34:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3224753848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38585d80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 -- 172.21.15.120:0/3224753848 >> 172.21.15.120:0/3224753848 conn(0x55bd3860d1d0 msgr2=0x55bd386fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 -- 172.21.15.120:0/3224753848 shutdown_connections 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 -- 172.21.15.120:0/3224753848 wait complete. 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 Processor -- start 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 -- start start 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38709cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.533+0000 7fa9e840e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bd38613730 con 0x55bd38611e00 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa9e3b6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38709cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa9e3b6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38709cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40232/0 (socket says 172.21.15.120:40232) 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/2112336593 learned_addr learned my addr 172.21.15.120:0/2112336593 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/2112336593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd3870a230 con 0x55bd38611e00 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38709cd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4025da0 tx=0x7fa9d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa8cbfff640 1 -- 172.21.15.120:0/2112336593 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d405a600 con 0x55bd38611e00 2024-09-07T03:34:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa8cbfff640 1 -- 172.21.15.120:0/2112336593 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d4073070 con 0x55bd38611e00 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa8cbfff640 1 -- 172.21.15.120:0/2112336593 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d405a910 con 0x55bd38611e00 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd3870a4c0 con 0x55bd38611e00 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.534+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd3870b0d0 con 0x55bd38611e00 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.535+0000 7fa8cbfff640 1 -- 172.21.15.120:0/2112336593 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa9d4058070 con 0x55bd38611e00 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.535+0000 7fa8cbfff640 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8cc03c780 0x7fa8cc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.535+0000 7fa8cbfff640 1 -- 172.21.15.120:0/2112336593 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa9d406b040 con 0x55bd38611e00 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.535+0000 7fa9dbfff640 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8cc03c780 0x7fa8cc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.535+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd38613040 0x55bd38711320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.535+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38711860 con 0x55bd38613040 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.536+0000 7fa9e436c640 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd38613040 0x55bd38711320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.536+0000 7fa9dbfff640 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8cc03c780 0x7fa8cc03ec40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc000c00 tx=0x7fa9cc0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.536+0000 7fa9e436c640 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd38613040 0x55bd38711320 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.536+0000 7fa9e436c640 1 -- 172.21.15.120:0/2112336593 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9dc00a4d0 con 0x55bd38613040 2024-09-07T03:34:20.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.536+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38712160 0x55bd387145f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.536+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38714d60 con 0x55bd38712160 2024-09-07T03:34:20.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.536+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38712160 0x55bd387145f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.537+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38712160 0x55bd387145f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.537+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/2112336593 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9d4057030 con 0x55bd38712160 2024-09-07T03:34:20.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.537+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38716610 con 0x55bd38712160 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.537+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/2112336593 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9d4057030 con 0x55bd38712160 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.537+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38715720 con 0x55bd38712160 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.538+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/2112336593 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9d4057030 con 0x55bd38712160 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.538+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38715b40 con 0x55bd38613040 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.538+0000 7fa9e436c640 1 -- 172.21.15.120:0/2112336593 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9dc00a4d0 con 0x55bd38613040 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.538+0000 7fa9e840e800 1 Processor -- start 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.538+0000 7fa9e840e800 1 -- start start 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa9e840e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38724ac0 0x55bd38724ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa9e840e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bd38509a00 con 0x55bd38724ac0 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa9e436c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38724ac0 0x55bd38724ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa9e436c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38724ac0 0x55bd38724ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40246/0 (socket says 172.21.15.120:40246) 2024-09-07T03:34:20.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa9e436c640 1 -- 172.21.15.120:0/2967973912 learned_addr learned my addr 172.21.15.120:0/2967973912 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa9e436c640 1 -- 172.21.15.120:0/2967973912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd38725520 con 0x55bd38724ac0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa9e436c640 1 --2- 172.21.15.120:0/2967973912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38724ac0 0x55bd38724ee0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc016d20 tx=0x7fa9dc00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa8c97fa640 1 -- 172.21.15.120:0/2967973912 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc017660 con 0x55bd38724ac0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa8c97fa640 1 -- 172.21.15.120:0/2967973912 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9dc01b030 con 0x55bd38724ac0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa9e840e800 1 -- 172.21.15.120:0/2967973912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd38725d50 con 0x55bd38724ac0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa8c97fa640 1 -- 172.21.15.120:0/2967973912 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc017950 con 0x55bd38724ac0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.539+0000 7fa9e840e800 1 -- 172.21.15.120:0/2967973912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd387262f0 con 0x55bd38724ac0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.540+0000 7fa8c97fa640 1 -- 172.21.15.120:0/2967973912 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa9dc017b40 con 0x55bd38724ac0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.540+0000 7fa8c97fa640 1 --2- 172.21.15.120:0/2967973912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8bc03c7f0 0x7fa8bc03ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.540+0000 7fa8c97fa640 1 -- 172.21.15.120:0/2967973912 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa9dc00e040 con 0x55bd38724ac0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.540+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/2967973912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8bc03c7f0 0x7fa8bc03ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.541+0000 7fa9e840e800 1 Processor -- start 2024-09-07T03:34:20.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.541+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/2967973912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8bc03c7f0 0x7fa8bc03ecb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55bd38715240 tx=0x7fa9d4084040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.541+0000 7fa9e840e800 1 -- start start 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.541+0000 7fa9e840e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38731960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.541+0000 7fa9e840e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bd38705120 con 0x55bd38731560 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.541+0000 7fa9e436c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38731960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.541+0000 7fa9e436c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38731960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40254/0 (socket says 172.21.15.120:40254) 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.541+0000 7fa9e436c640 1 -- 172.21.15.120:0/1758093838 learned_addr learned my addr 172.21.15.120:0/1758093838 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.541+0000 7fa9e436c640 1 -- 172.21.15.120:0/1758093838 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd38731f50 con 0x55bd38731560 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa9e436c640 1 --2- 172.21.15.120:0/1758093838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38731960 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc013450 tx=0x7fa9dc053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d507328a443639 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa8c2ffd640 1 -- 172.21.15.120:0/1758093838 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc014a00 con 0x55bd38731560 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa8c2ffd640 1 -- 172.21.15.120:0/1758093838 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9dc051070 con 0x55bd38731560 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa8c2ffd640 1 -- 172.21.15.120:0/1758093838 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc028350 con 0x55bd38731560 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa9e840e800 1 -- 172.21.15.120:0/1758093838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 msgr2=0x55bd38731960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa9e840e800 1 --2- 172.21.15.120:0/1758093838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38731960 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc013450 tx=0x7fa9dc053f40 comp rx=0 tx=0).stop 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa9e840e800 1 -- 172.21.15.120:0/1758093838 shutdown_connections 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa9e840e800 1 --2- 172.21.15.120:0/1758093838 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38731960 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa9e840e800 1 -- 172.21.15.120:0/1758093838 >> 172.21.15.120:0/1758093838 conn(0x55bd3872d960 msgr2=0x55bd3872bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa9e840e800 1 -- 172.21.15.120:0/1758093838 shutdown_connections 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa9e840e800 1 -- 172.21.15.120:0/1758093838 wait complete. 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.542+0000 7fa9e840e800 1 Processor -- start 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.543+0000 7fa9e840e800 1 -- start start 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.543+0000 7fa9e840e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38738b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.543+0000 7fa9e840e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55bd38732570 con 0x55bd38731560 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.543+0000 7fa9e436c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38738b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.543+0000 7fa9e436c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38738b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40258/0 (socket says 172.21.15.120:40258) 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.543+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 learned_addr learned my addr 172.21.15.120:0/3402292842 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.543+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd387390d0 con 0x55bd38731560 2024-09-07T03:34:20.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.543+0000 7fa9e436c640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38738b70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00dd00 tx=0x7fa9dc053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.543+0000 7fa8c17fa640 1 -- 172.21.15.120:0/3402292842 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc005030 con 0x55bd38731560 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.544+0000 7fa8c17fa640 1 -- 172.21.15.120:0/3402292842 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9dc0051d0 con 0x55bd38731560 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.544+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd38739360 con 0x55bd38731560 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.544+0000 7fa8c17fa640 1 -- 172.21.15.120:0/3402292842 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc005530 con 0x55bd38731560 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.544+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd38739ce0 con 0x55bd38731560 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.544+0000 7fa8c17fa640 1 -- 172.21.15.120:0/3402292842 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa9dc0127a0 con 0x55bd38731560 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.544+0000 7fa8c17fa640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8ac03c6e0 0x7fa8ac03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.544+0000 7fa8c17fa640 1 -- 172.21.15.120:0/3402292842 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa9dc055040 con 0x55bd38731560 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.545+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8ac03c6e0 0x7fa8ac03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.545+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8ac03c6e0 0x7fa8ac03eba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4097010 tx=0x7fa9d408a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.545+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.545+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd387446e0 0x55bd38746ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.545+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd387472f0 con 0x55bd387446e0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.545+0000 7fa9dbfff640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd387446e0 0x55bd38746ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9dbfff640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd387446e0 0x55bd38746ba0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 20 realm 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38743a30 con 0x55bd387446e0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38747de0 con 0x55bd387446e0 2024-09-07T03:34:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38748bc0 0x55bd3874afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.546+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd3874b680 con 0x55bd38748bc0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.547+0000 7fa9e436c640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38748bc0 0x55bd3874afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.547+0000 7fa9e436c640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38748bc0 0x55bd3874afb0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.547+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.547+0000 7fa9e840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.547+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.547+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd3874bed0 con 0x55bd38748bc0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.547+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.548+0000 7fa9e840e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:20.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.548+0000 7fa9e840e800 20 searching for the correct realm 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.548+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bd3874dc40 0x55bd387500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.548+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd3874dc40 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.548+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bd3874dc40 0x55bd387500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.548+0000 7fa9e3b6b640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bd3874dc40 0x55bd387500b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.548+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.548+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd38748bc0 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.549+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.549+0000 7fa9e436c640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fa9dc004970 0x7fa9dc020880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.549+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x7fa9dc004970 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.549+0000 7fa9dbfff640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fa9dc004970 0x7fa9dc020880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.549+0000 7fa9dbfff640 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fa9dc004970 0x7fa9dc020880 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.549+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x7fa9dc004970 2024-09-07T03:34:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.549+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd387446e0 2024-09-07T03:34:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.549+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.549+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd387446e0 2024-09-07T03:34:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.550+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.550+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd3874dc40 2024-09-07T03:34:20.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.550+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.550+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd387446e0 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.550+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.550+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd38748bc0 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.550+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.550+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd38748bc0 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.551+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.551+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd387446e0 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.551+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.551+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x7fa9dc004970 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.551+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x7fa9dc004970 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.551+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd387446e0 2024-09-07T03:34:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.551+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.551+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x7fa9dc004970 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.552+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x7fa9dc004970 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.552+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd38748bc0 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.552+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.552+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd3874dc40 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.552+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.552+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd387446e0 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.552+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.552+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd38748bc0 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.553+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.553+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd3874dc40 2024-09-07T03:34:20.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.553+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.553+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd387446e0 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.553+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.553+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd387446e0 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.553+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.553+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd387446e0 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x55bd387446e0 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd3874dc40 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x7fa9dc004970 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x7fa9dc004970 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x7fa9dc004970 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x7fa9dc004970 2024-09-07T03:34:20.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x7fa9dc004970 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x7fa9dc004970 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.554+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd3874dc40 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.555+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.555+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x7fa9dc004970 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.555+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc00f5f0 con 0x7fa9dc004970 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.555+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd38748bc0 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.555+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.555+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd38748bc0 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd3874dc40 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd38748bc0 2024-09-07T03:34:20.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750780 con 0x55bd38748bc0 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e840e800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e840e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e840e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e840e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e840e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e840e800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.556+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd3874c820 con 0x55bd387446e0 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd3874c430 con 0x55bd38748bc0 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd3874d110 con 0x55bd387446e0 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 20 zone default found 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 4 Realm: () 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 20 zonegroup default 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.557+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38750c00 con 0x7fa9dc004970 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x7fa9dc004970 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38752e40 con 0x55bd3874dc40 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd387531e0 con 0x55bd3874dc40 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 20 started sync module instance, tier type = 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.558+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd387522d0 con 0x55bd38748bc0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.559+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.559+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94271184381952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd387522d0 con 0x55bd38748bc0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.559+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38753c50 con 0x55bd387446e0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.560+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94271184381952] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.561+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.561+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94271184379424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38752240 con 0x55bd387446e0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.561+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38754b10 con 0x55bd38748bc0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.562+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94271184379424] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.562+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.562+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94271184388160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38754b10 con 0x55bd38748bc0 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.562+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38755510 con 0x7fa9dc004970 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.563+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94271184388160] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.563+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x7fa9dc004970 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.563+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94271184392224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38754b10 con 0x7fa9dc004970 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.563+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38755f90 con 0x55bd38748bc0 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.564+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94271184392224] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x7fa9dc004970 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.564+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.564+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94271184394912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38754b10 con 0x55bd38748bc0 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.564+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd387569a0 con 0x55bd3874dc40 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.565+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.565+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94271184397552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38757240 con 0x55bd3874dc40 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.565+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38757ce0 con 0x55bd3874dc40 2024-09-07T03:34:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.565+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94271184394912] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.566+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94271184397552] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.566+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.566+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94271184402352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38756d90 con 0x55bd3874dc40 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.566+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38758580 con 0x7fa9dc004970 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.567+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94271184402352] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x7fa9dc004970 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94271184389728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38756d90 con 0x7fa9dc004970 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9e840e800 20 add_watcher() i=0 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9e840e800 20 add_watcher() i=1 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9e840e800 20 add_watcher() i=2 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9e840e800 20 add_watcher() i=3 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9e840e800 20 add_watcher() i=4 2024-09-07T03:34:20.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9e840e800 20 add_watcher() i=5 2024-09-07T03:34:20.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9e840e800 20 add_watcher() i=6 2024-09-07T03:34:20.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.568+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94271184389728] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x7fa9dc004970 2024-09-07T03:34:20.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.569+0000 7fa9e840e800 20 add_watcher() i=7 2024-09-07T03:34:20.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.569+0000 7fa9e840e800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:20.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.569+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd3875b6f0 con 0x55bd387446e0 2024-09-07T03:34:20.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.569+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.569+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94271184404688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38758c40 con 0x55bd387446e0 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.570+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94271184404688] v36'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.570+0000 7fa899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa9e840e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa9e840e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa9e840e800 5 note: GC not initialized 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa898fe1640 20 reqs_thread_entry: start 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa9e840e800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa9e840e800 20 Filter name: none 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa8127fc640 20 reqs_thread_entry: start 2024-09-07T03:34:20.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa9e840e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa9e840e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.571+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878e7f0 con 0x55bd387446e0 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.572+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.572+0000 7fa9e840e800 20 rados_obj.operate() r=0 bl.length=473 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.572+0000 7fa9e840e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.572+0000 7fa9e840e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.572+0000 7fa9e840e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.572+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd38794f90 con 0x55bd387446e0 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.573+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.573+0000 7fa9e840e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.573+0000 7fa9e840e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.573+0000 7fa9e840e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:20.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.573+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94271184652688 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55bd38790610 con 0x55bd38748bc0 2024-09-07T03:34:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.574+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94271184394912 notify 154618822692 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55bd38739ce0 con 0x55bd38748bc0 2024-09-07T03:34:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.574+0000 7fa8c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822692 cookie 94271184394912 notifier 4834 bl.length()=636 2024-09-07T03:34:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.574+0000 7fa8c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.574+0000 7fa8c2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.574+0000 7fa8c2ffd640 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa8a8003ea0 con 0x55bd38748bc0 2024-09-07T03:34:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.574+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94271184652688 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.574+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.574+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94271184652688 notify 154618822692 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa9dc06d020 con 0x55bd38748bc0 2024-09-07T03:34:20.586 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:20.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.575+0000 7fa899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:20.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.575+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94271184404688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878c660 con 0x55bd387446e0 2024-09-07T03:34:20.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.576+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94271184404688] v36'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.576+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94271184381952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878c660 con 0x55bd38748bc0 2024-09-07T03:34:20.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.577+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94271184381952] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.577+0000 7fa9e840e800 20 remove_watcher() i=0 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.577+0000 7fa9e840e800 2 removed watcher, disabling cache 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.577+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94271184379424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878c660 con 0x55bd387446e0 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.578+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94271184379424] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x55bd387446e0 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.578+0000 7fa9e840e800 20 remove_watcher() i=1 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.578+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94271184388160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878c660 con 0x55bd38748bc0 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.579+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94271184388160] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.579+0000 7fa9e840e800 20 remove_watcher() i=2 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.579+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94271184392224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878c660 con 0x7fa9dc004970 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.580+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94271184392224] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x7fa9dc004970 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.580+0000 7fa9e840e800 20 remove_watcher() i=3 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.580+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94271184394912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878c660 con 0x55bd38748bc0 2024-09-07T03:34:20.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.581+0000 7fa9e436c640 1 -- 172.21.15.120:0/3402292842 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94271184394912] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9dc03b070 con 0x55bd38748bc0 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.581+0000 7fa9e840e800 20 remove_watcher() i=4 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.581+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94271184397552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878c660 con 0x55bd3874dc40 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.582+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94271184397552] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.582+0000 7fa9e840e800 20 remove_watcher() i=5 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.582+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94271184402352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878c660 con 0x55bd3874dc40 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.583+0000 7fa9e3b6b640 1 -- 172.21.15.120:0/3402292842 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94271184402352] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d40a1070 con 0x55bd3874dc40 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.583+0000 7fa9e840e800 20 remove_watcher() i=6 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.583+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94271184389728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55bd3878c660 con 0x7fa9dc004970 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94271184389728] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc03c040 con 0x7fa9dc004970 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 20 remove_watcher() i=7 2024-09-07T03:34:20.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38748bc0 msgr2=0x55bd3874afb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38748bc0 0x55bd3874afb0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd387446e0 msgr2=0x55bd38746ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd387446e0 0x55bd38746ba0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fa9dc004970 msgr2=0x7fa9dc020880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fa9dc004970 0x7fa9dc020880 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bd3874dc40 msgr2=0x55bd387500b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55bd3874dc40 0x55bd387500b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8ac03c6e0 msgr2=0x7fa8ac03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8ac03c6e0 0x7fa8ac03eba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4097010 tx=0x7fa9d408a000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 msgr2=0x55bd38738b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9dbfff640 1 -- 172.21.15.120:0/3402292842 reap_dead start 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38738b70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00dd00 tx=0x7fa9dc053d90 comp rx=0 tx=0).stop 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 shutdown_connections 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 --2- 172.21.15.120:0/3402292842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38731560 0x55bd38738b70 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 >> 172.21.15.120:0/3402292842 conn(0x55bd3872d960 msgr2=0x55bd3872bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 shutdown_connections 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.584+0000 7fa9e840e800 1 -- 172.21.15.120:0/3402292842 wait complete. 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2967973912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8bc03c7f0 msgr2=0x7fa8bc03ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2967973912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8bc03c7f0 0x7fa8bc03ecb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55bd38715240 tx=0x7fa9d4084040 comp rx=0 tx=0).stop 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2967973912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38724ac0 msgr2=0x55bd38724ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2967973912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38724ac0 0x55bd38724ee0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc016d20 tx=0x7fa9dc00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2967973912 shutdown_connections 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2967973912 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8bc03c7f0 0x7fa8bc03ecb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2967973912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38724ac0 0x55bd38724ee0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2967973912 >> 172.21.15.120:0/2967973912 conn(0x55bd38718e70 msgr2=0x55bd38719250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2967973912 shutdown_connections 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2967973912 wait complete. 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38712160 msgr2=0x55bd387145f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38712160 0x55bd387145f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd38613040 msgr2=0x55bd38711320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd38613040 0x55bd38711320 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8cc03c780 msgr2=0x7fa8cc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8cc03c780 0x7fa8cc03ec40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc000c00 tx=0x7fa9cc0013b0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 msgr2=0x55bd38709cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38709cd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4025da0 tx=0x7fa9d4002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 shutdown_connections 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55bd38712160 0x55bd387145f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55bd38613040 0x55bd38711320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa8cc03c780 0x7fa8cc03ec40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 --2- 172.21.15.120:0/2112336593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55bd38611e00 0x55bd38709cd0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 >> 172.21.15.120:0/2112336593 conn(0x55bd3860d1d0 msgr2=0x55bd386fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 shutdown_connections 2024-09-07T03:34:20.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.585+0000 7fa9e840e800 1 -- 172.21.15.120:0/2112336593 wait complete. 2024-09-07T03:34:20.598 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:20.598 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:20.598 ERROR:root:0 2024-09-07T03:34:20.598 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-07T03:34:20.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-07T03:34:20.598 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-07T03:34:20.652 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:20.652 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:20.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.651+0000 7fe008cbb800 1 Processor -- start 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.651+0000 7fe008cbb800 1 -- start start 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe008cbb800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56067548e540 0x56067548e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe008cbb800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560675339e40 con 0x56067548ee80 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe008cbb800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x560675304680 con 0x56067548e540 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe0067a5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56067548e540 0x56067548e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe0067a5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x56067548e540 0x56067548e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40264/0 (socket says 172.21.15.120:40264) 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe0067a5640 1 -- 172.21.15.120:0/2404869505 learned_addr learned my addr 172.21.15.120:0/2404869505 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe005fa4640 1 --1- 172.21.15.120:0/2404869505 >> v1:172.21.15.104:6789/0 conn(0x56067548ee80 0x56067548f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43884/0 (socket says 172.21.15.120:43884) 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe0067a5640 1 -- 172.21.15.120:0/2404869505 >> v1:172.21.15.104:6789/0 conn(0x56067548ee80 legacy=0x56067548f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe0057a3640 1 -- 172.21.15.120:0/2404869505 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139227584 0 0) 0x560675339e40 con 0x56067548ee80 2024-09-07T03:34:20.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.652+0000 7fe0067a5640 1 -- 172.21.15.120:0/2404869505 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606753206b0 con 0x56067548e540 2024-09-07T03:34:20.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.654+0000 7fe0067a5640 1 --2- 172.21.15.120:0/2404869505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x56067548e940 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdff800a520 tx=0x7fdff8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f55167e991ce619 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.654+0000 7fe0057a3640 1 -- 172.21.15.120:0/2404869505 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff8055070 con 0x56067548e540 2024-09-07T03:34:20.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.654+0000 7fe0057a3640 1 -- 172.21.15.120:0/2404869505 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff80515b0 con 0x56067548e540 2024-09-07T03:34:20.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.654+0000 7fe0057a3640 1 -- 172.21.15.120:0/2404869505 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff80518d0 con 0x56067548e540 2024-09-07T03:34:20.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.655+0000 7fe008cbb800 1 -- 172.21.15.120:0/2404869505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 msgr2=0x56067548e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.655+0000 7fe008cbb800 1 --2- 172.21.15.120:0/2404869505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x56067548e940 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdff800a520 tx=0x7fdff8045ba0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.655+0000 7fe008cbb800 1 -- 172.21.15.120:0/2404869505 shutdown_connections 2024-09-07T03:34:20.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.655+0000 7fe008cbb800 1 --2- 172.21.15.120:0/2404869505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x56067548e940 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.655+0000 7fe008cbb800 1 -- 172.21.15.120:0/2404869505 >> 172.21.15.120:0/2404869505 conn(0x56067548a250 msgr2=0x56067548c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.655+0000 7fe008cbb800 1 -- 172.21.15.120:0/2404869505 shutdown_connections 2024-09-07T03:34:20.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.655+0000 7fe008cbb800 1 -- 172.21.15.120:0/2404869505 wait complete. 2024-09-07T03:34:20.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.668+0000 7fe008cbb800 1 Processor -- start 2024-09-07T03:34:20.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.668+0000 7fe008cbb800 1 -- start start 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.668+0000 7fe008cbb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675581720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.668+0000 7fe008cbb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560675328dd0 con 0x56067548e540 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.669+0000 7fe0067a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675581720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.669+0000 7fe0067a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675581720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40266/0 (socket says 172.21.15.120:40266) 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.669+0000 7fe0067a5640 1 -- 172.21.15.120:0/1779094085 learned_addr learned my addr 172.21.15.120:0/1779094085 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.669+0000 7fe0067a5640 1 -- 172.21.15.120:0/1779094085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560675341e10 con 0x56067548e540 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.669+0000 7fe0067a5640 1 --2- 172.21.15.120:0/1779094085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675581720 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdff8025da0 tx=0x7fdff8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278926a21c6abcae server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.669+0000 7fdef4608640 1 -- 172.21.15.120:0/1779094085 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff8051950 con 0x56067548e540 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.669+0000 7fdef4608640 1 -- 172.21.15.120:0/1779094085 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff8051af0 con 0x56067548e540 2024-09-07T03:34:20.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.669+0000 7fdef4608640 1 -- 172.21.15.120:0/1779094085 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff8051dd0 con 0x56067548e540 2024-09-07T03:34:20.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 -- 172.21.15.120:0/1779094085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 msgr2=0x560675581720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 --2- 172.21.15.120:0/1779094085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675581720 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdff8025da0 tx=0x7fdff8051000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 -- 172.21.15.120:0/1779094085 shutdown_connections 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 --2- 172.21.15.120:0/1779094085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675581720 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 -- 172.21.15.120:0/1779094085 >> 172.21.15.120:0/1779094085 conn(0x56067548a250 msgr2=0x56067557d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 -- 172.21.15.120:0/1779094085 shutdown_connections 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 -- 172.21.15.120:0/1779094085 wait complete. 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 Processor -- start 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 -- start start 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675588e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.670+0000 7fe008cbb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x56067548fda0 con 0x56067548e540 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fe0067a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675588e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fe0067a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675588e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40270/0 (socket says 172.21.15.120:40270) 2024-09-07T03:34:20.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fe0067a5640 1 -- 172.21.15.120:0/3770228839 learned_addr learned my addr 172.21.15.120:0/3770228839 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fe0067a5640 1 -- 172.21.15.120:0/3770228839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560675589370 con 0x56067548e540 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fe0067a5640 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675588e10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdff800a520 tx=0x7fdff8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fdef2e05640 1 -- 172.21.15.120:0/3770228839 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff805a580 con 0x56067548e540 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fdef2e05640 1 -- 172.21.15.120:0/3770228839 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff8073070 con 0x56067548e540 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560675589600 con 0x56067548e540 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fdef2e05640 1 -- 172.21.15.120:0/3770228839 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdff805a890 con 0x56067548e540 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.671+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56067558a210 con 0x56067548e540 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.672+0000 7fdef2e05640 1 -- 172.21.15.120:0/3770228839 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdff8058070 con 0x56067548e540 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.672+0000 7fdef2e05640 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdeec03c780 0x7fdeec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.672+0000 7fdef2e05640 1 -- 172.21.15.120:0/3770228839 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fdff806b040 con 0x56067548e540 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.672+0000 7fe005fa4640 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdeec03c780 0x7fdeec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.672+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56067548ee80 0x560675590460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.672+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755909a0 con 0x56067548ee80 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.673+0000 7fe006fa6640 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56067548ee80 0x560675590460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.673+0000 7fe005fa4640 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdeec03c780 0x7fdeec03ec40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdffc000c00 tx=0x7fdffc0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.673+0000 7fe006fa6640 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56067548ee80 0x560675590460 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.673+0000 7fe006fa6640 1 -- 172.21.15.120:0/3770228839 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe00000a4d0 con 0x56067548ee80 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.673+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755912a0 0x560675593730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.673+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560675593ea0 con 0x5606755912a0 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.673+0000 7fe0067a5640 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755912a0 0x560675593730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.674+0000 7fe0067a5640 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755912a0 0x560675593730 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.674+0000 7fe0067a5640 1 -- 172.21.15.120:0/3770228839 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdff8091040 con 0x5606755912a0 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.674+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560675595750 con 0x5606755912a0 2024-09-07T03:34:20.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.674+0000 7fe0067a5640 1 -- 172.21.15.120:0/3770228839 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdff8091040 con 0x5606755912a0 2024-09-07T03:34:20.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.674+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560675594890 con 0x5606755912a0 2024-09-07T03:34:20.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.675+0000 7fe0067a5640 1 -- 172.21.15.120:0/3770228839 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdff8091040 con 0x5606755912a0 2024-09-07T03:34:20.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.675+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560675594cf0 con 0x56067548ee80 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.675+0000 7fe006fa6640 1 -- 172.21.15.120:0/3770228839 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe00000a4d0 con 0x56067548ee80 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.675+0000 7fe008cbb800 1 Processor -- start 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.675+0000 7fe008cbb800 1 -- start start 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.675+0000 7fe008cbb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755a3c40 0x5606755a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.675+0000 7fe008cbb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560675386a00 con 0x5606755a3c40 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fe006fa6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755a3c40 0x5606755a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fe006fa6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755a3c40 0x5606755a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40284/0 (socket says 172.21.15.120:40284) 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fe006fa6640 1 -- 172.21.15.120:0/2283046873 learned_addr learned my addr 172.21.15.120:0/2283046873 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fe006fa6640 1 -- 172.21.15.120:0/2283046873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606755a46a0 con 0x5606755a3c40 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fe006fa6640 1 --2- 172.21.15.120:0/2283046873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755a3c40 0x5606755a4060 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe000016d20 tx=0x7fe00000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fdeebfff640 1 -- 172.21.15.120:0/2283046873 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe000017660 con 0x5606755a3c40 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fdeebfff640 1 -- 172.21.15.120:0/2283046873 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00001b030 con 0x5606755a3c40 2024-09-07T03:34:20.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fdeebfff640 1 -- 172.21.15.120:0/2283046873 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe000017950 con 0x5606755a3c40 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fe008cbb800 1 -- 172.21.15.120:0/2283046873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606755a4ed0 con 0x5606755a3c40 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.676+0000 7fe008cbb800 1 -- 172.21.15.120:0/2283046873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606755a5470 con 0x5606755a3c40 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.677+0000 7fdeebfff640 1 -- 172.21.15.120:0/2283046873 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe000017b40 con 0x5606755a3c40 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.677+0000 7fdeebfff640 1 --2- 172.21.15.120:0/2283046873 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdee003c730 0x7fdee003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.677+0000 7fdeebfff640 1 -- 172.21.15.120:0/2283046873 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe00000e040 con 0x5606755a3c40 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.677+0000 7fe0067a5640 1 --2- 172.21.15.120:0/2283046873 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdee003c730 0x7fdee003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.677+0000 7fe008cbb800 1 Processor -- start 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.678+0000 7fe0067a5640 1 --2- 172.21.15.120:0/2283046873 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdee003c730 0x7fdee003ebf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x56067558a610 tx=0x7fdff8087040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.678+0000 7fe008cbb800 1 -- start start 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.678+0000 7fe008cbb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.678+0000 7fe008cbb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x560675581eb0 con 0x5606755b06c0 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.678+0000 7fe006fa6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.678+0000 7fe006fa6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40294/0 (socket says 172.21.15.120:40294) 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.678+0000 7fe006fa6640 1 -- 172.21.15.120:0/1702336368 learned_addr learned my addr 172.21.15.120:0/1702336368 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.678+0000 7fe006fa6640 1 -- 172.21.15.120:0/1702336368 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606755b10b0 con 0x5606755b06c0 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.678+0000 7fe006fa6640 1 --2- 172.21.15.120:0/1702336368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b0ac0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe000013450 tx=0x7fe000053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea081bca4c942895 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fdee9ffb640 1 -- 172.21.15.120:0/1702336368 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe000014a00 con 0x5606755b06c0 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fdee9ffb640 1 -- 172.21.15.120:0/1702336368 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe000051070 con 0x5606755b06c0 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fdee9ffb640 1 -- 172.21.15.120:0/1702336368 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe000028350 con 0x5606755b06c0 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fe008cbb800 1 -- 172.21.15.120:0/1702336368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 msgr2=0x5606755b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fe008cbb800 1 --2- 172.21.15.120:0/1702336368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b0ac0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe000013450 tx=0x7fe000053f40 comp rx=0 tx=0).stop 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fe008cbb800 1 -- 172.21.15.120:0/1702336368 shutdown_connections 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fe008cbb800 1 --2- 172.21.15.120:0/1702336368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b0ac0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fe008cbb800 1 -- 172.21.15.120:0/1702336368 >> 172.21.15.120:0/1702336368 conn(0x5606755acac0 msgr2=0x5606755aad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fe008cbb800 1 -- 172.21.15.120:0/1702336368 shutdown_connections 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fe008cbb800 1 -- 172.21.15.120:0/1702336368 wait complete. 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fe008cbb800 1 Processor -- start 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.679+0000 7fe008cbb800 1 -- start start 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fe008cbb800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fe008cbb800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5606755b16d0 con 0x5606755b06c0 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fe006fa6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fe006fa6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40304/0 (socket says 172.21.15.120:40304) 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 learned_addr learned my addr 172.21.15.120:0/8790658 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606755b82c0 con 0x5606755b06c0 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fe006fa6640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b7d60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe00000dd00 tx=0x7fe000053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fded7fff640 1 -- 172.21.15.120:0/8790658 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe000005030 con 0x5606755b06c0 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fded7fff640 1 -- 172.21.15.120:0/8790658 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0000051d0 con 0x5606755b06c0 2024-09-07T03:34:20.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fded7fff640 1 -- 172.21.15.120:0/8790658 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0000054d0 con 0x5606755b06c0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606755b8550 con 0x5606755b06c0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.680+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606755b8ed0 con 0x5606755b06c0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.681+0000 7fded7fff640 1 -- 172.21.15.120:0/8790658 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe0000127a0 con 0x5606755b06c0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.682+0000 7fded7fff640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fded003c780 0x7fded003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.682+0000 7fded7fff640 1 -- 172.21.15.120:0/8790658 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe000055040 con 0x5606755b06c0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.682+0000 7fe0067a5640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fded003c780 0x7fded003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.682+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.682+0000 7fe008cbb800 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5606755c3820 0x5606755c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.682+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755c6430 con 0x5606755c3820 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.682+0000 7fe005fa4640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5606755c3820 0x5606755c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.682+0000 7fe0067a5640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fded003c780 0x7fded003ec40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdff8095ce0 tx=0x7fdff808b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.682+0000 7fe005fa4640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5606755c3820 0x5606755c5ce0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 20 realm 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755c2b70 con 0x5606755c3820 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755c6f20 con 0x5606755c3820 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755c7d00 0x5606755ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755ca7c0 con 0x5606755c7d00 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.683+0000 7fe006fa6640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755c7d00 0x5606755ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe006fa6640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755c7d00 0x5606755ca0f0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe008cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755cb010 con 0x5606755c7d00 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe008cbb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe008cbb800 20 searching for the correct realm 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe008cbb800 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5606755ccd80 0x5606755cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.684+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755ccd80 2024-09-07T03:34:20.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.685+0000 7fe0067a5640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5606755ccd80 0x5606755cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.685+0000 7fe0067a5640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5606755ccd80 0x5606755cf1b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.685+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.685+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c7d00 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.685+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.685+0000 7fe006fa6640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe000020a70 0x7fe0000049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.685+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x7fe000020a70 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.686+0000 7fe005fa4640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe000020a70 0x7fe0000049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.686+0000 7fe005fa4640 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe000020a70 0x7fe0000049c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.686+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x7fe000020a70 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.686+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c3820 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.686+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.686+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c3820 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.686+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.686+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755ccd80 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.687+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.687+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c3820 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.687+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.687+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c7d00 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.687+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.687+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c7d00 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.687+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.687+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c3820 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.688+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.688+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x7fe000020a70 2024-09-07T03:34:20.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.688+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x7fe000020a70 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.688+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c3820 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.688+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.688+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x7fe000020a70 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.688+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdffc00f5f0 con 0x7fe000020a70 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.688+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c7d00 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.689+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.689+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755ccd80 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.689+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.689+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c3820 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.689+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.689+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c7d00 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.689+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.689+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755ccd80 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c3820 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c3820 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c3820 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x5606755c3820 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755ccd80 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.690+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x7fe000020a70 2024-09-07T03:34:20.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x7fe000020a70 2024-09-07T03:34:20.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x7fe000020a70 2024-09-07T03:34:20.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x7fe000020a70 2024-09-07T03:34:20.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x7fe000020a70 2024-09-07T03:34:20.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x7fe000020a70 2024-09-07T03:34:20.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755ccd80 2024-09-07T03:34:20.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x7fe000020a70 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdffc00f5f0 con 0x7fe000020a70 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.691+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c7d00 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.692+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.692+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c7d00 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.692+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.692+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755ccd80 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.692+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.692+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c7d00 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5606755cf880 con 0x5606755c7d00 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755cb990 con 0x5606755c3820 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755cb5d0 con 0x5606755c7d00 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.693+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755cc2b0 con 0x5606755c3820 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 zone default found 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 4 Realm: () 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:20.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 zonegroup default 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755cfd00 con 0x7fe000020a70 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x7fe000020a70 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755d1f40 con 0x5606755ccd80 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755d22e0 con 0x5606755ccd80 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 started sync module instance, tier type = 2024-09-07T03:34:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.694+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d13d0 con 0x5606755c7d00 2024-09-07T03:34:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.696+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.696+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94585738828016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d13d0 con 0x5606755c7d00 2024-09-07T03:34:20.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.696+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d2da0 con 0x5606755c3820 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.697+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94585738828016] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.697+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.697+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94585738825504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d3140 con 0x5606755c3820 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.697+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d3c30 con 0x5606755c7d00 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.698+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94585738825504] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.698+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.698+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94585738835712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d3bf0 con 0x5606755c7d00 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.698+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d4690 con 0x7fe000020a70 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.699+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94585738835712] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.699+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x7fe000020a70 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.699+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94585738832048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d4690 con 0x7fe000020a70 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.699+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d50e0 con 0x5606755c7d00 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.700+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94585738832048] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x7fe000020a70 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.700+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.700+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94585738838416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d50a0 con 0x5606755c7d00 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.700+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d5af0 con 0x5606755ccd80 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.701+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.701+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94585738843712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d6390 con 0x5606755ccd80 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.701+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d6e10 con 0x5606755ccd80 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.701+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94585738838416] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.703+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94585738843712] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.703+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.703+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94585738845920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d4bf0 con 0x5606755ccd80 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.703+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d76f0 con 0x7fe000020a70 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94585738845920] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x7fe000020a70 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94585738848512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d76b0 con 0x7fe000020a70 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe008cbb800 20 add_watcher() i=0 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe008cbb800 20 add_watcher() i=1 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe008cbb800 20 add_watcher() i=2 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe008cbb800 20 add_watcher() i=3 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe008cbb800 20 add_watcher() i=4 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe008cbb800 20 add_watcher() i=5 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.704+0000 7fe008cbb800 20 add_watcher() i=6 2024-09-07T03:34:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.705+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94585738848512] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x7fe000020a70 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.705+0000 7fe008cbb800 20 add_watcher() i=7 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.705+0000 7fe008cbb800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.705+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606755dac30 con 0x5606755c3820 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.706+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.706+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94585738851280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5606755d80f0 con 0x5606755c3820 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.707+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94585738851280] v36'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.707+0000 7fdebcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.707+0000 7fe008cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.707+0000 7fe008cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.707+0000 7fe008cbb800 5 note: GC not initialized 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.707+0000 7fde377fe640 20 reqs_thread_entry: start 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.707+0000 7fe008cbb800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.707+0000 7fe008cbb800 20 Filter name: none 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fde357fa640 20 reqs_thread_entry: start 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56067560dcd0 con 0x5606755ccd80 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56067560c390 con 0x5606755ccd80 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.708+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560cc60 con 0x5606755ccd80 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v36'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe008cbb800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe008cbb800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe008cbb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94585739069360 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606756111c0 con 0x5606755c7d00 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94585738828016 notify 154618822693 ret 0) ==== 575+0+0 (crc 0 0 0) 0x5606755b8ed0 con 0x5606755c7d00 2024-09-07T03:34:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fdee9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822693 cookie 94585738828016 notifier 4841 bl.length()=533 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(65 notify.0 [notify cookie 94585739069360 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fdee9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fdee9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fdee9ffb640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fdecc003ea0 con 0x5606755c7d00 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94585739069360 notify 154618822693 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe00006d020 con 0x5606755c7d00 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.710+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560c7b0 con 0x5606755ccd80 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.711+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v36'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.711+0000 7fe008cbb800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.711+0000 7fe008cbb800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.711+0000 7fe008cbb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.711+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94585739069280 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5606756115f0 con 0x5606755c3820 2024-09-07T03:34:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.712+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== watch-notify(notify (1) cookie 94585738825504 notify 154618822656 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7fdffc026040 con 0x5606755c3820 2024-09-07T03:34:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.712+0000 7fdee9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822656 cookie 94585738825504 notifier 4841 bl.length()=176 2024-09-07T03:34:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.712+0000 7fdee9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-07T03:34:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.712+0000 7fdee9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-07T03:34:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.712+0000 7fdee9ffb640 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fdecc003ea0 con 0x5606755c3820 2024-09-07T03:34:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.712+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(68 notify.1 [notify cookie 94585739069280 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.712+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== watch-notify(notify_complete (2) cookie 94585739069280 notify 154618822656 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdffc018040 con 0x5606755c3820 2024-09-07T03:34:20.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.712+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.730 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-07T03:34:20.709602Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.709591Z","tags":[],"group_ids":[]} 2024-09-07T03:34:20.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.713+0000 7fdebcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:20.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.713+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94585738851280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560bb40 con 0x5606755c3820 2024-09-07T03:34:20.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.714+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94585738851280] v36'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.714+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94585738828016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560bb40 con 0x5606755c7d00 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.716+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94585738828016] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.716+0000 7fe008cbb800 20 remove_watcher() i=0 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.716+0000 7fe008cbb800 2 removed watcher, disabling cache 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.716+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94585738825504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560bb40 con 0x5606755c3820 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.717+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94585738825504] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x5606755c3820 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.717+0000 7fe008cbb800 20 remove_watcher() i=1 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.717+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94585738835712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560bb40 con 0x5606755c7d00 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.718+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94585738835712] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.718+0000 7fe008cbb800 20 remove_watcher() i=2 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.718+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94585738832048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560bb40 con 0x7fe000020a70 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.719+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94585738832048] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x7fe000020a70 2024-09-07T03:34:20.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.719+0000 7fe008cbb800 20 remove_watcher() i=3 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.719+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94585738838416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560bb40 con 0x5606755c7d00 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.720+0000 7fe006fa6640 1 -- 172.21.15.120:0/8790658 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94585738838416] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00003b070 con 0x5606755c7d00 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.720+0000 7fe008cbb800 20 remove_watcher() i=4 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.720+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94585738843712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560bb40 con 0x5606755ccd80 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.721+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94585738843712] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.721+0000 7fe008cbb800 20 remove_watcher() i=5 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.721+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94585738845920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560bb40 con 0x5606755ccd80 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.722+0000 7fe0067a5640 1 -- 172.21.15.120:0/8790658 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94585738845920] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdff8091040 con 0x5606755ccd80 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.722+0000 7fe008cbb800 20 remove_watcher() i=6 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.722+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94585738848512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56067560bb40 con 0x7fe000020a70 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.723+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94585738848512] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdffc03c040 con 0x7fe000020a70 2024-09-07T03:34:20.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.723+0000 7fe008cbb800 20 remove_watcher() i=7 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.723+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755c7d00 msgr2=0x5606755ca0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.723+0000 7fe008cbb800 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755c7d00 0x5606755ca0f0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5606755c3820 msgr2=0x5606755c5ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5606755c3820 0x5606755c5ce0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe000020a70 msgr2=0x7fe0000049c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fe000020a70 0x7fe0000049c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5606755ccd80 msgr2=0x5606755cf1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5606755ccd80 0x5606755cf1b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fded003c780 msgr2=0x7fded003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fded003c780 0x7fded003ec40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdff8095ce0 tx=0x7fdff808b000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 msgr2=0x5606755b7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 --2- 172.21.15.120:0/8790658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755b06c0 0x5606755b7d60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe00000dd00 tx=0x7fe000053d90 comp rx=0 tx=0).stop 2024-09-07T03:34:20.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 reap_dead start 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe005fa4640 1 -- 172.21.15.120:0/8790658 reap_dead start 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 shutdown_connections 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 >> 172.21.15.120:0/8790658 conn(0x5606755acac0 msgr2=0x5606755aacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 shutdown_connections 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/8790658 wait complete. 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/2283046873 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdee003c730 msgr2=0x7fdee003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 --2- 172.21.15.120:0/2283046873 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdee003c730 0x7fdee003ebf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x56067558a610 tx=0x7fdff8087040 comp rx=0 tx=0).stop 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/2283046873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755a3c40 msgr2=0x5606755a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 --2- 172.21.15.120:0/2283046873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755a3c40 0x5606755a4060 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe000016d20 tx=0x7fe00000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/2283046873 shutdown_connections 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 --2- 172.21.15.120:0/2283046873 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdee003c730 0x7fdee003ebf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 --2- 172.21.15.120:0/2283046873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5606755a3c40 0x5606755a4060 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/2283046873 >> 172.21.15.120:0/2283046873 conn(0x560675597ff0 msgr2=0x5606755983d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/2283046873 shutdown_connections 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.724+0000 7fe008cbb800 1 -- 172.21.15.120:0/2283046873 wait complete. 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755912a0 msgr2=0x560675593730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755912a0 0x560675593730 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56067548ee80 msgr2=0x560675590460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56067548ee80 0x560675590460 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdeec03c780 msgr2=0x7fdeec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdeec03c780 0x7fdeec03ec40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdffc000c00 tx=0x7fdffc0013b0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 msgr2=0x560675588e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675588e10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdff800a520 tx=0x7fdff8002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 shutdown_connections 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5606755912a0 0x560675593730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x56067548ee80 0x560675590460 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdeec03c780 0x7fdeec03ec40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 --2- 172.21.15.120:0/3770228839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x56067548e540 0x560675588e10 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 >> 172.21.15.120:0/3770228839 conn(0x56067548a250 msgr2=0x56067557b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 shutdown_connections 2024-09-07T03:34:20.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.725+0000 7fe008cbb800 1 -- 172.21.15.120:0/3770228839 wait complete. 2024-09-07T03:34:20.742 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-07T03:34:20.709602Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.709591Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:20.742 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-07T03:34:20.709602Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.709591Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:20.742 ERROR:root:0 2024-09-07T03:34:20.743 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:20.756 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:20.756 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-07T03:34:20.756 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-07T03:34:20.756 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-07T03:34:20.800 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:20.800 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:20.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.800+0000 7fb27bc32800 1 Processor -- start 2024-09-07T03:34:20.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.800+0000 7fb27bc32800 1 -- start start 2024-09-07T03:34:20.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.800+0000 7fb27bc32800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a5391b5680 0x55a5391b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.800+0000 7fb27bc32800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a53905ee40 con 0x55a5391b8010 2024-09-07T03:34:20.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.800+0000 7fb27bc32800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a539029680 con 0x55a5391b5680 2024-09-07T03:34:20.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.800+0000 7fb276f53640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a5391b5680 0x55a5391b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.800+0000 7fb276f53640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a5391b5680 0x55a5391b7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40314/0 (socket says 172.21.15.120:40314) 2024-09-07T03:34:20.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.800+0000 7fb276f53640 1 -- 172.21.15.120:0/1199832227 learned_addr learned my addr 172.21.15.120:0/1199832227 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.800+0000 7fb26e752640 1 --1- 172.21.15.120:0/1199832227 >> v1:172.21.15.104:6789/0 conn(0x55a5391b8010 0x55a5391ba4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43886/0 (socket says 172.21.15.120:43886) 2024-09-07T03:34:20.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.801+0000 7fb276f53640 1 -- 172.21.15.120:0/1199832227 >> v1:172.21.15.104:6789/0 conn(0x55a5391b8010 legacy=0x55a5391ba4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.801+0000 7fb276f53640 1 -- 172.21.15.120:0/1199832227 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5390456b0 con 0x55a5391b5680 2024-09-07T03:34:20.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb276f53640 1 --2- 172.21.15.120:0/1199832227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5391b7a70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb26800a520 tx=0x7fb268045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b8c66ce8f589ae server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb276752640 1 -- 172.21.15.120:0/1199832227 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb268055070 con 0x55a5391b5680 2024-09-07T03:34:20.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb276752640 1 -- 172.21.15.120:0/1199832227 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2680515b0 con 0x55a5391b5680 2024-09-07T03:34:20.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb276752640 1 -- 172.21.15.120:0/1199832227 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2680518d0 con 0x55a5391b5680 2024-09-07T03:34:20.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb27bc32800 1 -- 172.21.15.120:0/1199832227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 msgr2=0x55a5391b7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb27bc32800 1 --2- 172.21.15.120:0/1199832227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5391b7a70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb26800a520 tx=0x7fb268045ba0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb27bc32800 1 -- 172.21.15.120:0/1199832227 shutdown_connections 2024-09-07T03:34:20.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb27bc32800 1 --2- 172.21.15.120:0/1199832227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5391b7a70 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb27bc32800 1 -- 172.21.15.120:0/1199832227 >> 172.21.15.120:0/1199832227 conn(0x55a5391af1c0 msgr2=0x55a5391b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb27bc32800 1 -- 172.21.15.120:0/1199832227 shutdown_connections 2024-09-07T03:34:20.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.803+0000 7fb27bc32800 1 -- 172.21.15.120:0/1199832227 wait complete. 2024-09-07T03:34:20.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.817+0000 7fb27bc32800 1 Processor -- start 2024-09-07T03:34:20.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.817+0000 7fb27bc32800 1 -- start start 2024-09-07T03:34:20.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.817+0000 7fb27bc32800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5392a4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.817+0000 7fb27bc32800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a53904ddd0 con 0x55a5391b5680 2024-09-07T03:34:20.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.817+0000 7fb276f53640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5392a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.817+0000 7fb276f53640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5392a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40324/0 (socket says 172.21.15.120:40324) 2024-09-07T03:34:20.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.817+0000 7fb276f53640 1 -- 172.21.15.120:0/1308264950 learned_addr learned my addr 172.21.15.120:0/1308264950 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.818+0000 7fb276f53640 1 -- 172.21.15.120:0/1308264950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a539066e10 con 0x55a5391b5680 2024-09-07T03:34:20.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.818+0000 7fb276f53640 1 --2- 172.21.15.120:0/1308264950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5392a4680 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb268025da0 tx=0x7fb268051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773260463bd5aa64 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.818+0000 7fb164e09640 1 -- 172.21.15.120:0/1308264950 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb268051ac0 con 0x55a5391b5680 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.818+0000 7fb164e09640 1 -- 172.21.15.120:0/1308264950 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb268051c60 con 0x55a5391b5680 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.818+0000 7fb164e09640 1 -- 172.21.15.120:0/1308264950 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb26805a450 con 0x55a5391b5680 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 -- 172.21.15.120:0/1308264950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 msgr2=0x55a5392a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 --2- 172.21.15.120:0/1308264950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5392a4680 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb268025da0 tx=0x7fb268051000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 -- 172.21.15.120:0/1308264950 shutdown_connections 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 --2- 172.21.15.120:0/1308264950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5392a4680 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 -- 172.21.15.120:0/1308264950 >> 172.21.15.120:0/1308264950 conn(0x55a5391af1c0 msgr2=0x55a5392a0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 -- 172.21.15.120:0/1308264950 shutdown_connections 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 -- 172.21.15.120:0/1308264950 wait complete. 2024-09-07T03:34:20.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 Processor -- start 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 -- start start 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5391b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb27bc32800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5391bc030 con 0x55a5391b5680 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb276f53640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5391b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb276f53640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5391b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40330/0 (socket says 172.21.15.120:40330) 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.819+0000 7fb276f53640 1 -- 172.21.15.120:0/2755634755 learned_addr learned my addr 172.21.15.120:0/2755634755 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.820+0000 7fb276f53640 1 -- 172.21.15.120:0/2755634755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5391b5300 con 0x55a5391b5680 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.820+0000 7fb276f53640 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5391b4da0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb268067040 tx=0x7fb268002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.820+0000 7fb163606640 1 -- 172.21.15.120:0/2755634755 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb268073070 con 0x55a5391b5680 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.820+0000 7fb163606640 1 -- 172.21.15.120:0/2755634755 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26805a600 con 0x55a5391b5680 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.820+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5391b36b0 con 0x55a5391b5680 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.820+0000 7fb163606640 1 -- 172.21.15.120:0/2755634755 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb26805a8e0 con 0x55a5391b5680 2024-09-07T03:34:20.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.820+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5391b3cd0 con 0x55a5391b5680 2024-09-07T03:34:20.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.821+0000 7fb163606640 1 -- 172.21.15.120:0/2755634755 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb268076070 con 0x55a5391b5680 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.821+0000 7fb163606640 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15c03c7d0 0x7fb15c03ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.821+0000 7fb163606640 1 -- 172.21.15.120:0/2755634755 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb268062070 con 0x55a5391b5680 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.821+0000 7fb26e752640 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15c03c7d0 0x7fb15c03ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.821+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5391b8010 0x55a5392b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.821+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392b58e0 con 0x55a5391b8010 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.822+0000 7fb277754640 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5391b8010 0x55a5392b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.822+0000 7fb26e752640 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15c03c7d0 0x7fb15c03ec90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb260001e30 tx=0x7fb260001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.822+0000 7fb277754640 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5391b8010 0x55a5392b5360 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.822+0000 7fb277754640 1 -- 172.21.15.120:0/2755634755 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb27000a4d0 con 0x55a5391b8010 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.822+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392b66d0 0x55a5392b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.822+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392b9120 con 0x55a5392b66d0 2024-09-07T03:34:20.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.822+0000 7fb276f53640 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392b66d0 0x55a5392b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.823+0000 7fb276f53640 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392b66d0 0x55a5392b8ac0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.823+0000 7fb276f53640 1 -- 172.21.15.120:0/2755634755 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392b66d0 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.823+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392ba9d0 con 0x55a5392b66d0 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.823+0000 7fb276f53640 1 -- 172.21.15.120:0/2755634755 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392b66d0 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.823+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392b9ae0 con 0x55a5392b66d0 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb276f53640 1 -- 172.21.15.120:0/2755634755 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392b66d0 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392b9f00 con 0x55a5391b8010 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb277754640 1 -- 172.21.15.120:0/2755634755 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb27000a4d0 con 0x55a5391b8010 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb27bc32800 1 Processor -- start 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb27bc32800 1 -- start start 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb27bc32800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392c8e80 0x55a5392c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb27bc32800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5390aba00 con 0x55a5392c8e80 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb277754640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392c8e80 0x55a5392c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb277754640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392c8e80 0x55a5392c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40334/0 (socket says 172.21.15.120:40334) 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.824+0000 7fb277754640 1 -- 172.21.15.120:0/3170054955 learned_addr learned my addr 172.21.15.120:0/3170054955 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.825+0000 7fb277754640 1 -- 172.21.15.120:0/3170054955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5392c98e0 con 0x55a5392c8e80 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.825+0000 7fb277754640 1 --2- 172.21.15.120:0/3170054955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392c8e80 0x55a5392c92a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb270016d20 tx=0x7fb27000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.825+0000 7fb160e01640 1 -- 172.21.15.120:0/3170054955 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb270017660 con 0x55a5392c8e80 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.825+0000 7fb160e01640 1 -- 172.21.15.120:0/3170054955 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27001b030 con 0x55a5392c8e80 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.825+0000 7fb27bc32800 1 -- 172.21.15.120:0/3170054955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5392ca110 con 0x55a5392c8e80 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.825+0000 7fb160e01640 1 -- 172.21.15.120:0/3170054955 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb270017950 con 0x55a5392c8e80 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.825+0000 7fb27bc32800 1 -- 172.21.15.120:0/3170054955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5392ca6b0 con 0x55a5392c8e80 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.826+0000 7fb160e01640 1 -- 172.21.15.120:0/3170054955 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb270017b40 con 0x55a5392c8e80 2024-09-07T03:34:20.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.826+0000 7fb160e01640 1 --2- 172.21.15.120:0/3170054955 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15003c7f0 0x7fb15003ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.826+0000 7fb160e01640 1 -- 172.21.15.120:0/3170054955 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb27000e040 con 0x55a5392c8e80 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.826+0000 7fb276f53640 1 --2- 172.21.15.120:0/3170054955 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15003c7f0 0x7fb15003ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.826+0000 7fb27bc32800 1 Processor -- start 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.826+0000 7fb27bc32800 1 -- start start 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb276f53640 1 --2- 172.21.15.120:0/3170054955 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15003c7f0 0x7fb15003ecb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55a5392b9600 tx=0x7fb26808a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb27bc32800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb27bc32800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5392a4e10 con 0x55a5392d5940 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb277754640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb277754640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392d5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40338/0 (socket says 172.21.15.120:40338) 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb277754640 1 -- 172.21.15.120:0/2823203826 learned_addr learned my addr 172.21.15.120:0/2823203826 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb277754640 1 -- 172.21.15.120:0/2823203826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5392d6330 con 0x55a5392d5940 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb277754640 1 --2- 172.21.15.120:0/2823203826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392d5d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb270013450 tx=0x7fb270053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce1afe2b641635 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb15a7fc640 1 -- 172.21.15.120:0/2823203826 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb270014a00 con 0x55a5392d5940 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb15a7fc640 1 -- 172.21.15.120:0/2823203826 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb270051070 con 0x55a5392d5940 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.827+0000 7fb15a7fc640 1 -- 172.21.15.120:0/2823203826 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb270028350 con 0x55a5392d5940 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 -- 172.21.15.120:0/2823203826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 msgr2=0x55a5392d5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2823203826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392d5d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb270013450 tx=0x7fb270053f40 comp rx=0 tx=0).stop 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 -- 172.21.15.120:0/2823203826 shutdown_connections 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2823203826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392d5d40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 -- 172.21.15.120:0/2823203826 >> 172.21.15.120:0/2823203826 conn(0x55a5392d1d40 msgr2=0x55a5392cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 -- 172.21.15.120:0/2823203826 shutdown_connections 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 -- 172.21.15.120:0/2823203826 wait complete. 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 Processor -- start 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 -- start start 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392dcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb27bc32800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a5392d6950 con 0x55a5392d5940 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb277754640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392dcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb277754640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392dcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40340/0 (socket says 172.21.15.120:40340) 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.828+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 learned_addr learned my addr 172.21.15.120:0/596449131 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.829+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5392dd4a0 con 0x55a5392d5940 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.829+0000 7fb277754640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392dcf40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb27000dd00 tx=0x7fb270053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.829+0000 7fb158ff9640 1 -- 172.21.15.120:0/596449131 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb270005030 con 0x55a5392d5940 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.829+0000 7fb158ff9640 1 -- 172.21.15.120:0/596449131 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2700051d0 con 0x55a5392d5940 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.829+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5392dd730 con 0x55a5392d5940 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.829+0000 7fb158ff9640 1 -- 172.21.15.120:0/596449131 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2700054d0 con 0x55a5392d5940 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.829+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5392de0b0 con 0x55a5392d5940 2024-09-07T03:34:20.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.830+0000 7fb158ff9640 1 -- 172.21.15.120:0/596449131 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb2700127a0 con 0x55a5392d5940 2024-09-07T03:34:20.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.830+0000 7fb158ff9640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb14003c6e0 0x7fb14003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.830+0000 7fb158ff9640 1 -- 172.21.15.120:0/596449131 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb270035d10 con 0x55a5392d5940 2024-09-07T03:34:20.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.830+0000 7fb276f53640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb14003c6e0 0x7fb14003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.830+0000 7fb276f53640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb14003c6e0 0x7fb14003eba0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb268065fd0 tx=0x7fb268094000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.830+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.830+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5392e8a40 0x55a5392eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.830+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392eb650 con 0x55a5392e8a40 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb26e752640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5392e8a40 0x55a5392eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb26e752640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5392e8a40 0x55a5392eaf00 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb27bc32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb27bc32800 20 realm 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392e7d90 con 0x55a5392e8a40 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb27bc32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb27bc32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:20.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.831+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392ec140 con 0x55a5392e8a40 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb27bc32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392ecf20 0x55a5392ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392ef9e0 con 0x55a5392ecf20 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb277754640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392ecf20 0x55a5392ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb277754640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392ecf20 0x55a5392ef310 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb27bc32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.832+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f0230 con 0x55a5392ecf20 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.833+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.833+0000 7fb27bc32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.833+0000 7fb27bc32800 20 searching for the correct realm 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.833+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a5392f1fa0 0x55a5392f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.833+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392f1fa0 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.833+0000 7fb276f53640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a5392f1fa0 0x55a5392f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.833+0000 7fb276f53640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a5392f1fa0 0x55a5392f43d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.833+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.833+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392ecf20 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.834+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.834+0000 7fb277754640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2700049a0 0x7fb270020880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.834+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x7fb2700049a0 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.834+0000 7fb26e752640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2700049a0 0x7fb270020880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.834+0000 7fb26e752640 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2700049a0 0x7fb270020880 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.834+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x7fb2700049a0 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.834+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392e8a40 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.835+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.835+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392e8a40 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.835+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.835+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392f1fa0 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.835+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.835+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392e8a40 2024-09-07T03:34:20.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.835+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.835+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392ecf20 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.836+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.836+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392ecf20 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.836+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.836+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392e8a40 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.836+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.836+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x7fb2700049a0 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.836+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x7fb2700049a0 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.836+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392e8a40 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.837+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.837+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x7fb2700049a0 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.837+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb26000f610 con 0x7fb2700049a0 2024-09-07T03:34:20.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.837+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392ecf20 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.837+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.837+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392f1fa0 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.837+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.837+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392e8a40 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392ecf20 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392f1fa0 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392e8a40 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392e8a40 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.838+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392e8a40 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.839+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x55a5392e8a40 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.839+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392f1fa0 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.839+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.839+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x7fb2700049a0 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.839+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x7fb2700049a0 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.839+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x7fb2700049a0 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.839+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x7fb2700049a0 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.839+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x7fb2700049a0 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.840+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x7fb2700049a0 2024-09-07T03:34:20.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.840+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392f1fa0 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.840+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.840+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x7fb2700049a0 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.840+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000f610 con 0x7fb2700049a0 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.840+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392ecf20 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.841+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.841+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392ecf20 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.841+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.841+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392f1fa0 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.841+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.841+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392ecf20 2024-09-07T03:34:20.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.841+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.841+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f4aa0 con 0x55a5392ecf20 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f0bb0 con 0x55a5392e8a40 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f07f0 con 0x55a5392ecf20 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.842+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f0ff0 con 0x55a5392e8a40 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 zone default found 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 4 Realm: () 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:20.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 zonegroup default 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f53d0 con 0x7fb2700049a0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x7fb2700049a0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f7610 con 0x55a5392f1fa0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f79b0 con 0x55a5392f1fa0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 started sync module instance, tier type = 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.843+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f6a50 con 0x55a5392ecf20 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.845+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.845+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94168117374528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f7260 con 0x55a5392ecf20 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.845+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f8820 con 0x55a5392e8a40 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.846+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94168117374528] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.846+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.846+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94168117378384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f9070 con 0x55a5392e8a40 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.846+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f9920 con 0x55a5392ecf20 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.847+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94168117378384] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.847+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.847+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94168117382080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f9490 con 0x55a5392ecf20 2024-09-07T03:34:20.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.847+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392fa3e0 con 0x7fb2700049a0 2024-09-07T03:34:20.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.848+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94168117382080] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.848+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x7fb2700049a0 2024-09-07T03:34:20.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.848+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94168117386928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f9490 con 0x7fb2700049a0 2024-09-07T03:34:20.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.848+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392fae50 con 0x55a5392ecf20 2024-09-07T03:34:20.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.849+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94168117386928] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x7fb2700049a0 2024-09-07T03:34:20.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.849+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.850+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94168117389632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f9490 con 0x55a5392ecf20 2024-09-07T03:34:20.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.850+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392fb860 con 0x55a5392f1fa0 2024-09-07T03:34:20.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.850+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.850+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94168117389632] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.851+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94168117383136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f9400 con 0x55a5392f1fa0 2024-09-07T03:34:20.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.851+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392fc5d0 con 0x55a5392f1fa0 2024-09-07T03:34:20.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.851+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94168117383136] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.852+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.852+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94168117394512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392fc5d0 con 0x55a5392f1fa0 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.852+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392fd040 con 0x7fb2700049a0 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94168117394512] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x7fb2700049a0 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94168117398320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392fd000 con 0x7fb2700049a0 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb27bc32800 20 add_watcher() i=0 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb27bc32800 20 add_watcher() i=1 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb27bc32800 20 add_watcher() i=2 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb27bc32800 20 add_watcher() i=3 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb27bc32800 20 add_watcher() i=4 2024-09-07T03:34:20.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb27bc32800 20 add_watcher() i=5 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.853+0000 7fb27bc32800 20 add_watcher() i=6 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.854+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94168117398320] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x7fb2700049a0 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.854+0000 7fb27bc32800 20 add_watcher() i=7 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.854+0000 7fb27bc32800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.854+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a539300580 con 0x55a5392e8a40 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.854+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.854+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94168117395568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392fda40 con 0x55a5392e8a40 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.855+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94168117395568] v36'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.855+0000 7fb12d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.855+0000 7fb27bc32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.855+0000 7fb27bc32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.856+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539308db0 con 0x55a5392ecf20 2024-09-07T03:34:20.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.857+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'62 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.857+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539308e70 con 0x7fb2700049a0 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.858+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x7fb2700049a0 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.858+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393094e0 con 0x55a5392f1fa0 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.859+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.859+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539309920 con 0x55a5392e8a40 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.860+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'252 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.860+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539309da0 con 0x55a5392ecf20 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.861+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'83 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.861+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539309ce0 con 0x55a5392f1fa0 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.862+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'63 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.862+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a120 con 0x55a5392ecf20 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.863+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'38 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.863+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393085c0 con 0x55a5392e8a40 2024-09-07T03:34:20.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.864+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.864+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393085c0 con 0x55a5392ecf20 2024-09-07T03:34:20.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.865+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.865+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393085c0 con 0x55a5392ecf20 2024-09-07T03:34:20.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.866+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.866+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393085c0 con 0x55a5392ecf20 2024-09-07T03:34:20.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.867+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'84 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.867+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393085c0 con 0x55a5392f1fa0 2024-09-07T03:34:20.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.868+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.868+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393085c0 con 0x55a5392ecf20 2024-09-07T03:34:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.869+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.869+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393085c0 con 0x55a5392e8a40 2024-09-07T03:34:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.870+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'70 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.870+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393085c0 con 0x55a5392e8a40 2024-09-07T03:34:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.871+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'253 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.871+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393086c0 con 0x55a5392ecf20 2024-09-07T03:34:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.872+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.872+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539308750 con 0x55a5392ecf20 2024-09-07T03:34:20.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.873+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'85 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.873+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539308750 con 0x55a5392f1fa0 2024-09-07T03:34:20.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.874+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.874+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539308750 con 0x55a5392ecf20 2024-09-07T03:34:20.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.875+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.875+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539308750 con 0x55a5392e8a40 2024-09-07T03:34:20.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.876+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'254 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.876+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a4a0 con 0x55a5392ecf20 2024-09-07T03:34:20.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.877+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'80 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.877+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a4a0 con 0x55a5392ecf20 2024-09-07T03:34:20.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.878+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.878+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a4a0 con 0x55a5392f1fa0 2024-09-07T03:34:20.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.879+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.879+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a480 con 0x55a5392ecf20 2024-09-07T03:34:20.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.880+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'47 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.880+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a460 con 0x55a5392f1fa0 2024-09-07T03:34:20.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.882+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.882+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a460 con 0x55a5392f1fa0 2024-09-07T03:34:20.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.882+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'64 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.882+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a460 con 0x55a5392f1fa0 2024-09-07T03:34:20.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.883+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.883+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a460 con 0x55a5392ecf20 2024-09-07T03:34:20.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.884+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.884+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a460 con 0x55a5392e8a40 2024-09-07T03:34:20.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.885+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.885+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a460 con 0x55a5392ecf20 2024-09-07T03:34:20.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.887+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'81 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.887+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a460 con 0x55a5392e8a40 2024-09-07T03:34:20.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.888+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'71 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.888+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a53930a460 con 0x7fb2700049a0 2024-09-07T03:34:20.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.889+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x7fb2700049a0 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.889+0000 7fb0a7fff640 20 reqs_thread_entry: start 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.889+0000 7fb27bc32800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.889+0000 7fb27bc32800 20 Filter name: none 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb0a5ffb640 20 reqs_thread_entry: start 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 20 rados->read ofs=0 len=0 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a539335360 con 0x55a5392f1fa0 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 20 rados_obj.operate() r=0 bl.length=349 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-07T03:34:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-07T03:34:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5393377a0 con 0x55a5392f1fa0 2024-09-07T03:34:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 10 removing key index: system_akey 2024-09-07T03:34:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.890+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393356b0 con 0x55a5392f1fa0 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.891+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(96 system_akey [delete] v36'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.891+0000 7fb27bc32800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.891+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94168117631616 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a5393356b0 con 0x55a5392e8a40 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.892+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== watch-notify(notify (1) cookie 94168117378384 notify 154618822657 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55a539309530 con 0x55a5392e8a40 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.892+0000 7fb15a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822657 cookie 94168117378384 notifier 4848 bl.length()=161 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.892+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(97 notify.1 [notify cookie 94168117631616 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.892+0000 7fb15a7fc640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb13c003d60 con 0x55a5392e8a40 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.892+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== watch-notify(notify_complete (2) cookie 94168117631616 notify 154618822657 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a539309210 con 0x55a5392e8a40 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.892+0000 7fb27bc32800 10 removing email index: 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.892+0000 7fb27bc32800 10 removing user buckets index 2024-09-07T03:34:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.892+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.892+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393356b0 con 0x55a5392f1fa0 2024-09-07T03:34:20.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.893+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(99 system_user.buckets [delete] v36'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.893+0000 7fb27bc32800 10 removing user index: system_user 2024-09-07T03:34:20.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.893+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5393356b0 con 0x55a5392f1fa0 2024-09-07T03:34:20.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.894+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(100 system_user [call,call,delete] v36'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.894+0000 7fb27bc32800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-07T03:34:20.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.894+0000 7fb27bc32800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-07T03:34:20.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.894+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94168117629440 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a539335620 con 0x55a5392ecf20 2024-09-07T03:34:20.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.894+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== watch-notify(notify (1) cookie 94168117374528 notify 154618822694 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a53930a1e0 con 0x55a5392ecf20 2024-09-07T03:34:20.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.894+0000 7fb159ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822694 cookie 94168117374528 notifier 4848 bl.length()=160 2024-09-07T03:34:20.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.894+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(101 notify.0 [notify cookie 94168117629440 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.894+0000 7fb159ffb640 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb0ac0032c0 con 0x55a5392ecf20 2024-09-07T03:34:20.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.895+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.895+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== watch-notify(notify_complete (2) cookie 94168117629440 notify 154618822694 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a5392dd730 con 0x55a5392ecf20 2024-09-07T03:34:20.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.895+0000 7fb12d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:20.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.895+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94168117395568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539307840 con 0x55a5392e8a40 2024-09-07T03:34:20.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.897+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94168117395568] v36'255 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.897+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94168117374528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539307840 con 0x55a5392ecf20 2024-09-07T03:34:20.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.898+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94168117374528] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.898+0000 7fb27bc32800 20 remove_watcher() i=0 2024-09-07T03:34:20.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.898+0000 7fb27bc32800 2 removed watcher, disabling cache 2024-09-07T03:34:20.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.898+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94168117378384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f6e40 con 0x55a5392e8a40 2024-09-07T03:34:20.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.899+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94168117378384] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x55a5392e8a40 2024-09-07T03:34:20.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.899+0000 7fb27bc32800 20 remove_watcher() i=1 2024-09-07T03:34:20.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.899+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94168117382080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539307840 con 0x55a5392ecf20 2024-09-07T03:34:20.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.900+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94168117382080] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.900+0000 7fb27bc32800 20 remove_watcher() i=2 2024-09-07T03:34:20.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.900+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94168117386928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f7d50 con 0x7fb2700049a0 2024-09-07T03:34:20.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.901+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94168117386928] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x7fb2700049a0 2024-09-07T03:34:20.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.901+0000 7fb27bc32800 20 remove_watcher() i=3 2024-09-07T03:34:20.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.901+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94168117389632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f6e40 con 0x55a5392ecf20 2024-09-07T03:34:20.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.902+0000 7fb277754640 1 -- 172.21.15.120:0/596449131 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94168117389632] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27003b070 con 0x55a5392ecf20 2024-09-07T03:34:20.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.902+0000 7fb27bc32800 20 remove_watcher() i=4 2024-09-07T03:34:20.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.902+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94168117383136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f8bc0 con 0x55a5392f1fa0 2024-09-07T03:34:20.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.903+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94168117383136] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.903+0000 7fb27bc32800 20 remove_watcher() i=5 2024-09-07T03:34:20.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.903+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94168117394512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a539307840 con 0x55a5392f1fa0 2024-09-07T03:34:20.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.904+0000 7fb276f53640 1 -- 172.21.15.120:0/596449131 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94168117394512] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26807f070 con 0x55a5392f1fa0 2024-09-07T03:34:20.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.904+0000 7fb27bc32800 20 remove_watcher() i=6 2024-09-07T03:34:20.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.904+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94168117398320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a5392f9eb0 con 0x7fb2700049a0 2024-09-07T03:34:20.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94168117398320] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26003c040 con 0x7fb2700049a0 2024-09-07T03:34:20.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 20 remove_watcher() i=7 2024-09-07T03:34:20.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392ecf20 msgr2=0x55a5392ef310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392ecf20 0x55a5392ef310 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5392e8a40 msgr2=0x55a5392eaf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5392e8a40 0x55a5392eaf00 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2700049a0 msgr2=0x7fb270020880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fb2700049a0 0x7fb270020880 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a5392f1fa0 msgr2=0x55a5392f43d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a5392f1fa0 0x55a5392f43d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb14003c6e0 msgr2=0x7fb14003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb14003c6e0 0x7fb14003eba0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb268065fd0 tx=0x7fb268094000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 msgr2=0x55a5392dcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb26e752640 1 -- 172.21.15.120:0/596449131 reap_dead start 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392dcf40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb27000dd00 tx=0x7fb270053d90 comp rx=0 tx=0).stop 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 shutdown_connections 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 --2- 172.21.15.120:0/596449131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392d5940 0x55a5392dcf40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 >> 172.21.15.120:0/596449131 conn(0x55a5392d1d40 msgr2=0x55a5392cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 shutdown_connections 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.905+0000 7fb27bc32800 1 -- 172.21.15.120:0/596449131 wait complete. 2024-09-07T03:34:20.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/3170054955 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15003c7f0 msgr2=0x7fb15003ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/3170054955 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15003c7f0 0x7fb15003ecb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55a5392b9600 tx=0x7fb26808a040 comp rx=0 tx=0).stop 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/3170054955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392c8e80 msgr2=0x55a5392c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/3170054955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392c8e80 0x55a5392c92a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb270016d20 tx=0x7fb27000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/3170054955 shutdown_connections 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/3170054955 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15003c7f0 0x7fb15003ecb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/3170054955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5392c8e80 0x55a5392c92a0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/3170054955 >> 172.21.15.120:0/3170054955 conn(0x55a5392bd230 msgr2=0x55a5392bd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/3170054955 shutdown_connections 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/3170054955 wait complete. 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392b66d0 msgr2=0x55a5392b8ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392b66d0 0x55a5392b8ac0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5391b8010 msgr2=0x55a5392b5360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5391b8010 0x55a5392b5360 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15c03c7d0 msgr2=0x7fb15c03ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15c03c7d0 0x7fb15c03ec90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb260001e30 tx=0x7fb260001390 comp rx=0 tx=0).stop 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 msgr2=0x55a5391b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5391b4da0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb268067040 tx=0x7fb268002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 shutdown_connections 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a5392b66d0 0x55a5392b8ac0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a5391b8010 0x55a5392b5360 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fb15c03c7d0 0x7fb15c03ec90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 --2- 172.21.15.120:0/2755634755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a5391b5680 0x55a5391b4da0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 >> 172.21.15.120:0/2755634755 conn(0x55a5391af1c0 msgr2=0x55a53929e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 shutdown_connections 2024-09-07T03:34:20.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.906+0000 7fb27bc32800 1 -- 172.21.15.120:0/2755634755 wait complete. 2024-09-07T03:34:20.917 ERROR:root:None 2024-09-07T03:34:20.917 ERROR:root:0 2024-09-07T03:34:20.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-07T03:34:20.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-07T03:34:20.917 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-07T03:34:20.971 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:20.971 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:20.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.970+0000 7f9a44335800 1 Processor -- start 2024-09-07T03:34:20.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.970+0000 7f9a44335800 1 -- start start 2024-09-07T03:34:20.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.970+0000 7f9a44335800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b8145c1660 0x55b8145c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.970+0000 7f9a44335800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b81446ae40 con 0x55b8145c4080 2024-09-07T03:34:20.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.970+0000 7f9a44335800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b814435680 con 0x55b8145c1660 2024-09-07T03:34:20.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.971+0000 7f9a4007d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b8145c1660 0x55b8145c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.971+0000 7f9a37fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b8145c4080 0x55b8145c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43894/0 (socket says 172.21.15.120:43894) 2024-09-07T03:34:20.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.971+0000 7f9a37fff640 1 -- 172.21.15.120:0/1596231170 learned_addr learned my addr 172.21.15.120:0/1596231170 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:20.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.971+0000 7f9a4007d640 1 -- 172.21.15.120:0/1596231170 >> v1:172.21.15.104:6789/0 conn(0x55b8145c4080 legacy=0x55b8145c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.971+0000 7f9a4007d640 1 -- 172.21.15.120:0/1596231170 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8144516b0 con 0x55b8145c1660 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a4007d640 1 --2- 172.21.15.120:0/1596231170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8145c3a50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000a470 tx=0x7f9a30045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469e71ff7e2756e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a3f87c640 1 -- 172.21.15.120:0/1596231170 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30053570 con 0x55b8145c1660 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a3f87c640 1 -- 172.21.15.120:0/1596231170 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a30058070 con 0x55b8145c1660 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a3f87c640 1 -- 172.21.15.120:0/1596231170 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30053880 con 0x55b8145c1660 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a44335800 1 -- 172.21.15.120:0/1596231170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 msgr2=0x55b8145c3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a44335800 1 --2- 172.21.15.120:0/1596231170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8145c3a50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000a470 tx=0x7f9a30045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a44335800 1 -- 172.21.15.120:0/1596231170 shutdown_connections 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a44335800 1 --2- 172.21.15.120:0/1596231170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8145c3a50 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a44335800 1 -- 172.21.15.120:0/1596231170 >> 172.21.15.120:0/1596231170 conn(0x55b8145bb220 msgr2=0x55b8145bd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a44335800 1 -- 172.21.15.120:0/1596231170 shutdown_connections 2024-09-07T03:34:20.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.973+0000 7f9a44335800 1 -- 172.21.15.120:0/1596231170 wait complete. 2024-09-07T03:34:20.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.987+0000 7f9a44335800 1 Processor -- start 2024-09-07T03:34:20.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.987+0000 7f9a44335800 1 -- start start 2024-09-07T03:34:20.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.987+0000 7f9a44335800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8145c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.987+0000 7f9a44335800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b814459dd0 con 0x55b8145c1660 2024-09-07T03:34:20.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.988+0000 7f9a4007d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8145c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.988+0000 7f9a4007d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8145c0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40366/0 (socket says 172.21.15.120:40366) 2024-09-07T03:34:20.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.988+0000 7f9a4007d640 1 -- 172.21.15.120:0/1990997262 learned_addr learned my addr 172.21.15.120:0/1990997262 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.988+0000 7f9a4007d640 1 -- 172.21.15.120:0/1990997262 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b814472e10 con 0x55b8145c1660 2024-09-07T03:34:20.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.988+0000 7f9a4007d640 1 --2- 172.21.15.120:0/1990997262 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8145c0df0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9a30025c20 tx=0x7f9a30051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b48a5728faaced4 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.988+0000 7f992e60c640 1 -- 172.21.15.120:0/1990997262 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30053a20 con 0x55b8145c1660 2024-09-07T03:34:20.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.988+0000 7f992e60c640 1 -- 172.21.15.120:0/1990997262 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a30063070 con 0x55b8145c1660 2024-09-07T03:34:20.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.988+0000 7f992e60c640 1 -- 172.21.15.120:0/1990997262 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30053cf0 con 0x55b8145c1660 2024-09-07T03:34:20.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 -- 172.21.15.120:0/1990997262 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 msgr2=0x55b8145c0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 --2- 172.21.15.120:0/1990997262 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8145c0df0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9a30025c20 tx=0x7f9a30051000 comp rx=0 tx=0).stop 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 -- 172.21.15.120:0/1990997262 shutdown_connections 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 --2- 172.21.15.120:0/1990997262 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8145c0df0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 -- 172.21.15.120:0/1990997262 >> 172.21.15.120:0/1990997262 conn(0x55b8145bb220 msgr2=0x55b8146ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 -- 172.21.15.120:0/1990997262 shutdown_connections 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 -- 172.21.15.120:0/1990997262 wait complete. 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 Processor -- start 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 -- start start 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8146ba220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.989+0000 7f9a44335800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b8145c80a0 con 0x55b8145c1660 2024-09-07T03:34:20.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f9a4007d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8146ba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f9a4007d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8146ba220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40376/0 (socket says 172.21.15.120:40376) 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f9a4007d640 1 -- 172.21.15.120:0/2382218764 learned_addr learned my addr 172.21.15.120:0/2382218764 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f9a4007d640 1 -- 172.21.15.120:0/2382218764 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8146ba780 con 0x55b8145c1660 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f9a4007d640 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8146ba220 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9a30025c20 tx=0x7f9a30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f992ce09640 1 -- 172.21.15.120:0/2382218764 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30068660 con 0x55b8145c1660 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f992ce09640 1 -- 172.21.15.120:0/2382218764 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a30068800 con 0x55b8145c1660 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8146baa10 con 0x55b8145c1660 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f992ce09640 1 -- 172.21.15.120:0/2382218764 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30068ae0 con 0x55b8145c1660 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.990+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8146bb620 con 0x55b8145c1660 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.991+0000 7f992ce09640 1 -- 172.21.15.120:0/2382218764 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9a30068c80 con 0x55b8145c1660 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.991+0000 7f992ce09640 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f992803c780 0x7f992803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.991+0000 7f992ce09640 1 -- 172.21.15.120:0/2382218764 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9a30098350 con 0x55b8145c1660 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.991+0000 7f9a37fff640 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f992803c780 0x7f992803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.991+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8145c4080 0x55b8146c1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.991+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146c1db0 con 0x55b8145c4080 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.991+0000 7f9a4087e640 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8145c4080 0x55b8146c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.992+0000 7f9a37fff640 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f992803c780 0x7f992803ec40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a28001d70 tx=0x7f9a280012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.992+0000 7f9a4087e640 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8145c4080 0x55b8146c1870 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.992+0000 7f9a4087e640 1 -- 172.21.15.120:0/2382218764 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a3800a4d0 con 0x55b8145c4080 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.992+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146c2660 0x55b8146c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.992+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146c5240 con 0x55b8146c2660 2024-09-07T03:34:20.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.992+0000 7f9a4007d640 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146c2660 0x55b8146c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.993+0000 7f9a4007d640 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146c2660 0x55b8146c4ad0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.993+0000 7f9a4007d640 1 -- 172.21.15.120:0/2382218764 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146c2660 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.993+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146c6af0 con 0x55b8146c2660 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.993+0000 7f9a4007d640 1 -- 172.21.15.120:0/2382218764 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146c2660 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.993+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146c5c30 con 0x55b8146c2660 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.993+0000 7f9a4007d640 1 -- 172.21.15.120:0/2382218764 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146c2660 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.993+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146c6090 con 0x55b8145c4080 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.994+0000 7f9a4087e640 1 -- 172.21.15.120:0/2382218764 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9a3800a4d0 con 0x55b8145c4080 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.994+0000 7f9a44335800 1 Processor -- start 2024-09-07T03:34:21.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.994+0000 7f9a44335800 1 -- start start 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.994+0000 7f9a44335800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146d5020 0x55b8146d5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.994+0000 7f9a44335800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b8144b7a00 con 0x55b8146d5020 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.994+0000 7f9a4087e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146d5020 0x55b8146d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.994+0000 7f9a4087e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146d5020 0x55b8146d5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40384/0 (socket says 172.21.15.120:40384) 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.994+0000 7f9a4087e640 1 -- 172.21.15.120:0/333333709 learned_addr learned my addr 172.21.15.120:0/333333709 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.995+0000 7f9a4087e640 1 -- 172.21.15.120:0/333333709 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8146d5a80 con 0x55b8146d5020 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.995+0000 7f9a4087e640 1 --2- 172.21.15.120:0/333333709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146d5020 0x55b8146d5440 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9a38016d20 tx=0x7f9a3800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.995+0000 7f9925ffb640 1 -- 172.21.15.120:0/333333709 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a38017660 con 0x55b8146d5020 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.995+0000 7f9925ffb640 1 -- 172.21.15.120:0/333333709 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3801b030 con 0x55b8146d5020 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.995+0000 7f9a44335800 1 -- 172.21.15.120:0/333333709 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8146d62b0 con 0x55b8146d5020 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.995+0000 7f9925ffb640 1 -- 172.21.15.120:0/333333709 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a38017950 con 0x55b8146d5020 2024-09-07T03:34:21.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.995+0000 7f9a44335800 1 -- 172.21.15.120:0/333333709 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8146d6850 con 0x55b8146d5020 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.996+0000 7f9925ffb640 1 -- 172.21.15.120:0/333333709 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9a38017af0 con 0x55b8146d5020 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.996+0000 7f9925ffb640 1 --2- 172.21.15.120:0/333333709 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991803c780 0x7f991803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.996+0000 7f9925ffb640 1 -- 172.21.15.120:0/333333709 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9a3800e040 con 0x55b8146d5020 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.996+0000 7f9a4007d640 1 --2- 172.21.15.120:0/333333709 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991803c780 0x7f991803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.996+0000 7f9a44335800 1 Processor -- start 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.996+0000 7f9a44335800 1 -- start start 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.996+0000 7f9a4007d640 1 --2- 172.21.15.120:0/333333709 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991803c780 0x7f991803ec40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55b8146bba20 tx=0x7f9a30083040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.996+0000 7f9a44335800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.996+0000 7f9a44335800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b8145bf690 con 0x55b8146e1b20 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a4087e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a4087e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40398/0 (socket says 172.21.15.120:40398) 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a4087e640 1 -- 172.21.15.120:0/67339130 learned_addr learned my addr 172.21.15.120:0/67339130 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a4087e640 1 -- 172.21.15.120:0/67339130 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8146e2510 con 0x55b8146e1b20 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a4087e640 1 --2- 172.21.15.120:0/67339130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e1f20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9a38040fd0 tx=0x7f9a38017ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef49cbbcee9a6338 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f991f7fe640 1 -- 172.21.15.120:0/67339130 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3804a070 con 0x55b8146e1b20 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f991f7fe640 1 -- 172.21.15.120:0/67339130 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38055040 con 0x55b8146e1b20 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f991f7fe640 1 -- 172.21.15.120:0/67339130 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a38052070 con 0x55b8146e1b20 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a44335800 1 -- 172.21.15.120:0/67339130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 msgr2=0x55b8146e1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a44335800 1 --2- 172.21.15.120:0/67339130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e1f20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9a38040fd0 tx=0x7f9a38017ea0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a44335800 1 -- 172.21.15.120:0/67339130 shutdown_connections 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a44335800 1 --2- 172.21.15.120:0/67339130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e1f20 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.997+0000 7f9a44335800 1 -- 172.21.15.120:0/67339130 >> 172.21.15.120:0/67339130 conn(0x55b8146ddf20 msgr2=0x55b8146dc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a44335800 1 -- 172.21.15.120:0/67339130 shutdown_connections 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a44335800 1 -- 172.21.15.120:0/67339130 wait complete. 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a44335800 1 Processor -- start 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a44335800 1 -- start start 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a44335800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a44335800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b8146e2b30 con 0x55b8146e1b20 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a4087e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a4087e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40412/0 (socket says 172.21.15.120:40412) 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 learned_addr learned my addr 172.21.15.120:0/1092580805 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8146e9680 con 0x55b8146e1b20 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.998+0000 7f9a4087e640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e9120 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9a38048040 tx=0x7f9a38053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.999+0000 7f991dffb640 1 -- 172.21.15.120:0/1092580805 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3804a040 con 0x55b8146e1b20 2024-09-07T03:34:21.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.999+0000 7f991dffb640 1 -- 172.21.15.120:0/1092580805 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38014a90 con 0x55b8146e1b20 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.999+0000 7f991dffb640 1 -- 172.21.15.120:0/1092580805 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a380284c0 con 0x55b8146e1b20 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.999+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8146e9910 con 0x55b8146e1b20 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.999+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8146ea4a0 con 0x55b8146e1b20 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:20.999+0000 7f991dffb640 1 -- 172.21.15.120:0/1092580805 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9a38014440 con 0x55b8146e1b20 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.000+0000 7f991dffb640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991003c6e0 0x7f991003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.000+0000 7f991dffb640 1 -- 172.21.15.120:0/1092580805 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9a380153d0 con 0x55b8146e1b20 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.000+0000 7f9a4007d640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991003c6e0 0x7f991003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.000+0000 7f9a4007d640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991003c6e0 0x7f991003eba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a30074fd0 tx=0x7f9a3008d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.000+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.000+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8146f4c20 0x55b8146f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.000+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146f7830 con 0x55b8146f4c20 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.000+0000 7f9a37fff640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8146f4c20 0x55b8146f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a37fff640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8146f4c20 0x55b8146f70e0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a28009050 con 0x55b8146f4c20 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 20 realm 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146f3f70 con 0x55b8146f4c20 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a28009050 con 0x55b8146f4c20 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146f8320 con 0x55b8146f4c20 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a28009050 con 0x55b8146f4c20 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146f9100 0x55b8146fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.001+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146fbbc0 con 0x55b8146f9100 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a4087e640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146f9100 0x55b8146fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a4087e640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146f9100 0x55b8146fb4f0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a3804d040 con 0x55b8146f9100 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a44335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146fc410 con 0x55b8146f9100 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a3804d040 con 0x55b8146f9100 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a44335800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a44335800 20 searching for the correct realm 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b8146fe180 0x55b8147005b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.002+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146fe180 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.003+0000 7f9a4007d640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b8146fe180 0x55b8147005b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.003+0000 7f9a4007d640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b8146fe180 0x55b8147005b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.003+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.003+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f9100 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.003+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3804d040 con 0x55b8146f9100 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.003+0000 7f9a4087e640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9a38056b90 0x7f9a38048120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.003+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x7f9a38056b90 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.004+0000 7f9a37fff640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9a38056b90 0x7f9a38048120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.004+0000 7f9a37fff640 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9a38056b90 0x7f9a38048120 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.004+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28009050 con 0x7f9a38056b90 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.004+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f4c20 2024-09-07T03:34:21.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.004+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28009050 con 0x55b8146f4c20 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.004+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f4c20 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.004+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.004+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146fe180 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.005+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.005+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f4c20 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.005+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.005+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f9100 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.005+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a3804d040 con 0x55b8146f9100 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.005+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f9100 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.006+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.006+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f4c20 2024-09-07T03:34:21.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.006+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.006+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x7f9a38056b90 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.006+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.006+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f4c20 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.006+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.006+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x7f9a38056b90 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.007+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.007+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f9100 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.007+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.007+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146fe180 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.007+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.007+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f4c20 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.007+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.007+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f9100 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146fe180 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f4c20 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f4c20 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f4c20 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.008+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146fe180 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x7f9a38056b90 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x7f9a38056b90 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x7f9a38056b90 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146fe180 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.009+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x7f9a38056b90 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.010+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.010+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f9100 2024-09-07T03:34:21.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.010+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.010+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f9100 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.010+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.010+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146fe180 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.010+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.010+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f9100 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b814700c80 con 0x55b8146f9100 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:21.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146fcd90 con 0x55b8146f4c20 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.011+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146fc9d0 con 0x55b8146f9100 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8146fd1d0 con 0x55b8146f4c20 2024-09-07T03:34:21.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 zone default found 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 4 Realm: () 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 zonegroup default 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8147015b0 con 0x7f9a38056b90 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8147037f0 con 0x55b8146fe180 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.012+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b814703b90 con 0x55b8146fe180 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.013+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.013+0000 7f9a44335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.013+0000 7f9a44335800 20 started sync module instance, tier type = 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.013+0000 7f9a44335800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.013+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814702c30 con 0x55b8146f9100 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.014+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.014+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94249105240096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814703440 con 0x55b8146f9100 2024-09-07T03:34:21.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.014+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814704660 con 0x55b8146f4c20 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.015+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94249105240096] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.015+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.015+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94249105244592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814704a80 con 0x55b8146f4c20 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.015+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814705440 con 0x55b8146f9100 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.016+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94249105244592] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.016+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.016+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94249105246128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814705440 con 0x55b8146f9100 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.016+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814705e40 con 0x7f9a38056b90 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.017+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94249105246128] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.018+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.018+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94249105250640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814705440 con 0x7f9a38056b90 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.018+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b8147068c0 con 0x55b8146f9100 2024-09-07T03:34:21.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.018+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94249105250640] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.019+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.019+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94249105253328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814705440 con 0x55b8146f9100 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.019+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b8147072d0 con 0x55b8146fe180 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.020+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94249105253328] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.020+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.020+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94249105248624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b8147072d0 con 0x55b8146fe180 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.020+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b814707d40 con 0x55b8146fe180 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.021+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94249105248624] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.021+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.021+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94249105258512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b8147072d0 con 0x55b8146fe180 2024-09-07T03:34:21.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.021+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b8147087b0 con 0x7f9a38056b90 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94249105258512] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94249105261216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b8147072d0 con 0x7f9a38056b90 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a44335800 20 add_watcher() i=0 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a44335800 20 add_watcher() i=1 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a44335800 20 add_watcher() i=2 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a44335800 20 add_watcher() i=3 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a44335800 20 add_watcher() i=4 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a44335800 20 add_watcher() i=5 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.022+0000 7f9a44335800 20 add_watcher() i=6 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.023+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94249105261216] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.023+0000 7f9a44335800 20 add_watcher() i=7 2024-09-07T03:34:21.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.023+0000 7f9a44335800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.023+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b81470bbd0 con 0x55b8146f4c20 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.023+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.023+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94249105256432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b8147090a0 con 0x55b8146f4c20 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.024+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94249105256432] v36'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.024+0000 7f98f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f9a44335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f9a44335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f9a44335800 5 note: GC not initialized 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f98f57e2640 20 reqs_thread_entry: start 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f9a44335800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f9a44335800 20 Filter name: none 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f9866ffd640 20 reqs_thread_entry: start 2024-09-07T03:34:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f9a44335800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.025+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b81473ed30 con 0x55b8146f9100 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b81473d3f0 con 0x55b8146fe180 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-07T03:34:21.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.026+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473dc90 con 0x55b8146f9100 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v36'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f9a44335800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f9a44335800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f9a44335800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94249105479648 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b8147421c0 con 0x55b8146f9100 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== watch-notify(notify (1) cookie 94249105246128 notify 154618822695 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55b81473e680 con 0x55b8146f9100 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f991f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822695 cookie 94249105246128 notifier 4855 bl.length()=542 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f991f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f991f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-07T03:34:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f991f7fe640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9904003ea0 con 0x55b8146f9100 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.027+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(65 notify.2 [notify cookie 94249105479648 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.028+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.028+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== watch-notify(notify_complete (2) cookie 94249105479648 notify 154618822695 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b8146e9910 con 0x55b8146f9100 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.028+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473dc90 con 0x55b8146fe180 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v36'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f9a44335800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f9a44335800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f9a44335800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94249105479648 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b81473dc60 con 0x55b8146fe180 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== watch-notify(notify (1) cookie 94249105248624 notify 154618822692 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55b8146bb620 con 0x55b8146fe180 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f991effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822692 cookie 94249105248624 notifier 4855 bl.length()=175 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f991effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-07T03:34:21.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f991effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-07T03:34:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f991effd640 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9874003400 con 0x55b8146fe180 2024-09-07T03:34:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.029+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(68 notify.5 [notify cookie 94249105479648 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.030+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== watch-notify(notify_complete (2) cookie 94249105479648 notify 154618822692 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b8146baa10 con 0x55b8146fe180 2024-09-07T03:34:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.030+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.046 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-07T03:34:21.027416Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:21.027406Z","tags":[],"group_ids":[]} 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.030+0000 7f98f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.030+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94249105256432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473cba0 con 0x55b8146f4c20 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.031+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94249105256432] v36'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.031+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94249105240096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473cba0 con 0x55b8146f9100 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.032+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94249105240096] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.032+0000 7f9a44335800 20 remove_watcher() i=0 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.032+0000 7f9a44335800 2 removed watcher, disabling cache 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.033+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94249105244592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473cba0 con 0x55b8146f4c20 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.034+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94249105244592] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x55b8146f4c20 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.034+0000 7f9a44335800 20 remove_watcher() i=1 2024-09-07T03:34:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.034+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94249105246128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473cba0 con 0x55b8146f9100 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.035+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94249105246128] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.035+0000 7f9a44335800 20 remove_watcher() i=2 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.035+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94249105250640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473cba0 con 0x7f9a38056b90 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.036+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94249105250640] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.036+0000 7f9a44335800 20 remove_watcher() i=3 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.036+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94249105253328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473cba0 con 0x55b8146f9100 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.037+0000 7f9a4087e640 1 -- 172.21.15.120:0/1092580805 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94249105253328] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a38064040 con 0x55b8146f9100 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.037+0000 7f9a44335800 20 remove_watcher() i=4 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.037+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94249105248624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473cba0 con 0x55b8146fe180 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.038+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94249105248624] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.038+0000 7f9a44335800 20 remove_watcher() i=5 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.038+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94249105258512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473cba0 con 0x55b8146fe180 2024-09-07T03:34:21.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.039+0000 7f9a4007d640 1 -- 172.21.15.120:0/1092580805 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94249105258512] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a30051070 con 0x55b8146fe180 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.039+0000 7f9a44335800 20 remove_watcher() i=6 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.039+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94249105261216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b81473cba0 con 0x7f9a38056b90 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94249105261216] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a28028040 con 0x7f9a38056b90 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 20 remove_watcher() i=7 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146f9100 msgr2=0x55b8146fb4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146f9100 0x55b8146fb4f0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8146f4c20 msgr2=0x55b8146f70e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8146f4c20 0x55b8146f70e0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9a38056b90 msgr2=0x7f9a38048120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9a38056b90 0x7f9a38048120 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b8146fe180 msgr2=0x55b8147005b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b8146fe180 0x55b8147005b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991003c6e0 msgr2=0x7f991003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991003c6e0 0x7f991003eba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a30074fd0 tx=0x7f9a3008d000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 msgr2=0x55b8146e9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a37fff640 1 -- 172.21.15.120:0/1092580805 reap_dead start 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e9120 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9a38048040 tx=0x7f9a38053d00 comp rx=0 tx=0).stop 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 shutdown_connections 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/1092580805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146e1b20 0x55b8146e9120 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 >> 172.21.15.120:0/1092580805 conn(0x55b8146ddf20 msgr2=0x55b8146dc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 shutdown_connections 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/1092580805 wait complete. 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/333333709 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991803c780 msgr2=0x7f991803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/333333709 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991803c780 0x7f991803ec40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55b8146bba20 tx=0x7f9a30083040 comp rx=0 tx=0).stop 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/333333709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146d5020 msgr2=0x55b8146d5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/333333709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146d5020 0x55b8146d5440 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9a38016d20 tx=0x7f9a3800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/333333709 shutdown_connections 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/333333709 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f991803c780 0x7f991803ec40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 --2- 172.21.15.120:0/333333709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8146d5020 0x55b8146d5440 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/333333709 >> 172.21.15.120:0/333333709 conn(0x55b8146c93d0 msgr2=0x55b8146c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/333333709 shutdown_connections 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.040+0000 7f9a44335800 1 -- 172.21.15.120:0/333333709 wait complete. 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146c2660 msgr2=0x55b8146c4ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146c2660 0x55b8146c4ad0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8145c4080 msgr2=0x55b8146c1870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8145c4080 0x55b8146c1870 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f992803c780 msgr2=0x7f992803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f992803c780 0x7f992803ec40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a28001d70 tx=0x7f9a280012d0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 msgr2=0x55b8146ba220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8146ba220 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9a30025c20 tx=0x7f9a30002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 shutdown_connections 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b8146c2660 0x55b8146c4ad0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b8145c4080 0x55b8146c1870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f992803c780 0x7f992803ec40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 --2- 172.21.15.120:0/2382218764 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b8145c1660 0x55b8146ba220 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 >> 172.21.15.120:0/2382218764 conn(0x55b8145bb220 msgr2=0x55b8146abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 shutdown_connections 2024-09-07T03:34:21.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.041+0000 7f9a44335800 1 -- 172.21.15.120:0/2382218764 wait complete. 2024-09-07T03:34:21.057 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-07T03:34:21.027416Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:21.027406Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.058 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-07T03:34:21.027416Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:21.027406Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.058 ERROR:root:0 2024-09-07T03:34:21.058 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:21.071 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:21.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-07T03:34:21.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-07T03:34:21.071 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-07T03:34:21.115 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:21.115 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:21.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25b3925800 1 Processor -- start 2024-09-07T03:34:21.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25b3925800 1 -- start start 2024-09-07T03:34:21.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25b3925800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a7ffffd300 0x55a7ffffd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25b3925800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a7ffea7e40 con 0x55a7ffffdd30 2024-09-07T03:34:21.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25b3925800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55a7ffe72680 con 0x55a7ffffd300 2024-09-07T03:34:21.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25af533640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55a7ffffd300 0x55a7ffffd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25a6d32640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55a7ffffdd30 0x55a7ffffe1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43908/0 (socket says 172.21.15.120:43908) 2024-09-07T03:34:21.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25a6d32640 1 -- 172.21.15.120:0/293754405 learned_addr learned my addr 172.21.15.120:0/293754405 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:21.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25af533640 1 -- 172.21.15.120:0/293754405 >> v1:172.21.15.104:6789/0 conn(0x55a7ffffdd30 legacy=0x55a7ffffe1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.115+0000 7f25af533640 1 -- 172.21.15.120:0/293754405 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ffe8e6b0 con 0x55a7ffffd300 2024-09-07T03:34:21.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.117+0000 7f25af533640 1 --2- 172.21.15.120:0/293754405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a7ffffd700 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f25a000a470 tx=0x7f25a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3810f932646d9ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.117+0000 7f25aed32640 1 -- 172.21.15.120:0/293754405 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a0053570 con 0x55a7ffffd300 2024-09-07T03:34:21.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.117+0000 7f25aed32640 1 -- 172.21.15.120:0/293754405 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a0058070 con 0x55a7ffffd300 2024-09-07T03:34:21.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.117+0000 7f25aed32640 1 -- 172.21.15.120:0/293754405 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a0053880 con 0x55a7ffffd300 2024-09-07T03:34:21.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.118+0000 7f25b3925800 1 -- 172.21.15.120:0/293754405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 msgr2=0x55a7ffffd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.118+0000 7f25b3925800 1 --2- 172.21.15.120:0/293754405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a7ffffd700 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f25a000a470 tx=0x7f25a0045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:21.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.118+0000 7f25b3925800 1 -- 172.21.15.120:0/293754405 shutdown_connections 2024-09-07T03:34:21.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.118+0000 7f25b3925800 1 --2- 172.21.15.120:0/293754405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a7ffffd700 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.118+0000 7f25b3925800 1 -- 172.21.15.120:0/293754405 >> 172.21.15.120:0/293754405 conn(0x55a7ffff7920 msgr2=0x55a7ffff9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.118+0000 7f25b3925800 1 -- 172.21.15.120:0/293754405 shutdown_connections 2024-09-07T03:34:21.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.118+0000 7f25b3925800 1 -- 172.21.15.120:0/293754405 wait complete. 2024-09-07T03:34:21.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.131+0000 7f25b3925800 1 Processor -- start 2024-09-07T03:34:21.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.132+0000 7f25b3925800 1 -- start start 2024-09-07T03:34:21.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.132+0000 7f25b3925800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a7ffffc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.132+0000 7f25b3925800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a7ffe96dd0 con 0x55a7ffffd300 2024-09-07T03:34:21.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.132+0000 7f25af533640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a7ffffc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.132+0000 7f25af533640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a7ffffc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40422/0 (socket says 172.21.15.120:40422) 2024-09-07T03:34:21.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.132+0000 7f25af533640 1 -- 172.21.15.120:0/637240595 learned_addr learned my addr 172.21.15.120:0/637240595 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.132+0000 7f25af533640 1 -- 172.21.15.120:0/637240595 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ffeafe10 con 0x55a7ffffd300 2024-09-07T03:34:21.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.133+0000 7f25af533640 1 --2- 172.21.15.120:0/637240595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a7ffffc4e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f25a0025c20 tx=0x7f25a0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f4425d00921543 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.133+0000 7f249d60a640 1 -- 172.21.15.120:0/637240595 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a0053a20 con 0x55a7ffffd300 2024-09-07T03:34:21.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.133+0000 7f249d60a640 1 -- 172.21.15.120:0/637240595 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a0063070 con 0x55a7ffffd300 2024-09-07T03:34:21.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.133+0000 7f249d60a640 1 -- 172.21.15.120:0/637240595 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a0053cf0 con 0x55a7ffffd300 2024-09-07T03:34:21.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 -- 172.21.15.120:0/637240595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 msgr2=0x55a7ffffc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 --2- 172.21.15.120:0/637240595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a7ffffc4e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f25a0025c20 tx=0x7f25a0051000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 -- 172.21.15.120:0/637240595 shutdown_connections 2024-09-07T03:34:21.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 --2- 172.21.15.120:0/637240595 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a7ffffc4e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 -- 172.21.15.120:0/637240595 >> 172.21.15.120:0/637240595 conn(0x55a7ffff7920 msgr2=0x55a8000e7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 -- 172.21.15.120:0/637240595 shutdown_connections 2024-09-07T03:34:21.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 -- 172.21.15.120:0/637240595 wait complete. 2024-09-07T03:34:21.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 Processor -- start 2024-09-07T03:34:21.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 -- start start 2024-09-07T03:34:21.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a8000f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25b3925800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a8000040b0 con 0x55a7ffffd300 2024-09-07T03:34:21.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25af533640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a8000f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25af533640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a8000f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40432/0 (socket says 172.21.15.120:40432) 2024-09-07T03:34:21.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25af533640 1 -- 172.21.15.120:0/2792333862 learned_addr learned my addr 172.21.15.120:0/2792333862 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.134+0000 7f25af533640 1 -- 172.21.15.120:0/2792333862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8000f54b0 con 0x55a7ffffd300 2024-09-07T03:34:21.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.135+0000 7f25af533640 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a8000f4f50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f25a0025c20 tx=0x7f25a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.135+0000 7f249be07640 1 -- 172.21.15.120:0/2792333862 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a0068660 con 0x55a7ffffd300 2024-09-07T03:34:21.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.135+0000 7f249be07640 1 -- 172.21.15.120:0/2792333862 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a0068800 con 0x55a7ffffd300 2024-09-07T03:34:21.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.135+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8000f5740 con 0x55a7ffffd300 2024-09-07T03:34:21.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.135+0000 7f249be07640 1 -- 172.21.15.120:0/2792333862 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a0068ae0 con 0x55a7ffffd300 2024-09-07T03:34:21.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.135+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8000f6350 con 0x55a7ffffd300 2024-09-07T03:34:21.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.136+0000 7f249be07640 1 -- 172.21.15.120:0/2792333862 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f25a0068c80 con 0x55a7ffffd300 2024-09-07T03:34:21.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.136+0000 7f249be07640 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f249403c730 0x7f249403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.136+0000 7f249be07640 1 -- 172.21.15.120:0/2792333862 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f25a00982d0 con 0x55a7ffffd300 2024-09-07T03:34:21.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.136+0000 7f25a6d32640 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f249403c730 0x7f249403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.136+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a7ffffdd30 0x55a8000fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.136+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8000fcae0 con 0x55a7ffffdd30 2024-09-07T03:34:21.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.136+0000 7f25afd34640 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a7ffffdd30 0x55a8000fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.136+0000 7f25a6d32640 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f249403c730 0x7f249403ebf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2598001d70 tx=0x7f25980012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.136+0000 7f25afd34640 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a7ffffdd30 0x55a8000fc5a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.137+0000 7f25afd34640 1 -- 172.21.15.120:0/2792333862 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25a800a4d0 con 0x55a7ffffdd30 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.137+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a8000fd390 0x55a8000ff830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.137+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8000fffa0 con 0x55a8000fd390 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.137+0000 7f25af533640 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a8000fd390 0x55a8000ff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.137+0000 7f25af533640 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a8000fd390 0x55a8000ff830 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.138+0000 7f25af533640 1 -- 172.21.15.120:0/2792333862 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25a0051070 con 0x55a8000fd390 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.138+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800101850 con 0x55a8000fd390 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.138+0000 7f25af533640 1 -- 172.21.15.120:0/2792333862 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f25a0051070 con 0x55a8000fd390 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.138+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800100960 con 0x55a8000fd390 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.138+0000 7f25af533640 1 -- 172.21.15.120:0/2792333862 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25a0051070 con 0x55a8000fd390 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.138+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800100d80 con 0x55a7ffffdd30 2024-09-07T03:34:21.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.139+0000 7f25afd34640 1 -- 172.21.15.120:0/2792333862 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f25a800a4d0 con 0x55a7ffffdd30 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.139+0000 7f25b3925800 1 Processor -- start 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.139+0000 7f25b3925800 1 -- start start 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.139+0000 7f25b3925800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8000ed9a0 0x55a8000ec210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.139+0000 7f25b3925800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a7ffef4a00 con 0x55a8000ed9a0 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.139+0000 7f25afd34640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8000ed9a0 0x55a8000ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.140+0000 7f25afd34640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8000ed9a0 0x55a8000ec210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40434/0 (socket says 172.21.15.120:40434) 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.140+0000 7f25afd34640 1 -- 172.21.15.120:0/441942447 learned_addr learned my addr 172.21.15.120:0/441942447 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.140+0000 7f25afd34640 1 -- 172.21.15.120:0/441942447 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8000edec0 con 0x55a8000ed9a0 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.140+0000 7f25afd34640 1 --2- 172.21.15.120:0/441942447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8000ed9a0 0x55a8000ec210 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f25a8016d20 tx=0x7f25a800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.140+0000 7f2499602640 1 -- 172.21.15.120:0/441942447 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a8017660 con 0x55a8000ed9a0 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.140+0000 7f2499602640 1 -- 172.21.15.120:0/441942447 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a801b030 con 0x55a8000ed9a0 2024-09-07T03:34:21.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.140+0000 7f25b3925800 1 -- 172.21.15.120:0/441942447 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8000ec750 con 0x55a8000ed9a0 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.140+0000 7f2499602640 1 -- 172.21.15.120:0/441942447 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a8017950 con 0x55a8000ed9a0 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.140+0000 7f25b3925800 1 -- 172.21.15.120:0/441942447 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8000eccf0 con 0x55a8000ed9a0 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.141+0000 7f2499602640 1 -- 172.21.15.120:0/441942447 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f25a8017af0 con 0x55a8000ed9a0 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.141+0000 7f2499602640 1 --2- 172.21.15.120:0/441942447 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f248803c840 0x7f248803ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.141+0000 7f2499602640 1 -- 172.21.15.120:0/441942447 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f25a800e040 con 0x55a8000ed9a0 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.141+0000 7f25af533640 1 --2- 172.21.15.120:0/441942447 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f248803c840 0x7f248803ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.141+0000 7f25b3925800 1 Processor -- start 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.141+0000 7f25b3925800 1 -- start start 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.141+0000 7f25af533640 1 --2- 172.21.15.120:0/441942447 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f248803c840 0x7f248803ed00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55a800100480 tx=0x7f25a0045e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f25b3925800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a80011ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f25b3925800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a8000f02e0 con 0x55a80011ea30 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f25afd34640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a80011ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f25afd34640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a80011ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40446/0 (socket says 172.21.15.120:40446) 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f25afd34640 1 -- 172.21.15.120:0/1383605203 learned_addr learned my addr 172.21.15.120:0/1383605203 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f25afd34640 1 -- 172.21.15.120:0/1383605203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a80011f420 con 0x55a80011ea30 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f25afd34640 1 --2- 172.21.15.120:0/1383605203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a80011ee30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f25a8053e00 tx=0x7f25a8017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f3a26d0e8d835c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f2492ffd640 1 -- 172.21.15.120:0/1383605203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a8014d40 con 0x55a80011ea30 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f2492ffd640 1 -- 172.21.15.120:0/1383605203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a8051070 con 0x55a80011ea30 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.142+0000 7f2492ffd640 1 -- 172.21.15.120:0/1383605203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a80149b0 con 0x55a80011ea30 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 -- 172.21.15.120:0/1383605203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 msgr2=0x55a80011ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 --2- 172.21.15.120:0/1383605203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a80011ee30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f25a8053e00 tx=0x7f25a8017de0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 -- 172.21.15.120:0/1383605203 shutdown_connections 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 --2- 172.21.15.120:0/1383605203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a80011ee30 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 -- 172.21.15.120:0/1383605203 >> 172.21.15.120:0/1383605203 conn(0x55a80011ae30 msgr2=0x55a800119070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 -- 172.21.15.120:0/1383605203 shutdown_connections 2024-09-07T03:34:21.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 -- 172.21.15.120:0/1383605203 wait complete. 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 Processor -- start 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 -- start start 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a800126060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25b3925800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55a80011fa40 con 0x55a80011ea30 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25afd34640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a800126060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25afd34640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a800126060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40458/0 (socket says 172.21.15.120:40458) 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.143+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 learned_addr learned my addr 172.21.15.120:0/3634248236 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.144+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8001265c0 con 0x55a80011ea30 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.144+0000 7f25afd34640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a800126060 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f25a8017fd0 tx=0x7f25a8053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.144+0000 7f24917fa640 1 -- 172.21.15.120:0/3634248236 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a8028990 con 0x55a80011ea30 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.144+0000 7f24917fa640 1 -- 172.21.15.120:0/3634248236 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a802e070 con 0x55a80011ea30 2024-09-07T03:34:21.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.144+0000 7f24917fa640 1 -- 172.21.15.120:0/3634248236 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25a8012e00 con 0x55a80011ea30 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.144+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a800126850 con 0x55a80011ea30 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.144+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8001271d0 con 0x55a80011ea30 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.145+0000 7f24917fa640 1 -- 172.21.15.120:0/3634248236 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f25a8039060 con 0x55a80011ea30 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.145+0000 7f24917fa640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247803c6e0 0x7f247803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.145+0000 7f24917fa640 1 -- 172.21.15.120:0/3634248236 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f25a803d9d0 con 0x55a80011ea30 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.145+0000 7f25af533640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247803c6e0 0x7f247803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.145+0000 7f25af533640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247803c6e0 0x7f247803eba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f25a0068fd0 tx=0x7f25a0088000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a800131b60 0x55a800134020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800134770 con 0x55a800131b60 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25a6d32640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a800131b60 0x55a800134020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25a6d32640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a800131b60 0x55a800134020 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2598009050 con 0x55a800131b60 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 20 realm 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800130eb0 con 0x55a800131b60 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2598009050 con 0x55a800131b60 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.146+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800135260 con 0x55a800131b60 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2598009050 con 0x55a800131b60 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25b3925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a800136040 0x55a800138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800138b00 con 0x55a800136040 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25afd34640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a800136040 0x55a800138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25afd34640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a800136040 0x55a800138430 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25b3925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.147+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800139350 con 0x55a800136040 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.148+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.148+0000 7f25b3925800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.148+0000 7f25b3925800 20 searching for the correct realm 2024-09-07T03:34:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.148+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a80013b0c0 0x55a80013d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.148+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a80013b0c0 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.148+0000 7f25af533640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a80013b0c0 0x55a80013d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.148+0000 7f25af533640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a80013b0c0 0x55a80013d510 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.149+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.149+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800136040 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.149+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.149+0000 7f25afd34640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f25a803ac20 0x7f25a8048020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.149+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x7f25a803ac20 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.149+0000 7f25a6d32640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f25a803ac20 0x7f25a8048020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.149+0000 7f25a6d32640 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f25a803ac20 0x7f25a8048020 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.149+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598009050 con 0x7f25a803ac20 2024-09-07T03:34:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.149+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800131b60 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.150+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598009050 con 0x55a800131b60 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.150+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800131b60 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.150+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.150+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a80013b0c0 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.150+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.150+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800131b60 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.150+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.150+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800136040 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.151+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.151+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800136040 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.151+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.151+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800131b60 2024-09-07T03:34:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.151+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.151+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x7f25a803ac20 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.151+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.151+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800131b60 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x7f25a803ac20 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800136040 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a80013b0c0 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800131b60 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.152+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800136040 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.153+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.153+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a80013b0c0 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.153+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.153+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800131b60 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.153+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.153+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800131b60 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.153+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.153+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800131b60 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.154+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.154+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a80013b0c0 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.154+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.154+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x7f25a803ac20 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.154+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.154+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x7f25a803ac20 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.154+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.154+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x7f25a803ac20 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.154+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.155+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a80013b0c0 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.155+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.155+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x7f25a803ac20 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.155+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.155+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800136040 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.155+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.155+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800136040 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.155+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.155+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a80013b0c0 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800136040 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a80013dbe0 con 0x55a800136040 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25b3925800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25b3925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25b3925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25b3925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25b3925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25b3925800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800139ca0 con 0x55a800131b60 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.156+0000 7f25b3925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8001398b0 con 0x55a800136040 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a80013a5d0 con 0x55a800131b60 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 20 zone default found 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 4 Realm: () 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 20 zonegroup default 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a80013e510 con 0x7f25a803ac20 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.157+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800140750 con 0x55a80013b0c0 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.158+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.158+0000 7f25b3925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.158+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.158+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800140af0 con 0x55a80013b0c0 2024-09-07T03:34:21.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.158+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.158+0000 7f25b3925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.158+0000 7f25b3925800 20 started sync module instance, tier type = 2024-09-07T03:34:21.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.158+0000 7f25b3925800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:21.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.158+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a80013fb90 con 0x55a800136040 2024-09-07T03:34:21.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.159+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.159+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94180044177328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800140fa0 con 0x55a800136040 2024-09-07T03:34:21.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.159+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8001417f0 con 0x55a800131b60 2024-09-07T03:34:21.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.160+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94180044177328] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.161+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.161+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94180044180208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800141440 con 0x55a800131b60 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.161+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800141f60 con 0x55a800136040 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.162+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94180044180208] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.162+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.162+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94180044184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800141f20 con 0x55a800136040 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.162+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8001429e0 con 0x7f25a803ac20 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.163+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.163+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94180044186864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8001429e0 con 0x7f25a803ac20 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.163+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800143980 con 0x55a800136040 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.163+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94180044184112] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.164+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.164+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94180044190800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800143940 con 0x55a800136040 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.164+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800144390 con 0x55a80013b0c0 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.164+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94180044186864] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.165+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94180044190800] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.165+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.165+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94180044181264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800143ee0 con 0x55a80013b0c0 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.165+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800144c30 con 0x55a80013b0c0 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.166+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94180044181264] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.168+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.169+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94180044189136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800143ee0 con 0x55a80013b0c0 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.169+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800145350 con 0x7f25a803ac20 2024-09-07T03:34:21.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.169+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94180044189136] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.170+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.170+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94180044197376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800145310 con 0x7f25a803ac20 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.170+0000 7f25b3925800 20 add_watcher() i=0 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.170+0000 7f25b3925800 20 add_watcher() i=1 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.170+0000 7f25b3925800 20 add_watcher() i=2 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.170+0000 7f25b3925800 20 add_watcher() i=3 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.170+0000 7f25b3925800 20 add_watcher() i=4 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.170+0000 7f25b3925800 20 add_watcher() i=5 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.170+0000 7f25b3925800 20 add_watcher() i=6 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.171+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94180044197376] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.171+0000 7f25b3925800 20 add_watcher() i=7 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.171+0000 7f25b3925800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:21.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.171+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800148830 con 0x55a800131b60 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.171+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.171+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94180044195712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800145d50 con 0x55a800131b60 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.172+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94180044195712] v36'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.172+0000 7f2465fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.172+0000 7f25b3925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.172+0000 7f25b3925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.173+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800136040 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.174+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.174+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x7f25a803ac20 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.175+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.175+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a80013b0c0 2024-09-07T03:34:21.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.176+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.176+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800131b60 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.177+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'259 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.177+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800136040 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.178+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'86 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.178+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a80013b0c0 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.179+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'65 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.179+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800136040 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.180+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'39 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.180+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800131b60 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.181+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.181+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800136040 2024-09-07T03:34:21.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.182+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.182+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800136040 2024-09-07T03:34:21.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.183+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.183+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800136040 2024-09-07T03:34:21.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.184+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'87 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.184+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a80013b0c0 2024-09-07T03:34:21.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.185+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.185+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800136040 2024-09-07T03:34:21.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.186+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.186+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800151220 con 0x55a800131b60 2024-09-07T03:34:21.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.187+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'72 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.187+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152990 con 0x55a800131b60 2024-09-07T03:34:21.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.188+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'260 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.188+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152a20 con 0x55a800136040 2024-09-07T03:34:21.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.190+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.190+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152a20 con 0x55a800136040 2024-09-07T03:34:21.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.191+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'88 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.191+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152a20 con 0x55a80013b0c0 2024-09-07T03:34:21.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.192+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.192+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152a20 con 0x55a800136040 2024-09-07T03:34:21.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.193+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.193+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152990 con 0x55a800131b60 2024-09-07T03:34:21.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.194+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'261 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.194+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152990 con 0x55a800136040 2024-09-07T03:34:21.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.195+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'83 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.195+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152990 con 0x55a800136040 2024-09-07T03:34:21.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.196+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.196+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152b60 con 0x55a80013b0c0 2024-09-07T03:34:21.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.197+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.197+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152b60 con 0x55a800136040 2024-09-07T03:34:21.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.198+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'48 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.198+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152b60 con 0x55a80013b0c0 2024-09-07T03:34:21.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.199+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.199+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152b90 con 0x55a80013b0c0 2024-09-07T03:34:21.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.200+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'66 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.200+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152b60 con 0x55a80013b0c0 2024-09-07T03:34:21.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.202+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.202+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152b60 con 0x55a800136040 2024-09-07T03:34:21.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.202+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.202+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152b60 con 0x55a800131b60 2024-09-07T03:34:21.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.204+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.204+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800152b60 con 0x55a800136040 2024-09-07T03:34:21.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.205+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'84 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.205+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800150890 con 0x55a800131b60 2024-09-07T03:34:21.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.206+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'73 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.206+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800150890 con 0x7f25a803ac20 2024-09-07T03:34:21.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.207+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.207+0000 7f2464fe1640 20 reqs_thread_entry: start 2024-09-07T03:34:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.207+0000 7f25b3925800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.207+0000 7f25b3925800 20 Filter name: none 2024-09-07T03:34:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.207+0000 7f23de7fc640 20 reqs_thread_entry: start 2024-09-07T03:34:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.207+0000 7f25b3925800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-07T03:34:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.207+0000 7f25b3925800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.207+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a80017d740 con 0x55a800136040 2024-09-07T03:34:21.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.208+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.208+0000 7f25b3925800 20 rados_obj.operate() r=0 bl.length=363 2024-09-07T03:34:21.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.208+0000 7f25b3925800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-07T03:34:21.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.208+0000 7f25b3925800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-07T03:34:21.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.208+0000 7f25b3925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:21.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.208+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800180070 con 0x55a800136040 2024-09-07T03:34:21.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.208+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f25a8027070 con 0x55a800136040 2024-09-07T03:34:21.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.208+0000 7f25b3925800 10 removing key index: true_admin_akey 2024-09-07T03:34:21.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.208+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a80017e050 con 0x55a80013b0c0 2024-09-07T03:34:21.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.209+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(96 true_admin_akey [delete] v36'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.209+0000 7f25b3925800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-07T03:34:21.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.209+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94180044434352 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a800180670 con 0x55a80013b0c0 2024-09-07T03:34:21.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.210+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== watch-notify(notify (1) cookie 94180044181264 notify 154618822693 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55a80014a960 con 0x55a80013b0c0 2024-09-07T03:34:21.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.210+0000 7f2492ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822693 cookie 94180044181264 notifier 4862 bl.length()=165 2024-09-07T03:34:21.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.210+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(97 notify.5 [notify cookie 94180044434352 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.210+0000 7f2492ffd640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2474003d60 con 0x55a80013b0c0 2024-09-07T03:34:21.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.210+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.210+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== watch-notify(notify_complete (2) cookie 94180044434352 notify 154618822693 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f25a0095040 con 0x55a80013b0c0 2024-09-07T03:34:21.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.210+0000 7f25b3925800 10 removing email index: 2024-09-07T03:34:21.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.210+0000 7f25b3925800 10 removing user buckets index 2024-09-07T03:34:21.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.210+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a80017dba0 con 0x55a800136040 2024-09-07T03:34:21.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.211+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(99 a_user.buckets [delete] v36'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f25a806d040 con 0x55a800136040 2024-09-07T03:34:21.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.211+0000 7f25b3925800 10 removing user index: a_user 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.211+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8001825f0 con 0x55a800136040 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.212+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(100 a_user [call,call,delete] v36'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f25a806d040 con 0x55a800136040 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.212+0000 7f25b3925800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.212+0000 7f25b3925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.212+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94180044439744 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a80017f060 con 0x55a800136040 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.213+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== watch-notify(notify (1) cookie 94180044184112 notify 154618822696 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55a800151340 con 0x55a800136040 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.213+0000 7f2492ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822696 cookie 94180044184112 notifier 4862 bl.length()=155 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.213+0000 7f2492ffd640 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2474003d60 con 0x55a800136040 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.213+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(101 notify.2 [notify cookie 94180044439744 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f25a806d040 con 0x55a800136040 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.213+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a806d040 con 0x55a800136040 2024-09-07T03:34:21.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.213+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== watch-notify(notify_complete (2) cookie 94180044439744 notify 154618822696 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a800126850 con 0x55a800136040 2024-09-07T03:34:21.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.214+0000 7f2465fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.214+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94180044195712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a80012d820 con 0x55a800131b60 2024-09-07T03:34:21.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.215+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94180044195712] v36'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.215+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94180044177328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800144780 con 0x55a800136040 2024-09-07T03:34:21.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.216+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94180044177328] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a806d040 con 0x55a800136040 2024-09-07T03:34:21.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.216+0000 7f25b3925800 20 remove_watcher() i=0 2024-09-07T03:34:21.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.216+0000 7f25b3925800 2 removed watcher, disabling cache 2024-09-07T03:34:21.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.216+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94180044180208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a80013ffb0 con 0x55a800131b60 2024-09-07T03:34:21.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.217+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94180044180208] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2598028040 con 0x55a800131b60 2024-09-07T03:34:21.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.217+0000 7f25b3925800 20 remove_watcher() i=1 2024-09-07T03:34:21.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.217+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94180044184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800140af0 con 0x55a800136040 2024-09-07T03:34:21.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.218+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94180044184112] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a806d040 con 0x55a800136040 2024-09-07T03:34:21.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.218+0000 7f25b3925800 20 remove_watcher() i=2 2024-09-07T03:34:21.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.218+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94180044186864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800140af0 con 0x7f25a803ac20 2024-09-07T03:34:21.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.219+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94180044186864] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.219+0000 7f25b3925800 20 remove_watcher() i=3 2024-09-07T03:34:21.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.219+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94180044190800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800140af0 con 0x55a800136040 2024-09-07T03:34:21.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.220+0000 7f25afd34640 1 -- 172.21.15.120:0/3634248236 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94180044190800] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a806d040 con 0x55a800136040 2024-09-07T03:34:21.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.220+0000 7f25b3925800 20 remove_watcher() i=4 2024-09-07T03:34:21.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.220+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94180044181264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800143450 con 0x55a80013b0c0 2024-09-07T03:34:21.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.221+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94180044181264] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.221+0000 7f25b3925800 20 remove_watcher() i=5 2024-09-07T03:34:21.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.221+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94180044189136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800141a30 con 0x55a80013b0c0 2024-09-07T03:34:21.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.222+0000 7f25af533640 1 -- 172.21.15.120:0/3634248236 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94180044189136] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25a0051070 con 0x55a80013b0c0 2024-09-07T03:34:21.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.222+0000 7f25b3925800 20 remove_watcher() i=6 2024-09-07T03:34:21.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.222+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94180044197376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a800141a30 con 0x7f25a803ac20 2024-09-07T03:34:21.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94180044197376] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2598028040 con 0x7f25a803ac20 2024-09-07T03:34:21.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 20 remove_watcher() i=7 2024-09-07T03:34:21.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a800136040 msgr2=0x55a800138430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a800136040 0x55a800138430 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a800131b60 msgr2=0x55a800134020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a800131b60 0x55a800134020 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f25a803ac20 msgr2=0x7f25a8048020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f25a803ac20 0x7f25a8048020 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a80013b0c0 msgr2=0x55a80013d510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55a80013b0c0 0x55a80013d510 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247803c6e0 msgr2=0x7f247803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f247803c6e0 0x7f247803eba0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f25a0068fd0 tx=0x7f25a0088000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 msgr2=0x55a800126060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25a6d32640 1 -- 172.21.15.120:0/3634248236 reap_dead start 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a800126060 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f25a8017fd0 tx=0x7f25a8053d60 comp rx=0 tx=0).stop 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 shutdown_connections 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 --2- 172.21.15.120:0/3634248236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a80011ea30 0x55a800126060 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 >> 172.21.15.120:0/3634248236 conn(0x55a80011ae30 msgr2=0x55a800119040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 shutdown_connections 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.223+0000 7f25b3925800 1 -- 172.21.15.120:0/3634248236 wait complete. 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/441942447 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f248803c840 msgr2=0x7f248803ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/441942447 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f248803c840 0x7f248803ed00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55a800100480 tx=0x7f25a0045e60 comp rx=0 tx=0).stop 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/441942447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8000ed9a0 msgr2=0x55a8000ec210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/441942447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8000ed9a0 0x55a8000ec210 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f25a8016d20 tx=0x7f25a800d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/441942447 shutdown_connections 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/441942447 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f248803c840 0x7f248803ed00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/441942447 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a8000ed9a0 0x55a8000ec210 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/441942447 >> 172.21.15.120:0/441942447 conn(0x55a8001040b0 msgr2=0x55a800104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/441942447 shutdown_connections 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/441942447 wait complete. 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a8000fd390 msgr2=0x55a8000ff830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a8000fd390 0x55a8000ff830 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a7ffffdd30 msgr2=0x55a8000fc5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a7ffffdd30 0x55a8000fc5a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f249403c730 msgr2=0x7f249403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f249403c730 0x7f249403ebf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2598001d70 tx=0x7f25980012d0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 msgr2=0x55a8000f4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a8000f4f50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f25a0025c20 tx=0x7f25a0002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 shutdown_connections 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55a8000fd390 0x55a8000ff830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55a7ffffdd30 0x55a8000fc5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f249403c730 0x7f249403ebf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 --2- 172.21.15.120:0/2792333862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55a7ffffd300 0x55a8000f4f50 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 >> 172.21.15.120:0/2792333862 conn(0x55a7ffff7920 msgr2=0x55a8000e66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 shutdown_connections 2024-09-07T03:34:21.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.224+0000 7f25b3925800 1 -- 172.21.15.120:0/2792333862 wait complete. 2024-09-07T03:34:21.234 ERROR:root:None 2024-09-07T03:34:21.235 ERROR:root:0 2024-09-07T03:34:21.235 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-07T03:34:21.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-07T03:34:21.235 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-07T03:34:21.281 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:21.281 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:21.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a25f24800 1 Processor -- start 2024-09-07T03:34:21.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a25f24800 1 -- start start 2024-09-07T03:34:21.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a25f24800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cb9f595720 0x55cb9f597b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a25f24800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cb9f43ee40 con 0x55cb9f598050 2024-09-07T03:34:21.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a25f24800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55cb9f409680 con 0x55cb9f595720 2024-09-07T03:34:21.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a21b02640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55cb9f595720 0x55cb9f597b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a1bfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55cb9f598050 0x55cb9f59a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43916/0 (socket says 172.21.15.120:43916) 2024-09-07T03:34:21.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a1bfff640 1 -- 172.21.15.120:0/408057884 learned_addr learned my addr 172.21.15.120:0/408057884 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:21.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a21b02640 1 -- 172.21.15.120:0/408057884 >> v1:172.21.15.104:6789/0 conn(0x55cb9f598050 legacy=0x55cb9f59a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.281+0000 7f8a21b02640 1 -- 172.21.15.120:0/408057884 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9f4256b0 con 0x55cb9f595720 2024-09-07T03:34:21.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.283+0000 7f8a21b02640 1 --2- 172.21.15.120:0/408057884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f597b10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400a470 tx=0x7f8a14045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6323e27e8547e201 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.283+0000 7f8a21301640 1 -- 172.21.15.120:0/408057884 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a14053570 con 0x55cb9f595720 2024-09-07T03:34:21.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.283+0000 7f8a21301640 1 -- 172.21.15.120:0/408057884 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a14058070 con 0x55cb9f595720 2024-09-07T03:34:21.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.283+0000 7f8a21301640 1 -- 172.21.15.120:0/408057884 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a14053880 con 0x55cb9f595720 2024-09-07T03:34:21.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.284+0000 7f8a25f24800 1 -- 172.21.15.120:0/408057884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 msgr2=0x55cb9f597b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.284+0000 7f8a25f24800 1 --2- 172.21.15.120:0/408057884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f597b10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400a470 tx=0x7f8a14045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.284+0000 7f8a25f24800 1 -- 172.21.15.120:0/408057884 shutdown_connections 2024-09-07T03:34:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.284+0000 7f8a25f24800 1 --2- 172.21.15.120:0/408057884 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f597b10 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.284+0000 7f8a25f24800 1 -- 172.21.15.120:0/408057884 >> 172.21.15.120:0/408057884 conn(0x55cb9f58f1c0 msgr2=0x55cb9f591620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.284+0000 7f8a25f24800 1 -- 172.21.15.120:0/408057884 shutdown_connections 2024-09-07T03:34:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.284+0000 7f8a25f24800 1 -- 172.21.15.120:0/408057884 wait complete. 2024-09-07T03:34:21.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.298+0000 7f8a25f24800 1 Processor -- start 2024-09-07T03:34:21.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.298+0000 7f8a25f24800 1 -- start start 2024-09-07T03:34:21.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.298+0000 7f8a25f24800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f594eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.298+0000 7f8a25f24800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f42ddd0 con 0x55cb9f595720 2024-09-07T03:34:21.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.298+0000 7f8a21b02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f594eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.298+0000 7f8a21b02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f594eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40484/0 (socket says 172.21.15.120:40484) 2024-09-07T03:34:21.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.298+0000 7f8a21b02640 1 -- 172.21.15.120:0/2652707181 learned_addr learned my addr 172.21.15.120:0/2652707181 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.298+0000 7f8a21b02640 1 -- 172.21.15.120:0/2652707181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9f446e10 con 0x55cb9f595720 2024-09-07T03:34:21.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.299+0000 7f8a21b02640 1 --2- 172.21.15.120:0/2652707181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f594eb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8a14025c20 tx=0x7f8a14051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a5f7747b9b712a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.299+0000 7f890fe07640 1 -- 172.21.15.120:0/2652707181 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a14053a20 con 0x55cb9f595720 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.299+0000 7f890fe07640 1 -- 172.21.15.120:0/2652707181 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a14063070 con 0x55cb9f595720 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.299+0000 7f890fe07640 1 -- 172.21.15.120:0/2652707181 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a14053cf0 con 0x55cb9f595720 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.299+0000 7f8a25f24800 1 -- 172.21.15.120:0/2652707181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 msgr2=0x55cb9f594eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.299+0000 7f8a25f24800 1 --2- 172.21.15.120:0/2652707181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f594eb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8a14025c20 tx=0x7f8a14051000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.299+0000 7f8a25f24800 1 -- 172.21.15.120:0/2652707181 shutdown_connections 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.299+0000 7f8a25f24800 1 --2- 172.21.15.120:0/2652707181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f594eb0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a25f24800 1 -- 172.21.15.120:0/2652707181 >> 172.21.15.120:0/2652707181 conn(0x55cb9f58f1c0 msgr2=0x55cb9f680080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a25f24800 1 -- 172.21.15.120:0/2652707181 shutdown_connections 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a25f24800 1 -- 172.21.15.120:0/2652707181 wait complete. 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a25f24800 1 Processor -- start 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a25f24800 1 -- start start 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a25f24800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f68e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a25f24800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f59c040 con 0x55cb9f595720 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a21b02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f68e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a21b02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f68e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40490/0 (socket says 172.21.15.120:40490) 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.300+0000 7f8a21b02640 1 -- 172.21.15.120:0/212382207 learned_addr learned my addr 172.21.15.120:0/212382207 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.301+0000 7f8a21b02640 1 -- 172.21.15.120:0/212382207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9f68e6a0 con 0x55cb9f595720 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.301+0000 7f8a21b02640 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f68e140 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8a14025c20 tx=0x7f8a14002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.301+0000 7f890e604640 1 -- 172.21.15.120:0/212382207 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a1406c030 con 0x55cb9f595720 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.301+0000 7f890e604640 1 -- 172.21.15.120:0/212382207 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a14068660 con 0x55cb9f595720 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.301+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb9f68e930 con 0x55cb9f595720 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.301+0000 7f890e604640 1 -- 172.21.15.120:0/212382207 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a14068940 con 0x55cb9f595720 2024-09-07T03:34:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.301+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9f68f330 con 0x55cb9f595720 2024-09-07T03:34:21.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.302+0000 7f890e604640 1 -- 172.21.15.120:0/212382207 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8a14068ae0 con 0x55cb9f595720 2024-09-07T03:34:21.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.302+0000 7f890e604640 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f890803c730 0x7f890803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.302+0000 7f890e604640 1 -- 172.21.15.120:0/212382207 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f8a14098000 con 0x55cb9f595720 2024-09-07T03:34:21.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.302+0000 7f8a1bfff640 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f890803c730 0x7f890803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.302+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f598050 0x55cb9f695790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.302+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f695cd0 con 0x55cb9f598050 2024-09-07T03:34:21.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.302+0000 7f8a22303640 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f598050 0x55cb9f695790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.302+0000 7f8a1bfff640 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f890803c730 0x7f890803ebf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c001d70 tx=0x7f8a0c0012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.303+0000 7f8a22303640 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f598050 0x55cb9f695790 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.303+0000 7f8a22303640 1 -- 172.21.15.120:0/212382207 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a1c00a4d0 con 0x55cb9f598050 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.303+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f696580 0x55cb9f698a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.303+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6991b0 con 0x55cb9f696580 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.303+0000 7f8a21b02640 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f696580 0x55cb9f698a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.303+0000 7f8a21b02640 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f696580 0x55cb9f698a40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.304+0000 7f8a21b02640 1 -- 172.21.15.120:0/212382207 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f696580 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.304+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f69aa60 con 0x55cb9f696580 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.304+0000 7f8a21b02640 1 -- 172.21.15.120:0/212382207 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f696580 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.304+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f699ba0 con 0x55cb9f696580 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.304+0000 7f8a21b02640 1 -- 172.21.15.120:0/212382207 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f696580 2024-09-07T03:34:21.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.304+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f69a000 con 0x55cb9f598050 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.304+0000 7f8a22303640 1 -- 172.21.15.120:0/212382207 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a1c00a4d0 con 0x55cb9f598050 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.305+0000 7f8a25f24800 1 Processor -- start 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.305+0000 7f8a25f24800 1 -- start start 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.305+0000 7f8a25f24800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6a8f50 0x55cb9f6a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.305+0000 7f8a25f24800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f48ba00 con 0x55cb9f6a8f50 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.305+0000 7f8a22303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6a8f50 0x55cb9f6a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.305+0000 7f8a22303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6a8f50 0x55cb9f6a9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40504/0 (socket says 172.21.15.120:40504) 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.305+0000 7f8a22303640 1 -- 172.21.15.120:0/891410392 learned_addr learned my addr 172.21.15.120:0/891410392 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.305+0000 7f8a22303640 1 -- 172.21.15.120:0/891410392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9f6a99b0 con 0x55cb9f6a8f50 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.306+0000 7f8a22303640 1 --2- 172.21.15.120:0/891410392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6a8f50 0x55cb9f6a9370 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c016d20 tx=0x7f8a1c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.306+0000 7f89077fe640 1 -- 172.21.15.120:0/891410392 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a1c017660 con 0x55cb9f6a8f50 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.306+0000 7f89077fe640 1 -- 172.21.15.120:0/891410392 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c01b030 con 0x55cb9f6a8f50 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.306+0000 7f8a25f24800 1 -- 172.21.15.120:0/891410392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb9f6aa1e0 con 0x55cb9f6a8f50 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.306+0000 7f89077fe640 1 -- 172.21.15.120:0/891410392 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a1c017950 con 0x55cb9f6a8f50 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.306+0000 7f8a25f24800 1 -- 172.21.15.120:0/891410392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9f6aa780 con 0x55cb9f6a8f50 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.306+0000 7f89077fe640 1 -- 172.21.15.120:0/891410392 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8a1c017af0 con 0x55cb9f6a8f50 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.307+0000 7f89077fe640 1 --2- 172.21.15.120:0/891410392 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88fc03c780 0x7f88fc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.307+0000 7f89077fe640 1 -- 172.21.15.120:0/891410392 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f8a1c00e040 con 0x55cb9f6a8f50 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.307+0000 7f8a21b02640 1 --2- 172.21.15.120:0/891410392 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88fc03c780 0x7f88fc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.307+0000 7f8a25f24800 1 Processor -- start 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.307+0000 7f8a25f24800 1 -- start start 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.307+0000 7f8a21b02640 1 --2- 172.21.15.120:0/891410392 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88fc03c780 0x7f88fc03ec40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55cb9f68f890 tx=0x7f8a14081040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.307+0000 7f8a25f24800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.307+0000 7f8a25f24800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f593750 con 0x55cb9f6b5a10 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.307+0000 7f8a22303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f8a22303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40518/0 (socket says 172.21.15.120:40518) 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f8a22303640 1 -- 172.21.15.120:0/4126451972 learned_addr learned my addr 172.21.15.120:0/4126451972 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f8a22303640 1 -- 172.21.15.120:0/4126451972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9f6b63e0 con 0x55cb9f6b5a10 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f8a22303640 1 --2- 172.21.15.120:0/4126451972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6b5df0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c017f20 tx=0x7f8a1c028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad2b6dcf47f536b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f89057fa640 1 -- 172.21.15.120:0/4126451972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a1c0149b0 con 0x55cb9f6b5a10 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f89057fa640 1 -- 172.21.15.120:0/4126451972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c028350 con 0x55cb9f6b5a10 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f89057fa640 1 -- 172.21.15.120:0/4126451972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a1c014b50 con 0x55cb9f6b5a10 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f8a25f24800 1 -- 172.21.15.120:0/4126451972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 msgr2=0x55cb9f6b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f8a25f24800 1 --2- 172.21.15.120:0/4126451972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6b5df0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c017f20 tx=0x7f8a1c028e80 comp rx=0 tx=0).stop 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f8a25f24800 1 -- 172.21.15.120:0/4126451972 shutdown_connections 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f8a25f24800 1 --2- 172.21.15.120:0/4126451972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6b5df0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.308+0000 7f8a25f24800 1 -- 172.21.15.120:0/4126451972 >> 172.21.15.120:0/4126451972 conn(0x55cb9f6b1e10 msgr2=0x55cb9f6b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.309+0000 7f8a25f24800 1 -- 172.21.15.120:0/4126451972 shutdown_connections 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.309+0000 7f8a25f24800 1 -- 172.21.15.120:0/4126451972 wait complete. 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.309+0000 7f8a25f24800 1 Processor -- start 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.309+0000 7f8a25f24800 1 -- start start 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.309+0000 7f8a25f24800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.309+0000 7f8a25f24800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f6b6a20 con 0x55cb9f6b5a10 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.309+0000 7f8a22303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.309+0000 7f8a22303640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6bcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40534/0 (socket says 172.21.15.120:40534) 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.309+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 learned_addr learned my addr 172.21.15.120:0/1724362679 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.310+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9f6bd550 con 0x55cb9f6b5a10 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.310+0000 7f8a22303640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6bcff0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c017f20 tx=0x7f8a1c053d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.310+0000 7f88f37fe640 1 -- 172.21.15.120:0/1724362679 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a1c04c070 con 0x55cb9f6b5a10 2024-09-07T03:34:21.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.310+0000 7f88f37fe640 1 -- 172.21.15.120:0/1724362679 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0129b0 con 0x55cb9f6b5a10 2024-09-07T03:34:21.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.310+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb9f6bd7e0 con 0x55cb9f6b5a10 2024-09-07T03:34:21.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.310+0000 7f88f37fe640 1 -- 172.21.15.120:0/1724362679 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a1c012c90 con 0x55cb9f6b5a10 2024-09-07T03:34:21.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.310+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9f6be160 con 0x55cb9f6b5a10 2024-09-07T03:34:21.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.311+0000 7f88f37fe640 1 -- 172.21.15.120:0/1724362679 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8a1c0135c0 con 0x55cb9f6b5a10 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.311+0000 7f88f37fe640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88ec03c730 0x7f88ec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.311+0000 7f88f37fe640 1 -- 172.21.15.120:0/1724362679 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f8a1c03bc00 con 0x55cb9f6b5a10 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.311+0000 7f8a21b02640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88ec03c730 0x7f88ec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.311+0000 7f8a21b02640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88ec03c730 0x7f88ec03ebf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8a14053ca0 tx=0x7f8a14083000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.311+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.311+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f6c8b40 0x55cb9f6cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.311+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6cb750 con 0x55cb9f6c8b40 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a1bfff640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f6c8b40 0x55cb9f6cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a1bfff640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f6c8b40 0x55cb9f6cb000 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0c009050 con 0x55cb9f6c8b40 2024-09-07T03:34:21.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a25f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a25f24800 20 realm 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6c7e90 con 0x55cb9f6c8b40 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0c009050 con 0x55cb9f6c8b40 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a25f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a25f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.312+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6cc240 con 0x55cb9f6c8b40 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0c009050 con 0x55cb9f6c8b40 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a25f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f6cd020 0x55cb9f6cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6cfae0 con 0x55cb9f6cd020 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a22303640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f6cd020 0x55cb9f6cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a22303640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f6cd020 0x55cb9f6cf410 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a25f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.313+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d0330 con 0x55cb9f6cd020 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.314+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.314+0000 7f8a25f24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.314+0000 7f8a25f24800 20 searching for the correct realm 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.314+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cb9f6d20a0 0x55cb9f6d44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.314+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.314+0000 7f8a21b02640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cb9f6d20a0 0x55cb9f6d44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.314+0000 7f8a21b02640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cb9f6d20a0 0x55cb9f6d44d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.314+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.314+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.315+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.315+0000 7f8a22303640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8a1c014440 0x7f8a1c0138b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.315+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x7f8a1c014440 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.315+0000 7f8a1bfff640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8a1c014440 0x7f8a1c0138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.315+0000 7f8a1bfff640 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8a1c014440 0x7f8a1c0138b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.315+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c009050 con 0x7f8a1c014440 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.315+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.315+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c009050 con 0x55cb9f6c8b40 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.315+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.316+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.316+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.316+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.316+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.316+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.316+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.316+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.316+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.317+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.317+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.317+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.317+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x7f8a1c014440 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.317+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.317+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.317+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.317+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x7f8a1c014440 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.318+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.318+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.318+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.318+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.318+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.318+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.318+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.318+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.319+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.320+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.320+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x7f8a1c014440 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.320+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.320+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x7f8a1c014440 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.320+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.320+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x7f8a1c014440 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.320+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.320+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.321+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.321+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x7f8a1c014440 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.321+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.321+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.321+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.321+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.321+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.321+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d4ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a25f24800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a25f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a25f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a25f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a25f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:21.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a25f24800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.322+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d0cb0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d08f0 con 0x55cb9f6cd020 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d10f0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 zone default found 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 4 Realm: () 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 zonegroup default 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d54d0 con 0x7f8a1c014440 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.323+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d7710 con 0x55cb9f6d20a0 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a25f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d7ab0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a25f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a25f24800 20 started sync module instance, tier type = 2024-09-07T03:34:21.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a25f24800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.324+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d6ba0 con 0x55cb9f6cd020 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.325+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.325+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94333041471376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d8350 con 0x55cb9f6cd020 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.325+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d8ba0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.326+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94333041471376] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.327+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.327+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94333041475232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d8890 con 0x55cb9f6c8b40 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.327+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d93b0 con 0x55cb9f6cd020 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.327+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94333041475232] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.328+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.328+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94333041479296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d9370 con 0x55cb9f6cd020 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.328+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d9e30 con 0x7f8a1c014440 2024-09-07T03:34:21.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.329+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94333041479296] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.329+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.329+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94333041482048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6d9e30 con 0x7f8a1c014440 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.329+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6da880 con 0x55cb9f6cd020 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.330+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94333041482048] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.330+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.330+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94333041484656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6da840 con 0x55cb9f6cd020 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.330+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6db2b0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.331+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94333041484656] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.331+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.331+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94333041487328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6db2b0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.331+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6dbcd0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.332+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94333041487328] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.332+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.332+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94333041489856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6dbc90 con 0x55cb9f6d20a0 2024-09-07T03:34:21.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.332+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6dc7d0 con 0x7f8a1c014440 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.333+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94333041489856] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94333041476352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6dc7d0 con 0x7f8a1c014440 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 20 add_watcher() i=0 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 20 add_watcher() i=1 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 20 add_watcher() i=2 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 20 add_watcher() i=3 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 20 add_watcher() i=4 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 20 add_watcher() i=5 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 20 add_watcher() i=6 2024-09-07T03:34:21.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94333041476352] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 20 add_watcher() i=7 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.334+0000 7f8a25f24800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.335+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6dfce0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.335+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.335+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94333041492656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f6dd230 con 0x55cb9f6c8b40 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.336+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94333041492656] v36'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.336+0000 7f88d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.336+0000 7f8a25f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.336+0000 7f8a25f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.336+0000 7f8a25f24800 5 note: GC not initialized 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f88d2ffd640 20 reqs_thread_entry: start 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:21.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 20 Filter name: none 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f88d0ff9640 20 reqs_thread_entry: start 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f712d40 con 0x55cb9f6c8b40 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 20 rados_obj.operate() r=0 bl.length=460 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.337+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f719180 con 0x55cb9f6c8b40 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f8a25f24800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f8a25f24800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f8a25f24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94333041740672 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f714820 con 0x55cb9f6cd020 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94333041484656 notify 154618822697 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55cb9f6be160 con 0x55cb9f6cd020 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f89057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822697 cookie 94333041484656 notifier 4869 bl.length()=666 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f89057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f89057fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94333041740672 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f89057fa640 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f88e4003ea0 con 0x55cb9f6cd020 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.339+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94333041740672 notify 154618822697 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb9f6bd7e0 con 0x55cb9f6cd020 2024-09-07T03:34:21.356 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:21.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.340+0000 7f88d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.340+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94333041492656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f710bb0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.341+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94333041492656] v36'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.341+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94333041471376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f710bb0 con 0x55cb9f6cd020 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.342+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94333041471376] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.342+0000 7f8a25f24800 20 remove_watcher() i=0 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.342+0000 7f8a25f24800 2 removed watcher, disabling cache 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.342+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94333041475232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f710bb0 con 0x55cb9f6c8b40 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.343+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94333041475232] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x55cb9f6c8b40 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.343+0000 7f8a25f24800 20 remove_watcher() i=1 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.343+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94333041479296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f710bb0 con 0x55cb9f6cd020 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.344+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94333041479296] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.344+0000 7f8a25f24800 20 remove_watcher() i=2 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.344+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94333041482048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f710bb0 con 0x7f8a1c014440 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.345+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94333041482048] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.345+0000 7f8a25f24800 20 remove_watcher() i=3 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.345+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94333041484656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f710bb0 con 0x55cb9f6cd020 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.346+0000 7f8a22303640 1 -- 172.21.15.120:0/1724362679 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94333041484656] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a1c027070 con 0x55cb9f6cd020 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.346+0000 7f8a25f24800 20 remove_watcher() i=4 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.346+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94333041487328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f710bb0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.347+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94333041487328] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.347+0000 7f8a25f24800 20 remove_watcher() i=5 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.347+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94333041489856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f710bb0 con 0x55cb9f6d20a0 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.348+0000 7f8a21b02640 1 -- 172.21.15.120:0/1724362679 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94333041489856] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a14051070 con 0x55cb9f6d20a0 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.348+0000 7f8a25f24800 20 remove_watcher() i=6 2024-09-07T03:34:21.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.348+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94333041476352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55cb9f710bb0 con 0x7f8a1c014440 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94333041476352] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0c028040 con 0x7f8a1c014440 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a25f24800 20 remove_watcher() i=7 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f6cd020 msgr2=0x55cb9f6cf410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f6cd020 0x55cb9f6cf410 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f6c8b40 msgr2=0x55cb9f6cb000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f6c8b40 0x55cb9f6cb000 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8a1c014440 msgr2=0x7f8a1c0138b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8a1c014440 0x7f8a1c0138b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cb9f6d20a0 msgr2=0x55cb9f6d44d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.349+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55cb9f6d20a0 0x55cb9f6d44d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88ec03c730 msgr2=0x7f88ec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88ec03c730 0x7f88ec03ebf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8a14053ca0 tx=0x7f8a14083000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 msgr2=0x55cb9f6bcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a1bfff640 1 -- 172.21.15.120:0/1724362679 reap_dead start 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6bcff0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c017f20 tx=0x7f8a1c053d40 comp rx=0 tx=0).stop 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 shutdown_connections 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 --2- 172.21.15.120:0/1724362679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6b5a10 0x55cb9f6bcff0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 >> 172.21.15.120:0/1724362679 conn(0x55cb9f6b1e10 msgr2=0x55cb9f6b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 shutdown_connections 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/1724362679 wait complete. 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/891410392 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88fc03c780 msgr2=0x7f88fc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 --2- 172.21.15.120:0/891410392 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88fc03c780 0x7f88fc03ec40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55cb9f68f890 tx=0x7f8a14081040 comp rx=0 tx=0).stop 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/891410392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6a8f50 msgr2=0x55cb9f6a9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 --2- 172.21.15.120:0/891410392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6a8f50 0x55cb9f6a9370 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c016d20 tx=0x7f8a1c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/891410392 shutdown_connections 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 --2- 172.21.15.120:0/891410392 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f88fc03c780 0x7f88fc03ec40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 --2- 172.21.15.120:0/891410392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f6a8f50 0x55cb9f6a9370 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/891410392 >> 172.21.15.120:0/891410392 conn(0x55cb9f69d300 msgr2=0x55cb9f69d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/891410392 shutdown_connections 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/891410392 wait complete. 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f696580 msgr2=0x55cb9f698a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f696580 0x55cb9f698a40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f598050 msgr2=0x55cb9f695790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.350+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f598050 0x55cb9f695790 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f890803c730 msgr2=0x7f890803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f890803c730 0x7f890803ebf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c001d70 tx=0x7f8a0c0012d0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 msgr2=0x55cb9f68e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f68e140 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8a14025c20 tx=0x7f8a14002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 shutdown_connections 2024-09-07T03:34:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55cb9f696580 0x55cb9f698a40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55cb9f598050 0x55cb9f695790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f890803c730 0x7f890803ebf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 --2- 172.21.15.120:0/212382207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55cb9f595720 0x55cb9f68e140 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 >> 172.21.15.120:0/212382207 conn(0x55cb9f58f1c0 msgr2=0x55cb9f67fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 shutdown_connections 2024-09-07T03:34:21.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.351+0000 7f8a25f24800 1 -- 172.21.15.120:0/212382207 wait complete. 2024-09-07T03:34:21.367 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.368 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.368 ERROR:root:0 2024-09-07T03:34:21.368 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:21.380 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:21.381 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-07T03:34:21.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-07T03:34:21.381 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-07T03:34:21.427 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:21.428 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:21.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.427+0000 7f460760f800 1 Processor -- start 2024-09-07T03:34:21.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.427+0000 7f460760f800 1 -- start start 2024-09-07T03:34:21.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.427+0000 7f460760f800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563964d0ffd0 0x563964d18af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.427+0000 7f460760f800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563964bb9e40 con 0x563964d0e4b0 2024-09-07T03:34:21.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.427+0000 7f460760f800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x563964b84680 con 0x563964d0ffd0 2024-09-07T03:34:21.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.428+0000 7f46048f8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563964d0ffd0 0x563964d18af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.428+0000 7f46050f9640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x563964d0e4b0 0x563964d0e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43924/0 (socket says 172.21.15.120:43924) 2024-09-07T03:34:21.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.428+0000 7f46050f9640 1 -- 172.21.15.120:0/1135482268 learned_addr learned my addr 172.21.15.120:0/1135482268 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:21.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.428+0000 7f46048f8640 1 -- 172.21.15.120:0/1135482268 >> v1:172.21.15.104:6789/0 conn(0x563964d0e4b0 legacy=0x563964d0e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.428+0000 7f46048f8640 1 -- 172.21.15.120:0/1135482268 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563964ba06b0 con 0x563964d0ffd0 2024-09-07T03:34:21.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f46048f8640 1 --2- 172.21.15.120:0/1135482268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0ffd0 0x563964d18af0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f45f000a470 tx=0x7f45f0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ca040c4c7a06b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f45fffff640 1 -- 172.21.15.120:0/1135482268 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f0053570 con 0x563964d0ffd0 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f45fffff640 1 -- 172.21.15.120:0/1135482268 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f0058070 con 0x563964d0ffd0 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f45fffff640 1 -- 172.21.15.120:0/1135482268 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f0053880 con 0x563964d0ffd0 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f460760f800 1 -- 172.21.15.120:0/1135482268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0ffd0 msgr2=0x563964d18af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f460760f800 1 --2- 172.21.15.120:0/1135482268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0ffd0 0x563964d18af0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f45f000a470 tx=0x7f45f0045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f460760f800 1 -- 172.21.15.120:0/1135482268 shutdown_connections 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f460760f800 1 --2- 172.21.15.120:0/1135482268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0ffd0 0x563964d18af0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f460760f800 1 -- 172.21.15.120:0/1135482268 >> 172.21.15.120:0/1135482268 conn(0x563964d0a200 msgr2=0x563964d0c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f460760f800 1 -- 172.21.15.120:0/1135482268 shutdown_connections 2024-09-07T03:34:21.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.430+0000 7f460760f800 1 -- 172.21.15.120:0/1135482268 wait complete. 2024-09-07T03:34:21.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.444+0000 7f460760f800 1 Processor -- start 2024-09-07T03:34:21.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.444+0000 7f460760f800 1 -- start start 2024-09-07T03:34:21.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.444+0000 7f460760f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e01870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.444+0000 7f460760f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563964ba8dd0 con 0x563964d0e4b0 2024-09-07T03:34:21.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.445+0000 7f46050f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e01870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.445+0000 7f46050f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e01870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40552/0 (socket says 172.21.15.120:40552) 2024-09-07T03:34:21.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.445+0000 7f46050f9640 1 -- 172.21.15.120:0/4267758427 learned_addr learned my addr 172.21.15.120:0/4267758427 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.445+0000 7f46050f9640 1 -- 172.21.15.120:0/4267758427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563964bc1e10 con 0x563964d0e4b0 2024-09-07T03:34:21.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.445+0000 7f46050f9640 1 --2- 172.21.15.120:0/4267758427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e01870 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4600001800 tx=0x7f4600001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2f25b725f0edd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.445+0000 7f44f3606640 1 -- 172.21.15.120:0/4267758427 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4600004520 con 0x563964d0e4b0 2024-09-07T03:34:21.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.445+0000 7f44f3606640 1 -- 172.21.15.120:0/4267758427 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46000046c0 con 0x563964d0e4b0 2024-09-07T03:34:21.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.445+0000 7f44f3606640 1 -- 172.21.15.120:0/4267758427 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46000049e0 con 0x563964d0e4b0 2024-09-07T03:34:21.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.446+0000 7f460760f800 1 -- 172.21.15.120:0/4267758427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 msgr2=0x563964e01870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.446+0000 7f460760f800 1 --2- 172.21.15.120:0/4267758427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e01870 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4600001800 tx=0x7f4600001cc0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.446+0000 7f460760f800 1 -- 172.21.15.120:0/4267758427 shutdown_connections 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.446+0000 7f460760f800 1 --2- 172.21.15.120:0/4267758427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e01870 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.446+0000 7f460760f800 1 -- 172.21.15.120:0/4267758427 >> 172.21.15.120:0/4267758427 conn(0x563964d0a200 msgr2=0x563964dfd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.446+0000 7f460760f800 1 -- 172.21.15.120:0/4267758427 shutdown_connections 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.446+0000 7f460760f800 1 -- 172.21.15.120:0/4267758427 wait complete. 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.446+0000 7f460760f800 1 Processor -- start 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.446+0000 7f460760f800 1 -- start start 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.447+0000 7f460760f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e09200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.447+0000 7f460760f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563964d19300 con 0x563964d0e4b0 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.447+0000 7f46050f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e09200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.447+0000 7f46050f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e09200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40554/0 (socket says 172.21.15.120:40554) 2024-09-07T03:34:21.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.447+0000 7f46050f9640 1 -- 172.21.15.120:0/3214768327 learned_addr learned my addr 172.21.15.120:0/3214768327 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.447+0000 7f46050f9640 1 -- 172.21.15.120:0/3214768327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563964e09760 con 0x563964d0e4b0 2024-09-07T03:34:21.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.447+0000 7f46050f9640 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e09200 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4600000f80 tx=0x7f4600001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.447+0000 7f44f1e03640 1 -- 172.21.15.120:0/3214768327 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4600022020 con 0x563964d0e4b0 2024-09-07T03:34:21.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.448+0000 7f44f1e03640 1 -- 172.21.15.120:0/3214768327 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4600014890 con 0x563964d0e4b0 2024-09-07T03:34:21.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.448+0000 7f44f1e03640 1 -- 172.21.15.120:0/3214768327 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4600014bb0 con 0x563964d0e4b0 2024-09-07T03:34:21.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.448+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563964e099f0 con 0x563964d0e4b0 2024-09-07T03:34:21.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.448+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563964e0a3f0 con 0x563964d0e4b0 2024-09-07T03:34:21.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.448+0000 7f44f1e03640 1 -- 172.21.15.120:0/3214768327 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4600025020 con 0x563964d0e4b0 2024-09-07T03:34:21.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.449+0000 7f44f1e03640 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44ec03c730 0x7f44ec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.449+0000 7f44f1e03640 1 -- 172.21.15.120:0/3214768327 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f4600018030 con 0x563964d0e4b0 2024-09-07T03:34:21.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.449+0000 7f46048f8640 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44ec03c730 0x7f44ec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.449+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964d0ffd0 0x563964e10850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.449+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e10d90 con 0x563964d0ffd0 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.449+0000 7f46058fa640 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964d0ffd0 0x563964e10850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.449+0000 7f46048f8640 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44ec03c730 0x7f44ec03ebf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f45f0057000 tx=0x7f45f0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.449+0000 7f46058fa640 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964d0ffd0 0x563964e10850 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.450+0000 7f46058fa640 1 -- 172.21.15.120:0/3214768327 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964d0ffd0 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.450+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e11640 0x563964e13b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.450+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e14270 con 0x563964e11640 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.450+0000 7f46050f9640 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e11640 0x563964e13b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.450+0000 7f46050f9640 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e11640 0x563964e13b00 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.450+0000 7f46050f9640 1 -- 172.21.15.120:0/3214768327 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4600046040 con 0x563964e11640 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.450+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e15b20 con 0x563964e11640 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.451+0000 7f46050f9640 1 -- 172.21.15.120:0/3214768327 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4600046040 con 0x563964e11640 2024-09-07T03:34:21.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.451+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e14c90 con 0x563964e11640 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.451+0000 7f46050f9640 1 -- 172.21.15.120:0/3214768327 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4600046040 con 0x563964e11640 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.451+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e150b0 con 0x563964d0ffd0 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.451+0000 7f46058fa640 1 -- 172.21.15.120:0/3214768327 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f45f80083e0 con 0x563964d0ffd0 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.452+0000 7f460760f800 1 Processor -- start 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.452+0000 7f460760f800 1 -- start start 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.452+0000 7f460760f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e23fe0 0x563964e24400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.452+0000 7f460760f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563964c06a00 con 0x563964e23fe0 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.452+0000 7f46058fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e23fe0 0x563964e24400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.452+0000 7f46058fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e23fe0 0x563964e24400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40566/0 (socket says 172.21.15.120:40566) 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.452+0000 7f46058fa640 1 -- 172.21.15.120:0/2515010664 learned_addr learned my addr 172.21.15.120:0/2515010664 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.452+0000 7f46058fa640 1 -- 172.21.15.120:0/2515010664 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563964e24a40 con 0x563964e23fe0 2024-09-07T03:34:21.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.453+0000 7f46058fa640 1 --2- 172.21.15.120:0/2515010664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e23fe0 0x563964e24400 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f45f800aa90 tx=0x7f45f800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.453+0000 7f44eaffd640 1 -- 172.21.15.120:0/2515010664 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f8007d70 con 0x563964e23fe0 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.453+0000 7f44eaffd640 1 -- 172.21.15.120:0/2515010664 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8018430 con 0x563964e23fe0 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.453+0000 7f44eaffd640 1 -- 172.21.15.120:0/2515010664 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f8018750 con 0x563964e23fe0 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.453+0000 7f460760f800 1 -- 172.21.15.120:0/2515010664 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563964e25270 con 0x563964e23fe0 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.453+0000 7f460760f800 1 -- 172.21.15.120:0/2515010664 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563964e25810 con 0x563964e23fe0 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f44eaffd640 1 -- 172.21.15.120:0/2515010664 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f45f8020020 con 0x563964e23fe0 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f44eaffd640 1 --2- 172.21.15.120:0/2515010664 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44e003c780 0x7f44e003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f44eaffd640 1 -- 172.21.15.120:0/2515010664 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f45f801e020 con 0x563964e23fe0 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f46050f9640 1 --2- 172.21.15.120:0/2515010664 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44e003c780 0x7f44e003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f460760f800 1 Processor -- start 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f460760f800 1 -- start start 2024-09-07T03:34:21.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f46050f9640 1 --2- 172.21.15.120:0/2515010664 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44e003c780 0x7f44e003ec40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x563964e0a910 tx=0x7f4600051ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f460760f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e30f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f460760f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563964e020c0 con 0x563964e30b00 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f46058fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e30f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f46058fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e30f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40574/0 (socket says 172.21.15.120:40574) 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.454+0000 7f46058fa640 1 -- 172.21.15.120:0/3927422231 learned_addr learned my addr 172.21.15.120:0/3927422231 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f46058fa640 1 -- 172.21.15.120:0/3927422231 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563964e314f0 con 0x563964e30b00 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f46058fa640 1 --2- 172.21.15.120:0/3927422231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e30f00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f45f80531c0 tx=0x7f45f80206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2069047a9ba69f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f44e8ff9640 1 -- 172.21.15.120:0/3927422231 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f804a070 con 0x563964e30b00 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f44e8ff9640 1 -- 172.21.15.120:0/3927422231 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8020b70 con 0x563964e30b00 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f44e8ff9640 1 -- 172.21.15.120:0/3927422231 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f8022410 con 0x563964e30b00 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f460760f800 1 -- 172.21.15.120:0/3927422231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 msgr2=0x563964e30f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f460760f800 1 --2- 172.21.15.120:0/3927422231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e30f00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f45f80531c0 tx=0x7f45f80206e0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f460760f800 1 -- 172.21.15.120:0/3927422231 shutdown_connections 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f460760f800 1 --2- 172.21.15.120:0/3927422231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e30f00 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f460760f800 1 -- 172.21.15.120:0/3927422231 >> 172.21.15.120:0/3927422231 conn(0x563964e2cf00 msgr2=0x563964e2b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f460760f800 1 -- 172.21.15.120:0/3927422231 shutdown_connections 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.455+0000 7f460760f800 1 -- 172.21.15.120:0/3927422231 wait complete. 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.456+0000 7f460760f800 1 Processor -- start 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.456+0000 7f460760f800 1 -- start start 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.456+0000 7f460760f800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e38140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.456+0000 7f460760f800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563964e31b10 con 0x563964e30b00 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.456+0000 7f46058fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e38140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.456+0000 7f46058fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e38140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40584/0 (socket says 172.21.15.120:40584) 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.456+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 learned_addr learned my addr 172.21.15.120:0/2016557309 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.456+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563964e386a0 con 0x563964e30b00 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.456+0000 7f46058fa640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e38140 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f45f8017a50 tx=0x7f45f8053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.457+0000 7f44d6ffd640 1 -- 172.21.15.120:0/2016557309 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f804a070 con 0x563964e30b00 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.457+0000 7f44d6ffd640 1 -- 172.21.15.120:0/2016557309 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8032020 con 0x563964e30b00 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.457+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563964e38930 con 0x563964e30b00 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.457+0000 7f44d6ffd640 1 -- 172.21.15.120:0/2016557309 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f8022410 con 0x563964e30b00 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.457+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563964e392b0 con 0x563964e30b00 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.457+0000 7f44d6ffd640 1 -- 172.21.15.120:0/2016557309 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f45f8016040 con 0x563964e30b00 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.458+0000 7f44d6ffd640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44d003c730 0x7f44d003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.458+0000 7f44d6ffd640 1 -- 172.21.15.120:0/2016557309 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f45f8033030 con 0x563964e30b00 2024-09-07T03:34:21.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.458+0000 7f46050f9640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44d003c730 0x7f44d003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.458+0000 7f46050f9640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44d003c730 0x7f44d003ebf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f46000045e0 tx=0x7f460004a070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.458+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.458+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964e43cb0 0x563964e46170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.458+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e468c0 con 0x563964e43cb0 2024-09-07T03:34:21.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.458+0000 7f46048f8640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964e43cb0 0x563964e46170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f46048f8640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964e43cb0 0x563964e46170 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 20 realm 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e46cf0 con 0x563964e43cb0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e475c0 con 0x563964e43cb0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e47fe0 0x563964e4a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.459+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e4ab80 con 0x563964e47fe0 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f46058fa640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e47fe0 0x563964e4a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f46058fa640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e47fe0 0x563964e4a410 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f460760f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e4b3d0 con 0x563964e47fe0 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f460760f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f460760f800 20 searching for the correct realm 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563964e4d140 0x563964e4f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.460+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563964e4fc40 con 0x563964e4d140 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.461+0000 7f46050f9640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563964e4d140 0x563964e4f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.461+0000 7f46050f9640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563964e4d140 0x563964e4f570 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.461+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4600046040 con 0x563964e4d140 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.461+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563964e4fc40 con 0x563964e47fe0 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.461+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.461+0000 7f46058fa640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f45f802d440 0x7f45f8044400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.461+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563964e4fc40 con 0x7f45f802d440 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.462+0000 7f46048f8640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f45f802d440 0x7f45f8044400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.462+0000 7f46048f8640 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f45f802d440 0x7f45f8044400 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.462+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.462+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563964e4fc40 con 0x563964e43cb0 2024-09-07T03:34:21.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.462+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.462+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563964e4fc40 con 0x563964e43cb0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.462+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.462+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563964e4fc40 con 0x563964e4d140 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.463+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.463+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563964e4fc40 con 0x563964e43cb0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.463+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.463+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563964e4fc40 con 0x563964e47fe0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.463+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.463+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563964e4fc40 con 0x563964e47fe0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e43cb0 2024-09-07T03:34:21.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x7f45f802d440 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e43cb0 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x7f45f802d440 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.464+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e47fe0 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.465+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.465+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e4d140 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.465+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.465+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e43cb0 2024-09-07T03:34:21.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.465+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.465+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e47fe0 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.465+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.465+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e4d140 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e43cb0 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e43cb0 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e43cb0 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e4d140 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.466+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x7f45f802d440 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.467+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.467+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x7f45f802d440 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.467+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.467+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x7f45f802d440 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.467+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.467+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e4d140 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.467+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.467+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x7f45f802d440 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.468+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.468+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e47fe0 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.468+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.468+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e47fe0 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.468+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.468+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e4d140 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.468+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.468+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e47fe0 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f45f8066040 con 0x563964e47fe0 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:21.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e4bc20 con 0x563964e43cb0 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e4c010 con 0x563964e47fe0 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.469+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e4c010 con 0x563964e43cb0 2024-09-07T03:34:21.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 zone default found 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 4 Realm: () 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 zonegroup default 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e500c0 con 0x7f45f802d440 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e51e50 con 0x563964e4d140 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e522d0 con 0x563964e4d140 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 started sync module instance, tier type = 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.470+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e512f0 con 0x563964e47fe0 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.472+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.472+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94804505859856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e512f0 con 0x563964e47fe0 2024-09-07T03:34:21.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.472+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e52be0 con 0x563964e43cb0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.473+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.473+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94804505859856] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.473+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94804505857600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e51260 con 0x563964e43cb0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.473+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e538e0 con 0x563964e47fe0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.474+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94804505857600] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.474+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.474+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94804505866112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e53850 con 0x563964e47fe0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.474+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e54270 con 0x7f45f802d440 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.475+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94804505866112] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.475+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.475+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94804505869664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e53850 con 0x7f45f802d440 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.475+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e54ce0 con 0x563964e47fe0 2024-09-07T03:34:21.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.476+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94804505869664] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.476+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.476+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94804505872336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e53850 con 0x563964e47fe0 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.476+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e556f0 con 0x563964e4d140 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.477+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94804505872336] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.477+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.477+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94804505875488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e53850 con 0x563964e4d140 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.477+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e56180 con 0x563964e4d140 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.478+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94804505875488] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.478+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.479+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94804505877584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e53850 con 0x563964e4d140 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.479+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e56c30 con 0x7f45f802d440 2024-09-07T03:34:21.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94804505877584] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94804505880336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e56c30 con 0x7f45f802d440 2024-09-07T03:34:21.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f460760f800 20 add_watcher() i=0 2024-09-07T03:34:21.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f460760f800 20 add_watcher() i=1 2024-09-07T03:34:21.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f460760f800 20 add_watcher() i=2 2024-09-07T03:34:21.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f460760f800 20 add_watcher() i=3 2024-09-07T03:34:21.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f460760f800 20 add_watcher() i=4 2024-09-07T03:34:21.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f460760f800 20 add_watcher() i=5 2024-09-07T03:34:21.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.480+0000 7f460760f800 20 add_watcher() i=6 2024-09-07T03:34:21.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.481+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94804505880336] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.481+0000 7f460760f800 20 add_watcher() i=7 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.481+0000 7f460760f800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.481+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e56c30 con 0x563964e43cb0 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.481+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.481+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94804505881648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e575e0 con 0x563964e43cb0 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.482+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94804505881648] v36'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.482+0000 7f44bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.482+0000 7f460760f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.482+0000 7f460760f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.482+0000 7f460760f800 5 note: GC not initialized 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.482+0000 7f44ba7e4640 20 reqs_thread_entry: start 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 20 Filter name: none 2024-09-07T03:34:21.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f442bfff640 20 reqs_thread_entry: start 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e8d1c0 con 0x563964e43cb0 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 20 rados_obj.operate() r=0 bl.length=490 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.483+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e93770 con 0x563964e43cb0 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f460760f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f460760f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f460760f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94804506128688 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563964e8ed90 con 0x563964e47fe0 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94804505872336 notify 154618822698 ret 0) ==== 708+0+0 (crc 0 0 0) 0x563964e392b0 con 0x563964e47fe0 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f44e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822698 cookie 94804505872336 notifier 4876 bl.length()=666 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f44e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f44e8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94804506128688 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f44e8ff9640 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f44c8003ea0 con 0x563964e47fe0 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.485+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94804506128688 notify 154618822698 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563964e38930 con 0x563964e47fe0 2024-09-07T03:34:21.501 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:21.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.486+0000 7f44bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.486+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94804505881648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e8b030 con 0x563964e43cb0 2024-09-07T03:34:21.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.487+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94804505881648] v36'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.487+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94804505859856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e8b030 con 0x563964e47fe0 2024-09-07T03:34:21.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.488+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94804505859856] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.488+0000 7f460760f800 20 remove_watcher() i=0 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.488+0000 7f460760f800 2 removed watcher, disabling cache 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.488+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94804505857600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e8b030 con 0x563964e43cb0 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.489+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94804505857600] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x563964e43cb0 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.489+0000 7f460760f800 20 remove_watcher() i=1 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.489+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94804505866112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e8b030 con 0x563964e47fe0 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.491+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94804505866112] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.491+0000 7f460760f800 20 remove_watcher() i=2 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.491+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94804505869664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e8b030 con 0x7f45f802d440 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.492+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94804505869664] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.492+0000 7f460760f800 20 remove_watcher() i=3 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.492+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94804505872336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e8b030 con 0x563964e47fe0 2024-09-07T03:34:21.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.493+0000 7f46058fa640 1 -- 172.21.15.120:0/2016557309 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94804505872336] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f80083e0 con 0x563964e47fe0 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.493+0000 7f460760f800 20 remove_watcher() i=4 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.493+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94804505875488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e8b030 con 0x563964e4d140 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.494+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94804505875488] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.494+0000 7f460760f800 20 remove_watcher() i=5 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.494+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94804505877584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e8b030 con 0x563964e4d140 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.495+0000 7f46050f9640 1 -- 172.21.15.120:0/2016557309 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94804505877584] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460005d040 con 0x563964e4d140 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.495+0000 7f460760f800 20 remove_watcher() i=6 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.495+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94804505880336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563964e8b030 con 0x7f45f802d440 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.495+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94804505880336] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f0051070 con 0x7f45f802d440 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.495+0000 7f460760f800 20 remove_watcher() i=7 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e47fe0 msgr2=0x563964e4a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e47fe0 0x563964e4a410 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964e43cb0 msgr2=0x563964e46170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964e43cb0 0x563964e46170 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f45f802d440 msgr2=0x7f45f8044400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f45f802d440 0x7f45f8044400 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563964e4d140 msgr2=0x563964e4f570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563964e4d140 0x563964e4f570 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44d003c730 msgr2=0x7f44d003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44d003c730 0x7f44d003ebf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f46000045e0 tx=0x7f460004a070 comp rx=0 tx=0).stop 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 msgr2=0x563964e38140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f46048f8640 1 -- 172.21.15.120:0/2016557309 reap_dead start 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e38140 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f45f8017a50 tx=0x7f45f8053150 comp rx=0 tx=0).stop 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 shutdown_connections 2024-09-07T03:34:21.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2016557309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e30b00 0x563964e38140 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 >> 172.21.15.120:0/2016557309 conn(0x563964e2cf00 msgr2=0x563964e2b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 shutdown_connections 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2016557309 wait complete. 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2515010664 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44e003c780 msgr2=0x7f44e003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2515010664 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44e003c780 0x7f44e003ec40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x563964e0a910 tx=0x7f4600051ef0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2515010664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e23fe0 msgr2=0x563964e24400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2515010664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e23fe0 0x563964e24400 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f45f800aa90 tx=0x7f45f800af50 comp rx=0 tx=0).stop 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2515010664 shutdown_connections 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2515010664 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44e003c780 0x7f44e003ec40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 --2- 172.21.15.120:0/2515010664 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964e23fe0 0x563964e24400 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2515010664 >> 172.21.15.120:0/2515010664 conn(0x563964e18390 msgr2=0x563964e18770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2515010664 shutdown_connections 2024-09-07T03:34:21.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.496+0000 7f460760f800 1 -- 172.21.15.120:0/2515010664 wait complete. 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e11640 msgr2=0x563964e13b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e11640 0x563964e13b00 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964d0ffd0 msgr2=0x563964e10850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964d0ffd0 0x563964e10850 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44ec03c730 msgr2=0x7f44ec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44ec03c730 0x7f44ec03ebf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f45f0057000 tx=0x7f45f0052000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 msgr2=0x563964e09200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e09200 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4600000f80 tx=0x7f4600001250 comp rx=0 tx=0).stop 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 shutdown_connections 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563964e11640 0x563964e13b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563964d0ffd0 0x563964e10850 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f44ec03c730 0x7f44ec03ebf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 --2- 172.21.15.120:0/3214768327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563964d0e4b0 0x563964e09200 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 >> 172.21.15.120:0/3214768327 conn(0x563964d0a200 msgr2=0x563964e02b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 shutdown_connections 2024-09-07T03:34:21.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.497+0000 7f460760f800 1 -- 172.21.15.120:0/3214768327 wait complete. 2024-09-07T03:34:21.513 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.513 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.513 ERROR:root:0 2024-09-07T03:34:21.513 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:21.526 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:21.526 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-07T03:34:21.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-07T03:34:21.527 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-07T03:34:21.573 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:21.573 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:21.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f31951af800 1 Processor -- start 2024-09-07T03:34:21.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f31951af800 1 -- start start 2024-09-07T03:34:21.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f31951af800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5574f08d5e00 0x5574f08d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f31951af800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5574f0780e40 con 0x5574f08d7040 2024-09-07T03:34:21.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f31951af800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5574f074b680 con 0x5574f08d5e00 2024-09-07T03:34:21.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f3192c99640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5574f08d5e00 0x5574f08d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f318a498640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5574f08d7040 0x5574f08dbda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43938/0 (socket says 172.21.15.120:43938) 2024-09-07T03:34:21.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f318a498640 1 -- 172.21.15.120:0/4115764228 learned_addr learned my addr 172.21.15.120:0/4115764228 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:21.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f3192c99640 1 -- 172.21.15.120:0/4115764228 >> v1:172.21.15.104:6789/0 conn(0x5574f08d7040 legacy=0x5574f08dbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f3192498640 1 -- 172.21.15.120:0/4115764228 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611574104 0 0) 0x5574f0780e40 con 0x5574f08d7040 2024-09-07T03:34:21.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.573+0000 7f3192c99640 1 -- 172.21.15.120:0/4115764228 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574f07676b0 con 0x5574f08d5e00 2024-09-07T03:34:21.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.575+0000 7f3192c99640 1 --2- 172.21.15.120:0/4115764228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f08d6b00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f318400a470 tx=0x7f3184045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783b22fa84000f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.575+0000 7f3192498640 1 -- 172.21.15.120:0/4115764228 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184053570 con 0x5574f08d5e00 2024-09-07T03:34:21.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.575+0000 7f3192498640 1 -- 172.21.15.120:0/4115764228 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3184058070 con 0x5574f08d5e00 2024-09-07T03:34:21.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.575+0000 7f3192498640 1 -- 172.21.15.120:0/4115764228 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184053880 con 0x5574f08d5e00 2024-09-07T03:34:21.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.576+0000 7f31951af800 1 -- 172.21.15.120:0/4115764228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 msgr2=0x5574f08d6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.576+0000 7f31951af800 1 --2- 172.21.15.120:0/4115764228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f08d6b00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f318400a470 tx=0x7f3184045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:21.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.576+0000 7f31951af800 1 -- 172.21.15.120:0/4115764228 shutdown_connections 2024-09-07T03:34:21.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.576+0000 7f31951af800 1 --2- 172.21.15.120:0/4115764228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f08d6b00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.576+0000 7f31951af800 1 -- 172.21.15.120:0/4115764228 >> 172.21.15.120:0/4115764228 conn(0x5574f08d11d0 msgr2=0x5574f08d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.576+0000 7f31951af800 1 -- 172.21.15.120:0/4115764228 shutdown_connections 2024-09-07T03:34:21.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.576+0000 7f31951af800 1 -- 172.21.15.120:0/4115764228 wait complete. 2024-09-07T03:34:21.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.590+0000 7f31951af800 1 Processor -- start 2024-09-07T03:34:21.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.590+0000 7f31951af800 1 -- start start 2024-09-07T03:34:21.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.590+0000 7f31951af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f0849dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.590+0000 7f31951af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5574f076fdd0 con 0x5574f08d5e00 2024-09-07T03:34:21.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.590+0000 7f3192c99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f0849dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.590+0000 7f3192c99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f0849dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40602/0 (socket says 172.21.15.120:40602) 2024-09-07T03:34:21.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.590+0000 7f3192c99640 1 -- 172.21.15.120:0/569241347 learned_addr learned my addr 172.21.15.120:0/569241347 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.591+0000 7f3192c99640 1 -- 172.21.15.120:0/569241347 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574f0788e10 con 0x5574f08d5e00 2024-09-07T03:34:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.591+0000 7f3192c99640 1 --2- 172.21.15.120:0/569241347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f0849dc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3184025c20 tx=0x7f3184051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad77ab246159bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.591+0000 7f3080e09640 1 -- 172.21.15.120:0/569241347 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184053a20 con 0x5574f08d5e00 2024-09-07T03:34:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.591+0000 7f3080e09640 1 -- 172.21.15.120:0/569241347 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3184063070 con 0x5574f08d5e00 2024-09-07T03:34:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.591+0000 7f3080e09640 1 -- 172.21.15.120:0/569241347 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184053d30 con 0x5574f08d5e00 2024-09-07T03:34:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 -- 172.21.15.120:0/569241347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 msgr2=0x5574f0849dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 --2- 172.21.15.120:0/569241347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f0849dc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3184025c20 tx=0x7f3184051000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 -- 172.21.15.120:0/569241347 shutdown_connections 2024-09-07T03:34:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 --2- 172.21.15.120:0/569241347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f0849dc0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 -- 172.21.15.120:0/569241347 >> 172.21.15.120:0/569241347 conn(0x5574f08d11d0 msgr2=0x5574f09c0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 -- 172.21.15.120:0/569241347 shutdown_connections 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 -- 172.21.15.120:0/569241347 wait complete. 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 Processor -- start 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 -- start start 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f09c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f31951af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5574f08d7730 con 0x5574f08d5e00 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.592+0000 7f3192c99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f09c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.593+0000 7f3192c99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f09c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40604/0 (socket says 172.21.15.120:40604) 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.593+0000 7f3192c99640 1 -- 172.21.15.120:0/2303369225 learned_addr learned my addr 172.21.15.120:0/2303369225 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.593+0000 7f3192c99640 1 -- 172.21.15.120:0/2303369225 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574f09c6d50 con 0x5574f08d5e00 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.593+0000 7f3192c99640 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f09c67f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3184025c20 tx=0x7f3184002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.593+0000 7f307f606640 1 -- 172.21.15.120:0/2303369225 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184078070 con 0x5574f08d5e00 2024-09-07T03:34:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.593+0000 7f307f606640 1 -- 172.21.15.120:0/2303369225 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3184073470 con 0x5574f08d5e00 2024-09-07T03:34:21.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.593+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574f09c5100 con 0x5574f08d5e00 2024-09-07T03:34:21.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.593+0000 7f307f606640 1 -- 172.21.15.120:0/2303369225 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3184073750 con 0x5574f08d5e00 2024-09-07T03:34:21.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.593+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574f09c5720 con 0x5574f08d5e00 2024-09-07T03:34:21.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.594+0000 7f307f606640 1 -- 172.21.15.120:0/2303369225 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f318407b070 con 0x5574f08d5e00 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.594+0000 7f307f606640 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f307803c7d0 0x7f307803ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.594+0000 7f307f606640 1 -- 172.21.15.120:0/2303369225 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3184097c40 con 0x5574f08d5e00 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.594+0000 7f318a498640 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f307803c7d0 0x7f307803ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.595+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f08d7040 0x5574f09d7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.595+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f09d78c0 con 0x5574f08d7040 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.595+0000 7f319349a640 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f08d7040 0x5574f09d7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.595+0000 7f318a498640 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f307803c7d0 0x7f307803ec90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f317c000c00 tx=0x7f317c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.595+0000 7f319349a640 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f08d7040 0x5574f09d7380 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.595+0000 7f319349a640 1 -- 172.21.15.120:0/2303369225 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f318c00a4d0 con 0x5574f08d7040 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.595+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f09d8620 0x5574f09daa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.595+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f09db000 con 0x5574f09d8620 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.596+0000 7f3192c99640 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f09d8620 0x5574f09daa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.596+0000 7f3192c99640 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f09d8620 0x5574f09daa10 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.596+0000 7f3192c99640 1 -- 172.21.15.120:0/2303369225 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f318407a030 con 0x5574f09d8620 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.596+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f09dc8b0 con 0x5574f09d8620 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.596+0000 7f3192c99640 1 -- 172.21.15.120:0/2303369225 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f318407a030 con 0x5574f09d8620 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.596+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f09dba50 con 0x5574f09d8620 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.597+0000 7f3192c99640 1 -- 172.21.15.120:0/2303369225 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f318407a030 con 0x5574f09d8620 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.597+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f09dbe70 con 0x5574f08d7040 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.597+0000 7f319349a640 1 -- 172.21.15.120:0/2303369225 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f318c00a4d0 con 0x5574f08d7040 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.597+0000 7f31951af800 1 Processor -- start 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.597+0000 7f31951af800 1 -- start start 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.597+0000 7f31951af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09eacb0 0x5574f09eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.597+0000 7f31951af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5574f07cda00 con 0x5574f09eacb0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f319349a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09eacb0 0x5574f09eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f319349a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09eacb0 0x5574f09eb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40612/0 (socket says 172.21.15.120:40612) 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f319349a640 1 -- 172.21.15.120:0/4035204117 learned_addr learned my addr 172.21.15.120:0/4035204117 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f319349a640 1 -- 172.21.15.120:0/4035204117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574f09eb710 con 0x5574f09eacb0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f319349a640 1 --2- 172.21.15.120:0/4035204117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09eacb0 0x5574f09eb0d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f318c016d20 tx=0x7f318c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f307ce01640 1 -- 172.21.15.120:0/4035204117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c017660 con 0x5574f09eacb0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f307ce01640 1 -- 172.21.15.120:0/4035204117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c01b030 con 0x5574f09eacb0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f31951af800 1 -- 172.21.15.120:0/4035204117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574f09ebf40 con 0x5574f09eacb0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f307ce01640 1 -- 172.21.15.120:0/4035204117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c017950 con 0x5574f09eacb0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.598+0000 7f31951af800 1 -- 172.21.15.120:0/4035204117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574f09ec4e0 con 0x5574f09eacb0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.599+0000 7f307ce01640 1 -- 172.21.15.120:0/4035204117 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f318c017af0 con 0x5574f09eacb0 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.599+0000 7f307ce01640 1 --2- 172.21.15.120:0/4035204117 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f306c03c840 0x7f306c03ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.599+0000 7f307ce01640 1 -- 172.21.15.120:0/4035204117 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f318c00e040 con 0x5574f09eacb0 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.599+0000 7f3192c99640 1 --2- 172.21.15.120:0/4035204117 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f306c03c840 0x7f306c03ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f31951af800 1 Processor -- start 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f3192c99640 1 --2- 172.21.15.120:0/4035204117 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f306c03c840 0x7f306c03ed00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5574f09db570 tx=0x7f318408b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f31951af800 1 -- start start 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f31951af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f31951af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5574f09c9190 con 0x5574f09f77b0 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f319349a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f319349a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09f7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40618/0 (socket says 172.21.15.120:40618) 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f319349a640 1 -- 172.21.15.120:0/4039944368 learned_addr learned my addr 172.21.15.120:0/4039944368 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f319349a640 1 -- 172.21.15.120:0/4039944368 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574f09f81a0 con 0x5574f09f77b0 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f319349a640 1 --2- 172.21.15.120:0/4039944368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09f7bb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f318c053e00 tx=0x7f318c017de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faede2b843eda00 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f30767fc640 1 -- 172.21.15.120:0/4039944368 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c014d40 con 0x5574f09f77b0 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f30767fc640 1 -- 172.21.15.120:0/4039944368 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c051070 con 0x5574f09f77b0 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.600+0000 7f30767fc640 1 -- 172.21.15.120:0/4039944368 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c0149b0 con 0x5574f09f77b0 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 -- 172.21.15.120:0/4039944368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 msgr2=0x5574f09f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 --2- 172.21.15.120:0/4039944368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09f7bb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f318c053e00 tx=0x7f318c017de0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 -- 172.21.15.120:0/4039944368 shutdown_connections 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 --2- 172.21.15.120:0/4039944368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09f7bb0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 -- 172.21.15.120:0/4039944368 >> 172.21.15.120:0/4039944368 conn(0x5574f09f3bb0 msgr2=0x5574f09f1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 -- 172.21.15.120:0/4039944368 shutdown_connections 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 -- 172.21.15.120:0/4039944368 wait complete. 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 Processor -- start 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 -- start start 2024-09-07T03:34:21.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09fee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.601+0000 7f31951af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5574f09f87c0 con 0x5574f09f77b0 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f319349a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09fee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f319349a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09fee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40630/0 (socket says 172.21.15.120:40630) 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 learned_addr learned my addr 172.21.15.120:0/3218154694 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574f09ff380 con 0x5574f09f77b0 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f319349a640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09fee20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f318c013550 tx=0x7f318c053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f3074ff9640 1 -- 172.21.15.120:0/3218154694 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c0289b0 con 0x5574f09f77b0 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f3074ff9640 1 -- 172.21.15.120:0/3218154694 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c02e070 con 0x5574f09f77b0 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574f09ff610 con 0x5574f09f77b0 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f3074ff9640 1 -- 172.21.15.120:0/3218154694 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318c012da0 con 0x5574f09f77b0 2024-09-07T03:34:21.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.602+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574f09fff90 con 0x5574f09f77b0 2024-09-07T03:34:21.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.603+0000 7f3074ff9640 1 -- 172.21.15.120:0/3218154694 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f318c005050 con 0x5574f09f77b0 2024-09-07T03:34:21.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.603+0000 7f3074ff9640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f305c03c920 0x7f305c03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.603+0000 7f3074ff9640 1 -- 172.21.15.120:0/3218154694 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f318c0153d0 con 0x5574f09f77b0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.603+0000 7f3192c99640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f305c03c920 0x7f305c03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f3192c99640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f305c03c920 0x7f305c03ede0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3184053730 tx=0x7f31840893b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f0a0a8c0 0x5574f0a0cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a0d4d0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f318a498640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f0a0a8c0 0x5574f0a0cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f318a498640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f0a0a8c0 0x5574f0a0cd80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f31951af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f31951af800 20 realm 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.604+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a09c10 con 0x5574f0a0a8c0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f31951af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f31951af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a0dfc0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f31951af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f0a0eda0 0x5574f0a11190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a11860 con 0x5574f0a0eda0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f319349a640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f0a0eda0 0x5574f0a11190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.605+0000 7f319349a640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f0a0eda0 0x5574f0a11190 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f31951af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a12100 con 0x5574f0a0eda0 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f31951af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f31951af800 20 searching for the correct realm 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5574f0a13e70 0x5574f0a16280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a13e70 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f3192c99640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5574f0a13e70 0x5574f0a16280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f3192c99640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5574f0a13e70 0x5574f0a16280 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.606+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0eda0 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.607+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.607+0000 7f319349a640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f318c04e070 0x7f318c0479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.607+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x7f318c04e070 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.607+0000 7f318a498640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f318c04e070 0x7f318c0479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.607+0000 7f318a498640 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f318c04e070 0x7f318c0479b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.608+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x7f318c04e070 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.608+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0a8c0 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.608+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.608+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0a8c0 2024-09-07T03:34:21.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.608+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.608+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a13e70 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.608+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.608+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0a8c0 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0eda0 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0eda0 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0a8c0 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x7f318c04e070 2024-09-07T03:34:21.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x7f318c04e070 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.609+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0a8c0 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.610+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.610+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x7f318c04e070 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.610+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f317c00f5f0 con 0x7f318c04e070 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.610+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0eda0 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.610+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.610+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a13e70 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.610+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.610+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0a8c0 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.611+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.611+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0eda0 2024-09-07T03:34:21.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.611+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.611+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a13e70 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.611+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.611+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0a8c0 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.611+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.611+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0a8c0 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.612+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.612+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0a8c0 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.612+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.612+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a13e70 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.612+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.612+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x7f318c04e070 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.612+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x7f318c04e070 2024-09-07T03:34:21.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.612+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x7f318c04e070 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.613+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x7f318c04e070 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.613+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x7f318c04e070 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.613+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x7f318c04e070 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.613+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a13e70 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.613+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.613+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x7f318c04e070 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.613+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f317c00f5f0 con 0x7f318c04e070 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.613+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0eda0 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.614+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.614+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0eda0 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.614+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.614+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a13e70 2024-09-07T03:34:21.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.614+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.614+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0eda0 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.614+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.614+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16950 con 0x5574f0a0eda0 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:21.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a12a80 con 0x5574f0a0a8c0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a126c0 con 0x5574f0a0eda0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a133a0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 zone default found 2024-09-07T03:34:21.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 4 Realm: () 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 zonegroup default 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.615+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a16dd0 con 0x7f318c04e070 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x7f318c04e070 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a19010 con 0x5574f0a13e70 2024-09-07T03:34:21.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a193b0 con 0x5574f0a13e70 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 20 started sync module instance, tier type = 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.616+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a18450 con 0x5574f0a0eda0 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.618+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.618+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93960741685360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a18450 con 0x5574f0a0eda0 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.618+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a19c90 con 0x5574f0a0a8c0 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.619+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93960741685360] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.619+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.619+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93960741683104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a183c0 con 0x5574f0a0a8c0 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.619+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1a990 con 0x5574f0a0eda0 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.620+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93960741683104] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.620+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.620+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93960741691440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1a900 con 0x5574f0a0eda0 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.620+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1b3d0 con 0x7f318c04e070 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.622+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93960741691440] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.622+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x7f318c04e070 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.622+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93960741695168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1a900 con 0x7f318c04e070 2024-09-07T03:34:21.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.622+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1be40 con 0x5574f0a0eda0 2024-09-07T03:34:21.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.623+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93960741695168] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x7f318c04e070 2024-09-07T03:34:21.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.623+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.623+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93960741697840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1a900 con 0x5574f0a0eda0 2024-09-07T03:34:21.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.623+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1c850 con 0x5574f0a13e70 2024-09-07T03:34:21.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.624+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.624+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93960741697840] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.624+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93960741700512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1c820 con 0x5574f0a13e70 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.624+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1a4b0 con 0x5574f0a13e70 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.626+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.626+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93960741704416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1a4b0 con 0x5574f0a13e70 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.626+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1e270 con 0x7f318c04e070 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.626+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93960741700512] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93960741704416] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x7f318c04e070 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93960741705472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1e270 con 0x7f318c04e070 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f31951af800 20 add_watcher() i=0 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f31951af800 20 add_watcher() i=1 2024-09-07T03:34:21.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f31951af800 20 add_watcher() i=2 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f31951af800 20 add_watcher() i=3 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f31951af800 20 add_watcher() i=4 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f31951af800 20 add_watcher() i=5 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.627+0000 7f31951af800 20 add_watcher() i=6 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.628+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93960741705472] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x7f318c04e070 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.628+0000 7f31951af800 20 add_watcher() i=7 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.628+0000 7f31951af800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.628+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1dd50 con 0x5574f0a0a8c0 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.628+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.628+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93960741702720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a1ea00 con 0x5574f0a0a8c0 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.629+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93960741702720] v36'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.629+0000 7f30497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.629+0000 7f31951af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:21.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.629+0000 7f31951af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.629+0000 7f31951af800 5 note: GC not initialized 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f2fc3fff640 20 reqs_thread_entry: start 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f31951af800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f31951af800 20 Filter name: none 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f2fc1ffb640 20 reqs_thread_entry: start 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f31951af800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f31951af800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a54220 con 0x5574f0a0a8c0 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f31951af800 20 rados_obj.operate() r=0 bl.length=490 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f31951af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f31951af800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.630+0000 7f31951af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.631+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a5a760 con 0x5574f0a0a8c0 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v36'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f31951af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f31951af800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f31951af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93960741953888 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a55dc0 con 0x5574f0a0eda0 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 93960741697840 notify 154618822699 ret 0) ==== 721+0+0 (crc 0 0 0) 0x5574f09fff90 con 0x5574f0a0eda0 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f30767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822699 cookie 93960741697840 notifier 4883 bl.length()=679 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f30767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f30767fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 93960741953888 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f30767fc640 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3058003ea0 con 0x5574f0a0eda0 2024-09-07T03:34:21.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.632+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.633+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 93960741953888 notify 154618822699 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f318c06d020 con 0x5574f0a0eda0 2024-09-07T03:34:21.646 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.633+0000 7f30497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.633+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93960741702720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a52050 con 0x5574f0a0a8c0 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.634+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93960741702720] v36'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.634+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93960741685360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a52050 con 0x5574f0a0eda0 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.635+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93960741685360] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.635+0000 7f31951af800 20 remove_watcher() i=0 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.635+0000 7f31951af800 2 removed watcher, disabling cache 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.635+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93960741683104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a52050 con 0x5574f0a0a8c0 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.636+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93960741683104] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x5574f0a0a8c0 2024-09-07T03:34:21.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.636+0000 7f31951af800 20 remove_watcher() i=1 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.636+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93960741691440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a52050 con 0x5574f0a0eda0 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.637+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93960741691440] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.637+0000 7f31951af800 20 remove_watcher() i=2 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.637+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93960741695168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a52050 con 0x7f318c04e070 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.638+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93960741695168] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x7f318c04e070 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.638+0000 7f31951af800 20 remove_watcher() i=3 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.639+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93960741697840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a52050 con 0x5574f0a0eda0 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.640+0000 7f319349a640 1 -- 172.21.15.120:0/3218154694 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93960741697840] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318c027070 con 0x5574f0a0eda0 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.640+0000 7f31951af800 20 remove_watcher() i=4 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.640+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93960741700512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a52050 con 0x5574f0a13e70 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.641+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93960741700512] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.641+0000 7f31951af800 20 remove_watcher() i=5 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.641+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93960741704416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a52050 con 0x5574f0a13e70 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.642+0000 7f3192c99640 1 -- 172.21.15.120:0/3218154694 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93960741704416] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840a0030 con 0x5574f0a13e70 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.642+0000 7f31951af800 20 remove_watcher() i=6 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.642+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93960741705472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5574f0a52050 con 0x7f318c04e070 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93960741705472] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f317c03c040 con 0x7f318c04e070 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 20 remove_watcher() i=7 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f0a0eda0 msgr2=0x5574f0a11190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f0a0eda0 0x5574f0a11190 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f0a0a8c0 msgr2=0x5574f0a0cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f0a0a8c0 0x5574f0a0cd80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f318c04e070 msgr2=0x7f318c0479b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f318c04e070 0x7f318c0479b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5574f0a13e70 msgr2=0x5574f0a16280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5574f0a13e70 0x5574f0a16280 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f305c03c920 msgr2=0x7f305c03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f305c03c920 0x7f305c03ede0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3184053730 tx=0x7f31840893b0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 msgr2=0x5574f09fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09fee20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f318c013550 tx=0x7f318c053d60 comp rx=0 tx=0).stop 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f318a498640 1 -- 172.21.15.120:0/3218154694 reap_dead start 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 shutdown_connections 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 --2- 172.21.15.120:0/3218154694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09f77b0 0x5574f09fee20 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 >> 172.21.15.120:0/3218154694 conn(0x5574f09f3bb0 msgr2=0x5574f09f1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 shutdown_connections 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/3218154694 wait complete. 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 -- 172.21.15.120:0/4035204117 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f306c03c840 msgr2=0x7f306c03ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.643+0000 7f31951af800 1 --2- 172.21.15.120:0/4035204117 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f306c03c840 0x7f306c03ed00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5574f09db570 tx=0x7f318408b040 comp rx=0 tx=0).stop 2024-09-07T03:34:21.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/4035204117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09eacb0 msgr2=0x5574f09eb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/4035204117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09eacb0 0x5574f09eb0d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f318c016d20 tx=0x7f318c00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/4035204117 shutdown_connections 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/4035204117 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f306c03c840 0x7f306c03ed00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/4035204117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f09eacb0 0x5574f09eb0d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/4035204117 >> 172.21.15.120:0/4035204117 conn(0x5574f09df060 msgr2=0x5574f09df440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/4035204117 shutdown_connections 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/4035204117 wait complete. 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f09d8620 msgr2=0x5574f09daa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f09d8620 0x5574f09daa10 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f08d7040 msgr2=0x5574f09d7380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f08d7040 0x5574f09d7380 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f307803c7d0 msgr2=0x7f307803ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f307803c7d0 0x7f307803ec90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f317c000c00 tx=0x7f317c0013b0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 msgr2=0x5574f09c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f09c67f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3184025c20 tx=0x7f3184002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 shutdown_connections 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5574f09d8620 0x5574f09daa10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5574f08d7040 0x5574f09d7380 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f307803c7d0 0x7f307803ec90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 --2- 172.21.15.120:0/2303369225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5574f08d5e00 0x5574f09c67f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 >> 172.21.15.120:0/2303369225 conn(0x5574f08d11d0 msgr2=0x5574f09bf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 shutdown_connections 2024-09-07T03:34:21.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.644+0000 7f31951af800 1 -- 172.21.15.120:0/2303369225 wait complete. 2024-09-07T03:34:21.657 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.657 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.658 ERROR:root:0 2024-09-07T03:34:21.658 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:21.670 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:21.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-07T03:34:21.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-07T03:34:21.671 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-07T03:34:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:21.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.717+0000 7f485d326800 1 Processor -- start 2024-09-07T03:34:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.717+0000 7f485d326800 1 -- start start 2024-09-07T03:34:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.717+0000 7f485d326800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b66966fe00 0x55b669670b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.717+0000 7f485d326800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b66951ae40 con 0x55b669671040 2024-09-07T03:34:21.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.717+0000 7f485d326800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55b6694e5680 con 0x55b66966fe00 2024-09-07T03:34:21.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.718+0000 7f4858fd9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b66966fe00 0x55b669670b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.718+0000 7f4853fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55b669671040 0x55b669675da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43950/0 (socket says 172.21.15.120:43950) 2024-09-07T03:34:21.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.718+0000 7f4858fd9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55b66966fe00 0x55b669670b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40636/0 (socket says 172.21.15.120:40636) 2024-09-07T03:34:21.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.718+0000 7f4853fff640 1 -- 172.21.15.120:0/1553390107 learned_addr learned my addr 172.21.15.120:0/1553390107 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:21.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.718+0000 7f4858fd9640 1 -- 172.21.15.120:0/1553390107 >> v1:172.21.15.104:6789/0 conn(0x55b669671040 legacy=0x55b669675da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.718+0000 7f4858fd9640 1 -- 172.21.15.120:0/1553390107 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6695016b0 con 0x55b66966fe00 2024-09-07T03:34:21.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.720+0000 7f4858fd9640 1 --2- 172.21.15.120:0/1553390107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b669670b00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f484c00a470 tx=0x7f484c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cab33d18502e6c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.720+0000 7f48537fe640 1 -- 172.21.15.120:0/1553390107 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f484c053570 con 0x55b66966fe00 2024-09-07T03:34:21.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.720+0000 7f48537fe640 1 -- 172.21.15.120:0/1553390107 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c058070 con 0x55b66966fe00 2024-09-07T03:34:21.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.720+0000 7f48537fe640 1 -- 172.21.15.120:0/1553390107 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f484c053880 con 0x55b66966fe00 2024-09-07T03:34:21.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.721+0000 7f485d326800 1 -- 172.21.15.120:0/1553390107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 msgr2=0x55b669670b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.721+0000 7f485d326800 1 --2- 172.21.15.120:0/1553390107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b669670b00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f484c00a470 tx=0x7f484c045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:21.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.721+0000 7f485d326800 1 -- 172.21.15.120:0/1553390107 shutdown_connections 2024-09-07T03:34:21.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.721+0000 7f485d326800 1 --2- 172.21.15.120:0/1553390107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b669670b00 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.721+0000 7f485d326800 1 -- 172.21.15.120:0/1553390107 >> 172.21.15.120:0/1553390107 conn(0x55b66966b1d0 msgr2=0x55b66966d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.721+0000 7f485d326800 1 -- 172.21.15.120:0/1553390107 shutdown_connections 2024-09-07T03:34:21.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.721+0000 7f485d326800 1 -- 172.21.15.120:0/1553390107 wait complete. 2024-09-07T03:34:21.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.734+0000 7f485d326800 1 Processor -- start 2024-09-07T03:34:21.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.734+0000 7f485d326800 1 -- start start 2024-09-07T03:34:21.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.735+0000 7f485d326800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b6695e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.735+0000 7f485d326800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b669509dd0 con 0x55b66966fe00 2024-09-07T03:34:21.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.735+0000 7f4858fd9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b6695e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.735+0000 7f4858fd9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b6695e3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40644/0 (socket says 172.21.15.120:40644) 2024-09-07T03:34:21.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.735+0000 7f4858fd9640 1 -- 172.21.15.120:0/1293024771 learned_addr learned my addr 172.21.15.120:0/1293024771 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.735+0000 7f4858fd9640 1 -- 172.21.15.120:0/1293024771 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b669522e10 con 0x55b66966fe00 2024-09-07T03:34:21.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.735+0000 7f4858fd9640 1 --2- 172.21.15.120:0/1293024771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b6695e3dc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f484c025c20 tx=0x7f484c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b04ff2b5e17d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.735+0000 7f4746e05640 1 -- 172.21.15.120:0/1293024771 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f484c053a20 con 0x55b66966fe00 2024-09-07T03:34:21.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.736+0000 7f4746e05640 1 -- 172.21.15.120:0/1293024771 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c063070 con 0x55b66966fe00 2024-09-07T03:34:21.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.736+0000 7f4746e05640 1 -- 172.21.15.120:0/1293024771 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f484c053cf0 con 0x55b66966fe00 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.736+0000 7f485d326800 1 -- 172.21.15.120:0/1293024771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 msgr2=0x55b6695e3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.736+0000 7f485d326800 1 --2- 172.21.15.120:0/1293024771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b6695e3dc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f484c025c20 tx=0x7f484c051000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.736+0000 7f485d326800 1 -- 172.21.15.120:0/1293024771 shutdown_connections 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.736+0000 7f485d326800 1 --2- 172.21.15.120:0/1293024771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b6695e3dc0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.736+0000 7f485d326800 1 -- 172.21.15.120:0/1293024771 >> 172.21.15.120:0/1293024771 conn(0x55b66966b1d0 msgr2=0x55b66975af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.736+0000 7f485d326800 1 -- 172.21.15.120:0/1293024771 shutdown_connections 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.736+0000 7f485d326800 1 -- 172.21.15.120:0/1293024771 wait complete. 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.737+0000 7f485d326800 1 Processor -- start 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.737+0000 7f485d326800 1 -- start start 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.737+0000 7f485d326800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b669767ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.737+0000 7f485d326800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b669671730 con 0x55b66966fe00 2024-09-07T03:34:21.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.737+0000 7f4858fd9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b669767ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.737+0000 7f4858fd9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b669767ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40654/0 (socket says 172.21.15.120:40654) 2024-09-07T03:34:21.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.737+0000 7f4858fd9640 1 -- 172.21.15.120:0/2976316811 learned_addr learned my addr 172.21.15.120:0/2976316811 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.737+0000 7f4858fd9640 1 -- 172.21.15.120:0/2976316811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b669768440 con 0x55b66966fe00 2024-09-07T03:34:21.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.737+0000 7f4858fd9640 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b669767ee0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f484c025c20 tx=0x7f484c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.738+0000 7f4745602640 1 -- 172.21.15.120:0/2976316811 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f484c06c030 con 0x55b66966fe00 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.738+0000 7f4745602640 1 -- 172.21.15.120:0/2976316811 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c068660 con 0x55b66966fe00 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.738+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6697686d0 con 0x55b66966fe00 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.738+0000 7f4745602640 1 -- 172.21.15.120:0/2976316811 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f484c068940 con 0x55b66966fe00 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.738+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6697690d0 con 0x55b66966fe00 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.738+0000 7f4745602640 1 -- 172.21.15.120:0/2976316811 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f484c068ae0 con 0x55b66966fe00 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.739+0000 7f4745602640 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f474003c730 0x7f474003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.739+0000 7f4745602640 1 -- 172.21.15.120:0/2976316811 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f484c098000 con 0x55b66966fe00 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.739+0000 7f4853fff640 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f474003c730 0x7f474003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.739+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b669671040 0x55b66976f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.739+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b66976fa70 con 0x55b669671040 2024-09-07T03:34:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.739+0000 7f48597da640 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b669671040 0x55b66976f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.739+0000 7f4853fff640 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f474003c730 0x7f474003ebf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4844001d70 tx=0x7f48440012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.739+0000 7f48597da640 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b669671040 0x55b66976f530 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.739+0000 7f48597da640 1 -- 172.21.15.120:0/2976316811 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f485400a4d0 con 0x55b669671040 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.740+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b669770320 0x55b6697727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.740+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b669772f50 con 0x55b669770320 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.740+0000 7f4858fd9640 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b669770320 0x55b6697727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.740+0000 7f4858fd9640 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b669770320 0x55b6697727e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.740+0000 7f4858fd9640 1 -- 172.21.15.120:0/2976316811 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f484c051070 con 0x55b669770320 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.740+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b669774850 con 0x55b669770320 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.741+0000 7f4858fd9640 1 -- 172.21.15.120:0/2976316811 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f484c051070 con 0x55b669770320 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.741+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697739c0 con 0x55b669770320 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.741+0000 7f4858fd9640 1 -- 172.21.15.120:0/2976316811 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f484c051070 con 0x55b669770320 2024-09-07T03:34:21.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.741+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b669773de0 con 0x55b669671040 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.741+0000 7f48597da640 1 -- 172.21.15.120:0/2976316811 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f485400a4d0 con 0x55b669671040 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.742+0000 7f485d326800 1 Processor -- start 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.742+0000 7f485d326800 1 -- start start 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.742+0000 7f485d326800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b669782d10 0x55b669783130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.742+0000 7f485d326800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b669567a00 con 0x55b669782d10 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.742+0000 7f48597da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b669782d10 0x55b669783130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.742+0000 7f48597da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b669782d10 0x55b669783130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40666/0 (socket says 172.21.15.120:40666) 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.742+0000 7f48597da640 1 -- 172.21.15.120:0/2902698471 learned_addr learned my addr 172.21.15.120:0/2902698471 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.742+0000 7f48597da640 1 -- 172.21.15.120:0/2902698471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b669783770 con 0x55b669782d10 2024-09-07T03:34:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.743+0000 7f48597da640 1 --2- 172.21.15.120:0/2902698471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b669782d10 0x55b669783130 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4854016cf0 tx=0x7f485400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.743+0000 7f473e7fc640 1 -- 172.21.15.120:0/2902698471 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4854017660 con 0x55b669782d10 2024-09-07T03:34:21.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.743+0000 7f473e7fc640 1 -- 172.21.15.120:0/2902698471 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485401b030 con 0x55b669782d10 2024-09-07T03:34:21.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.743+0000 7f485d326800 1 -- 172.21.15.120:0/2902698471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b669783fa0 con 0x55b669782d10 2024-09-07T03:34:21.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.743+0000 7f473e7fc640 1 -- 172.21.15.120:0/2902698471 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4854017950 con 0x55b669782d10 2024-09-07T03:34:21.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.743+0000 7f485d326800 1 -- 172.21.15.120:0/2902698471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b669784540 con 0x55b669782d10 2024-09-07T03:34:21.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.744+0000 7f473e7fc640 1 -- 172.21.15.120:0/2902698471 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4854017af0 con 0x55b669782d10 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.744+0000 7f473e7fc640 1 --2- 172.21.15.120:0/2902698471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f473003c780 0x7f473003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.744+0000 7f473e7fc640 1 -- 172.21.15.120:0/2902698471 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f485400e040 con 0x55b669782d10 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.744+0000 7f4858fd9640 1 --2- 172.21.15.120:0/2902698471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f473003c780 0x7f473003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.744+0000 7f485d326800 1 Processor -- start 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.744+0000 7f4858fd9640 1 --2- 172.21.15.120:0/2902698471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f473003c780 0x7f473003ec40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55b669769630 tx=0x7f484c081040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.744+0000 7f485d326800 1 -- start start 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.744+0000 7f485d326800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b66978fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.744+0000 7f485d326800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b669763360 con 0x55b66978f810 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.745+0000 7f48597da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b66978fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.745+0000 7f48597da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b66978fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40670/0 (socket says 172.21.15.120:40670) 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.745+0000 7f48597da640 1 -- 172.21.15.120:0/2417525546 learned_addr learned my addr 172.21.15.120:0/2417525546 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.745+0000 7f48597da640 1 -- 172.21.15.120:0/2417525546 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b669790200 con 0x55b66978f810 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.745+0000 7f48597da640 1 --2- 172.21.15.120:0/2417525546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b66978fc10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4854016ff0 tx=0x7f4854013460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcd0cfa5eebbb3f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.745+0000 7f472ffff640 1 -- 172.21.15.120:0/2417525546 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f485404a070 con 0x55b66978f810 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.745+0000 7f472ffff640 1 -- 172.21.15.120:0/2417525546 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485404d100 con 0x55b66978f810 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.745+0000 7f472ffff640 1 -- 172.21.15.120:0/2417525546 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4854052070 con 0x55b66978f810 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.745+0000 7f485d326800 1 -- 172.21.15.120:0/2417525546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 msgr2=0x55b66978fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 --2- 172.21.15.120:0/2417525546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b66978fc10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4854016ff0 tx=0x7f4854013460 comp rx=0 tx=0).stop 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 -- 172.21.15.120:0/2417525546 shutdown_connections 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 --2- 172.21.15.120:0/2417525546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b66978fc10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 -- 172.21.15.120:0/2417525546 >> 172.21.15.120:0/2417525546 conn(0x55b66978bc10 msgr2=0x55b669789e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 -- 172.21.15.120:0/2417525546 shutdown_connections 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 -- 172.21.15.120:0/2417525546 wait complete. 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 Processor -- start 2024-09-07T03:34:21.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 -- start start 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b6697609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f485d326800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55b669790820 con 0x55b66978f810 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f48597da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b6697609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f48597da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b6697609c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40682/0 (socket says 172.21.15.120:40682) 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.746+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 learned_addr learned my addr 172.21.15.120:0/1789364240 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.747+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b669760f20 con 0x55b66978f810 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.747+0000 7f48597da640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b6697609c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4854048040 tx=0x7f4854053ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.747+0000 7f472e7fc640 1 -- 172.21.15.120:0/1789364240 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f485404a040 con 0x55b66978f810 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.747+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b66975f2d0 con 0x55b66978f810 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.747+0000 7f472e7fc640 1 -- 172.21.15.120:0/1789364240 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4854014570 con 0x55b66978f810 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.747+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b66975f870 con 0x55b66978f810 2024-09-07T03:34:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.747+0000 7f472e7fc640 1 -- 172.21.15.120:0/1789364240 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4854028480 con 0x55b66978f810 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.748+0000 7f472e7fc640 1 -- 172.21.15.120:0/1789364240 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4854028620 con 0x55b66978f810 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.748+0000 7f472e7fc640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f472403c780 0x7f472403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.748+0000 7f472e7fc640 1 -- 172.21.15.120:0/1789364240 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f4854015f60 con 0x55b66978f810 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.748+0000 7f4858fd9640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f472403c780 0x7f472403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b6697a4b60 0x55b6697a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697a7770 con 0x55b6697a4b60 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f4858fd9640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f472403c780 0x7f472403ec40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f484c053ca0 tx=0x7f484c083000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f4853fff640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b6697a4b60 0x55b6697a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f4853fff640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b6697a4b60 0x55b6697a7020 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4844009050 con 0x55b6697a4b60 2024-09-07T03:34:21.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f485d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f485d326800 20 realm 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.749+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697a3eb0 con 0x55b6697a4b60 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4844009050 con 0x55b6697a4b60 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f485d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f485d326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697a8260 con 0x55b6697a4b60 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4844009050 con 0x55b6697a4b60 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f485d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b6697a9040 0x55b6697ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697abb00 con 0x55b6697a9040 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f48597da640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b6697a9040 0x55b6697ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.750+0000 7f48597da640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b6697a9040 0x55b6697ab430 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f485d326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697ac350 con 0x55b6697a9040 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f485d326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f485d326800 20 searching for the correct realm 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b6697ae0c0 0x55b6697b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697ae0c0 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f4858fd9640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b6697ae0c0 0x55b6697b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.751+0000 7f4858fd9640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b6697ae0c0 0x55b6697b0530 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.752+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.752+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a9040 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.752+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.752+0000 7f48597da640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f4854052070 0x7f48540489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.752+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x7f4854052070 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.752+0000 7f4853fff640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f4854052070 0x7f48540489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.752+0000 7f4853fff640 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f4854052070 0x7f48540489d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.753+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844009050 con 0x7f4854052070 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.753+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a4b60 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.753+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844009050 con 0x55b6697a4b60 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.753+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a4b60 2024-09-07T03:34:21.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.753+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.753+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697ae0c0 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.753+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.753+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a4b60 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.754+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.754+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a9040 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.754+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.754+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a9040 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.754+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.754+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a4b60 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.754+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.754+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x7f4854052070 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.755+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.755+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a4b60 2024-09-07T03:34:21.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.755+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.755+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x7f4854052070 2024-09-07T03:34:21.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.755+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.755+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a9040 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.755+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.755+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697ae0c0 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.756+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.756+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a4b60 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.756+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.756+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a9040 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.756+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.756+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697ae0c0 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.756+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.756+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a4b60 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.756+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.757+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a4b60 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.757+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.757+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a4b60 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.757+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.757+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697ae0c0 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.757+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.757+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x7f4854052070 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.757+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.757+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x7f4854052070 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.758+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.758+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x7f4854052070 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.758+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.758+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697ae0c0 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.758+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.758+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x7f4854052070 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.758+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.758+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a9040 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.759+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.759+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a9040 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.759+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.759+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697ae0c0 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.759+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.759+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a9040 2024-09-07T03:34:21.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.759+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.759+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b0c00 con 0x55b6697a9040 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697accd0 con 0x55b6697a4b60 2024-09-07T03:34:21.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697ac8e0 con 0x55b6697a9040 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.760+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697ad600 con 0x55b6697a4b60 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 zone default found 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 4 Realm: () 2024-09-07T03:34:21.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 zonegroup default 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b1530 con 0x7f4854052070 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b3770 con 0x55b6697ae0c0 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b3b10 con 0x55b6697ae0c0 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 started sync module instance, tier type = 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.761+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b2c00 con 0x55b6697a9040 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.763+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.763+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94241942089760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b4360 con 0x55b6697a9040 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.763+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b4bb0 con 0x55b6697a4b60 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.764+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.764+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94241942089760] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.764+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94241942094688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b4d10 con 0x55b6697a4b60 2024-09-07T03:34:21.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.764+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b3ed0 con 0x55b6697a9040 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.765+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94241942094688] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.765+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.765+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94241942095744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b3ed0 con 0x55b6697a9040 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.765+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b5dd0 con 0x7f4854052070 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.766+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94241942095744] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.766+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.766+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94241942098688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b5dd0 con 0x7f4854052070 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.766+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b6790 con 0x55b6697a9040 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.767+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94241942098688] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.767+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.767+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94241942103232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b5dd0 con 0x55b6697a9040 2024-09-07T03:34:21.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.767+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b5dd0 con 0x55b6697ae0c0 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.769+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.769+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94241942105328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b7660 con 0x55b6697ae0c0 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.769+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94241942103232] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.769+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b7c50 con 0x55b6697ae0c0 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.770+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(56 notify.6 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.770+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94241942105328] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.770+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94241942100256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b7c50 con 0x55b6697ae0c0 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.770+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b7110 con 0x7f4854052070 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94241942100256] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94241942110272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b7110 con 0x7f4854052070 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f485d326800 20 add_watcher() i=0 2024-09-07T03:34:21.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f485d326800 20 add_watcher() i=1 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f485d326800 20 add_watcher() i=2 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f485d326800 20 add_watcher() i=3 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f485d326800 20 add_watcher() i=4 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f485d326800 20 add_watcher() i=5 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.771+0000 7f485d326800 20 add_watcher() i=6 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.773+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94241942110272] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.773+0000 7f485d326800 20 add_watcher() i=7 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.773+0000 7f485d326800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.773+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697bbbf0 con 0x55b6697a4b60 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.774+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.774+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94241942112016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697b9050 con 0x55b6697a4b60 2024-09-07T03:34:21.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94241942112016] v36'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f470f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f485d326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:21.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f485d326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:21.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f485d326800 5 note: GC not initialized 2024-09-07T03:34:21.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f470e7e4640 20 reqs_thread_entry: start 2024-09-07T03:34:21.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f485d326800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f485d326800 20 Filter name: none 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f4707fff640 20 reqs_thread_entry: start 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f485d326800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f485d326800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.775+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eec10 con 0x55b6697a4b60 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.776+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.776+0000 7f485d326800 20 rados_obj.operate() r=0 bl.length=503 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.776+0000 7f485d326800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.776+0000 7f485d326800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.776+0000 7f485d326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.776+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697f5400 con 0x55b6697a4b60 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.777+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.777+0000 7f485d326800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.777+0000 7f485d326800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.777+0000 7f485d326800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.777+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94241942359552 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6697f0b00 con 0x55b6697a9040 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.778+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94241942103232 notify 154618822700 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55b66975f870 con 0x55b6697a9040 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.778+0000 7f472ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822700 cookie 94241942103232 notifier 4890 bl.length()=636 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.778+0000 7f472ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.778+0000 7f472ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.778+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94241942359552 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.778+0000 7f472ffff640 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f471c003ea0 con 0x55b6697a9040 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.778+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.778+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94241942359552 notify 154618822700 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b66975f2d0 con 0x55b6697a9040 2024-09-07T03:34:21.790 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.779+0000 7f470f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.779+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94241942112016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eca70 con 0x55b6697a4b60 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.780+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94241942112016] v36'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.780+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94241942089760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eca70 con 0x55b6697a9040 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.781+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94241942089760] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.781+0000 7f485d326800 20 remove_watcher() i=0 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.781+0000 7f485d326800 2 removed watcher, disabling cache 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.781+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94241942094688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eca70 con 0x55b6697a4b60 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.782+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94241942094688] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4844028040 con 0x55b6697a4b60 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.782+0000 7f485d326800 20 remove_watcher() i=1 2024-09-07T03:34:21.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.782+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94241942095744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eca70 con 0x55b6697a9040 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.783+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94241942095744] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.783+0000 7f485d326800 20 remove_watcher() i=2 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.783+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94241942098688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eca70 con 0x7f4854052070 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.784+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94241942098688] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.784+0000 7f485d326800 20 remove_watcher() i=3 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.784+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94241942103232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eca70 con 0x55b6697a9040 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.785+0000 7f48597da640 1 -- 172.21.15.120:0/1789364240 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94241942103232] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854027070 con 0x55b6697a9040 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.785+0000 7f485d326800 20 remove_watcher() i=4 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.785+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94241942105328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eca70 con 0x55b6697ae0c0 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.786+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94241942105328] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.786+0000 7f485d326800 20 remove_watcher() i=5 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.786+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94241942100256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eca70 con 0x55b6697ae0c0 2024-09-07T03:34:21.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.787+0000 7f4858fd9640 1 -- 172.21.15.120:0/1789364240 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94241942100256] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f484c051070 con 0x55b6697ae0c0 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.787+0000 7f485d326800 20 remove_watcher() i=6 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.787+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94241942110272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6697eca70 con 0x7f4854052070 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94241942110272] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4844028040 con 0x7f4854052070 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 20 remove_watcher() i=7 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b6697a9040 msgr2=0x55b6697ab430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b6697a9040 0x55b6697ab430 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b6697a4b60 msgr2=0x55b6697a7020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b6697a4b60 0x55b6697a7020 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f4854052070 msgr2=0x7f48540489d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f4854052070 0x7f48540489d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b6697ae0c0 msgr2=0x55b6697b0530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55b6697ae0c0 0x55b6697b0530 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f472403c780 msgr2=0x7f472403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f472403c780 0x7f472403ec40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f484c053ca0 tx=0x7f484c083000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 msgr2=0x55b6697609c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f4853fff640 1 -- 172.21.15.120:0/1789364240 reap_dead start 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.788+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b6697609c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4854048040 tx=0x7f4854053ce0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 shutdown_connections 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 --2- 172.21.15.120:0/1789364240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66978f810 0x55b6697609c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 >> 172.21.15.120:0/1789364240 conn(0x55b66978bc10 msgr2=0x55b669789e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 shutdown_connections 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/1789364240 wait complete. 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2902698471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f473003c780 msgr2=0x7f473003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 --2- 172.21.15.120:0/2902698471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f473003c780 0x7f473003ec40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55b669769630 tx=0x7f484c081040 comp rx=0 tx=0).stop 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2902698471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b669782d10 msgr2=0x55b669783130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 --2- 172.21.15.120:0/2902698471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b669782d10 0x55b669783130 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4854016cf0 tx=0x7f485400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2902698471 shutdown_connections 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 --2- 172.21.15.120:0/2902698471 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f473003c780 0x7f473003ec40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 --2- 172.21.15.120:0/2902698471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b669782d10 0x55b669783130 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2902698471 >> 172.21.15.120:0/2902698471 conn(0x55b6697770c0 msgr2=0x55b6697774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2902698471 shutdown_connections 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2902698471 wait complete. 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b669770320 msgr2=0x55b6697727e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b669770320 0x55b6697727e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b669671040 msgr2=0x55b66976f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b669671040 0x55b66976f530 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f474003c730 msgr2=0x7f474003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f474003c730 0x7f474003ebf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4844001d70 tx=0x7f48440012d0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 msgr2=0x55b669767ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.789+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b669767ee0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f484c025c20 tx=0x7f484c002fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.790+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 shutdown_connections 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.790+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55b669770320 0x55b6697727e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.790+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55b669671040 0x55b66976f530 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.790+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f474003c730 0x7f474003ebf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.790+0000 7f485d326800 1 --2- 172.21.15.120:0/2976316811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55b66966fe00 0x55b669767ee0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.790+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 >> 172.21.15.120:0/2976316811 conn(0x55b66966b1d0 msgr2=0x55b669759760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.790+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 shutdown_connections 2024-09-07T03:34:21.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.790+0000 7f485d326800 1 -- 172.21.15.120:0/2976316811 wait complete. 2024-09-07T03:34:21.801 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.801 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.802 ERROR:root:0 2024-09-07T03:34:21.802 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-07T03:34:21.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-07T03:34:21.802 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-07T03:34:21.848 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:21.848 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:21.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.848+0000 7f0cc5440800 1 Processor -- start 2024-09-07T03:34:21.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.848+0000 7f0cc5440800 1 -- start start 2024-09-07T03:34:21.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.848+0000 7f0cc5440800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d6e29fffd0 0x55d6e2a08af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.848+0000 7f0cc5440800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6e28a9e40 con 0x55d6e29fe4b0 2024-09-07T03:34:21.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.848+0000 7f0cc5440800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55d6e2874680 con 0x55d6e29fffd0 2024-09-07T03:34:21.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.848+0000 7f0cc2730640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55d6e29fffd0 0x55d6e2a08af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.848+0000 7f0cc2f31640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55d6e29fe4b0 0x55d6e29fe8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43962/0 (socket says 172.21.15.120:43962) 2024-09-07T03:34:21.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.848+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2460761629 learned_addr learned my addr 172.21.15.120:0/2460761629 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:21.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.849+0000 7f0cc2730640 1 -- 172.21.15.120:0/2460761629 >> v1:172.21.15.104:6789/0 conn(0x55d6e29fe4b0 legacy=0x55d6e29fe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.849+0000 7f0cc2730640 1 -- 172.21.15.120:0/2460761629 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e28906b0 con 0x55d6e29fffd0 2024-09-07T03:34:21.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.850+0000 7f0cc2730640 1 --2- 172.21.15.120:0/2460761629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fffd0 0x55d6e2a08af0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800a470 tx=0x7f0cb8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51511f10045984a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc1f2f640 1 -- 172.21.15.120:0/2460761629 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb8053570 con 0x55d6e29fffd0 2024-09-07T03:34:21.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc1f2f640 1 -- 172.21.15.120:0/2460761629 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb8058070 con 0x55d6e29fffd0 2024-09-07T03:34:21.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc1f2f640 1 -- 172.21.15.120:0/2460761629 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb8053880 con 0x55d6e29fffd0 2024-09-07T03:34:21.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc5440800 1 -- 172.21.15.120:0/2460761629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fffd0 msgr2=0x55d6e2a08af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2460761629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fffd0 0x55d6e2a08af0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800a470 tx=0x7f0cb8045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:21.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc5440800 1 -- 172.21.15.120:0/2460761629 shutdown_connections 2024-09-07T03:34:21.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2460761629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fffd0 0x55d6e2a08af0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc5440800 1 -- 172.21.15.120:0/2460761629 >> 172.21.15.120:0/2460761629 conn(0x55d6e29fa200 msgr2=0x55d6e29fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc5440800 1 -- 172.21.15.120:0/2460761629 shutdown_connections 2024-09-07T03:34:21.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.851+0000 7f0cc5440800 1 -- 172.21.15.120:0/2460761629 wait complete. 2024-09-07T03:34:21.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.865+0000 7f0cc5440800 1 Processor -- start 2024-09-07T03:34:21.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.865+0000 7f0cc5440800 1 -- start start 2024-09-07T03:34:21.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.865+0000 7f0cc5440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.865+0000 7f0cc5440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d6e2898dd0 con 0x55d6e29fe4b0 2024-09-07T03:34:21.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.865+0000 7f0cc2f31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.866+0000 7f0cc2f31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40704/0 (socket says 172.21.15.120:40704) 2024-09-07T03:34:21.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.866+0000 7f0cc2f31640 1 -- 172.21.15.120:0/507842451 learned_addr learned my addr 172.21.15.120:0/507842451 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.866+0000 7f0cc2f31640 1 -- 172.21.15.120:0/507842451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e28b1e10 con 0x55d6e29fe4b0 2024-09-07T03:34:21.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.866+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/507842451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af1870 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4001e40 tx=0x7f0cb4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fe48b7dcb9f1fb server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.866+0000 7f0bb0e09640 1 -- 172.21.15.120:0/507842451 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb4012020 con 0x55d6e29fe4b0 2024-09-07T03:34:21.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.866+0000 7f0bb0e09640 1 -- 172.21.15.120:0/507842451 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb400e5a0 con 0x55d6e29fe4b0 2024-09-07T03:34:21.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.866+0000 7f0bb0e09640 1 -- 172.21.15.120:0/507842451 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb400e8a0 con 0x55d6e29fe4b0 2024-09-07T03:34:21.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 -- 172.21.15.120:0/507842451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 msgr2=0x55d6e2af1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 --2- 172.21.15.120:0/507842451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af1870 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4001e40 tx=0x7f0cb4001e70 comp rx=0 tx=0).stop 2024-09-07T03:34:21.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 -- 172.21.15.120:0/507842451 shutdown_connections 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 --2- 172.21.15.120:0/507842451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af1870 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 -- 172.21.15.120:0/507842451 >> 172.21.15.120:0/507842451 conn(0x55d6e29fa200 msgr2=0x55d6e2aed1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 -- 172.21.15.120:0/507842451 shutdown_connections 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 -- 172.21.15.120:0/507842451 wait complete. 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 Processor -- start 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 -- start start 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc5440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d6e2a09300 con 0x55d6e29fe4b0 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc2f31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc2f31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40718/0 (socket says 172.21.15.120:40718) 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.867+0000 7f0cc2f31640 1 -- 172.21.15.120:0/1074840984 learned_addr learned my addr 172.21.15.120:0/1074840984 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.868+0000 7f0cc2f31640 1 -- 172.21.15.120:0/1074840984 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e2af9730 con 0x55d6e29fe4b0 2024-09-07T03:34:21.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.868+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af91d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40012b0 tx=0x7f0cb4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.868+0000 7f0baf606640 1 -- 172.21.15.120:0/1074840984 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb4012030 con 0x55d6e29fe4b0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.868+0000 7f0baf606640 1 -- 172.21.15.120:0/1074840984 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb401a750 con 0x55d6e29fe4b0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.868+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6e2af99c0 con 0x55d6e29fe4b0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.868+0000 7f0baf606640 1 -- 172.21.15.120:0/1074840984 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb401aa70 con 0x55d6e29fe4b0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.868+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e2afa3c0 con 0x55d6e29fe4b0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.869+0000 7f0baf606640 1 -- 172.21.15.120:0/1074840984 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0cb4015020 con 0x55d6e29fe4b0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.869+0000 7f0baf606640 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ba803c730 0x7f0ba803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.869+0000 7f0baf606640 1 -- 172.21.15.120:0/1074840984 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f0cb4020030 con 0x55d6e29fe4b0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.869+0000 7f0cc2730640 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ba803c730 0x7f0ba803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.869+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e29fffd0 0x55d6e2b00820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.869+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b00d60 con 0x55d6e29fffd0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.869+0000 7f0cc3732640 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e29fffd0 0x55d6e2b00820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.869+0000 7f0cc2730640 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ba803c730 0x7f0ba803ebf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8057000 tx=0x7f0cb8052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.870+0000 7f0cc3732640 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e29fffd0 0x55d6e2b00820 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.870+0000 7f0cc3732640 1 -- 172.21.15.120:0/1074840984 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cbc00a4d0 con 0x55d6e29fffd0 2024-09-07T03:34:21.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.870+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b01610 0x55d6e2b03aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.870+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b04210 con 0x55d6e2b01610 2024-09-07T03:34:21.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.870+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b01610 0x55d6e2b03aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.871+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b01610 0x55d6e2b03aa0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.871+0000 7f0cc2f31640 1 -- 172.21.15.120:0/1074840984 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b01610 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.871+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b05ac0 con 0x55d6e2b01610 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.871+0000 7f0cc2f31640 1 -- 172.21.15.120:0/1074840984 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b01610 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.871+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b04bd0 con 0x55d6e2b01610 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.872+0000 7f0cc2f31640 1 -- 172.21.15.120:0/1074840984 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b01610 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.872+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b04ff0 con 0x55d6e29fffd0 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.872+0000 7f0cc3732640 1 -- 172.21.15.120:0/1074840984 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0cbc00a4d0 con 0x55d6e29fffd0 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.872+0000 7f0cc5440800 1 Processor -- start 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.872+0000 7f0cc5440800 1 -- start start 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.872+0000 7f0cc5440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b13f70 0x55d6e2b14390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.872+0000 7f0cc5440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d6e28f6a00 con 0x55d6e2b13f70 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0cc3732640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b13f70 0x55d6e2b14390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0cc3732640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b13f70 0x55d6e2b14390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40726/0 (socket says 172.21.15.120:40726) 2024-09-07T03:34:21.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0cc3732640 1 -- 172.21.15.120:0/3103698090 learned_addr learned my addr 172.21.15.120:0/3103698090 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0cc3732640 1 -- 172.21.15.120:0/3103698090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e2b149d0 con 0x55d6e2b13f70 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0cc3732640 1 --2- 172.21.15.120:0/3103698090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b13f70 0x55d6e2b14390 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc016d20 tx=0x7f0cbc00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0bace01640 1 -- 172.21.15.120:0/3103698090 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc017660 con 0x55d6e2b13f70 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0bace01640 1 -- 172.21.15.120:0/3103698090 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc01b030 con 0x55d6e2b13f70 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0cc5440800 1 -- 172.21.15.120:0/3103698090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6e2b15200 con 0x55d6e2b13f70 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0bace01640 1 -- 172.21.15.120:0/3103698090 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc017950 con 0x55d6e2b13f70 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.873+0000 7f0cc5440800 1 -- 172.21.15.120:0/3103698090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e2b157a0 con 0x55d6e2b13f70 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.874+0000 7f0bace01640 1 -- 172.21.15.120:0/3103698090 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0cbc017b40 con 0x55d6e2b13f70 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.874+0000 7f0bace01640 1 --2- 172.21.15.120:0/3103698090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b9c03c7f0 0x7f0b9c03ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.874+0000 7f0bace01640 1 -- 172.21.15.120:0/3103698090 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f0cbc00e040 con 0x55d6e2b13f70 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.874+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/3103698090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b9c03c7f0 0x7f0b9c03ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.874+0000 7f0cc5440800 1 Processor -- start 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/3103698090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b9c03c7f0 0x7f0b9c03ecb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55d6e2b046f0 tx=0x7f0cb4051fb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0cc5440800 1 -- start start 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0cc5440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b20e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0cc5440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d6e2af20c0 con 0x55d6e2b20a70 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0cc3732640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b20e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0cc3732640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b20e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40734/0 (socket says 172.21.15.120:40734) 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0cc3732640 1 -- 172.21.15.120:0/479523158 learned_addr learned my addr 172.21.15.120:0/479523158 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0cc3732640 1 -- 172.21.15.120:0/479523158 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e2b21460 con 0x55d6e2b20a70 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0cc3732640 1 --2- 172.21.15.120:0/479523158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b20e70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc053e70 tx=0x7f0cbc054040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d256c83335a1f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0ba67fc640 1 -- 172.21.15.120:0/479523158 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc048020 con 0x55d6e2b20a70 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0ba67fc640 1 -- 172.21.15.120:0/479523158 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc051030 con 0x55d6e2b20a70 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.875+0000 7f0ba67fc640 1 -- 172.21.15.120:0/479523158 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc014a00 con 0x55d6e2b20a70 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 -- 172.21.15.120:0/479523158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 msgr2=0x55d6e2b20e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 --2- 172.21.15.120:0/479523158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b20e70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc053e70 tx=0x7f0cbc054040 comp rx=0 tx=0).stop 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 -- 172.21.15.120:0/479523158 shutdown_connections 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 --2- 172.21.15.120:0/479523158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b20e70 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 -- 172.21.15.120:0/479523158 >> 172.21.15.120:0/479523158 conn(0x55d6e2b1ce70 msgr2=0x55d6e2b1b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 -- 172.21.15.120:0/479523158 shutdown_connections 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 -- 172.21.15.120:0/479523158 wait complete. 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 Processor -- start 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 -- start start 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b28080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc5440800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55d6e2b21a80 con 0x55d6e2b20a70 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc3732640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b28080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc3732640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b28080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40740/0 (socket says 172.21.15.120:40740) 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.876+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 learned_addr learned my addr 172.21.15.120:0/2074932446 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:21.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.877+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e2b285e0 con 0x55d6e2b20a70 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.877+0000 7f0cc3732640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b28080 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc053f00 tx=0x7f0cbc053dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.877+0000 7f0ba4ff9640 1 -- 172.21.15.120:0/2074932446 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc0127a0 con 0x55d6e2b20a70 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.877+0000 7f0ba4ff9640 1 -- 172.21.15.120:0/2074932446 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc012940 con 0x55d6e2b20a70 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.877+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6e2b28870 con 0x55d6e2b20a70 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.877+0000 7f0ba4ff9640 1 -- 172.21.15.120:0/2074932446 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc012c20 con 0x55d6e2b20a70 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.877+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e2b291f0 con 0x55d6e2b20a70 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.878+0000 7f0ba4ff9640 1 -- 172.21.15.120:0/2074932446 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0cbc04b020 con 0x55d6e2b20a70 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.878+0000 7f0ba4ff9640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b8c03c780 0x7f0b8c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.878+0000 7f0ba4ff9640 1 -- 172.21.15.120:0/2074932446 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f0cbc030070 con 0x55d6e2b20a70 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.878+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b8c03c780 0x7f0b8c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.878+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b8c03c780 0x7f0b8c03ec40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4001e90 tx=0x7f0cb4035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e2b33bb0 0x55d6e2b36070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b367c0 con 0x55d6e2b33bb0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc2730640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e2b33bb0 0x55d6e2b36070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc2730640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e2b33bb0 0x55d6e2b36070 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc5440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc5440800 20 realm 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.879+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b36bf0 con 0x55d6e2b33bb0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc5440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc5440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b374c0 con 0x55d6e2b33bb0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc5440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b37ee0 0x55d6e2b3a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3aa80 con 0x55d6e2b37ee0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.880+0000 7f0cc3732640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b37ee0 0x55d6e2b3a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc3732640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b37ee0 0x55d6e2b3a310 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc5440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3b2d0 con 0x55d6e2b37ee0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc5440800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc5440800 20 searching for the correct realm 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d6e2b3d040 0x55d6e2b3f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b3d040 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.881+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d6e2b3d040 0x55d6e2b3f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.882+0000 7f0cc2f31640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d6e2b3d040 0x55d6e2b3f470 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.882+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.882+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.882+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.882+0000 7f0cc3732640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0cbc04d040 0x7f0cbc0362a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.882+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x7f0cbc04d040 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.882+0000 7f0cc2730640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0cbc04d040 0x7f0cbc0362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.882+0000 7f0cc2730640 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0cbc04d040 0x7f0cbc0362a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.883+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.883+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b33bb0 2024-09-07T03:34:21.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.883+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.883+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b33bb0 2024-09-07T03:34:21.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.883+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.883+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b3d040 2024-09-07T03:34:21.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.883+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.883+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b33bb0 2024-09-07T03:34:21.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.884+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.884+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.884+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.884+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.884+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.884+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b33bb0 2024-09-07T03:34:21.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.884+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.884+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x7f0cbc04d040 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.885+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.885+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b33bb0 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.885+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.885+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x7f0cbc04d040 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.885+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.885+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.885+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.885+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b3d040 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.886+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.886+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b33bb0 2024-09-07T03:34:21.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.886+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.886+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.886+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.886+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b3d040 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b33bb0 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b33bb0 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b33bb0 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b3d040 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.887+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x7f0cbc04d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x7f0cbc04d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x7f0cbc04d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b3d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x7f0cbc04d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.888+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.889+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.889+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.889+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.889+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b3d040 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.889+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.889+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.889+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.889+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3fb40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3bc20 con 0x55d6e2b33bb0 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3b860 con 0x55d6e2b37ee0 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b3c060 con 0x55d6e2b33bb0 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.890+0000 7f0cc5440800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 zone default found 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 4 Realm: () 2024-09-07T03:34:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 zonegroup default 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b40470 con 0x7f0cbc04d040 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b426b0 con 0x55d6e2b3d040 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b42a50 con 0x55d6e2b3d040 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 started sync module instance, tier type = 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.891+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b41b40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.892+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.892+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94381414817856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b41b40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.892+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b43450 con 0x55d6e2b33bb0 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.893+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94381414817856] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.893+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.894+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94381414815376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b437f0 con 0x55d6e2b33bb0 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.894+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b442a0 con 0x55d6e2b37ee0 2024-09-07T03:34:21.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.894+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.894+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94381414825344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b442a0 con 0x55d6e2b37ee0 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.895+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b452a0 con 0x7f0cbc04d040 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.895+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94381414815376] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.895+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94381414825344] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.896+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.896+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94381414829456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b45260 con 0x7f0cbc04d040 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.896+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b45b40 con 0x55d6e2b37ee0 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.897+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.897+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94381414831760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b45f60 con 0x55d6e2b37ee0 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.897+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b467b0 con 0x55d6e2b3d040 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.897+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94381414829456] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.898+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94381414831760] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.898+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.898+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94381414832816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b46380 con 0x55d6e2b3d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.898+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b47000 con 0x55d6e2b3d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.899+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94381414832816] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.899+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.899+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94381414837072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b47420 con 0x55d6e2b3d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.899+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b47de0 con 0x7f0cbc04d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94381414837072] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94381414838608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b47de0 con 0x7f0cbc04d040 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc5440800 20 add_watcher() i=0 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc5440800 20 add_watcher() i=1 2024-09-07T03:34:21.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc5440800 20 add_watcher() i=2 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc5440800 20 add_watcher() i=3 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc5440800 20 add_watcher() i=4 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc5440800 20 add_watcher() i=5 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.900+0000 7f0cc5440800 20 add_watcher() i=6 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.901+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94381414838608] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.901+0000 7f0cc5440800 20 add_watcher() i=7 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.901+0000 7f0cc5440800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.901+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b4b270 con 0x55d6e2b33bb0 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.901+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.901+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94381414841088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b48790 con 0x55d6e2b33bb0 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.902+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94381414841088] v36'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0b797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0cc5440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0cc5440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0cc5440800 5 note: GC not initialized 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0af3fff640 20 reqs_thread_entry: start 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0cc5440800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0cc5440800 20 Filter name: none 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0af1ffb640 20 reqs_thread_entry: start 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0cc5440800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0cc5440800 20 rados->read ofs=0 len=0 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.903+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7e3a0 con 0x55d6e2b33bb0 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.904+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.904+0000 7f0cc5440800 20 rados_obj.operate() r=0 bl.length=460 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.904+0000 7f0cc5440800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-07T03:34:21.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.904+0000 7f0cc5440800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.904+0000 7f0cc5440800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:21.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.904+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b847c0 con 0x55d6e2b33bb0 2024-09-07T03:34:21.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0cc5440800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0cc5440800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0cc5440800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:21.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94381415088512 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7fe00 con 0x55d6e2b37ee0 2024-09-07T03:34:21.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94381414831760 notify 154618822701 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55d6e2b291f0 con 0x55d6e2b37ee0 2024-09-07T03:34:21.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0ba67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822701 cookie 94381414831760 notifier 4897 bl.length()=666 2024-09-07T03:34:21.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0ba67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:21.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0ba67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:21.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94381415088512 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.905+0000 7f0ba67fc640 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f0b88003ea0 con 0x55d6e2b37ee0 2024-09-07T03:34:21.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.906+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.906+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94381415088512 notify 154618822701 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d6e2b28870 con 0x55d6e2b37ee0 2024-09-07T03:34:21.919 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:21.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.907+0000 7f0b797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:21.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.907+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94381414841088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7c1d0 con 0x55d6e2b33bb0 2024-09-07T03:34:21.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.907+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94381414841088] v36'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.908+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94381414817856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7c1d0 con 0x55d6e2b37ee0 2024-09-07T03:34:21.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.908+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94381414817856] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.908+0000 7f0cc5440800 20 remove_watcher() i=0 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.908+0000 7f0cc5440800 2 removed watcher, disabling cache 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.909+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94381414815376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7c1d0 con 0x55d6e2b33bb0 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.909+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94381414815376] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x55d6e2b33bb0 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.909+0000 7f0cc5440800 20 remove_watcher() i=1 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.909+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94381414825344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7c1d0 con 0x55d6e2b37ee0 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.910+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94381414825344] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.910+0000 7f0cc5440800 20 remove_watcher() i=2 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.910+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94381414829456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7c1d0 con 0x7f0cbc04d040 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.911+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94381414829456] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.911+0000 7f0cc5440800 20 remove_watcher() i=3 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.911+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94381414831760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7c1d0 con 0x55d6e2b37ee0 2024-09-07T03:34:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.913+0000 7f0cc3732640 1 -- 172.21.15.120:0/2074932446 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94381414831760] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03a020 con 0x55d6e2b37ee0 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.913+0000 7f0cc5440800 20 remove_watcher() i=4 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.913+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94381414832816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7c1d0 con 0x55d6e2b3d040 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.913+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94381414832816] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.913+0000 7f0cc5440800 20 remove_watcher() i=5 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.914+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94381414837072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7c1d0 con 0x55d6e2b3d040 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.914+0000 7f0cc2f31640 1 -- 172.21.15.120:0/2074932446 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94381414837072] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4018ce0 con 0x55d6e2b3d040 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.914+0000 7f0cc5440800 20 remove_watcher() i=6 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.914+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94381414838608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d6e2b7c1d0 con 0x7f0cbc04d040 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.915+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94381414838608] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb8051070 con 0x7f0cbc04d040 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.915+0000 7f0cc5440800 20 remove_watcher() i=7 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.915+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b37ee0 msgr2=0x55d6e2b3a310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.915+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b37ee0 0x55d6e2b3a310 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e2b33bb0 msgr2=0x55d6e2b36070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e2b33bb0 0x55d6e2b36070 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0cbc04d040 msgr2=0x7f0cbc0362a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f0cbc04d040 0x7f0cbc0362a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d6e2b3d040 msgr2=0x55d6e2b3f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55d6e2b3d040 0x55d6e2b3f470 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b8c03c780 msgr2=0x7f0b8c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b8c03c780 0x7f0b8c03ec40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4001e90 tx=0x7f0cb4035000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 msgr2=0x55d6e2b28080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 --2- 172.21.15.120:0/2074932446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b20a70 0x55d6e2b28080 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc053f00 tx=0x7f0cbc053dd0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 reap_dead start 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc2730640 1 -- 172.21.15.120:0/2074932446 reap_dead start 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 shutdown_connections 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 >> 172.21.15.120:0/2074932446 conn(0x55d6e2b1ce70 msgr2=0x55d6e2b1b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 shutdown_connections 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/2074932446 wait complete. 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/3103698090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b9c03c7f0 msgr2=0x7f0b9c03ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 --2- 172.21.15.120:0/3103698090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b9c03c7f0 0x7f0b9c03ecb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55d6e2b046f0 tx=0x7f0cb4051fb0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/3103698090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b13f70 msgr2=0x55d6e2b14390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 --2- 172.21.15.120:0/3103698090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b13f70 0x55d6e2b14390 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc016d20 tx=0x7f0cbc00d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/3103698090 shutdown_connections 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 --2- 172.21.15.120:0/3103698090 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0b9c03c7f0 0x7f0b9c03ecb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 --2- 172.21.15.120:0/3103698090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e2b13f70 0x55d6e2b14390 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/3103698090 >> 172.21.15.120:0/3103698090 conn(0x55d6e2b08320 msgr2=0x55d6e2b08700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/3103698090 shutdown_connections 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.916+0000 7f0cc5440800 1 -- 172.21.15.120:0/3103698090 wait complete. 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b01610 msgr2=0x55d6e2b03aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b01610 0x55d6e2b03aa0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e29fffd0 msgr2=0x55d6e2b00820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e29fffd0 0x55d6e2b00820 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ba803c730 msgr2=0x7f0ba803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ba803c730 0x7f0ba803ebf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8057000 tx=0x7f0cb8052000 comp rx=0 tx=0).stop 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 msgr2=0x55d6e2af91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af91d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40012b0 tx=0x7f0cb4000ed0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 shutdown_connections 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55d6e2b01610 0x55d6e2b03aa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55d6e29fffd0 0x55d6e2b00820 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f0ba803c730 0x7f0ba803ebf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 --2- 172.21.15.120:0/1074840984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d6e29fe4b0 0x55d6e2af91d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 >> 172.21.15.120:0/1074840984 conn(0x55d6e29fa200 msgr2=0x55d6e2af2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 shutdown_connections 2024-09-07T03:34:21.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.917+0000 7f0cc5440800 1 -- 172.21.15.120:0/1074840984 wait complete. 2024-09-07T03:34:21.930 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.931 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:21.931 ERROR:root:0 2024-09-07T03:34:21.931 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:21.943 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000fc6700b8ab28b583-0066dbc9bd-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:34:21.943 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-07T03:34:21.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-07T03:34:21.943 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-07T03:34:21.990 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:21.990 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:21.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.989+0000 7f8dbe5ad800 1 Processor -- start 2024-09-07T03:34:21.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.990+0000 7f8dbe5ad800 1 -- start start 2024-09-07T03:34:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.990+0000 7f8dbe5ad800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e98e1fe210 0x55e98e2006d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.990+0000 7f8dbe5ad800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e98e0a3e40 con 0x55e98e1fa610 2024-09-07T03:34:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.990+0000 7f8dbe5ad800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x55e98e06e680 con 0x55e98e1fe210 2024-09-07T03:34:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.990+0000 7f8dbb896640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55e98e1fe210 0x55e98e2006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.990+0000 7f8dbc097640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55e98e1fa610 0x55e98e1fca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43974/0 (socket says 172.21.15.120:43974) 2024-09-07T03:34:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.990+0000 7f8dbc097640 1 -- 172.21.15.120:0/159547733 learned_addr learned my addr 172.21.15.120:0/159547733 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:34:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.990+0000 7f8dbb896640 1 -- 172.21.15.120:0/159547733 >> v1:172.21.15.104:6789/0 conn(0x55e98e1fa610 legacy=0x55e98e1fca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.990+0000 7f8dbb896640 1 -- 172.21.15.120:0/159547733 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98e08a6b0 con 0x55e98e1fe210 2024-09-07T03:34:21.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.992+0000 7f8dbb896640 1 --2- 172.21.15.120:0/159547733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fe210 0x55e98e2006d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8db000a470 tx=0x7f8db0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67454ec25190ebe server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:21.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.992+0000 7f8dbb095640 1 -- 172.21.15.120:0/159547733 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db0053570 con 0x55e98e1fe210 2024-09-07T03:34:21.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.992+0000 7f8dbb095640 1 -- 172.21.15.120:0/159547733 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db0058070 con 0x55e98e1fe210 2024-09-07T03:34:21.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.992+0000 7f8dbb095640 1 -- 172.21.15.120:0/159547733 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db0053880 con 0x55e98e1fe210 2024-09-07T03:34:21.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.993+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/159547733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fe210 msgr2=0x55e98e2006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:21.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.993+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/159547733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fe210 0x55e98e2006d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8db000a470 tx=0x7f8db0045a20 comp rx=0 tx=0).stop 2024-09-07T03:34:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.993+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/159547733 shutdown_connections 2024-09-07T03:34:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.993+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/159547733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fe210 0x55e98e2006d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.993+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/159547733 >> 172.21.15.120:0/159547733 conn(0x55e98e1f41d0 msgr2=0x55e98e1f6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.993+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/159547733 shutdown_connections 2024-09-07T03:34:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:21.993+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/159547733 wait complete. 2024-09-07T03:34:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.006+0000 7f8dbe5ad800 1 Processor -- start 2024-09-07T03:34:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.006+0000 7f8dbe5ad800 1 -- start start 2024-09-07T03:34:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8dbe5ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e1f9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8dbe5ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e98e092dd0 con 0x55e98e1fa610 2024-09-07T03:34:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8dbc097640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e1f9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8dbc097640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e1f9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40768/0 (socket says 172.21.15.120:40768) 2024-09-07T03:34:22.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8dbc097640 1 -- 172.21.15.120:0/3528098566 learned_addr learned my addr 172.21.15.120:0/3528098566 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8dbc097640 1 -- 172.21.15.120:0/3528098566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98e0abe10 con 0x55e98e1fa610 2024-09-07T03:34:22.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8dbc097640 1 --2- 172.21.15.120:0/3528098566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e1f9d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8dac001df0 tx=0x7f8dac00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12acb313458f12f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8caa60c640 1 -- 172.21.15.120:0/3528098566 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dac012020 con 0x55e98e1fa610 2024-09-07T03:34:22.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8caa60c640 1 -- 172.21.15.120:0/3528098566 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac00e470 con 0x55e98e1fa610 2024-09-07T03:34:22.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.007+0000 7f8caa60c640 1 -- 172.21.15.120:0/3528098566 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dac00e7f0 con 0x55e98e1fa610 2024-09-07T03:34:22.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.008+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3528098566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 msgr2=0x55e98e1f9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.008+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/3528098566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e1f9d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8dac001df0 tx=0x7f8dac00b6c0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.008+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3528098566 shutdown_connections 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.008+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/3528098566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e1f9d80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.008+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3528098566 >> 172.21.15.120:0/3528098566 conn(0x55e98e1f41d0 msgr2=0x55e98e2e5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.008+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3528098566 shutdown_connections 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.008+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3528098566 wait complete. 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.008+0000 7f8dbe5ad800 1 Processor -- start 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8dbe5ad800 1 -- start start 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8dbe5ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e2f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8dbe5ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e98e201050 con 0x55e98e1fa610 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8dbc097640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e2f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8dbc097640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e2f3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40782/0 (socket says 172.21.15.120:40782) 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8dbc097640 1 -- 172.21.15.120:0/1306914636 learned_addr learned my addr 172.21.15.120:0/1306914636 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8dbc097640 1 -- 172.21.15.120:0/1306914636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98e2f37b0 con 0x55e98e1fa610 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8dbc097640 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e2f3250 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55e98e1f98b0 tx=0x7f8dac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8ca8e09640 1 -- 172.21.15.120:0/1306914636 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dac012030 con 0x55e98e1fa610 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8ca8e09640 1 -- 172.21.15.120:0/1306914636 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac01a6d0 con 0x55e98e1fa610 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e98e2f3a40 con 0x55e98e1fa610 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.009+0000 7f8ca8e09640 1 -- 172.21.15.120:0/1306914636 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dac01a9d0 con 0x55e98e1fa610 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.010+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98e2f4440 con 0x55e98e1fa610 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.010+0000 7f8ca8e09640 1 -- 172.21.15.120:0/1306914636 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8dac015020 con 0x55e98e1fa610 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8ca8e09640 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ca403c780 0x7f8ca403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8ca8e09640 1 -- 172.21.15.120:0/1306914636 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f8dac020030 con 0x55e98e1fa610 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8dbb896640 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ca403c780 0x7f8ca403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e1fe210 0x55e98e2fa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e2fade0 con 0x55e98e1fe210 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8dbc898640 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e1fe210 0x55e98e2fa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8dbb896640 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ca403c780 0x7f8ca403ec40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8db0057000 tx=0x7f8db0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8dbc898640 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e1fe210 0x55e98e2fa8a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8dbc898640 1 -- 172.21.15.120:0/1306914636 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db400a4d0 con 0x55e98e1fe210 2024-09-07T03:34:22.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e2fb690 0x55e98e2fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.011+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e2fe2a0 con 0x55e98e2fb690 2024-09-07T03:34:22.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.012+0000 7f8dbc097640 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e2fb690 0x55e98e2fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.012+0000 7f8dbc097640 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e2fb690 0x55e98e2fdb30 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.012+0000 7f8dbc097640 1 -- 172.21.15.120:0/1306914636 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8dac01ad50 con 0x55e98e2fb690 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.012+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e2ffb50 con 0x55e98e2fb690 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.013+0000 7f8dbc097640 1 -- 172.21.15.120:0/1306914636 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8dac01ad50 con 0x55e98e2fb690 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.013+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e2fecc0 con 0x55e98e2fb690 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.013+0000 7f8dbc097640 1 -- 172.21.15.120:0/1306914636 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8dac01ad50 con 0x55e98e2fb690 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.013+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e2ff120 con 0x55e98e1fe210 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.013+0000 7f8dbc898640 1 -- 172.21.15.120:0/1306914636 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8db400a4d0 con 0x55e98e1fe210 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.013+0000 7f8dbe5ad800 1 Processor -- start 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.013+0000 7f8dbe5ad800 1 -- start start 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8dbe5ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e30e040 0x55e98e30e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8dbe5ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e98e0f0a00 con 0x55e98e30e040 2024-09-07T03:34:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8dbc898640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e30e040 0x55e98e30e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8dbc898640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e30e040 0x55e98e30e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40784/0 (socket says 172.21.15.120:40784) 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8dbc898640 1 -- 172.21.15.120:0/3851115473 learned_addr learned my addr 172.21.15.120:0/3851115473 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8dbc898640 1 -- 172.21.15.120:0/3851115473 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98e30eaa0 con 0x55e98e30e040 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8dbc898640 1 --2- 172.21.15.120:0/3851115473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e30e040 0x55e98e30e460 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8db4016d20 tx=0x7f8db400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8ca1ffb640 1 -- 172.21.15.120:0/3851115473 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db4017660 con 0x55e98e30e040 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8ca1ffb640 1 -- 172.21.15.120:0/3851115473 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db401b030 con 0x55e98e30e040 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3851115473 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e98e30f2d0 con 0x55e98e30e040 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8ca1ffb640 1 -- 172.21.15.120:0/3851115473 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db4017950 con 0x55e98e30e040 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.014+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3851115473 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98e30f870 con 0x55e98e30e040 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.015+0000 7f8ca1ffb640 1 -- 172.21.15.120:0/3851115473 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8db4017b40 con 0x55e98e30e040 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.015+0000 7f8ca1ffb640 1 --2- 172.21.15.120:0/3851115473 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c9403c7f0 0x7f8c9403ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.015+0000 7f8ca1ffb640 1 -- 172.21.15.120:0/3851115473 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f8db400e040 con 0x55e98e30e040 2024-09-07T03:34:22.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.015+0000 7f8dbc097640 1 --2- 172.21.15.120:0/3851115473 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c9403c7f0 0x7f8c9403ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbe5ad800 1 Processor -- start 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbe5ad800 1 -- start start 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbc097640 1 --2- 172.21.15.120:0/3851115473 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c9403c7f0 0x7f8c9403ecb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55e98e2f4990 tx=0x7f8dac022650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbe5ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e31aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbe5ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e98e1f8620 con 0x55e98e31aae0 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbc898640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e31aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbc898640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e31aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40800/0 (socket says 172.21.15.120:40800) 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbc898640 1 -- 172.21.15.120:0/971442056 learned_addr learned my addr 172.21.15.120:0/971442056 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbc898640 1 -- 172.21.15.120:0/971442056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98e31b4d0 con 0x55e98e31aae0 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8dbc898640 1 --2- 172.21.15.120:0/971442056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e31aee0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8db40134e0 tx=0x7f8db4013510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223b8821dbdf2498 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.016+0000 7f8c9b7fe640 1 -- 172.21.15.120:0/971442056 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db4014a00 con 0x55e98e31aae0 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8c9b7fe640 1 -- 172.21.15.120:0/971442056 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db4049070 con 0x55e98e31aae0 2024-09-07T03:34:22.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8c9b7fe640 1 -- 172.21.15.120:0/971442056 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db4028350 con 0x55e98e31aae0 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/971442056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 msgr2=0x55e98e31aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/971442056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e31aee0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8db40134e0 tx=0x7f8db4013510 comp rx=0 tx=0).stop 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/971442056 shutdown_connections 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/971442056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e31aee0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/971442056 >> 172.21.15.120:0/971442056 conn(0x55e98e316ee0 msgr2=0x55e98e315120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/971442056 shutdown_connections 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/971442056 wait complete. 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 Processor -- start 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 -- start start 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e322160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.017+0000 7f8dbe5ad800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e98e31baf0 con 0x55e98e31aae0 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8dbc898640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e322160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8dbc898640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e322160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40802/0 (socket says 172.21.15.120:40802) 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 learned_addr learned my addr 172.21.15.120:0/2446437010 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98e3226c0 con 0x55e98e31aae0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8dbc898640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e322160 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8db4014840 tx=0x7f8db4053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8c99ffb640 1 -- 172.21.15.120:0/2446437010 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db40053f0 con 0x55e98e31aae0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8c99ffb640 1 -- 172.21.15.120:0/2446437010 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db40127a0 con 0x55e98e31aae0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e98e322950 con 0x55e98e31aae0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8c99ffb640 1 -- 172.21.15.120:0/2446437010 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db4012ac0 con 0x55e98e31aae0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.018+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98e3232d0 con 0x55e98e31aae0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.019+0000 7f8c99ffb640 1 -- 172.21.15.120:0/2446437010 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8db4012cb0 con 0x55e98e31aae0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.019+0000 7f8c99ffb640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c8c03c730 0x7f8c8c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.019+0000 7f8c99ffb640 1 -- 172.21.15.120:0/2446437010 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f8db403ed00 con 0x55e98e31aae0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.019+0000 7f8dbc097640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c8c03c730 0x7f8c8c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.019+0000 7f8dbc097640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c8c03c730 0x7f8c8c03ebf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8dac023000 tx=0x7f8dac052240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e32dc20 0x55e98e3300e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e330830 con 0x55e98e32dc20 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbb896640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e32dc20 0x55e98e3300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbb896640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e32dc20 0x55e98e3300e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbe5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbe5ad800 20 realm 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.020+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e330c60 con 0x55e98e32dc20 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbe5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbe5ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e331530 con 0x55e98e32dc20 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbe5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e331f50 0x55e98e334380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e334af0 con 0x55e98e331f50 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbc898640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e331f50 0x55e98e334380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.021+0000 7f8dbc898640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e331f50 0x55e98e334380 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbe5ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e335340 con 0x55e98e331f50 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbe5ad800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbe5ad800 20 searching for the correct realm 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e98e3370b0 0x55e98e3394e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e3370b0 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbc097640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e98e3370b0 0x55e98e3394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.022+0000 7f8dbc097640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e98e3370b0 0x55e98e3394e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.023+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.023+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e331f50 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.023+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.023+0000 7f8dbc898640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8db4034020 0x7f8db40135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.023+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x7f8db4034020 2024-09-07T03:34:22.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.023+0000 7f8dbb896640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8db4034020 0x7f8db40135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.023+0000 7f8dbb896640 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8db4034020 0x7f8db40135c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.023+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.023+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e32dc20 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.024+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.024+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e32dc20 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.024+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.024+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e3370b0 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.024+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.024+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e32dc20 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.024+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.024+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e331f50 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.025+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.025+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e331f50 2024-09-07T03:34:22.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.025+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.025+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e32dc20 2024-09-07T03:34:22.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.025+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.025+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x7f8db4034020 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.025+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.025+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e32dc20 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.026+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.026+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x7f8db4034020 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.026+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.026+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e331f50 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.026+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.026+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e3370b0 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.026+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.026+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e32dc20 2024-09-07T03:34:22.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.027+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.027+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e331f50 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.027+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.027+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e3370b0 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.027+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.027+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e32dc20 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.027+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.027+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e32dc20 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e32dc20 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e3370b0 2024-09-07T03:34:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x7f8db4034020 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x7f8db4034020 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.028+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x7f8db4034020 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.029+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.029+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e3370b0 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.029+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.029+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x7f8db4034020 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.029+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.029+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e331f50 2024-09-07T03:34:22.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.029+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.029+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e331f50 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e3370b0 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e331f50 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e98e339bb0 con 0x55e98e331f50 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbe5ad800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbe5ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbe5ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbe5ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:22.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbe5ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbe5ad800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.030+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e335cc0 con 0x55e98e32dc20 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3358a0 con 0x55e98e331f50 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:22.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e336630 con 0x55e98e32dc20 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 zone default found 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 4 Realm: () 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 zonegroup default 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33a4e0 con 0x7f8db4034020 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.031+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33c720 con 0x55e98e3370b0 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.032+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.032+0000 7f8dbe5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.032+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.032+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33cac0 con 0x55e98e3370b0 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.032+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.032+0000 7f8dbe5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.032+0000 7f8dbe5ad800 20 started sync module instance, tier type = 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.032+0000 7f8dbe5ad800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.032+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33bb60 con 0x55e98e331f50 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.033+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.033+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94461601496912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33c370 con 0x55e98e331f50 2024-09-07T03:34:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.033+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33d7c0 con 0x55e98e32dc20 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.034+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94461601496912] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.034+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.034+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94461601501248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33e060 con 0x55e98e32dc20 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.034+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33ea20 con 0x55e98e331f50 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.035+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94461601501248] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.036+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.036+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94461601504688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33ea20 con 0x55e98e331f50 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.036+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33f420 con 0x7f8db4034020 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.037+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94461601504688] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.037+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.037+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94461601506672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33f5c0 con 0x7f8db4034020 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.037+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33fe50 con 0x55e98e331f50 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.038+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94461601506672] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.038+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.038+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94461601509648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e33f9e0 con 0x55e98e331f50 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.038+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e340860 con 0x55e98e3370b0 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.039+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.039+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94461601514416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e341100 con 0x55e98e3370b0 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.039+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e341b80 con 0x55e98e3370b0 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.039+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94461601509648] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.041+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94461601514416] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.041+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.041+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94461601519216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e340c50 con 0x55e98e3370b0 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.041+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e342450 con 0x7f8db4034020 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94461601521568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e342870 con 0x7f8db4034020 2024-09-07T03:34:22.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbe5ad800 20 add_watcher() i=0 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbe5ad800 20 add_watcher() i=1 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbe5ad800 20 add_watcher() i=2 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbe5ad800 20 add_watcher() i=3 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbe5ad800 20 add_watcher() i=4 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbe5ad800 20 add_watcher() i=5 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94461601519216] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.042+0000 7f8dbe5ad800 20 add_watcher() i=6 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.043+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94461601521568] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.043+0000 7f8dbe5ad800 20 add_watcher() i=7 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.043+0000 7f8dbe5ad800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.043+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e345520 con 0x55e98e32dc20 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.043+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.043+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94461601510704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e342870 con 0x55e98e32dc20 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.044+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94461601510704] v36'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8c727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8dbe5ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8dbe5ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8dbe5ad800 5 note: GC not initialized 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8c717e2640 20 reqs_thread_entry: start 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8dbe5ad800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8dbe5ad800 20 Filter name: none 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8be2ffd640 20 reqs_thread_entry: start 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8dbe5ad800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8dbe5ad800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.045+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e378650 con 0x55e98e32dc20 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.046+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.046+0000 7f8dbe5ad800 20 rados_obj.operate() r=0 bl.length=490 2024-09-07T03:34:22.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.046+0000 7f8dbe5ad800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-07T03:34:22.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.046+0000 7f8dbe5ad800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:22.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.046+0000 7f8dbe5ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:22.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.046+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e37ebe0 con 0x55e98e32dc20 2024-09-07T03:34:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.047+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.047+0000 7f8dbe5ad800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.047+0000 7f8dbe5ad800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.047+0000 7f8dbe5ad800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.047+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94461601768864 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e98e37a220 con 0x55e98e331f50 2024-09-07T03:34:22.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.048+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94461601509648 notify 154618822702 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55e98e3232d0 con 0x55e98e331f50 2024-09-07T03:34:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.048+0000 7f8c9b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822702 cookie 94461601509648 notifier 4904 bl.length()=636 2024-09-07T03:34:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.048+0000 7f8c9b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.048+0000 7f8c9b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.048+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94461601768864 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.048+0000 7f8c9b7fe640 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f8c80003ea0 con 0x55e98e331f50 2024-09-07T03:34:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.048+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.048+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 94461601768864 notify 154618822702 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e98e322950 con 0x55e98e331f50 2024-09-07T03:34:22.061 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:22.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.049+0000 7f8c727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:22.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.049+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94461601510704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3764a0 con 0x55e98e32dc20 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.050+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94461601510704] v36'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.050+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94461601496912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3764a0 con 0x55e98e331f50 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.051+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94461601496912] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.051+0000 7f8dbe5ad800 20 remove_watcher() i=0 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.051+0000 7f8dbe5ad800 2 removed watcher, disabling cache 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.051+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94461601501248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3764a0 con 0x55e98e32dc20 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.052+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94461601501248] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x55e98e32dc20 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.052+0000 7f8dbe5ad800 20 remove_watcher() i=1 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.052+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94461601504688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3764a0 con 0x55e98e331f50 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.053+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94461601504688] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.053+0000 7f8dbe5ad800 20 remove_watcher() i=2 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.053+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94461601506672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3764a0 con 0x7f8db4034020 2024-09-07T03:34:22.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.054+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94461601506672] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.054+0000 7f8dbe5ad800 20 remove_watcher() i=3 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.054+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94461601509648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3764a0 con 0x55e98e331f50 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.055+0000 7f8dbc898640 1 -- 172.21.15.120:0/2446437010 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94461601509648] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db403b070 con 0x55e98e331f50 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.055+0000 7f8dbe5ad800 20 remove_watcher() i=4 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.055+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94461601514416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3764a0 con 0x55e98e3370b0 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.056+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94461601514416] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.056+0000 7f8dbe5ad800 20 remove_watcher() i=5 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.056+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94461601519216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3764a0 con 0x55e98e3370b0 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.057+0000 7f8dbc097640 1 -- 172.21.15.120:0/2446437010 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94461601519216] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dac036040 con 0x55e98e3370b0 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.057+0000 7f8dbe5ad800 20 remove_watcher() i=6 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.057+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94461601521568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e98e3764a0 con 0x7f8db4034020 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94461601521568] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db0051070 con 0x7f8db4034020 2024-09-07T03:34:22.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbe5ad800 20 remove_watcher() i=7 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e331f50 msgr2=0x55e98e334380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e331f50 0x55e98e334380 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e32dc20 msgr2=0x55e98e3300e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e32dc20 0x55e98e3300e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8db4034020 msgr2=0x7f8db40135c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f8db4034020 0x7f8db40135c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e98e3370b0 msgr2=0x55e98e3394e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.058+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55e98e3370b0 0x55e98e3394e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c8c03c730 msgr2=0x7f8c8c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c8c03c730 0x7f8c8c03ebf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8dac023000 tx=0x7f8dac052240 comp rx=0 tx=0).stop 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 msgr2=0x55e98e322160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/2446437010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e31aae0 0x55e98e322160 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8db4014840 tx=0x7f8db4053d90 comp rx=0 tx=0).stop 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 reap_dead start 2024-09-07T03:34:22.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbb896640 1 -- 172.21.15.120:0/2446437010 reap_dead start 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 shutdown_connections 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 >> 172.21.15.120:0/2446437010 conn(0x55e98e316ee0 msgr2=0x55e98e3150f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 shutdown_connections 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/2446437010 wait complete. 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3851115473 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c9403c7f0 msgr2=0x7f8c9403ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/3851115473 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c9403c7f0 0x7f8c9403ecb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55e98e2f4990 tx=0x7f8dac022650 comp rx=0 tx=0).stop 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3851115473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e30e040 msgr2=0x55e98e30e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/3851115473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e30e040 0x55e98e30e460 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8db4016d20 tx=0x7f8db400d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3851115473 shutdown_connections 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/3851115473 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8c9403c7f0 0x7f8c9403ecb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/3851115473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e30e040 0x55e98e30e460 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3851115473 >> 172.21.15.120:0/3851115473 conn(0x55e98e3023f0 msgr2=0x55e98e3027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3851115473 shutdown_connections 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/3851115473 wait complete. 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e2fb690 msgr2=0x55e98e2fdb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e2fb690 0x55e98e2fdb30 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e1fe210 msgr2=0x55e98e2fa8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.059+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e1fe210 0x55e98e2fa8a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ca403c780 msgr2=0x7f8ca403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ca403c780 0x7f8ca403ec40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8db0057000 tx=0x7f8db0052000 comp rx=0 tx=0).stop 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 msgr2=0x55e98e2f3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e2f3250 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55e98e1f98b0 tx=0x7f8dac000bc0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 shutdown_connections 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55e98e2fb690 0x55e98e2fdb30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55e98e1fe210 0x55e98e2fa8a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f8ca403c780 0x7f8ca403ec40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 --2- 172.21.15.120:0/1306914636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e98e1fa610 0x55e98e2f3250 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 >> 172.21.15.120:0/1306914636 conn(0x55e98e1f41d0 msgr2=0x55e98e2e4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 shutdown_connections 2024-09-07T03:34:22.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.060+0000 7f8dbe5ad800 1 -- 172.21.15.120:0/1306914636 wait complete. 2024-09-07T03:34:22.073 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:22.073 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:22.073 ERROR:root:0 2024-09-07T03:34:22.073 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-07T03:34:22.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-07T03:34:22.073 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-07T03:34:22.120 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:22.121 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:22.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.120+0000 7fc135b46800 1 Processor -- start 2024-09-07T03:34:22.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.120+0000 7fc135b46800 1 -- start start 2024-09-07T03:34:22.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.120+0000 7fc135b46800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55738a1852d0 0x55738a18ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.120+0000 7fc135b46800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55738a02de40 con 0x55738a184000 2024-09-07T03:34:22.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.120+0000 7fc135b46800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x557389ff8680 con 0x55738a1852d0 2024-09-07T03:34:22.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.121+0000 7fc132e2f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55738a1852d0 0x55738a18ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.121+0000 7fc132e2f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x55738a1852d0 0x55738a18ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40812/0 (socket says 172.21.15.120:40812) 2024-09-07T03:34:22.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.121+0000 7fc133630640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x55738a184000 0x55738a184bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43978/0 (socket says 172.21.15.120:43978) 2024-09-07T03:34:22.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.121+0000 7fc132e2f640 1 -- 172.21.15.120:0/237181446 learned_addr learned my addr 172.21.15.120:0/237181446 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.121+0000 7fc132e2f640 1 -- 172.21.15.120:0/237181446 >> v1:172.21.15.104:6789/0 conn(0x55738a184000 legacy=0x55738a184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.121+0000 7fc13262e640 1 -- 172.21.15.120:0/237181446 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374142743 0 0) 0x55738a02de40 con 0x55738a184000 2024-09-07T03:34:22.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.121+0000 7fc132e2f640 1 -- 172.21.15.120:0/237181446 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55738a0146b0 con 0x55738a1852d0 2024-09-07T03:34:22.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc132e2f640 1 --2- 172.21.15.120:0/237181446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a1852d0 0x55738a18ae70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00a520 tx=0x7fc11c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cea275fedda1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc13262e640 1 -- 172.21.15.120:0/237181446 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc11c055070 con 0x55738a1852d0 2024-09-07T03:34:22.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc13262e640 1 -- 172.21.15.120:0/237181446 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c0515b0 con 0x55738a1852d0 2024-09-07T03:34:22.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc13262e640 1 -- 172.21.15.120:0/237181446 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc11c0518d0 con 0x55738a1852d0 2024-09-07T03:34:22.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc135b46800 1 -- 172.21.15.120:0/237181446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a1852d0 msgr2=0x55738a18ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc135b46800 1 --2- 172.21.15.120:0/237181446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a1852d0 0x55738a18ae70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00a520 tx=0x7fc11c045ba0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc135b46800 1 -- 172.21.15.120:0/237181446 shutdown_connections 2024-09-07T03:34:22.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc135b46800 1 --2- 172.21.15.120:0/237181446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a1852d0 0x55738a18ae70 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc135b46800 1 -- 172.21.15.120:0/237181446 >> 172.21.15.120:0/237181446 conn(0x55738a17f3d0 msgr2=0x55738a181830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc135b46800 1 -- 172.21.15.120:0/237181446 shutdown_connections 2024-09-07T03:34:22.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.123+0000 7fc135b46800 1 -- 172.21.15.120:0/237181446 wait complete. 2024-09-07T03:34:22.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.139+0000 7fc135b46800 1 Processor -- start 2024-09-07T03:34:22.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.139+0000 7fc135b46800 1 -- start start 2024-09-07T03:34:22.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.139+0000 7fc135b46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a273460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.139+0000 7fc135b46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55738a01cdd0 con 0x55738a184000 2024-09-07T03:34:22.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.139+0000 7fc133630640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a273460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.139+0000 7fc133630640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a273460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40818/0 (socket says 172.21.15.120:40818) 2024-09-07T03:34:22.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.139+0000 7fc133630640 1 -- 172.21.15.120:0/789115757 learned_addr learned my addr 172.21.15.120:0/789115757 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.139+0000 7fc133630640 1 -- 172.21.15.120:0/789115757 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55738a035e10 con 0x55738a184000 2024-09-07T03:34:22.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.139+0000 7fc133630640 1 --2- 172.21.15.120:0/789115757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a273460 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006fa0 tx=0x7fc12c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a781ff57f2b3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc02160a640 1 -- 172.21.15.120:0/789115757 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c003450 con 0x55738a184000 2024-09-07T03:34:22.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc02160a640 1 -- 172.21.15.120:0/789115757 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12c003610 con 0x55738a184000 2024-09-07T03:34:22.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc02160a640 1 -- 172.21.15.120:0/789115757 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c003970 con 0x55738a184000 2024-09-07T03:34:22.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc135b46800 1 -- 172.21.15.120:0/789115757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 msgr2=0x55738a273460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc135b46800 1 --2- 172.21.15.120:0/789115757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a273460 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006fa0 tx=0x7fc12c001b00 comp rx=0 tx=0).stop 2024-09-07T03:34:22.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc135b46800 1 -- 172.21.15.120:0/789115757 shutdown_connections 2024-09-07T03:34:22.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc135b46800 1 --2- 172.21.15.120:0/789115757 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a273460 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc135b46800 1 -- 172.21.15.120:0/789115757 >> 172.21.15.120:0/789115757 conn(0x55738a17f3d0 msgr2=0x55738a26ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc135b46800 1 -- 172.21.15.120:0/789115757 shutdown_connections 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.140+0000 7fc135b46800 1 -- 172.21.15.120:0/789115757 wait complete. 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.141+0000 7fc135b46800 1 Processor -- start 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.141+0000 7fc135b46800 1 -- start start 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.141+0000 7fc135b46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a278ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.141+0000 7fc135b46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55738a1859c0 con 0x55738a184000 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.141+0000 7fc133630640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a278ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.141+0000 7fc133630640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a278ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40828/0 (socket says 172.21.15.120:40828) 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.141+0000 7fc133630640 1 -- 172.21.15.120:0/2660062312 learned_addr learned my addr 172.21.15.120:0/2660062312 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.141+0000 7fc133630640 1 -- 172.21.15.120:0/2660062312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55738a279100 con 0x55738a184000 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.142+0000 7fc133630640 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a278ba0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc12c001330 tx=0x7fc12c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.142+0000 7fc01fe07640 1 -- 172.21.15.120:0/2660062312 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c014a10 con 0x55738a184000 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.142+0000 7fc01fe07640 1 -- 172.21.15.120:0/2660062312 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12c014bb0 con 0x55738a184000 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.142+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55738a279390 con 0x55738a184000 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.142+0000 7fc01fe07640 1 -- 172.21.15.120:0/2660062312 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c01e3f0 con 0x55738a184000 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.142+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55738a2825a0 con 0x55738a184000 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.143+0000 7fc01fe07640 1 -- 172.21.15.120:0/2660062312 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc12c010070 con 0x55738a184000 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.143+0000 7fc01fe07640 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc01803c730 0x7fc01803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.143+0000 7fc01fe07640 1 -- 172.21.15.120:0/2660062312 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc12c018070 con 0x55738a184000 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.143+0000 7fc132e2f640 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc01803c730 0x7fc01803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.143+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a1852d0 0x55738a288a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.143+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a288f40 con 0x55738a1852d0 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.143+0000 7fc133e31640 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a1852d0 0x55738a288a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.143+0000 7fc132e2f640 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc01803c730 0x7fc01803ebf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc11c057000 tx=0x7fc11c052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.144+0000 7fc133e31640 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a1852d0 0x55738a288a00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.144+0000 7fc133e31640 1 -- 172.21.15.120:0/2660062312 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a1852d0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.144+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2897f0 0x55738a28bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.144+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a28c390 con 0x55738a2897f0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.144+0000 7fc133630640 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2897f0 0x55738a28bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.144+0000 7fc133630640 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2897f0 0x55738a28bc20 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.145+0000 7fc133630640 1 -- 172.21.15.120:0/2660062312 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc12c01b070 con 0x55738a2897f0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.145+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a28dc40 con 0x55738a2897f0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.145+0000 7fc133630640 1 -- 172.21.15.120:0/2660062312 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc12c01b070 con 0x55738a2897f0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.145+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a28cd80 con 0x55738a2897f0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.145+0000 7fc133630640 1 -- 172.21.15.120:0/2660062312 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc12c01b070 con 0x55738a2897f0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.145+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a28d1e0 con 0x55738a1852d0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.146+0000 7fc133e31640 1 -- 172.21.15.120:0/2660062312 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a1852d0 2024-09-07T03:34:22.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.146+0000 7fc135b46800 1 Processor -- start 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.146+0000 7fc135b46800 1 -- start start 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.146+0000 7fc135b46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a29c130 0x55738a29c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.146+0000 7fc135b46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55738a07aa00 con 0x55738a29c130 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.146+0000 7fc133e31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a29c130 0x55738a29c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.146+0000 7fc133e31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a29c130 0x55738a29c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40836/0 (socket says 172.21.15.120:40836) 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.146+0000 7fc133e31640 1 -- 172.21.15.120:0/3109616766 learned_addr learned my addr 172.21.15.120:0/3109616766 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.146+0000 7fc133e31640 1 -- 172.21.15.120:0/3109616766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55738a29cb90 con 0x55738a29c130 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.147+0000 7fc133e31640 1 --2- 172.21.15.120:0/3109616766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a29c130 0x55738a29c550 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc12400aa90 tx=0x7fc12400af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.147+0000 7fc01d602640 1 -- 172.21.15.120:0/3109616766 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc124007d70 con 0x55738a29c130 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.147+0000 7fc01d602640 1 -- 172.21.15.120:0/3109616766 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc124018430 con 0x55738a29c130 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.147+0000 7fc135b46800 1 -- 172.21.15.120:0/3109616766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55738a29d3c0 con 0x55738a29c130 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.147+0000 7fc01d602640 1 -- 172.21.15.120:0/3109616766 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc124018750 con 0x55738a29c130 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.147+0000 7fc135b46800 1 -- 172.21.15.120:0/3109616766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55738a29d960 con 0x55738a29c130 2024-09-07T03:34:22.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.148+0000 7fc01d602640 1 -- 172.21.15.120:0/3109616766 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc124020020 con 0x55738a29c130 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.148+0000 7fc01d602640 1 --2- 172.21.15.120:0/3109616766 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc00c03c780 0x7fc00c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.148+0000 7fc01d602640 1 -- 172.21.15.120:0/3109616766 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc12401e020 con 0x55738a29c130 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.148+0000 7fc133630640 1 --2- 172.21.15.120:0/3109616766 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc00c03c780 0x7fc00c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.149+0000 7fc133630640 1 --2- 172.21.15.120:0/3109616766 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc00c03c780 0x7fc00c03ec40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55738a282ac0 tx=0x7fc12c051fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.149+0000 7fc135b46800 1 Processor -- start 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.149+0000 7fc135b46800 1 -- start start 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.149+0000 7fc135b46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2a9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.149+0000 7fc135b46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55738a273cb0 con 0x55738a2a8c10 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.149+0000 7fc133e31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.149+0000 7fc133e31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40848/0 (socket says 172.21.15.120:40848) 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.149+0000 7fc133e31640 1 -- 172.21.15.120:0/3909395260 learned_addr learned my addr 172.21.15.120:0/3909395260 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.149+0000 7fc133e31640 1 -- 172.21.15.120:0/3909395260 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55738a2a9600 con 0x55738a2a8c10 2024-09-07T03:34:22.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc133e31640 1 --2- 172.21.15.120:0/3909395260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2a9010 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc1240531c0 tx=0x7fc1240206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e14805e4f9e2962 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc016ffd640 1 -- 172.21.15.120:0/3909395260 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12404a070 con 0x55738a2a8c10 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc016ffd640 1 -- 172.21.15.120:0/3909395260 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc124020b70 con 0x55738a2a8c10 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc016ffd640 1 -- 172.21.15.120:0/3909395260 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc124022410 con 0x55738a2a8c10 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc135b46800 1 -- 172.21.15.120:0/3909395260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 msgr2=0x55738a2a9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc135b46800 1 --2- 172.21.15.120:0/3909395260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2a9010 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc1240531c0 tx=0x7fc1240206e0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc135b46800 1 -- 172.21.15.120:0/3909395260 shutdown_connections 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc135b46800 1 --2- 172.21.15.120:0/3909395260 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2a9010 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc135b46800 1 -- 172.21.15.120:0/3909395260 >> 172.21.15.120:0/3909395260 conn(0x55738a2a5010 msgr2=0x55738a2a3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc135b46800 1 -- 172.21.15.120:0/3909395260 shutdown_connections 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.150+0000 7fc135b46800 1 -- 172.21.15.120:0/3909395260 wait complete. 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc135b46800 1 Processor -- start 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc135b46800 1 -- start start 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc135b46800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc135b46800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55738a2a9c20 con 0x55738a2a8c10 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc133e31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc133e31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40854/0 (socket says 172.21.15.120:40854) 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 learned_addr learned my addr 172.21.15.120:0/1473078999 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55738a2b07c0 con 0x55738a2a8c10 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc133e31640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2b0260 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc124053120 tx=0x7fc124053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.151+0000 7fc0157fa640 1 -- 172.21.15.120:0/1473078999 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc124031020 con 0x55738a2a8c10 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.152+0000 7fc0157fa640 1 -- 172.21.15.120:0/1473078999 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12404b040 con 0x55738a2a8c10 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.152+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55738a2b0a50 con 0x55738a2a8c10 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.152+0000 7fc0157fa640 1 -- 172.21.15.120:0/1473078999 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12404a030 con 0x55738a2a8c10 2024-09-07T03:34:22.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.152+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55738a2b13d0 con 0x55738a2a8c10 2024-09-07T03:34:22.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.152+0000 7fc0157fa640 1 -- 172.21.15.120:0/1473078999 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc124034020 con 0x55738a2a8c10 2024-09-07T03:34:22.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.153+0000 7fc0157fa640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbffc03c780 0x7fbffc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.153+0000 7fc0157fa640 1 -- 172.21.15.120:0/1473078999 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc124013040 con 0x55738a2a8c10 2024-09-07T03:34:22.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.153+0000 7fc133630640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbffc03c780 0x7fbffc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.153+0000 7fc133630640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbffc03c780 0x7fbffc03ec40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc12c014680 tx=0x7fc12c044000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.153+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.153+0000 7fc135b46800 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a2bbd40 0x55738a2be200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.153+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2be950 con 0x55738a2bbd40 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.153+0000 7fc132e2f640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a2bbd40 0x55738a2be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc132e2f640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a2bbd40 0x55738a2be200 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 20 realm 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2bed80 con 0x55738a2bbd40 2024-09-07T03:34:22.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2bf650 con 0x55738a2bbd40 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2c0070 0x55738a2c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.154+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c2c10 con 0x55738a2c0070 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc133e31640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2c0070 0x55738a2c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc133e31640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2c0070 0x55738a2c24a0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc135b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c3460 con 0x55738a2c0070 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc135b46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc135b46800 20 searching for the correct realm 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc135b46800 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55738a2c51d0 0x55738a2c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.155+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c7cd0 con 0x55738a2c51d0 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.156+0000 7fc133630640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55738a2c51d0 0x55738a2c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.156+0000 7fc133630640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55738a2c51d0 0x55738a2c7600 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.156+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.156+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c7cd0 con 0x55738a2c0070 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.156+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.156+0000 7fc133e31640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc124036020 0x7fc12404c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.156+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c7cd0 con 0x7fc124036020 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.157+0000 7fc132e2f640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc124036020 0x7fc12404c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.157+0000 7fc132e2f640 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc124036020 0x7fc12404c9c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.157+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.157+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c7cd0 con 0x55738a2bbd40 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.157+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.157+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c7cd0 con 0x55738a2bbd40 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.158+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.158+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c7cd0 con 0x55738a2c51d0 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.158+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.158+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2bbd40 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.158+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.158+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c0070 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c0070 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2bbd40 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x7fc124036020 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2bbd40 2024-09-07T03:34:22.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.159+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x7fc124036020 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.160+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.160+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c0070 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.160+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.160+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c51d0 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.160+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.160+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2bbd40 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.161+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.161+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c0070 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.161+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.161+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c51d0 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.161+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.161+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2bbd40 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.161+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.161+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2bbd40 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2bbd40 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c51d0 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x7fc124036020 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x7fc124036020 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.162+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x7fc124036020 2024-09-07T03:34:22.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.163+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.163+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c51d0 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.163+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.163+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x7fc124036020 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.163+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.163+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c0070 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.163+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.163+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c0070 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c51d0 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c0070 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc12c05e040 con 0x55738a2c0070 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc135b46800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc135b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc135b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc135b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc135b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc135b46800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.164+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c3de0 con 0x55738a2bbd40 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c3a20 con 0x55738a2c0070 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c4700 con 0x55738a2bbd40 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 zone default found 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 4 Realm: () 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:22.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 zonegroup default 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c8150 con 0x7fc124036020 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.165+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2ca390 con 0x55738a2c51d0 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.166+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.166+0000 7fc135b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.166+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.166+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2ca730 con 0x55738a2c51d0 2024-09-07T03:34:22.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.166+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.166+0000 7fc135b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.166+0000 7fc135b46800 20 started sync module instance, tier type = 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.166+0000 7fc135b46800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.166+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c97d0 con 0x55738a2c0070 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.167+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.167+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93954727779312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c97d0 con 0x55738a2c0070 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.167+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cb040 con 0x55738a2bbd40 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.168+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.168+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93954727779312] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.168+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93954727783312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cb890 con 0x55738a2bbd40 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.168+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2c9320 con 0x55738a2c0070 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.169+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93954727783312] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.169+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.169+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93954727785440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cb800 con 0x55738a2c0070 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.169+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cc870 con 0x7fc124036020 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.170+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93954727785440] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.170+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.170+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93954727787936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cc870 con 0x7fc124036020 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.170+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cd230 con 0x55738a2c0070 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.171+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93954727787936] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.172+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.172+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93954727792480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cc870 con 0x55738a2c0070 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.172+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cdc70 con 0x55738a2c51d0 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.173+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93954727792480] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.173+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.173+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93954727795104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cc870 con 0x55738a2c51d0 2024-09-07T03:34:22.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.173+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2ce680 con 0x55738a2c51d0 2024-09-07T03:34:22.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.174+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93954727795104] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.174+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.174+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93954727797680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cc870 con 0x55738a2c51d0 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.174+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cf120 con 0x7fc124036020 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93954727797680] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93954727799824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cc870 con 0x7fc124036020 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc135b46800 20 add_watcher() i=0 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc135b46800 20 add_watcher() i=1 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc135b46800 20 add_watcher() i=2 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc135b46800 20 add_watcher() i=3 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc135b46800 20 add_watcher() i=4 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc135b46800 20 add_watcher() i=5 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.175+0000 7fc135b46800 20 add_watcher() i=6 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.176+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93954727799824] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.176+0000 7fc135b46800 20 add_watcher() i=7 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.176+0000 7fc135b46800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.176+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a2d25d0 con 0x55738a2bbd40 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.176+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.177+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93954727789968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a2cfaf0 con 0x55738a2bbd40 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93954727789968] v36'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fbfe9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fc135b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fc135b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fc135b46800 5 note: GC not initialized 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fbfe8fe1640 20 reqs_thread_entry: start 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fc135b46800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fc135b46800 20 Filter name: none 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fbf627fc640 20 reqs_thread_entry: start 2024-09-07T03:34:22.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fc135b46800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fc135b46800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.178+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a305660 con 0x55738a2bbd40 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.179+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.179+0000 7fc135b46800 20 rados_obj.operate() r=0 bl.length=460 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.179+0000 7fc135b46800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.179+0000 7fc135b46800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.179+0000 7fc135b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.179+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a30ba80 con 0x55738a2bbd40 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc135b46800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc135b46800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc135b46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93954728047744 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55738a307100 con 0x55738a2c0070 2024-09-07T03:34:22.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 93954727792480 notify 154618822703 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55738a2b13d0 con 0x55738a2c0070 2024-09-07T03:34:22.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc016ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822703 cookie 93954727792480 notifier 4911 bl.length()=649 2024-09-07T03:34:22.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc016ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:22.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc016ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:22.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc016ffd640 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fbff8003ea0 con 0x55738a2c0070 2024-09-07T03:34:22.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.180+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 93954728047744 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.181+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.181+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== watch-notify(notify_complete (2) cookie 93954728047744 notify 154618822703 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc12406c040 con 0x55738a2c0070 2024-09-07T03:34:22.195 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:22.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.182+0000 7fbfe9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.182+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93954727789968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a30ad60 con 0x55738a2bbd40 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.183+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93954727789968] v36'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.183+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93954727779312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a30ad60 con 0x55738a2c0070 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.184+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93954727779312] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.184+0000 7fc135b46800 20 remove_watcher() i=0 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.184+0000 7fc135b46800 2 removed watcher, disabling cache 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.184+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93954727783312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a3034d0 con 0x55738a2bbd40 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.184+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93954727783312] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x55738a2bbd40 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.184+0000 7fc135b46800 20 remove_watcher() i=1 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.184+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93954727785440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a3034d0 con 0x55738a2c0070 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.185+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93954727785440] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.185+0000 7fc135b46800 20 remove_watcher() i=2 2024-09-07T03:34:22.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.185+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93954727787936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a3034d0 con 0x7fc124036020 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.186+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93954727787936] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.186+0000 7fc135b46800 20 remove_watcher() i=3 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.186+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93954727792480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a3034d0 con 0x55738a2c0070 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.187+0000 7fc133e31640 1 -- 172.21.15.120:0/1473078999 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93954727792480] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1240083e0 con 0x55738a2c0070 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.188+0000 7fc135b46800 20 remove_watcher() i=4 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.188+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93954727795104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a3034d0 con 0x55738a2c51d0 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.188+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93954727795104] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.188+0000 7fc135b46800 20 remove_watcher() i=5 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.188+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93954727797680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a3034d0 con 0x55738a2c51d0 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.189+0000 7fc133630640 1 -- 172.21.15.120:0/1473078999 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93954727797680] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc12c051070 con 0x55738a2c51d0 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.189+0000 7fc135b46800 20 remove_watcher() i=6 2024-09-07T03:34:22.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.189+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93954727799824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55738a3034d0 con 0x7fc124036020 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93954727799824] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc11c057030 con 0x7fc124036020 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc135b46800 20 remove_watcher() i=7 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2c0070 msgr2=0x55738a2c24a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc135b46800 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2c0070 0x55738a2c24a0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a2bbd40 msgr2=0x55738a2be200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc135b46800 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a2bbd40 0x55738a2be200 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc124036020 msgr2=0x7fc12404c9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc135b46800 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7fc124036020 0x7fc12404c9c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55738a2c51d0 msgr2=0x55738a2c7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.190+0000 7fc135b46800 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x55738a2c51d0 0x55738a2c7600 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbffc03c780 msgr2=0x7fbffc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbffc03c780 0x7fbffc03ec40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc12c014680 tx=0x7fc12c044000 comp rx=0 tx=0).stop 2024-09-07T03:34:22.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 msgr2=0x55738a2b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 --2- 172.21.15.120:0/1473078999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a2a8c10 0x55738a2b0260 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc124053120 tx=0x7fc124053150 comp rx=0 tx=0).stop 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 reap_dead start 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc132e2f640 1 -- 172.21.15.120:0/1473078999 reap_dead start 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 shutdown_connections 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 >> 172.21.15.120:0/1473078999 conn(0x55738a2a5010 msgr2=0x55738a2a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 shutdown_connections 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/1473078999 wait complete. 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/3109616766 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc00c03c780 msgr2=0x7fc00c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 --2- 172.21.15.120:0/3109616766 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc00c03c780 0x7fc00c03ec40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55738a282ac0 tx=0x7fc12c051fe0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/3109616766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a29c130 msgr2=0x55738a29c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 --2- 172.21.15.120:0/3109616766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a29c130 0x55738a29c550 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc12400aa90 tx=0x7fc12400af50 comp rx=0 tx=0).stop 2024-09-07T03:34:22.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/3109616766 shutdown_connections 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 --2- 172.21.15.120:0/3109616766 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc00c03c780 0x7fc00c03ec40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 --2- 172.21.15.120:0/3109616766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a29c130 0x55738a29c550 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/3109616766 >> 172.21.15.120:0/3109616766 conn(0x55738a2904e0 msgr2=0x55738a2908c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/3109616766 shutdown_connections 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/3109616766 wait complete. 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2897f0 msgr2=0x55738a28bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2897f0 0x55738a28bc20 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a1852d0 msgr2=0x55738a288a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.191+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a1852d0 0x55738a288a00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc01803c730 msgr2=0x7fc01803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc01803c730 0x7fc01803ebf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc11c057000 tx=0x7fc11c052000 comp rx=0 tx=0).stop 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 msgr2=0x55738a278ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a278ba0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc12c001330 tx=0x7fc12c001250 comp rx=0 tx=0).stop 2024-09-07T03:34:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 shutdown_connections 2024-09-07T03:34:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x55738a2897f0 0x55738a28bc20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x55738a1852d0 0x55738a288a00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc01803c730 0x7fc01803ebf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 --2- 172.21.15.120:0/2660062312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55738a184000 0x55738a278ba0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 >> 172.21.15.120:0/2660062312 conn(0x55738a17f3d0 msgr2=0x55738a274740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 shutdown_connections 2024-09-07T03:34:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.192+0000 7fc135b46800 1 -- 172.21.15.120:0/2660062312 wait complete. 2024-09-07T03:34:22.207 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:22.207 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:22.207 ERROR:root:0 2024-09-07T03:34:22.207 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-07T03:34:22.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-07T03:34:22.208 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-07T03:34:22.254 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:34:22.254 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:34:22.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.253+0000 7f84ec60e800 1 Processor -- start 2024-09-07T03:34:22.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.253+0000 7f84ec60e800 1 -- start start 2024-09-07T03:34:22.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.253+0000 7f84ec60e800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563059b837c0 0x563059b8b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.253+0000 7f84ec60e800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563059a2ee40 con 0x563059b83300 2024-09-07T03:34:22.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.253+0000 7f84ec60e800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5630599f9680 con 0x563059b837c0 2024-09-07T03:34:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.254+0000 7f84df56a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563059b837c0 0x563059b8b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.254+0000 7f84df56a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x563059b837c0 0x563059b8b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40870/0 (socket says 172.21.15.120:40870) 2024-09-07T03:34:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.254+0000 7f84df56a640 1 -- 172.21.15.120:0/3351423064 learned_addr learned my addr 172.21.15.120:0/3351423064 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.254+0000 7f84e7d6b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x563059b83300 0x563059b87f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:43980/0 (socket says 172.21.15.120:43980) 2024-09-07T03:34:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.254+0000 7f84df56a640 1 -- 172.21.15.120:0/3351423064 >> v1:172.21.15.104:6789/0 conn(0x563059b83300 legacy=0x563059b87f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.254+0000 7f84df56a640 1 -- 172.21.15.120:0/3351423064 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563059a156b0 con 0x563059b837c0 2024-09-07T03:34:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.254+0000 7f84e756a640 1 -- 172.21.15.120:0/3351423064 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268808213 0 0) 0x563059a2ee40 con 0x563059b83300 2024-09-07T03:34:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84df56a640 1 --2- 172.21.15.120:0/3351423064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b837c0 0x563059b8b6c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f84d000a520 tx=0x7f84d0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfcb08819635ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84e756a640 1 -- 172.21.15.120:0/3351423064 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d0055070 con 0x563059b837c0 2024-09-07T03:34:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84e756a640 1 -- 172.21.15.120:0/3351423064 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d00515b0 con 0x563059b837c0 2024-09-07T03:34:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84e756a640 1 -- 172.21.15.120:0/3351423064 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d00518d0 con 0x563059b837c0 2024-09-07T03:34:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84ec60e800 1 -- 172.21.15.120:0/3351423064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b837c0 msgr2=0x563059b8b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84ec60e800 1 --2- 172.21.15.120:0/3351423064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b837c0 0x563059b8b6c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f84d000a520 tx=0x7f84d0045ba0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84ec60e800 1 -- 172.21.15.120:0/3351423064 shutdown_connections 2024-09-07T03:34:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84ec60e800 1 --2- 172.21.15.120:0/3351423064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b837c0 0x563059b8b6c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84ec60e800 1 -- 172.21.15.120:0/3351423064 >> 172.21.15.120:0/3351423064 conn(0x563059b7e930 msgr2=0x563059b80db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84ec60e800 1 -- 172.21.15.120:0/3351423064 shutdown_connections 2024-09-07T03:34:22.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.256+0000 7f84ec60e800 1 -- 172.21.15.120:0/3351423064 wait complete. 2024-09-07T03:34:22.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.270+0000 7f84ec60e800 1 Processor -- start 2024-09-07T03:34:22.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.270+0000 7f84ec60e800 1 -- start start 2024-09-07T03:34:22.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.271+0000 7f84ec60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c744e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.271+0000 7f84ec60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563059a1ddd0 con 0x563059b83300 2024-09-07T03:34:22.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.271+0000 7f84e7d6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.271+0000 7f84e7d6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c744e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40876/0 (socket says 172.21.15.120:40876) 2024-09-07T03:34:22.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.271+0000 7f84e7d6b640 1 -- 172.21.15.120:0/1661995419 learned_addr learned my addr 172.21.15.120:0/1661995419 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.271+0000 7f84e7d6b640 1 -- 172.21.15.120:0/1661995419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563059a36e10 con 0x563059b83300 2024-09-07T03:34:22.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.271+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/1661995419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c744e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f84d8001ea0 tx=0x7f84d800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e39f817a6e25a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f83d5e0b640 1 -- 172.21.15.120:0/1661995419 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d8008070 con 0x563059b83300 2024-09-07T03:34:22.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f83d5e0b640 1 -- 172.21.15.120:0/1661995419 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d800d500 con 0x563059b83300 2024-09-07T03:34:22.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f83d5e0b640 1 -- 172.21.15.120:0/1661995419 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d800d880 con 0x563059b83300 2024-09-07T03:34:22.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f84ec60e800 1 -- 172.21.15.120:0/1661995419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 msgr2=0x563059c744e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1661995419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c744e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f84d8001ea0 tx=0x7f84d800b6a0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f84ec60e800 1 -- 172.21.15.120:0/1661995419 shutdown_connections 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1661995419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c744e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f84ec60e800 1 -- 172.21.15.120:0/1661995419 >> 172.21.15.120:0/1661995419 conn(0x563059b7e930 msgr2=0x563059c6fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f84ec60e800 1 -- 172.21.15.120:0/1661995419 shutdown_connections 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.272+0000 7f84ec60e800 1 -- 172.21.15.120:0/1661995419 wait complete. 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f84ec60e800 1 Processor -- start 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f84ec60e800 1 -- start start 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f84ec60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c7be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f84ec60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563059b8c040 con 0x563059b83300 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f84e7d6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c7be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f84e7d6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c7be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40878/0 (socket says 172.21.15.120:40878) 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f84e7d6b640 1 -- 172.21.15.120:0/1559254415 learned_addr learned my addr 172.21.15.120:0/1559254415 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f84e7d6b640 1 -- 172.21.15.120:0/1559254415 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563059c7c3d0 con 0x563059b83300 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c7be70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f84d80012f0 tx=0x7f84d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f83cffff640 1 -- 172.21.15.120:0/1559254415 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d800f9d0 con 0x563059b83300 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.273+0000 7f83cffff640 1 -- 172.21.15.120:0/1559254415 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d800fb70 con 0x563059b83300 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.274+0000 7f83cffff640 1 -- 172.21.15.120:0/1559254415 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d800fe50 con 0x563059b83300 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.274+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563059c7c660 con 0x563059b83300 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.274+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563059c7d060 con 0x563059b83300 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.274+0000 7f83cffff640 1 -- 172.21.15.120:0/1559254415 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f84d8017040 con 0x563059b83300 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.275+0000 7f83cffff640 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83d003c8d0 0x7f83d003ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.275+0000 7f83cffff640 1 -- 172.21.15.120:0/1559254415 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f84d8015020 con 0x563059b83300 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.275+0000 7f84df56a640 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83d003c8d0 0x7f83d003ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.275+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059b837c0 0x563059c834c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.275+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059c83a00 con 0x563059b837c0 2024-09-07T03:34:22.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.275+0000 7f84e856c640 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059b837c0 0x563059c834c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.275+0000 7f84df56a640 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83d003c8d0 0x7f83d003ed90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f84d0057000 tx=0x7f84d0052000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.275+0000 7f84e856c640 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059b837c0 0x563059c834c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.275+0000 7f84e856c640 1 -- 172.21.15.120:0/1559254415 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84e000a4d0 con 0x563059b837c0 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.276+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059c842b0 0x563059c86720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.276+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059c86e90 con 0x563059c842b0 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.276+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059c842b0 0x563059c86720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.276+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059c842b0 0x563059c86720 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.276+0000 7f84e7d6b640 1 -- 172.21.15.120:0/1559254415 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84d802d070 con 0x563059c842b0 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.276+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059c88740 con 0x563059c842b0 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.277+0000 7f84e7d6b640 1 -- 172.21.15.120:0/1559254415 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f84d802d070 con 0x563059c842b0 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.277+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059c87850 con 0x563059c842b0 2024-09-07T03:34:22.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.277+0000 7f84e7d6b640 1 -- 172.21.15.120:0/1559254415 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84d802d070 con 0x563059c842b0 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.277+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059c87c70 con 0x563059b837c0 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.277+0000 7f84e856c640 1 -- 172.21.15.120:0/1559254415 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f84e000a4d0 con 0x563059b837c0 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.278+0000 7f84ec60e800 1 Processor -- start 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.278+0000 7f84ec60e800 1 -- start start 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.278+0000 7f84ec60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059c96c00 0x563059c97020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.278+0000 7f84ec60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563059a7ba00 con 0x563059c96c00 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.278+0000 7f84e856c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059c96c00 0x563059c97020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.278+0000 7f84e856c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059c96c00 0x563059c97020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40894/0 (socket says 172.21.15.120:40894) 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.278+0000 7f84e856c640 1 -- 172.21.15.120:0/732003727 learned_addr learned my addr 172.21.15.120:0/732003727 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.278+0000 7f84e856c640 1 -- 172.21.15.120:0/732003727 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563059c97660 con 0x563059c96c00 2024-09-07T03:34:22.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.278+0000 7f84e856c640 1 --2- 172.21.15.120:0/732003727 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059c96c00 0x563059c97020 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f84e0016d20 tx=0x7f84e000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.279+0000 7f83cd7fa640 1 -- 172.21.15.120:0/732003727 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84e0017660 con 0x563059c96c00 2024-09-07T03:34:22.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.279+0000 7f83cd7fa640 1 -- 172.21.15.120:0/732003727 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e001b030 con 0x563059c96c00 2024-09-07T03:34:22.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.279+0000 7f83cd7fa640 1 -- 172.21.15.120:0/732003727 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84e0017950 con 0x563059c96c00 2024-09-07T03:34:22.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.279+0000 7f84ec60e800 1 -- 172.21.15.120:0/732003727 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563059c97e90 con 0x563059c96c00 2024-09-07T03:34:22.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.279+0000 7f84ec60e800 1 -- 172.21.15.120:0/732003727 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563059c98430 con 0x563059c96c00 2024-09-07T03:34:22.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.279+0000 7f83cd7fa640 1 -- 172.21.15.120:0/732003727 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f84e0017b40 con 0x563059c96c00 2024-09-07T03:34:22.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.279+0000 7f83cd7fa640 1 --2- 172.21.15.120:0/732003727 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83c003c730 0x7f83c003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f83cd7fa640 1 -- 172.21.15.120:0/732003727 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f84e000e040 con 0x563059c96c00 2024-09-07T03:34:22.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/732003727 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83c003c730 0x7f83c003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84ec60e800 1 Processor -- start 2024-09-07T03:34:22.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/732003727 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83c003c730 0x7f83c003ebf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563059c87370 tx=0x7f84d8052690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84ec60e800 1 -- start start 2024-09-07T03:34:22.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84ec60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059b85410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84ec60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563059c74d30 con 0x563059b85010 2024-09-07T03:34:22.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84e856c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059b85410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84e856c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059b85410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40906/0 (socket says 172.21.15.120:40906) 2024-09-07T03:34:22.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84e856c640 1 -- 172.21.15.120:0/975318814 learned_addr learned my addr 172.21.15.120:0/975318814 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.280+0000 7f84e856c640 1 -- 172.21.15.120:0/975318814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563059b85950 con 0x563059b85010 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f84e856c640 1 --2- 172.21.15.120:0/975318814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059b85410 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f84e0013450 tx=0x7f84e0053f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9cc4ca6a04defc server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f83c6ffd640 1 -- 172.21.15.120:0/975318814 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84e0014a00 con 0x563059b85010 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f83c6ffd640 1 -- 172.21.15.120:0/975318814 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e0051070 con 0x563059b85010 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f83c6ffd640 1 -- 172.21.15.120:0/975318814 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84e0028350 con 0x563059b85010 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f84ec60e800 1 -- 172.21.15.120:0/975318814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 msgr2=0x563059b85410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f84ec60e800 1 --2- 172.21.15.120:0/975318814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059b85410 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f84e0013450 tx=0x7f84e0053f40 comp rx=0 tx=0).stop 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f84ec60e800 1 -- 172.21.15.120:0/975318814 shutdown_connections 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f84ec60e800 1 --2- 172.21.15.120:0/975318814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059b85410 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f84ec60e800 1 -- 172.21.15.120:0/975318814 >> 172.21.15.120:0/975318814 conn(0x563059c9fac0 msgr2=0x563059c9dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f84ec60e800 1 -- 172.21.15.120:0/975318814 shutdown_connections 2024-09-07T03:34:22.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f84ec60e800 1 -- 172.21.15.120:0/975318814 wait complete. 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.281+0000 7f84ec60e800 1 Processor -- start 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84ec60e800 1 -- start start 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84ec60e800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059cacec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84ec60e800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x563059b83ed0 con 0x563059b85010 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84e856c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059cacec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84e856c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059cacec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:40910/0 (socket says 172.21.15.120:40910) 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 learned_addr learned my addr 172.21.15.120:0/2446616241 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563059cad420 con 0x563059b85010 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84e856c640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059cacec0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f84e0013450 tx=0x7f84e0053d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f83c57fa640 1 -- 172.21.15.120:0/2446616241 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84e0005030 con 0x563059b85010 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f83c57fa640 1 -- 172.21.15.120:0/2446616241 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e00051d0 con 0x563059b85010 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563059cad6b0 con 0x563059b85010 2024-09-07T03:34:22.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f83c57fa640 1 -- 172.21.15.120:0/2446616241 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84e00054b0 con 0x563059b85010 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.282+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563059cae030 con 0x563059b85010 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.283+0000 7f83c57fa640 1 -- 172.21.15.120:0/2446616241 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f84e00127a0 con 0x563059b85010 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.283+0000 7f83c57fa640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83b003c730 0x7f83b003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.283+0000 7f83c57fa640 1 -- 172.21.15.120:0/2446616241 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f84e0030030 con 0x563059b85010 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.283+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83b003c730 0x7f83b003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.284+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83b003c730 0x7f83b003ebf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f84d8054520 tx=0x7f84d8048000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.284+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.284+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059cb8990 0x563059cbae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.284+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cbb5a0 con 0x563059cb8990 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.284+0000 7f84df56a640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059cb8990 0x563059cbae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.284+0000 7f84df56a640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059cb8990 0x563059cbae50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 20 realm 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cbb9d0 con 0x563059cb8990 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cbc2a0 con 0x563059cb8990 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059cbccc0 0x563059cbf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cbf860 con 0x563059cbccc0 2024-09-07T03:34:22.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.285+0000 7f84e856c640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059cbccc0 0x563059cbf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84e856c640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059cbccc0 0x563059cbf0f0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84ec60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:22.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cc00b0 con 0x563059cbccc0 2024-09-07T03:34:22.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84ec60e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84ec60e800 20 searching for the correct realm 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563059cc1e20 0x563059cc4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cc1e20 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.286+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563059cc1e20 0x563059cc4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.287+0000 7f84e7d6b640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563059cc1e20 0x563059cc4250 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.287+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.287+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cbccc0 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.287+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.287+0000 7f84e856c640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f84e0004b30 0x7f84e0012a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.287+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x7f84e0004b30 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.287+0000 7f84df56a640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f84e0004b30 0x7f84e0012a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:34:22.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.288+0000 7f84df56a640 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f84e0004b30 0x7f84e0012a90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.288+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.288+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cb8990 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.288+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.288+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cb8990 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.288+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.288+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cc1e20 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cb8990 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cbccc0 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cbccc0 2024-09-07T03:34:22.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cb8990 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.289+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x7f84e0004b30 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.290+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.290+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cb8990 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.290+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.290+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x7f84e0004b30 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.290+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.290+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cbccc0 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.290+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.290+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cc1e20 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.291+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.291+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cb8990 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.291+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.291+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cbccc0 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.291+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.291+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cc1e20 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.291+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.291+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cb8990 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.292+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.292+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cb8990 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.292+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.292+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cb8990 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.292+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.292+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cc1e20 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.292+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.292+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x7f84e0004b30 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.293+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.293+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x7f84e0004b30 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.293+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.293+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x7f84e0004b30 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.293+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.293+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cc1e20 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.293+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.293+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x7f84e0004b30 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.293+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.294+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cbccc0 2024-09-07T03:34:22.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.294+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.294+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cbccc0 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.294+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.294+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cc1e20 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.294+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.294+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cbccc0 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563059cc4920 con 0x563059cbccc0 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:34:22.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cc0a00 con 0x563059cb8990 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cc0610 con 0x563059cbccc0 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.295+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cc1370 con 0x563059cb8990 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 20 zone default found 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 4 Realm: () 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 20 zonegroup default 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cc5250 con 0x7f84e0004b30 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cc7490 con 0x563059cc1e20 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059cc7830 con 0x563059cc1e20 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.296+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.297+0000 7f84ec60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.297+0000 7f84ec60e800 20 started sync module instance, tier type = 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.297+0000 7f84ec60e800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.297+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc6920 con 0x563059cbccc0 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.298+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.298+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94765664988704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc6920 con 0x563059cbccc0 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.298+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc8230 con 0x563059cb8990 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.299+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94765664988704] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.299+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.299+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94765664986224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc6890 con 0x563059cb8990 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.299+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc90f0 con 0x563059cbccc0 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.300+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94765664986224] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.300+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.300+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94765664994848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc90f0 con 0x563059cbccc0 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.300+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc9b00 con 0x7f84e0004b30 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.301+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94765664994848] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.301+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.301+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94765664999472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc90f0 con 0x7f84e0004b30 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.301+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cca550 con 0x563059cbccc0 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.302+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94765664999472] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.302+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.303+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94765665001568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc90f0 con 0x563059cbccc0 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.303+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059ccaf60 con 0x563059cc1e20 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.304+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94765665001568] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.304+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.304+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94765664996416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cc9060 con 0x563059cc1e20 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.304+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059ccbe20 con 0x563059cc1e20 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.305+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94765664996416] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.305+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.305+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94765665007984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059ccc240 con 0x563059cc1e20 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.305+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059cccc00 con 0x7f84e0004b30 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94765665011536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059ccd020 con 0x7f84e0004b30 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84ec60e800 20 add_watcher() i=0 2024-09-07T03:34:22.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84ec60e800 20 add_watcher() i=1 2024-09-07T03:34:22.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84ec60e800 20 add_watcher() i=2 2024-09-07T03:34:22.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84ec60e800 20 add_watcher() i=3 2024-09-07T03:34:22.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84ec60e800 20 add_watcher() i=4 2024-09-07T03:34:22.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84ec60e800 20 add_watcher() i=5 2024-09-07T03:34:22.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94765665007984] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.306+0000 7f84ec60e800 20 add_watcher() i=6 2024-09-07T03:34:22.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.307+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94765665011536] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.307+0000 7f84ec60e800 20 add_watcher() i=7 2024-09-07T03:34:22.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.307+0000 7f84ec60e800 2 all 8 watchers are set, enabling cache 2024-09-07T03:34:22.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.307+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059ccbd90 con 0x563059cb8990 2024-09-07T03:34:22.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.307+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.307+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94765665012592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059ccbd90 con 0x563059cb8990 2024-09-07T03:34:22.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.308+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94765665012592] v36'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.308+0000 7f839dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.308+0000 7f84ec60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.308+0000 7f84ec60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.309+0000 7f84ec60e800 5 note: GC not initialized 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.309+0000 7f839cfe1640 20 reqs_thread_entry: start 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.309+0000 7f84ec60e800 20 init_complete bucket index max shards: 11 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.309+0000 7f84ec60e800 20 Filter name: none 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.309+0000 7f83167fc640 20 reqs_thread_entry: start 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.309+0000 7f84ec60e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.309+0000 7f84ec60e800 20 rados->read ofs=0 len=0 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.309+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059d03150 con 0x563059cb8990 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.310+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.310+0000 7f84ec60e800 20 rados_obj.operate() r=0 bl.length=473 2024-09-07T03:34:22.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.310+0000 7f84ec60e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.310+0000 7f84ec60e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.310+0000 7f84ec60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.310+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d09880 con 0x563059cb8990 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f84ec60e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f84ec60e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f84ec60e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94765665260160 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563059d04f20 con 0x563059cbccc0 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== watch-notify(notify (1) cookie 94765665001568 notify 154618822704 ret 0) ==== 691+0+0 (crc 0 0 0) 0x563059cae030 con 0x563059cbccc0 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(64 notify.4 [notify cookie 94765665260160 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f83c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822704 cookie 94765665001568 notifier 4918 bl.length()=649 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f83c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-07T03:34:22.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f83c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-07T03:34:22.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f83c6ffd640 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f83ac003ea0 con 0x563059cbccc0 2024-09-07T03:34:22.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== watch-notify(notify_complete (2) cookie 94765665260160 notify 154618822704 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f84e0071020 con 0x563059cbccc0 2024-09-07T03:34:22.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.311+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.325 INFO:teuthology.orchestra.run.smithi120.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-07T03:34:20.318854Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-07T03:34:20.318840Z","tags":[],"group_ids":[]} 2024-09-07T03:34:22.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.312+0000 7f839dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:34:22.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.312+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94765665012592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d00f80 con 0x563059cb8990 2024-09-07T03:34:22.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.314+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94765665012592] v36'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.314+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94765664988704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d00f80 con 0x563059cbccc0 2024-09-07T03:34:22.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.315+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94765664988704] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.315+0000 7f84ec60e800 20 remove_watcher() i=0 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.315+0000 7f84ec60e800 2 removed watcher, disabling cache 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.315+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94765664986224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d00f80 con 0x563059cb8990 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.316+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94765664986224] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x563059cb8990 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.316+0000 7f84ec60e800 20 remove_watcher() i=1 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.316+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94765664994848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d00f80 con 0x563059cbccc0 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.317+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94765664994848] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.317+0000 7f84ec60e800 20 remove_watcher() i=2 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.317+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94765664999472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d00f80 con 0x7f84e0004b30 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.318+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94765664999472] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.318+0000 7f84ec60e800 20 remove_watcher() i=3 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.318+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94765665001568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d00f80 con 0x563059cbccc0 2024-09-07T03:34:22.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.319+0000 7f84e856c640 1 -- 172.21.15.120:0/2446616241 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94765665001568] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84e0027070 con 0x563059cbccc0 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.319+0000 7f84ec60e800 20 remove_watcher() i=4 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.319+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94765664996416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d00f80 con 0x563059cc1e20 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.320+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94765664996416] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.320+0000 7f84ec60e800 20 remove_watcher() i=5 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.320+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94765665007984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d00f80 con 0x563059cc1e20 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.321+0000 7f84e7d6b640 1 -- 172.21.15.120:0/2446616241 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94765665007984] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d802d070 con 0x563059cc1e20 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.321+0000 7f84ec60e800 20 remove_watcher() i=6 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.321+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94765665011536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563059d00f80 con 0x7f84e0004b30 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94765665011536] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84d0057030 con 0x7f84e0004b30 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 20 remove_watcher() i=7 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059cbccc0 msgr2=0x563059cbf0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059cbccc0 0x563059cbf0f0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059cb8990 msgr2=0x563059cbae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059cb8990 0x563059cbae50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f84e0004b30 msgr2=0x7f84e0012a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f84e0004b30 0x7f84e0012a90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563059cc1e20 msgr2=0x563059cc4250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x563059cc1e20 0x563059cc4250 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83b003c730 msgr2=0x7f83b003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83b003c730 0x7f83b003ebf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f84d8054520 tx=0x7f84d8048000 comp rx=0 tx=0).stop 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 msgr2=0x563059cacec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84df56a640 1 -- 172.21.15.120:0/2446616241 reap_dead start 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059cacec0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f84e0013450 tx=0x7f84e0053d90 comp rx=0 tx=0).stop 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 shutdown_connections 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 --2- 172.21.15.120:0/2446616241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b85010 0x563059cacec0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.322+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 >> 172.21.15.120:0/2446616241 conn(0x563059c9fac0 msgr2=0x563059c9dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 shutdown_connections 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/2446616241 wait complete. 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/732003727 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83c003c730 msgr2=0x7f83c003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/732003727 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83c003c730 0x7f83c003ebf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563059c87370 tx=0x7f84d8052690 comp rx=0 tx=0).stop 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/732003727 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059c96c00 msgr2=0x563059c97020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/732003727 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059c96c00 0x563059c97020 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f84e0016d20 tx=0x7f84e000d7b0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/732003727 shutdown_connections 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/732003727 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83c003c730 0x7f83c003ebf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/732003727 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059c96c00 0x563059c97020 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/732003727 >> 172.21.15.120:0/732003727 conn(0x563059c8afb0 msgr2=0x563059c8b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/732003727 shutdown_connections 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/732003727 wait complete. 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059c842b0 msgr2=0x563059c86720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059c842b0 0x563059c86720 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059b837c0 msgr2=0x563059c834c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059b837c0 0x563059c834c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83d003c8d0 msgr2=0x7f83d003ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83d003c8d0 0x7f83d003ed90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f84d0057000 tx=0x7f84d0052000 comp rx=0 tx=0).stop 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 msgr2=0x563059c7be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c7be70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f84d80012f0 tx=0x7f84d8000ed0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 shutdown_connections 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x563059c842b0 0x563059c86720 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x563059b837c0 0x563059c834c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f83d003c8d0 0x7f83d003ed90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 --2- 172.21.15.120:0/1559254415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x563059b83300 0x563059c7be70 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 >> 172.21.15.120:0/1559254415 conn(0x563059b7e930 msgr2=0x563059c757c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:34:22.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 shutdown_connections 2024-09-07T03:34:22.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:34:22.323+0000 7f84ec60e800 1 -- 172.21.15.120:0/1559254415 wait complete. 2024-09-07T03:34:22.336 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:22.337 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-07T03:34:20.318854Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-07T03:34:20.318840Z', 'tags': [], 'group_ids': []} 2024-09-07T03:34:22.337 ERROR:root:0 2024-09-07T03:34:22.337 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-07T03:34:22.352 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.352 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.364 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-07T03:34:22.379 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.379 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.406 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.406 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-07T03:34:22.422 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-07T03:34:22.422 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.434 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.435 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-07T03:34:22.450 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:34:22.450 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.462 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.462 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-07T03:34:22.478 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-07T03:34:22.478 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.490 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-07T03:34:22.506 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-07T03:34:22.507 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.517 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-07T03:34:22.533 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:34:22.533 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.545 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.545 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-07T03:34:22.576 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:34:22.576 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.588 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.588 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-07T03:34:22.603 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:34:22.604 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.615 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.616 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.628 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-07T03:34:22.629 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-07T03:34:22.641 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-07T03:34:22.660 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-07T03:34:22.672 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-07T03:34:22.672 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-07T03:34:22.684 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1445b2f9-7226-49a1-ba30-52d0fcf4c719', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-07T03:34:22.655881Z', 'creation_time': '2024-09-07T03:34:22.653246Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-07T03:34:22.684 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-07T03:34:22.696 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1445b2f9-7226-49a1-ba30-52d0fcf4c719', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-07T03:34:22.655881Z', 'creation_time': '2024-09-07T03:34:22.653246Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-07T03:34:22.701 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-07T03:34:22.714 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1445b2f9-7226-49a1-ba30-52d0fcf4c719', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-07T03:34:22.655881Z', 'creation_time': '2024-09-07T03:34:22.653246Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-07T03:34:22.714 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-07T03:34:22.726 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx0000079d569ffecf06936-0066dbc9be-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:34:22.730 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-07T03:34:22.746 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:34:22.746 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-07T03:34:22.762 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:34:22.771 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11'} 2024-09-07T03:34:22.789 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:34:22.838 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11'} 2024-09-07T03:34:22.856 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:34:22.856 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-07T03:34:22.874 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:34:22.891 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-07T03:34:22.907 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:34:22.907 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-07T03:34:22.920 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1445b2f9-7226-49a1-ba30-52d0fcf4c719', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11', 'marker': 'cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-07T03:34:22.851534Z', 'creation_time': '2024-09-07T03:34:22.653246Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-07T03:35:22.967 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-07T03:35:22.999 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:35:23.000 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-07T03:35:23.023 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:35:23.023 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-07T03:35:23.037 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:35:23.037 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-07T03:35:23.049 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:35:23.050 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-07T03:35:23.062 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:35:23.062 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-07T03:35:23.075 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:35:23.076 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-07T03:35:23.090 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-07T03:00:00.000000Z', 'epoch': 1725678000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-07T03:35:23.090 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-07T03:35:23.105 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:35:23.105 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-07T03:35:23.117 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-07T03:35:23.118 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-07T03:35:23.135 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:35:23.148 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-07T03:35:23.166 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:35:23.436 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-07T03:35:23.449 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000e0e12e52bbcf5426-0066dbc9fb-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:23.550 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-07T03:35:23.563 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-07T03:35:23.569 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-07T03:35:23.581 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-07T03:35:23.697 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-07T03:35:23.744 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:35:23.745 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-07T03:35:23.759 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-07T03:35:23.760 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-07T03:35:23.774 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-07T03:35:23.788 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-07T03:35:23.800 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000486fe8593440059f-0066dbc9fb-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:23.822 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-07T03:35:23.859 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:35:23.860 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-07T03:35:23.871 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000004f8fad3a052e18f8-0066dbc9fb-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:23.872 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-07T03:35:23.883 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'ccd99612-983c-4850-93dd-2abdd870e9cd'}]}} 2024-09-07T03:35:23.883 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-07T03:35:23.901 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-07T03:35:23.902 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-07T03:35:23.913 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-07T03:35:23.914 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-07T03:35:23.926 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000000515da9a272e4561-0066dbc9fb-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:23.927 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-07T03:35:23.939 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000043cf4897ac11ce71-0066dbc9fb-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:23.949 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-07T03:35:23.961 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-07T03:35:23.961 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-07T03:35:23.973 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000009981db02d29e40de-0066dbc9fb-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:23.973 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-07T03:35:23.986 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000cd2f4d67044b77ba-0066dbc9fb-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:23.986 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-07T03:35:23.998 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-07T03:35:23.998 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-07T03:35:24.010 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000ed9e256c1ce0db16-0066dbc9fc-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:24.010 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-07T03:35:24.022 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000c99ec5ff073a1802-0066dbc9fc-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:24.022 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-07T03:35:24.033 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000003acc08c9e77aa7ff-0066dbc9fc-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:24.034 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-07T03:35:24.046 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000009c0c5ef7702e85a6-0066dbc9fc-4225-default', 'HostId': '4225-default-default'} 2024-09-07T03:35:24.046 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-07T03:35:24.062 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:35:24.062 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-07T03:35:24.074 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-07T03:35:24.074 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-07T03:35:24.089 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:35:24.089 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-07T03:35:24.100 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-07T03:35:24.101 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-07T03:35:24.114 INFO:tasks.radosgw_admin_rest: empty result 2024-09-07T03:35:24.119 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-07T03:35:24.136 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-07T03:35:24.136 INFO:teuthology.orchestra.run:waiting for 300 2024-09-07T03:35:24.138 INFO:tasks.rgw.client.0.smithi120.stdout:2024-09-07T03:35:24.136+0000 7fd9401e7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 36449) UID: 0 2024-09-07T03:35:24.138 INFO:tasks.rgw.client.0.smithi120.stdout:2024-09-07T03:35:24.136+0000 7fd943a47880 -1 shutting down 2024-09-07T03:35:30.238 INFO:tasks.rgw.client.0:Stopped 2024-09-07T03:35:30.239 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-07T03:35:30.258 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/vault-root-token 2024-09-07T03:35:30.327 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-07T03:35:30.396 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-07T03:35:30.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-07T03:35:30.397 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-07T03:35:30.484 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-07T03:35:30.484 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-07T03:35:30.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.483+0000 7f3bfe1af800 1 Processor -- start 2024-09-07T03:35:30.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.483+0000 7f3bfe1af800 1 -- start start 2024-09-07T03:35:30.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.483+0000 7f3bfe1af800 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5605c2b154b0 0x5605c2b158b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.483+0000 7f3bfe1af800 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5605c29c0e40 con 0x5605c2b15df0 2024-09-07T03:35:30.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.483+0000 7f3bfe1af800 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x5605c298b680 con 0x5605c2b154b0 2024-09-07T03:35:30.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.483+0000 7f3bfbc99640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5605c2b154b0 0x5605c2b158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.483+0000 7f3bfb498640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x5605c2b15df0 0x5605c2b162a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.120:44144/0 (socket says 172.21.15.120:44144) 2024-09-07T03:35:30.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.483+0000 7f3bfbc99640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x5605c2b154b0 0x5605c2b158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:33866/0 (socket says 172.21.15.120:33866) 2024-09-07T03:35:30.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.483+0000 7f3bfb498640 1 -- 172.21.15.120:0/1172363255 learned_addr learned my addr 172.21.15.120:0/1172363255 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-07T03:35:30.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.484+0000 7f3bfbc99640 1 -- 172.21.15.120:0/1172363255 >> v1:172.21.15.104:6789/0 conn(0x5605c2b15df0 legacy=0x5605c2b162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.484+0000 7f3bfbc99640 1 -- 172.21.15.120:0/1172363255 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c29a76b0 con 0x5605c2b154b0 2024-09-07T03:35:30.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.484+0000 7f3bfac97640 1 -- 172.21.15.120:0/1172363255 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505940323 0 0) 0x5605c29c0e40 con 0x5605c2b15df0 2024-09-07T03:35:30.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.486+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/1172363255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2b158b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3bec005fd0 tx=0x7f3bec045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf41afbde611bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.486+0000 7f3bfac97640 1 -- 172.21.15.120:0/1172363255 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec058530 con 0x5605c2b154b0 2024-09-07T03:35:30.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.486+0000 7f3bfac97640 1 -- 172.21.15.120:0/1172363255 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec0586d0 con 0x5605c2b154b0 2024-09-07T03:35:30.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.486+0000 7f3bfac97640 1 -- 172.21.15.120:0/1172363255 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec0589d0 con 0x5605c2b154b0 2024-09-07T03:35:30.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.487+0000 7f3bfe1af800 1 -- 172.21.15.120:0/1172363255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 msgr2=0x5605c2b158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.487+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/1172363255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2b158b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3bec005fd0 tx=0x7f3bec045c30 comp rx=0 tx=0).stop 2024-09-07T03:35:30.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.487+0000 7f3bfe1af800 1 -- 172.21.15.120:0/1172363255 shutdown_connections 2024-09-07T03:35:30.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.487+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/1172363255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2b158b0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.487+0000 7f3bfe1af800 1 -- 172.21.15.120:0/1172363255 >> 172.21.15.120:0/1172363255 conn(0x5605c2b111c0 msgr2=0x5605c2b13620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:30.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.487+0000 7f3bfe1af800 1 -- 172.21.15.120:0/1172363255 shutdown_connections 2024-09-07T03:35:30.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.487+0000 7f3bfe1af800 1 -- 172.21.15.120:0/1172363255 wait complete. 2024-09-07T03:35:30.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.502+0000 7f3bfe1af800 1 Processor -- start 2024-09-07T03:35:30.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.502+0000 7f3bfe1af800 1 -- start start 2024-09-07T03:35:30.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.502+0000 7f3bfe1af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.502+0000 7f3bfe1af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5605c29afdd0 con 0x5605c2b154b0 2024-09-07T03:35:30.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.502+0000 7f3bfbc99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.502+0000 7f3bfbc99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c086e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:33880/0 (socket says 172.21.15.120:33880) 2024-09-07T03:35:30.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.502+0000 7f3bfbc99640 1 -- 172.21.15.120:0/3773293982 learned_addr learned my addr 172.21.15.120:0/3773293982 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:35:30.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.503+0000 7f3bfbc99640 1 -- 172.21.15.120:0/3773293982 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c29c8e10 con 0x5605c2b154b0 2024-09-07T03:35:30.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.503+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/3773293982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c086e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3bec025a60 tx=0x7f3bec051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8548f266db4ce7c server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.503+0000 7f3ae9e0b640 1 -- 172.21.15.120:0/3773293982 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec068070 con 0x5605c2b154b0 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.503+0000 7f3ae9e0b640 1 -- 172.21.15.120:0/3773293982 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec058880 con 0x5605c2b154b0 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.503+0000 7f3ae9e0b640 1 -- 172.21.15.120:0/3773293982 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec058ba0 con 0x5605c2b154b0 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.504+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3773293982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 msgr2=0x5605c2c086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.504+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3773293982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c086e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3bec025a60 tx=0x7f3bec051000 comp rx=0 tx=0).stop 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.504+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3773293982 shutdown_connections 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.504+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3773293982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c086e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.504+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3773293982 >> 172.21.15.120:0/3773293982 conn(0x5605c2b111c0 msgr2=0x5605c2c04060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.504+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3773293982 shutdown_connections 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.504+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3773293982 wait complete. 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.504+0000 7f3bfe1af800 1 Processor -- start 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.504+0000 7f3bfe1af800 1 -- start start 2024-09-07T03:35:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3bfe1af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c0ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3bfe1af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5605c2b16d10 con 0x5605c2b154b0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3bfbc99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c0ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3bfbc99640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c0ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:33896/0 (socket says 172.21.15.120:33896) 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3bfbc99640 1 -- 172.21.15.120:0/3734203357 learned_addr learned my addr 172.21.15.120:0/3734203357 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3bfbc99640 1 -- 172.21.15.120:0/3734203357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c2c104d0 con 0x5605c2b154b0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c0ff70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3bec025a60 tx=0x7f3bec003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3ae3fff640 1 -- 172.21.15.120:0/3734203357 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec068040 con 0x5605c2b154b0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3ae3fff640 1 -- 172.21.15.120:0/3734203357 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec071070 con 0x5605c2b154b0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.505+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605c2c10760 con 0x5605c2b154b0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.506+0000 7f3ae3fff640 1 -- 172.21.15.120:0/3734203357 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec0637b0 con 0x5605c2b154b0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.506+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c2c110e0 con 0x5605c2b154b0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.507+0000 7f3ae3fff640 1 -- 172.21.15.120:0/3734203357 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3bec0639e0 con 0x5605c2b154b0 2024-09-07T03:35:30.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.507+0000 7f3ae3fff640 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ae403c730 0x7f3ae403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.507+0000 7f3ae3fff640 1 -- 172.21.15.120:0/3734203357 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3bec097540 con 0x5605c2b154b0 2024-09-07T03:35:30.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.507+0000 7f3bfb498640 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ae403c730 0x7f3ae403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.507+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2b15df0 0x5605c2c175c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.507+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c11d30 con 0x5605c2b15df0 2024-09-07T03:35:30.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.507+0000 7f3bfc49a640 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2b15df0 0x5605c2c175c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.507+0000 7f3bfb498640 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ae403c730 0x7f3ae403ebf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3be4000c00 tx=0x7f3be40013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.507+0000 7f3bfc49a640 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2b15df0 0x5605c2c175c0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.508+0000 7f3bfc49a640 1 -- 172.21.15.120:0/3734203357 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2b15df0 2024-09-07T03:35:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.508+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c18530 0x5605c2c1a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.508+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c1af50 con 0x5605c2c18530 2024-09-07T03:35:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.508+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c18530 0x5605c2c1a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.508+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c18530 0x5605c2c1a920 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.509+0000 7f3bfbc99640 1 -- 172.21.15.120:0/3734203357 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c18530 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.509+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:3 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c1c800 con 0x5605c2c18530 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.509+0000 7f3bfbc99640 1 -- 172.21.15.120:0/3734203357 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(3 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [call out=48b,read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c18530 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.509+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c1b910 con 0x5605c2c18530 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.509+0000 7f3bfbc99640 1 -- 172.21.15.120:0/3734203357 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c18530 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.509+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:5 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c1bd30 con 0x5605c2b15df0 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.510+0000 7f3bfc49a640 1 -- 172.21.15.120:0/3734203357 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(5 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2b15df0 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.510+0000 7f3bfe1af800 1 Processor -- start 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.510+0000 7f3bfe1af800 1 -- start start 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.510+0000 7f3bfe1af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c2acb0 0x5605c2c2b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.510+0000 7f3bfe1af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5605c2a0da00 con 0x5605c2c2acb0 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3bfc49a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c2acb0 0x5605c2c2b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3bfc49a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c2acb0 0x5605c2c2b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:33898/0 (socket says 172.21.15.120:33898) 2024-09-07T03:35:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3bfc49a640 1 -- 172.21.15.120:0/898770076 learned_addr learned my addr 172.21.15.120:0/898770076 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3bfc49a640 1 -- 172.21.15.120:0/898770076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c2c2b710 con 0x5605c2c2acb0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3bfc49a640 1 --2- 172.21.15.120:0/898770076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c2acb0 0x5605c2c2b0d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400aa90 tx=0x7f3bf400af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3ae17fa640 1 -- 172.21.15.120:0/898770076 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf4007d70 con 0x5605c2c2acb0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3ae17fa640 1 -- 172.21.15.120:0/898770076 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf4018430 con 0x5605c2c2acb0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3ae17fa640 1 -- 172.21.15.120:0/898770076 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf4018750 con 0x5605c2c2acb0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3bfe1af800 1 -- 172.21.15.120:0/898770076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605c2c2bf40 con 0x5605c2c2acb0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.511+0000 7f3bfe1af800 1 -- 172.21.15.120:0/898770076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c2c2c4e0 con 0x5605c2c2acb0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.512+0000 7f3ae17fa640 1 -- 172.21.15.120:0/898770076 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3bf4020020 con 0x5605c2c2acb0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.512+0000 7f3ae17fa640 1 --2- 172.21.15.120:0/898770076 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ad403c840 0x7f3ad403ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.512+0000 7f3ae17fa640 1 -- 172.21.15.120:0/898770076 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3bf401e020 con 0x5605c2c2acb0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.512+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/898770076 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ad403c840 0x7f3ad403ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.513+0000 7f3bfe1af800 1 Processor -- start 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.513+0000 7f3bfe1af800 1 -- start start 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.513+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/898770076 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ad403c840 0x7f3ad403ed00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5605c2c1b430 tx=0x7f3bec080040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.513+0000 7f3bfe1af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c37bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.513+0000 7f3bfe1af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5605c2c08e70 con 0x5605c2c377b0 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.513+0000 7f3bfc49a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c37bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.513+0000 7f3bfc49a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c37bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:33910/0 (socket says 172.21.15.120:33910) 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.513+0000 7f3bfc49a640 1 -- 172.21.15.120:0/213952033 learned_addr learned my addr 172.21.15.120:0/213952033 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.513+0000 7f3bfc49a640 1 -- 172.21.15.120:0/213952033 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c2c381a0 con 0x5605c2c377b0 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3bfc49a640 1 --2- 172.21.15.120:0/213952033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c37bb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40531c0 tx=0x7f3bf40206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b45d85edfe9e88f server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3adaffd640 1 -- 172.21.15.120:0/213952033 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf4020b70 con 0x5605c2c377b0 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3adaffd640 1 -- 172.21.15.120:0/213952033 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf4022410 con 0x5605c2c377b0 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3adaffd640 1 -- 172.21.15.120:0/213952033 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf4053300 con 0x5605c2c377b0 2024-09-07T03:35:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3bfe1af800 1 -- 172.21.15.120:0/213952033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 msgr2=0x5605c2c37bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/213952033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c37bb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40531c0 tx=0x7f3bf40206e0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3bfe1af800 1 -- 172.21.15.120:0/213952033 shutdown_connections 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/213952033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c37bb0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3bfe1af800 1 -- 172.21.15.120:0/213952033 >> 172.21.15.120:0/213952033 conn(0x5605c2c33bb0 msgr2=0x5605c2c31df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3bfe1af800 1 -- 172.21.15.120:0/213952033 shutdown_connections 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.514+0000 7f3bfe1af800 1 -- 172.21.15.120:0/213952033 wait complete. 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.515+0000 7f3bfe1af800 1 Processor -- start 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.515+0000 7f3bfe1af800 1 -- start start 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.515+0000 7f3bfe1af800 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c3edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.515+0000 7f3bfe1af800 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5605c2c387c0 con 0x5605c2c377b0 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.515+0000 7f3bfc49a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c3edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.515+0000 7f3bfc49a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c3edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.120:33914/0 (socket says 172.21.15.120:33914) 2024-09-07T03:35:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.515+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 learned_addr learned my addr 172.21.15.120:0/2830462341 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-07T03:35:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.515+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c2c3f310 con 0x5605c2c377b0 2024-09-07T03:35:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.516+0000 7f3bfc49a640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c3edb0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4020d60 tx=0x7f3bf4053150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.516+0000 7f3ad97fa640 1 -- 172.21.15.120:0/2830462341 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf4017e60 con 0x5605c2c377b0 2024-09-07T03:35:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.516+0000 7f3ad97fa640 1 -- 172.21.15.120:0/2830462341 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf4020b70 con 0x5605c2c377b0 2024-09-07T03:35:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.516+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605c2c3f5a0 con 0x5605c2c377b0 2024-09-07T03:35:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.516+0000 7f3ad97fa640 1 -- 172.21.15.120:0/2830462341 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf404c7b0 con 0x5605c2c377b0 2024-09-07T03:35:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.516+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c2c3ff20 con 0x5605c2c377b0 2024-09-07T03:35:30.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.517+0000 7f3ad97fa640 1 -- 172.21.15.120:0/2830462341 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3bf4016040 con 0x5605c2c377b0 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.517+0000 7f3ad97fa640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ac403c780 0x7f3ac403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.517+0000 7f3ad97fa640 1 -- 172.21.15.120:0/2830462341 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3bf404b040 con 0x5605c2c377b0 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.517+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ac403c780 0x7f3ac403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.517+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ac403c780 0x7f3ac403ec40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3bec07e3f0 tx=0x7f3bec08a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.517+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2c4a920 0x5605c2c4cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c4d530 con 0x5605c2c4a920 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfb498640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2c4a920 0x5605c2c4cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfb498640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2c4a920 0x5605c2c4cde0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 20 realm 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c49c70 con 0x5605c2c4a920 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.518+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c4e020 con 0x5605c2c4a920 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.519+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.519+0000 7f3bfe1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:35:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.519+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.519+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c4ee00 0x5605c2c511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.519+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c518c0 con 0x5605c2c4ee00 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.519+0000 7f3bfc49a640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c4ee00 0x5605c2c511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfc49a640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c4ee00 0x5605c2c511f0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv6 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfe1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:5 5.f 5:f7ad674e:::zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4ee00 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== osd_op_reply(5 zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 [read 0~993 out=993b] v0'0 uv7 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfe1af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfe1af800 20 searching for the correct realm 2024-09-07T03:35:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5605c2c53e80 0x5605c2c562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c569a0 con 0x5605c2c53e80 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.520+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5605c2c53e80 0x5605c2c562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.521+0000 7f3bfbc99640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5605c2c53e80 0x5605c2c562d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.521+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.521+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c569a0 con 0x5605c2c4ee00 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.521+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.521+0000 7f3bfc49a640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3bf402d470 0x7f3bf402c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.521+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x7f3bf402d470 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.522+0000 7f3bfb498640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3bf402d470 0x7f3bf402c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.522+0000 7f3bfb498640 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3bf402d470 0x7f3bf402c3d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.522+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x7f3bf402d470 2024-09-07T03:35:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.522+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4a920 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.522+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.522+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4a920 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.522+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.523+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c53e80 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.523+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.523+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4a920 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.523+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.523+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4ee00 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.523+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.523+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4ee00 2024-09-07T03:35:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.524+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.524+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4a920 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.524+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.524+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x7f3bf402d470 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.524+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x7f3bf402d470 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.524+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4a920 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.524+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.524+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x7f3bf402d470 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.525+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3be400f5f0 con 0x7f3bf402d470 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.525+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4ee00 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.525+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.525+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c53e80 2024-09-07T03:35:30.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.525+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.525+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4a920 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.526+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.526+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4ee00 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.526+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.526+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c53e80 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.526+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.526+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4a920 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.526+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.526+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4a920 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.527+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.527+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4a920 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.527+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x5605c2c4a920 2024-09-07T03:35:30.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.527+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c53e80 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.527+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.527+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x7f3bf402d470 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.527+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x7f3bf402d470 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.527+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x7f3bf402d470 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.527+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x7f3bf402d470 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.528+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x7f3bf402d470 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.528+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=82b] v36'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f3be400f5f0 con 0x7f3bf402d470 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.528+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c53e80 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.528+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.528+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x7f3bf402d470 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.528+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be400f5f0 con 0x7f3bf402d470 2024-09-07T03:35:30.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.528+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c52110 con 0x5605c2c4ee00 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.529+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.529+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f3bf4067040 con 0x5605c2c4ee00 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.529+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.529+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f3bf4067040 con 0x5605c2c53e80 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.529+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.529+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f3bf4067040 con 0x5605c2c4ee00 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.529+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=173b] v36'7 uv7 ondisk = 1) ==== 144+0+173 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.529+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f3bf4067040 con 0x5605c2c4ee00 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 RGWRados::pool_iterate: got zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-07T03:35:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 RGWRados::pool_iterate: got period_config.default 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 RGWRados::pool_iterate: got zone_info.cf0fab6f-a978-4ce5-bacd-166891c31743 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c525c0 con 0x5605c2c4a920 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c529b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.530+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:40 5.1a 5:5aa201e8:::zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c529b0 con 0x5605c2c4a920 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 14 ==== osd_op_reply(40 zonegroup_info.1445b2f9-7226-49a1-ba30-52d0fcf4c719 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 20 zone default found 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 4 Realm: () 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 4 ZoneGroup: default (1445b2f9-7226-49a1-ba30-52d0fcf4c719) 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 4 Zone: default (cf0fab6f-a978-4ce5-bacd-166891c31743) 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 20 zonegroup default 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c53280 con 0x7f3bf402d470 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 8 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 20 rados_obj.operate() r=0 bl.length=187 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.531+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c58940 con 0x5605c2c53e80 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.532+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.532+0000 7f3bfe1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.532+0000 7f3bfe1af800 20 rados->read ofs=0 len=0 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.532+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c58e10 con 0x5605c2c53e80 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.532+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.532+0000 7f3bfe1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.532+0000 7f3bfe1af800 20 started sync module instance, tier type = 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.532+0000 7f3bfe1af800 20 started zone id=cf0fab6f-a978-4ce5-bacd-166891c31743 (name=default) with tier type = 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.532+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c57cb0 con 0x5605c2c4ee00 2024-09-07T03:35:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.533+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 13 ==== osd_op_reply(44 notify.0 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.533+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94582742548944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c57cb0 con 0x5605c2c4ee00 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.533+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c598d0 con 0x5605c2c4a920 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.534+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 15 ==== osd_op_reply(46 notify.1 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.534+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94582742548944] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.534+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94582742553568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c59c70 con 0x5605c2c4a920 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.534+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5a720 con 0x5605c2c4ee00 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.535+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94582742553568] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.536+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 15 ==== osd_op_reply(48 notify.2 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.536+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94582742546432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c59c70 con 0x5605c2c4ee00 2024-09-07T03:35:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.536+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5b170 con 0x7f3bf402d470 2024-09-07T03:35:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.537+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 9 ==== osd_op_reply(50 notify.3 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.537+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94582742559872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5b100 con 0x7f3bf402d470 2024-09-07T03:35:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.537+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5c100 con 0x5605c2c4ee00 2024-09-07T03:35:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.537+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94582742546432] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.538+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94582742559872] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.538+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 17 ==== osd_op_reply(52 notify.4 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.538+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94582742562144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5bc00 con 0x5605c2c4ee00 2024-09-07T03:35:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.538+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5c5b0 con 0x5605c2c53e80 2024-09-07T03:35:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.539+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 10 ==== osd_op_reply(54 notify.5 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.539+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94582742565120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5ce50 con 0x5605c2c53e80 2024-09-07T03:35:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.539+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5d8d0 con 0x5605c2c53e80 2024-09-07T03:35:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.539+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94582742562144] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.542+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94582742565120] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.542+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 12 ==== osd_op_reply(56 notify.6 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.542+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94582742567328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5a230 con 0x5605c2c53e80 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.542+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5e1d0 con 0x7f3bf402d470 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94582742567328] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 11 ==== osd_op_reply(58 notify.7 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94582742572224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5e190 con 0x7f3bf402d470 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfe1af800 20 add_watcher() i=0 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfe1af800 20 add_watcher() i=1 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfe1af800 20 add_watcher() i=2 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfe1af800 20 add_watcher() i=3 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfe1af800 20 add_watcher() i=4 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfe1af800 20 add_watcher() i=5 2024-09-07T03:35:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.543+0000 7f3bfe1af800 20 add_watcher() i=6 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.544+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94582742572224] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.544+0000 7f3bfe1af800 20 add_watcher() i=7 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.544+0000 7f3bfe1af800 2 all 8 watchers are set, enabling cache 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.544+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c61710 con 0x5605c2c4a920 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.545+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.545+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94582742569920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5ebc0 con 0x5605c2c4a920 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.546+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94582742569920] v36'280 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.546+0000 7f3ab1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.546+0000 7f3bfe1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.546+0000 7f3bfe1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.546+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c69f80 con 0x5605c2c4ee00 2024-09-07T03:35:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.548+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'64 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.548+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6a070 con 0x7f3bf402d470 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.549+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.549+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6a700 con 0x5605c2c53e80 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.550+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.550+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6a790 con 0x5605c2c4a920 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.551+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'281 uv172 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.551+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6ad50 con 0x5605c2c4ee00 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.552+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'89 uv61 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.552+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6ad50 con 0x5605c2c53e80 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.553+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'67 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.553+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6ade0 con 0x5605c2c4ee00 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.555+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'40 uv30 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.555+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b3b0 con 0x5605c2c4a920 2024-09-07T03:35:30.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.556+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'61 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.556+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b390 con 0x5605c2c4ee00 2024-09-07T03:35:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.557+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.557+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b4c0 con 0x5605c2c4ee00 2024-09-07T03:35:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.558+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.558+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b4c0 con 0x5605c2c4ee00 2024-09-07T03:35:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.559+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'90 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.559+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b4c0 con 0x5605c2c53e80 2024-09-07T03:35:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.560+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.560+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b590 con 0x5605c2c4ee00 2024-09-07T03:35:30.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.561+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'39 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.561+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b590 con 0x5605c2c4a920 2024-09-07T03:35:30.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.562+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'75 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.562+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b680 con 0x5605c2c4a920 2024-09-07T03:35:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.563+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'282 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.563+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b710 con 0x5605c2c4ee00 2024-09-07T03:35:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.565+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.565+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b710 con 0x5605c2c4ee00 2024-09-07T03:35:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.566+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'91 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.566+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b710 con 0x5605c2c53e80 2024-09-07T03:35:30.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.567+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.567+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b840 con 0x5605c2c4ee00 2024-09-07T03:35:30.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.568+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.568+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b840 con 0x5605c2c4a920 2024-09-07T03:35:30.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.570+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'283 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.570+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b840 con 0x5605c2c4ee00 2024-09-07T03:35:30.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.571+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.571+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b840 con 0x5605c2c4ee00 2024-09-07T03:35:30.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.572+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.572+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b880 con 0x5605c2c53e80 2024-09-07T03:35:30.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.573+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.573+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b880 con 0x5605c2c4ee00 2024-09-07T03:35:30.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.574+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'50 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.574+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b8c0 con 0x5605c2c53e80 2024-09-07T03:35:30.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.575+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.575+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b8c0 con 0x5605c2c53e80 2024-09-07T03:35:30.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.576+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'68 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.576+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b8e0 con 0x5605c2c53e80 2024-09-07T03:35:30.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.577+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.578+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b8e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.578+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'46 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.579+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b8e0 con 0x5605c2c4a920 2024-09-07T03:35:30.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.580+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.580+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b8e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.581+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'87 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.581+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b8e0 con 0x5605c2c4a920 2024-09-07T03:35:30.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.582+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'76 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.582+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c6b940 con 0x7f3bf402d470 2024-09-07T03:35:30.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.583+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.583+0000 7f3ab0fe1640 20 reqs_thread_entry: start 2024-09-07T03:35:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.583+0000 7f3bfe1af800 20 init_complete bucket index max shards: 11 2024-09-07T03:35:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.583+0000 7f3bfe1af800 20 Filter name: none 2024-09-07T03:35:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.584+0000 7f3a2a7fc640 20 reqs_thread_entry: start 2024-09-07T03:35:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.584+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-07T03:35:30.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.584+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:94 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.585+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 22 ==== osd_op_reply(94 gc.17 [call] v36'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.585+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:95 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.585+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 23 ==== osd_op_reply(95 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.585+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.585+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:96 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c53e80 2024-09-07T03:35:30.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.585+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 24 ==== osd_op_reply(96 gc.17 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.585+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:97 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.586+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 25 ==== osd_op_reply(97 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.586+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.586+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:98 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.586+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 26 ==== osd_op_reply(98 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.586+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.586+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:99 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.587+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 27 ==== osd_op_reply(99 gc.17 [call] v36'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.587+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-07T03:35:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.587+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:100 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.588+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 34 ==== osd_op_reply(100 gc.18 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.588+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:101 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.588+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 35 ==== osd_op_reply(101 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.588+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.588+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:102 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.588+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 36 ==== osd_op_reply(102 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.588+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:103 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.589+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 37 ==== osd_op_reply(103 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.589+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.589+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:104 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.589+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 38 ==== osd_op_reply(104 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.589+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.589+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:105 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.590+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 39 ==== osd_op_reply(105 gc.18 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.590+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-07T03:35:30.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.590+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:106 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.591+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 26 ==== osd_op_reply(106 gc.19 [call] v36'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.591+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:107 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.591+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 27 ==== osd_op_reply(107 gc.19 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.591+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.591+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:108 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4a920 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.591+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 28 ==== osd_op_reply(108 gc.19 [call out=24b] v0'0 uv284 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.591+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:109 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.592+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 29 ==== osd_op_reply(109 gc.19 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.592+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.592+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:110 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.592+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 30 ==== osd_op_reply(110 gc.19 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.592+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.592+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:111 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.593+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 31 ==== osd_op_reply(111 gc.19 [call] v36'285 uv285 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.593+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-07T03:35:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.593+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:112 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.594+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 40 ==== osd_op_reply(112 gc.20 [call] v36'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.594+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:113 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.594+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 41 ==== osd_op_reply(113 gc.20 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.594+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.594+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:114 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.595+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 42 ==== osd_op_reply(114 gc.20 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.595+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:115 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.595+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 43 ==== osd_op_reply(115 gc.20 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.595+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.595+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:116 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.595+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 44 ==== osd_op_reply(116 gc.20 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.595+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.595+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:117 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.596+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 45 ==== osd_op_reply(117 gc.20 [call] v36'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.596+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-07T03:35:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.596+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:118 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.597+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 46 ==== osd_op_reply(118 gc.21 [call] v36'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.597+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:119 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 47 ==== osd_op_reply(119 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:120 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 48 ==== osd_op_reply(120 gc.21 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:121 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 49 ==== osd_op_reply(121 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:122 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 50 ==== osd_op_reply(122 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.598+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:123 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.599+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 51 ==== osd_op_reply(123 gc.21 [call] v36'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.599+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.599+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:124 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.600+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 28 ==== osd_op_reply(124 gc.22 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.600+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:125 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.600+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 29 ==== osd_op_reply(125 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.600+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.600+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:126 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c53e80 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.601+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 30 ==== osd_op_reply(126 gc.22 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.601+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:127 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.601+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 31 ==== osd_op_reply(127 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.601+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.601+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:128 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.601+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 32 ==== osd_op_reply(128 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.601+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.601+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:129 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.602+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 33 ==== osd_op_reply(129 gc.22 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.602+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-07T03:35:30.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.602+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:130 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.604+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 52 ==== osd_op_reply(130 gc.23 [call] v36'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.604+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:131 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.604+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 53 ==== osd_op_reply(131 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.604+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.604+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:132 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.604+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 54 ==== osd_op_reply(132 gc.23 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.604+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:133 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.605+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 55 ==== osd_op_reply(133 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.605+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.605+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:134 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.605+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 56 ==== osd_op_reply(134 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.605+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.605+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:135 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.606+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 57 ==== osd_op_reply(135 gc.23 [call] v36'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.606+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-07T03:35:30.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.606+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:136 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.607+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 34 ==== osd_op_reply(136 gc.24 [call] v36'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.607+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:137 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.607+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 35 ==== osd_op_reply(137 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.607+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.607+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:138 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c53e80 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.607+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 36 ==== osd_op_reply(138 gc.24 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.607+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:139 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.608+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 37 ==== osd_op_reply(139 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.608+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.608+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:140 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.608+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 38 ==== osd_op_reply(140 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.608+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.608+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:141 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.609+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 39 ==== osd_op_reply(141 gc.24 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.609+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-07T03:35:30.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.609+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:142 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.610+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 40 ==== osd_op_reply(142 gc.25 [call] v36'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.610+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:143 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.610+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 41 ==== osd_op_reply(143 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.610+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.610+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:144 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.610+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 42 ==== osd_op_reply(144 gc.25 [call out=24b] v0'0 uv69 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.610+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:145 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.611+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 43 ==== osd_op_reply(145 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.611+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.611+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:146 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.611+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 44 ==== osd_op_reply(146 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.611+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.611+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:147 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.612+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 45 ==== osd_op_reply(147 gc.25 [call] v36'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.612+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-07T03:35:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.612+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:148 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.613+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 46 ==== osd_op_reply(148 gc.26 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.613+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:149 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.613+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 47 ==== osd_op_reply(149 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.613+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.613+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:150 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.613+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 48 ==== osd_op_reply(150 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.613+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:151 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.614+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 49 ==== osd_op_reply(151 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.614+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.614+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:152 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.614+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 50 ==== osd_op_reply(152 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.614+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.614+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:153 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.615+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 51 ==== osd_op_reply(153 gc.26 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.615+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-07T03:35:30.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.615+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:154 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 58 ==== osd_op_reply(154 gc.27 [call] v36'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:155 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 59 ==== osd_op_reply(155 gc.27 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:156 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 60 ==== osd_op_reply(156 gc.27 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:157 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 61 ==== osd_op_reply(157 gc.27 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.617+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:158 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.618+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 62 ==== osd_op_reply(158 gc.27 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.618+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.618+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:159 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.619+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 63 ==== osd_op_reply(159 gc.27 [call] v36'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.619+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.619+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:160 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 32 ==== osd_op_reply(160 gc.28 [call] v36'63 uv63 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:161 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 33 ==== osd_op_reply(161 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:162 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4a920 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 34 ==== osd_op_reply(162 gc.28 [call out=24b] v0'0 uv63 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:163 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 35 ==== osd_op_reply(163 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.620+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:164 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.621+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 36 ==== osd_op_reply(164 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.621+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.621+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:165 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.622+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 37 ==== osd_op_reply(165 gc.28 [call] v36'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.622+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-07T03:35:30.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.622+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:166 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.623+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 64 ==== osd_op_reply(166 gc.29 [call] v36'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.623+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:167 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.623+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 65 ==== osd_op_reply(167 gc.29 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.623+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.623+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:168 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.623+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 66 ==== osd_op_reply(168 gc.29 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.623+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:169 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.624+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 67 ==== osd_op_reply(169 gc.29 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.624+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.624+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:170 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.624+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 68 ==== osd_op_reply(170 gc.29 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.624+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.624+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:171 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.625+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 69 ==== osd_op_reply(171 gc.29 [call] v36'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.625+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-07T03:35:30.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.625+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:172 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.626+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 38 ==== osd_op_reply(172 gc.30 [call] v36'77 uv77 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.626+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:173 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.626+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 39 ==== osd_op_reply(173 gc.30 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.626+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.626+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:174 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4a920 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.626+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 40 ==== osd_op_reply(174 gc.30 [call out=24b] v0'0 uv77 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.626+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:175 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.627+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 41 ==== osd_op_reply(175 gc.30 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.627+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.627+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:176 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.627+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 42 ==== osd_op_reply(176 gc.30 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.627+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.627+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:177 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.628+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 43 ==== osd_op_reply(177 gc.30 [call] v36'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.628+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-07T03:35:30.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.628+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:178 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 15 ==== osd_op_reply(178 gc.31 [call] v36'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:179 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 16 ==== osd_op_reply(179 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:180 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x7f3bf402d470 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 17 ==== osd_op_reply(180 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:181 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 18 ==== osd_op_reply(181 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.629+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:182 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.630+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 19 ==== osd_op_reply(182 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.630+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.630+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:183 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.631+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 20 ==== osd_op_reply(183 gc.31 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.631+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.631+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:184 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.632+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 70 ==== osd_op_reply(184 gc.0 [call] v36'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.632+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:185 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.632+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 71 ==== osd_op_reply(185 gc.0 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.632+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.632+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:186 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.633+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 72 ==== osd_op_reply(186 gc.0 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.633+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:187 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.633+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 73 ==== osd_op_reply(187 gc.0 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.633+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.633+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:188 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.633+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 74 ==== osd_op_reply(188 gc.0 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.633+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.633+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:189 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.634+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 75 ==== osd_op_reply(189 gc.0 [call] v36'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.634+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-07T03:35:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.634+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:190 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.635+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 21 ==== osd_op_reply(190 gc.1 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.635+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:191 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.635+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 22 ==== osd_op_reply(191 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.635+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.636+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:192 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x7f3bf402d470 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.636+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 23 ==== osd_op_reply(192 gc.1 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.636+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:193 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.636+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 24 ==== osd_op_reply(193 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.636+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.636+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:194 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.636+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 25 ==== osd_op_reply(194 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.636+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.636+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:195 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x7f3bf402d470 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.637+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 26 ==== osd_op_reply(195 gc.1 [call] v36'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.637+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.637+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:196 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.638+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 52 ==== osd_op_reply(196 gc.2 [call] v36'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.638+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:197 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 53 ==== osd_op_reply(197 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:198 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c53e80 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 54 ==== osd_op_reply(198 gc.2 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:199 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 55 ==== osd_op_reply(199 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:200 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 56 ==== osd_op_reply(200 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.639+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:201 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.640+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 57 ==== osd_op_reply(201 gc.2 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.640+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.640+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:202 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.641+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 44 ==== osd_op_reply(202 gc.3 [call] v36'286 uv286 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.641+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:203 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 45 ==== osd_op_reply(203 gc.3 [call out=15b] v0'0 uv286 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:204 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4a920 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 46 ==== osd_op_reply(204 gc.3 [call out=24b] v0'0 uv286 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:205 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 47 ==== osd_op_reply(205 gc.3 [call out=15b] v0'0 uv286 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:206 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 48 ==== osd_op_reply(206 gc.3 [call out=15b] v0'0 uv286 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.642+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:207 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.644+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 49 ==== osd_op_reply(207 gc.3 [call] v36'287 uv287 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.644+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-07T03:35:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.644+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:208 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 76 ==== osd_op_reply(208 gc.4 [call] v36'92 uv92 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:209 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 77 ==== osd_op_reply(209 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:210 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 78 ==== osd_op_reply(210 gc.4 [call out=24b] v0'0 uv92 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:211 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 79 ==== osd_op_reply(211 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:212 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 80 ==== osd_op_reply(212 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.645+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:213 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.646+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 81 ==== osd_op_reply(213 gc.4 [call] v36'93 uv93 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.646+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-07T03:35:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.646+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:214 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.647+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 58 ==== osd_op_reply(214 gc.5 [call] v36'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.647+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:215 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.647+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 59 ==== osd_op_reply(215 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.647+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.647+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:216 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.648+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 60 ==== osd_op_reply(216 gc.5 [call out=24b] v0'0 uv71 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.648+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:217 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.648+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 61 ==== osd_op_reply(217 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.648+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.648+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:218 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.648+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 62 ==== osd_op_reply(218 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.648+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.648+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:219 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.649+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 63 ==== osd_op_reply(219 gc.5 [call] v36'72 uv72 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.649+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-07T03:35:30.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.649+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:220 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.650+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 82 ==== osd_op_reply(220 gc.6 [call] v36'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.650+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:221 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.651+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 83 ==== osd_op_reply(221 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.651+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.651+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:222 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.651+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 84 ==== osd_op_reply(222 gc.6 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.651+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:223 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.651+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 85 ==== osd_op_reply(223 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.651+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.651+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:224 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.652+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 86 ==== osd_op_reply(224 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.652+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.652+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:225 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.653+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 87 ==== osd_op_reply(225 gc.6 [call] v36'42 uv42 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.653+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-07T03:35:30.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.653+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:226 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.654+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 50 ==== osd_op_reply(226 gc.7 [call] v36'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.654+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:227 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.654+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 51 ==== osd_op_reply(227 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.654+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.654+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:228 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4a920 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.655+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 52 ==== osd_op_reply(228 gc.7 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.655+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:229 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.655+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 53 ==== osd_op_reply(229 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.655+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.655+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:230 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.655+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 54 ==== osd_op_reply(230 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.655+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.655+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:231 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4a920 2024-09-07T03:35:30.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.656+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 55 ==== osd_op_reply(231 gc.7 [call] v36'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.656+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-07T03:35:30.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.656+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:232 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.657+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 88 ==== osd_op_reply(232 gc.8 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.657+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:233 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 89 ==== osd_op_reply(233 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:234 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96a40 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 90 ==== osd_op_reply(234 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:235 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 91 ==== osd_op_reply(235 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:236 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c97a50 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 92 ==== osd_op_reply(236 gc.8 [call out=1716b] v0'0 uv33 ondisk = 0) ==== 148+0+1716 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-07T03:35:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 20 garbage collection: RGWGC::process iterating over entry tag='cf0fab6f-a978-4ce5-bacd-166891c31743.4225.17771145711858241260', time=2024-09-07T03:35:38.435383+0000, chain.objs.size()=7 2024-09-07T03:35:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_1 2024-09-07T03:35:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:237 3.21s0 3:8549cc03:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c98020 con 0x7f3bf402d470 2024-09-07T03:35:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_2 2024-09-07T03:35:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:238 3.2bs0 3:d423652a:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9ac50 con 0x5605c2c4a920 2024-09-07T03:35:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_3 2024-09-07T03:35:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:239 3.3ds0 3:bf276673:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d560 con 0x5605c2c53e80 2024-09-07T03:35:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.658+0000 7f3bfe1af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_4 2024-09-07T03:35:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.659+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:240 3.8s0 3:122d24b2:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9fdd0 con 0x5605c2c53e80 2024-09-07T03:35:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.659+0000 7f3bfe1af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_5 2024-09-07T03:35:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.659+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:241 3.38s0 3:1f1b1753:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9fdd0 con 0x5605c2c53e80 2024-09-07T03:35:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.659+0000 7f3bfe1af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_6 2024-09-07T03:35:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.659+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:242 3.3ds0 3:beac7f12:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9fdd0 con 0x5605c2c53e80 2024-09-07T03:35:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.659+0000 7f3bfe1af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_7 2024-09-07T03:35:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.659+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:243 3.4s0 3:2193fc5a:::cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2ca7090 con 0x5605c2c4a920 2024-09-07T03:35:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.661+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 56 ==== osd_op_reply(243 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_7 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.662+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 57 ==== osd_op_reply(238 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_2 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.662+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 64 ==== osd_op_reply(239 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_3 [call] v36'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.662+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 65 ==== osd_op_reply(240 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_4 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.662+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 27 ==== osd_op_reply(237 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_1 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.663+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 66 ==== osd_op_reply(241 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_5 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.664+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 67 ==== osd_op_reply(242 cf0fab6f-a978-4ce5-bacd-166891c31743.4225.11__shadow_.F79bLLxd11dfh7b-_d5oohDox_2GP0Z_6 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.664+0000 7f3bfe1af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-07T03:35:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.664+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:244 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.667+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 93 ==== osd_op_reply(244 gc.8 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.667+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:245 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.668+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 94 ==== osd_op_reply(245 gc.8 [call] v36'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.668+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-07T03:35:30.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.668+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:246 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.669+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 95 ==== osd_op_reply(246 gc.9 [call] v36'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.669+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:247 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.669+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 96 ==== osd_op_reply(247 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.669+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.669+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:248 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c4ee00 2024-09-07T03:35:30.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.669+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 97 ==== osd_op_reply(248 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.669+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:249 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.670+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 98 ==== osd_op_reply(249 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.670+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.670+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:250 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.670+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 99 ==== osd_op_reply(250 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.670+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.670+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:251 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.671+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 100 ==== osd_op_reply(251 gc.9 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.671+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-07T03:35:30.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.671+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:252 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 101 ==== osd_op_reply(252 gc.10 [call] v36'94 uv94 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:253 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 102 ==== osd_op_reply(253 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:254 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c4ee00 2024-09-07T03:35:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 103 ==== osd_op_reply(254 gc.10 [call out=24b] v0'0 uv94 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:255 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 104 ==== osd_op_reply(255 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.672+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:256 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.673+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 105 ==== osd_op_reply(256 gc.10 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.673+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.673+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:257 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c4ee00 2024-09-07T03:35:30.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.674+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 106 ==== osd_op_reply(257 gc.10 [call] v36'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.674+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-07T03:35:30.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.674+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:258 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d860 con 0x5605c2c53e80 2024-09-07T03:35:30.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 68 ==== osd_op_reply(258 gc.11 [call] v36'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:259 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c9d820 con 0x5605c2c53e80 2024-09-07T03:35:30.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 69 ==== osd_op_reply(259 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:260 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c53e80 2024-09-07T03:35:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 70 ==== osd_op_reply(260 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:261 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c985a0 con 0x5605c2c53e80 2024-09-07T03:35:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 71 ==== osd_op_reply(261 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.675+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:262 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c985a0 con 0x5605c2c53e80 2024-09-07T03:35:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.676+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 72 ==== osd_op_reply(262 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.676+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.676+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:263 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c985a0 con 0x5605c2c53e80 2024-09-07T03:35:30.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.676+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 73 ==== osd_op_reply(263 gc.11 [call] v36'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.676+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.676+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:264 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c985a0 con 0x5605c2c4ee00 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.677+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 107 ==== osd_op_reply(264 gc.12 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.677+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:265 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c985a0 con 0x5605c2c4ee00 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 108 ==== osd_op_reply(265 gc.12 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:266 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c4ee00 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 109 ==== osd_op_reply(266 gc.12 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:267 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c985a0 con 0x5605c2c4ee00 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 110 ==== osd_op_reply(267 gc.12 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:268 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c985a0 con 0x5605c2c4ee00 2024-09-07T03:35:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 111 ==== osd_op_reply(268 gc.12 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.678+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:269 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c985a0 con 0x5605c2c4ee00 2024-09-07T03:35:30.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.679+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 112 ==== osd_op_reply(269 gc.12 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.679+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-07T03:35:30.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.679+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:270 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c985a0 con 0x5605c2c4a920 2024-09-07T03:35:30.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.680+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 58 ==== osd_op_reply(270 gc.13 [call] v36'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.680+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:271 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4a920 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.680+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 59 ==== osd_op_reply(271 gc.13 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.680+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.680+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:272 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c4a920 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.681+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 60 ==== osd_op_reply(272 gc.13 [call out=24b] v0'0 uv79 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.681+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:273 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c4a920 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.681+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 61 ==== osd_op_reply(273 gc.13 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.681+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.681+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:274 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c4a920 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.681+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 62 ==== osd_op_reply(274 gc.13 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.681+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.681+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:275 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4a920 2024-09-07T03:35:30.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.682+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 63 ==== osd_op_reply(275 gc.13 [call] v36'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.682+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-07T03:35:30.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.682+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:276 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4a920 2024-09-07T03:35:30.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.683+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 64 ==== osd_op_reply(276 gc.14 [call] v36'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.683+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:277 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4a920 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.683+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 65 ==== osd_op_reply(277 gc.14 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.683+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.683+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:278 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c4a920 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.684+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 66 ==== osd_op_reply(278 gc.14 [call out=24b] v0'0 uv288 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.684+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:279 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c4a920 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.684+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 67 ==== osd_op_reply(279 gc.14 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.684+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.684+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:280 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c96ef0 con 0x5605c2c4a920 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.684+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 68 ==== osd_op_reply(280 gc.14 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.684+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.684+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:281 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4a920 2024-09-07T03:35:30.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.685+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 69 ==== osd_op_reply(281 gc.14 [call] v36'289 uv289 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.685+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-07T03:35:30.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.685+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:282 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.686+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 113 ==== osd_op_reply(282 gc.15 [call] v36'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.686+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:283 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.686+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 114 ==== osd_op_reply(283 gc.15 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.686+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.686+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:284 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.687+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 115 ==== osd_op_reply(284 gc.15 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.687+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:285 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.687+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 116 ==== osd_op_reply(285 gc.15 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.687+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.687+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:286 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.687+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 117 ==== osd_op_reply(286 gc.15 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.687+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.687+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:287 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.688+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 118 ==== osd_op_reply(287 gc.15 [call] v36'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.688+0000 7f3bfe1af800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-07T03:35:30.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.688+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:288 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.689+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 119 ==== osd_op_reply(288 gc.16 [call] v36'96 uv96 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.689+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:289 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.689+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 120 ==== osd_op_reply(289 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.689+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.689+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:290 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.690+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 121 ==== osd_op_reply(290 gc.16 [call out=24b] v0'0 uv96 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.690+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:291 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.690+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 122 ==== osd_op_reply(291 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.690+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.690+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:292 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.690+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 123 ==== osd_op_reply(292 gc.16 [call out=15b] v0'0 uv96 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.690+0000 7f3bfe1af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-07T03:35:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.690+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:293 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.691+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 124 ==== osd_op_reply(293 gc.16 [call] v36'97 uv97 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.692+0000 7f3ab1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-07T03:35:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.692+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94582742569920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4a920 2024-09-07T03:35:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.693+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 70 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94582742569920] v36'290 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.693+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94582742548944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4ee00 2024-09-07T03:35:30.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.694+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 125 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94582742548944] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.694+0000 7f3bfe1af800 20 remove_watcher() i=0 2024-09-07T03:35:30.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.694+0000 7f3bfe1af800 2 removed watcher, disabling cache 2024-09-07T03:35:30.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.694+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94582742553568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c984b0 con 0x5605c2c4a920 2024-09-07T03:35:30.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.695+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.1 v2:172.21.15.120:6808/3372043485 71 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94582742553568] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x5605c2c4a920 2024-09-07T03:35:30.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.695+0000 7f3bfe1af800 20 remove_watcher() i=1 2024-09-07T03:35:30.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.695+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94582742546432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c581d0 con 0x5605c2c4ee00 2024-09-07T03:35:30.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.696+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 126 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94582742546432] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.696+0000 7f3bfe1af800 20 remove_watcher() i=2 2024-09-07T03:35:30.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.696+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94582742559872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c581d0 con 0x7f3bf402d470 2024-09-07T03:35:30.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.697+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 28 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94582742559872] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.697+0000 7f3bfe1af800 20 remove_watcher() i=3 2024-09-07T03:35:30.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.697+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94582742562144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5ac80 con 0x5605c2c4ee00 2024-09-07T03:35:30.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.698+0000 7f3bfc49a640 1 -- 172.21.15.120:0/2830462341 <== osd.0 v2:172.21.15.104:6800/182397107 127 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94582742562144] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf40083e0 con 0x5605c2c4ee00 2024-09-07T03:35:30.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.698+0000 7f3bfe1af800 20 remove_watcher() i=4 2024-09-07T03:35:30.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.698+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94582742565120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c581d0 con 0x5605c2c53e80 2024-09-07T03:35:30.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.699+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 74 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94582742565120] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.699+0000 7f3bfe1af800 20 remove_watcher() i=5 2024-09-07T03:35:30.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.699+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94582742567328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5b560 con 0x5605c2c53e80 2024-09-07T03:35:30.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.700+0000 7f3bfbc99640 1 -- 172.21.15.120:0/2830462341 <== osd.3 v2:172.21.15.120:6800/1193158925 75 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94582742567328] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec063cd0 con 0x5605c2c53e80 2024-09-07T03:35:30.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.700+0000 7f3bfe1af800 20 remove_watcher() i=6 2024-09-07T03:35:30.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.700+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94582742572224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c2c5ac80 con 0x7f3bf402d470 2024-09-07T03:35:30.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 <== osd.2 v2:172.21.15.120:6809/3781833098 29 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94582742572224] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be403c040 con 0x7f3bf402d470 2024-09-07T03:35:30.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfe1af800 20 remove_watcher() i=7 2024-09-07T03:35:30.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c4ee00 msgr2=0x5605c2c511f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c4ee00 0x5605c2c511f0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2c4a920 msgr2=0x5605c2c4cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2c4a920 0x5605c2c4cde0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3bf402d470 msgr2=0x7f3bf402c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f3bf402d470 0x7f3bf402c3d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5605c2c53e80 msgr2=0x5605c2c562d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.701+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x5605c2c53e80 0x5605c2c562d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ac403c780 msgr2=0x7f3ac403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ac403c780 0x7f3ac403ec40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3bec07e3f0 tx=0x7f3bec08a000 comp rx=0 tx=0).stop 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 msgr2=0x5605c2c3edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfb498640 1 -- 172.21.15.120:0/2830462341 reap_dead start 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c3edb0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4020d60 tx=0x7f3bf4053150 comp rx=0 tx=0).stop 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 shutdown_connections 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/2830462341 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c377b0 0x5605c2c3edb0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 >> 172.21.15.120:0/2830462341 conn(0x5605c2c33bb0 msgr2=0x5605c2c31dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 shutdown_connections 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/2830462341 wait complete. 2024-09-07T03:35:30.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/898770076 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ad403c840 msgr2=0x7f3ad403ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/898770076 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ad403c840 0x7f3ad403ed00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5605c2c1b430 tx=0x7f3bec080040 comp rx=0 tx=0).stop 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/898770076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c2acb0 msgr2=0x5605c2c2b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/898770076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c2acb0 0x5605c2c2b0d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400aa90 tx=0x7f3bf400af50 comp rx=0 tx=0).stop 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/898770076 shutdown_connections 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/898770076 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ad403c840 0x7f3ad403ed00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/898770076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2c2acb0 0x5605c2c2b0d0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/898770076 >> 172.21.15.120:0/898770076 conn(0x5605c2c1f060 msgr2=0x5605c2c1f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/898770076 shutdown_connections 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.702+0000 7f3bfe1af800 1 -- 172.21.15.120:0/898770076 wait complete. 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c18530 msgr2=0x5605c2c1a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c18530 0x5605c2c1a920 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2b15df0 msgr2=0x5605c2c175c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2b15df0 0x5605c2c175c0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ae403c730 msgr2=0x7f3ae403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ae403c730 0x7f3ae403ebf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3be4000c00 tx=0x7f3be40013b0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 msgr2=0x5605c2c0ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c0ff70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3bec025a60 tx=0x7f3bec003330 comp rx=0 tx=0).stop 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 shutdown_connections 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x5605c2c18530 0x5605c2c1a920 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x5605c2b15df0 0x5605c2c175c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3ae403c730 0x7f3ae403ebf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 --2- 172.21.15.120:0/3734203357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5605c2b154b0 0x5605c2c0ff70 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 >> 172.21.15.120:0/3734203357 conn(0x5605c2b111c0 msgr2=0x5605c2c098a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 shutdown_connections 2024-09-07T03:35:30.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-07T03:35:30.703+0000 7f3bfe1af800 1 -- 172.21.15.120:0/3734203357 wait complete. 2024-09-07T03:35:30.714 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-07T03:35:30.745 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-07T03:35:30.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:35:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.842+0000 7fe2ce9f8640 1 Processor -- start 2024-09-07T03:35:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.842+0000 7fe2ce9f8640 1 -- start start 2024-09-07T03:35:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.842+0000 7fe2ce9f8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe2c8130270 0x7fe2c8132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.842+0000 7fe2ce9f8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c806dc00 con 0x7fe2c8129d80 2024-09-07T03:35:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.842+0000 7fe2ce9f8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c81299c0 con 0x7fe2c8130270 2024-09-07T03:35:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.843+0000 7fe2c77fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe2c8130270 0x7fe2c8132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.843+0000 7fe2c7fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe2c8129d80 0x7fe2c812a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57192/0 (socket says 172.21.15.104:57192) 2024-09-07T03:35:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.843+0000 7fe2c7fff640 1 -- 172.21.15.104:0/2125325265 learned_addr learned my addr 172.21.15.104:0/2125325265 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.843+0000 7fe2c77fe640 1 -- 172.21.15.104:0/2125325265 >> v1:172.21.15.104:6789/0 conn(0x7fe2c8129d80 legacy=0x7fe2c812a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.843+0000 7fe2c77fe640 1 -- 172.21.15.104:0/2125325265 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c812a870 con 0x7fe2c8130270 2024-09-07T03:35:30.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.843+0000 7fe2c6ffd640 1 -- 172.21.15.104:0/2125325265 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255908751 0 0) 0x7fe2c806dc00 con 0x7fe2c8129d80 2024-09-07T03:35:30.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.843+0000 7fe2c77fe640 1 --2- 172.21.15.104:0/2125325265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8130270 0x7fe2c8132660 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009720 tx=0x7fe2bc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfc4767f97b55e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2c6ffd640 1 -- 172.21.15.104:0/2125325265 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc037070 con 0x7fe2c8130270 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2c6ffd640 1 -- 172.21.15.104:0/2125325265 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc02ad90 con 0x7fe2c8130270 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2c6ffd640 1 -- 172.21.15.104:0/2125325265 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc032590 con 0x7fe2c8130270 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/2125325265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8130270 msgr2=0x7fe2c8132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2ce9f8640 1 --2- 172.21.15.104:0/2125325265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8130270 0x7fe2c8132660 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009720 tx=0x7fe2bc02a110 comp rx=0 tx=0).stop 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/2125325265 shutdown_connections 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2ce9f8640 1 --2- 172.21.15.104:0/2125325265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8130270 0x7fe2c8132660 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/2125325265 >> 172.21.15.104:0/2125325265 conn(0x7fe2c8070850 msgr2=0x7fe2c8072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/2125325265 shutdown_connections 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.844+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/2125325265 wait complete. 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.845+0000 7fe2ce9f8640 1 Processor -- start 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.845+0000 7fe2ce9f8640 1 -- start start 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2ce9f8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8129d80 0x7fe2c8115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2ce9f8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8073a10 con 0x7fe2c8129d80 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2c7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8129d80 0x7fe2c8115750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2c7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8129d80 0x7fe2c8115750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50594/0 (socket says 172.21.15.104:50594) 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2c7fff640 1 -- 172.21.15.104:0/254173453 learned_addr learned my addr 172.21.15.104:0/254173453 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2c7fff640 1 -- 172.21.15.104:0/254173453 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c8117520 con 0x7fe2c8129d80 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2c7fff640 1 --2- 172.21.15.104:0/254173453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8129d80 0x7fe2c8115750 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c3d0 tx=0x7fe2b800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2c4ff9640 1 -- 172.21.15.104:0/254173453 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2b80074d0 con 0x7fe2c8129d80 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2c4ff9640 1 -- 172.21.15.104:0/254173453 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b80047e0 con 0x7fe2c8129d80 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c8118520 con 0x7fe2c8129d80 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2c4ff9640 1 -- 172.21.15.104:0/254173453 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2b8007670 con 0x7fe2c8129d80 2024-09-07T03:35:30.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.846+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c8118960 con 0x7fe2c8129d80 2024-09-07T03:35:30.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.847+0000 7fe2c4ff9640 1 -- 172.21.15.104:0/254173453 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe2b8011070 con 0x7fe2c8129d80 2024-09-07T03:35:30.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.847+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c812a160 con 0x7fe2c8129d80 2024-09-07T03:35:30.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.847+0000 7fe2c4ff9640 1 --2- 172.21.15.104:0/254173453 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe2b403de40 0x7fe2b4040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:30.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.847+0000 7fe2c4ff9640 1 -- 172.21.15.104:0/254173453 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe2b8052960 con 0x7fe2c8129d80 2024-09-07T03:35:30.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.847+0000 7fe2c77fe640 1 --2- 172.21.15.104:0/254173453 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe2b403de40 0x7fe2b4040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:30.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.848+0000 7fe2c77fe640 1 --2- 172.21.15.104:0/254173453 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe2b403de40 0x7fe2b4040300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc034000 tx=0x7fe2bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:30.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:30.852+0000 7fe2c4ff9640 1 -- 172.21.15.104:0/254173453 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fe2b8012dd0 con 0x7fe2c8129d80 2024-09-07T03:35:31.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.022+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2c8068da0 con 0x7fe2b403de40 2024-09-07T03:35:31.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.032+0000 7fe2c4ff9640 1 -- 172.21.15.104:0/254173453 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666065 (secure 0 0 0) 0x7fe2c8068da0 con 0x7fe2b403de40 2024-09-07T03:35:31.043 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:35:31.049 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:35:31.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe2b403de40 msgr2=0x7fe2b4040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 --2- 172.21.15.104:0/254173453 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe2b403de40 0x7fe2b4040300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc034000 tx=0x7fe2bc02e000 comp rx=0 tx=0).stop 2024-09-07T03:35:31.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8129d80 msgr2=0x7fe2c8115750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 --2- 172.21.15.104:0/254173453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8129d80 0x7fe2c8115750 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c3d0 tx=0x7fe2b800c890 comp rx=0 tx=0).stop 2024-09-07T03:35:31.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 shutdown_connections 2024-09-07T03:35:31.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 --2- 172.21.15.104:0/254173453 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe2b403de40 0x7fe2b4040300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 --2- 172.21.15.104:0/254173453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2c8129d80 0x7fe2c8115750 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 >> 172.21.15.104:0/254173453 conn(0x7fe2c8070850 msgr2=0x7fe2c81282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:31.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 shutdown_connections 2024-09-07T03:35:31.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.037+0000 7fe2ce9f8640 1 -- 172.21.15.104:0/254173453 wait complete. 2024-09-07T03:35:31.055 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-07T03:35:29.261873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416913,"num_objects":261,"num_object_clones":0,"num_object_copies":536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5214,"num_read_kb":4764,"num_write":2244,"num_write_kb":60589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4631,"ondisk_log_size":4631,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190456,"kb_used_data":36600,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377296904,"statfs":{"total":386547056640,"available":386352029696,"internally_reserved":0,"allocated":37478400,"data_stored":36232962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":536,"num_read_kb":491,"num_write":388,"num_write_kb":29374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004580"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281796+0000","last_change":"2024-09-07T03:32:12.133842+0000","last_active":"2024-09-07T03:32:50.281796+0000","last_peered":"2024-09-07T03:32:50.281796+0000","last_clean":"2024-09-07T03:32:50.281796+0000","last_became_active":"2024-09-07T03:32:12.133110+0000","last_became_peered":"2024-09-07T03:32:12.133110+0000","last_unstale":"2024-09-07T03:32:50.281796+0000","last_undegraded":"2024-09-07T03:32:50.281796+0000","last_fullsized":"2024-09-07T03:32:50.281796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:21:24.282602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985450+0000","last_change":"2024-09-07T03:32:14.110006+0000","last_active":"2024-09-07T03:33:38.985450+0000","last_peered":"2024-09-07T03:33:38.985450+0000","last_clean":"2024-09-07T03:33:38.985450+0000","last_became_active":"2024-09-07T03:32:14.109379+0000","last_became_peered":"2024-09-07T03:32:14.109379+0000","last_unstale":"2024-09-07T03:33:38.985450+0000","last_undegraded":"2024-09-07T03:33:38.985450+0000","last_fullsized":"2024-09-07T03:33:38.985450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472145+0000","last_change":"2024-09-07T03:32:12.137021+0000","last_active":"2024-09-07T03:32:50.472145+0000","last_peered":"2024-09-07T03:32:50.472145+0000","last_clean":"2024-09-07T03:32:50.472145+0000","last_became_active":"2024-09-07T03:32:12.135945+0000","last_became_peered":"2024-09-07T03:32:12.135945+0000","last_unstale":"2024-09-07T03:32:50.472145+0000","last_undegraded":"2024-09-07T03:32:50.472145+0000","last_fullsized":"2024-09-07T03:32:50.472145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:24.882510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'18","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.476438+0000","last_change":"2024-09-07T03:32:50.283523+0000","last_active":"2024-09-07T03:35:23.476438+0000","last_peered":"2024-09-07T03:35:23.476438+0000","last_clean":"2024-09-07T03:35:23.476438+0000","last_became_active":"2024-09-07T03:32:50.279755+0000","last_became_peered":"2024-09-07T03:32:50.279755+0000","last_unstale":"2024-09-07T03:35:23.476438+0000","last_undegraded":"2024-09-07T03:35:23.476438+0000","last_fullsized":"2024-09-07T03:35:23.476438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:00:27.065883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.373446+0000","last_change":"2024-09-07T03:32:12.138579+0000","last_active":"2024-09-07T03:35:23.373446+0000","last_peered":"2024-09-07T03:35:23.373446+0000","last_clean":"2024-09-07T03:35:23.373446+0000","last_became_active":"2024-09-07T03:32:12.138176+0000","last_became_peered":"2024-09-07T03:32:12.138176+0000","last_unstale":"2024-09-07T03:35:23.373446+0000","last_undegraded":"2024-09-07T03:35:23.373446+0000","last_fullsized":"2024-09-07T03:35:23.373446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:43.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.299808+0000","last_change":"2024-09-07T03:32:50.282415+0000","last_active":"2024-09-07T03:32:56.299808+0000","last_peered":"2024-09-07T03:32:56.299808+0000","last_clean":"2024-09-07T03:32:56.299808+0000","last_became_active":"2024-09-07T03:32:50.282086+0000","last_became_peered":"2024-09-07T03:32:50.282086+0000","last_unstale":"2024-09-07T03:32:56.299808+0000","last_undegraded":"2024-09-07T03:32:56.299808+0000","last_fullsized":"2024-09-07T03:32:56.299808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:57:14.202152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275899+0000","last_change":"2024-09-07T03:32:12.129351+0000","last_active":"2024-09-07T03:32:50.275899+0000","last_peered":"2024-09-07T03:32:50.275899+0000","last_clean":"2024-09-07T03:32:50.275899+0000","last_became_active":"2024-09-07T03:32:12.128937+0000","last_became_peered":"2024-09-07T03:32:12.128937+0000","last_unstale":"2024-09-07T03:32:50.275899+0000","last_undegraded":"2024-09-07T03:32:50.275899+0000","last_fullsized":"2024-09-07T03:32:50.275899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:28:44.222642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963439+0000","last_change":"2024-09-07T03:32:14.123290+0000","last_active":"2024-09-07T03:34:22.963439+0000","last_peered":"2024-09-07T03:34:22.963439+0000","last_clean":"2024-09-07T03:34:22.963439+0000","last_became_active":"2024-09-07T03:32:14.122611+0000","last_became_peered":"2024-09-07T03:32:14.122611+0000","last_unstale":"2024-09-07T03:34:22.963439+0000","last_undegraded":"2024-09-07T03:34:22.963439+0000","last_fullsized":"2024-09-07T03:34:22.963439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279185+0000","last_change":"2024-09-07T03:32:12.124716+0000","last_active":"2024-09-07T03:32:50.279185+0000","last_peered":"2024-09-07T03:32:50.279185+0000","last_clean":"2024-09-07T03:32:50.279185+0000","last_became_active":"2024-09-07T03:32:12.123986+0000","last_became_peered":"2024-09-07T03:32:12.123986+0000","last_unstale":"2024-09-07T03:32:50.279185+0000","last_undegraded":"2024-09-07T03:32:50.279185+0000","last_fullsized":"2024-09-07T03:32:50.279185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:10.648401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.597575+0000","last_change":"2024-09-07T03:32:14.124801+0000","last_active":"2024-09-07T03:35:23.597575+0000","last_peered":"2024-09-07T03:35:23.597575+0000","last_clean":"2024-09-07T03:35:23.597575+0000","last_became_active":"2024-09-07T03:32:14.124523+0000","last_became_peered":"2024-09-07T03:32:14.124523+0000","last_unstale":"2024-09-07T03:35:23.597575+0000","last_undegraded":"2024-09-07T03:35:23.597575+0000","last_fullsized":"2024-09-07T03:35:23.597575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:39.133433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.558996+0000","last_change":"2024-09-07T03:32:12.133960+0000","last_active":"2024-09-07T03:32:56.558996+0000","last_peered":"2024-09-07T03:32:56.558996+0000","last_clean":"2024-09-07T03:32:56.558996+0000","last_became_active":"2024-09-07T03:32:12.133597+0000","last_became_peered":"2024-09-07T03:32:12.133597+0000","last_unstale":"2024-09-07T03:32:56.558996+0000","last_undegraded":"2024-09-07T03:32:56.558996+0000","last_fullsized":"2024-09-07T03:32:56.558996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:16:06.544105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.571091+0000","last_change":"2024-09-07T03:32:14.113584+0000","last_active":"2024-09-07T03:32:56.571091+0000","last_peered":"2024-09-07T03:32:56.571091+0000","last_clean":"2024-09-07T03:32:56.571091+0000","last_became_active":"2024-09-07T03:32:14.112622+0000","last_became_peered":"2024-09-07T03:32:14.112622+0000","last_unstale":"2024-09-07T03:32:56.571091+0000","last_undegraded":"2024-09-07T03:32:56.571091+0000","last_fullsized":"2024-09-07T03:32:56.571091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:52.320086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273279+0000","last_change":"2024-09-07T03:32:12.140541+0000","last_active":"2024-09-07T03:32:50.273279+0000","last_peered":"2024-09-07T03:32:50.273279+0000","last_clean":"2024-09-07T03:32:50.273279+0000","last_became_active":"2024-09-07T03:32:12.140221+0000","last_became_peered":"2024-09-07T03:32:12.140221+0000","last_unstale":"2024-09-07T03:32:50.273279+0000","last_undegraded":"2024-09-07T03:32:50.273279+0000","last_fullsized":"2024-09-07T03:32:50.273279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:56.248253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.300068+0000","last_change":"2024-09-07T03:32:14.114929+0000","last_active":"2024-09-07T03:32:56.300068+0000","last_peered":"2024-09-07T03:32:56.300068+0000","last_clean":"2024-09-07T03:32:56.300068+0000","last_became_active":"2024-09-07T03:32:14.114529+0000","last_became_peered":"2024-09-07T03:32:14.114529+0000","last_unstale":"2024-09-07T03:32:56.300068+0000","last_undegraded":"2024-09-07T03:32:56.300068+0000","last_fullsized":"2024-09-07T03:32:56.300068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'3","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:41.231186+0000","last_change":"2024-09-07T03:32:12.143568+0000","last_active":"2024-09-07T03:34:41.231186+0000","last_peered":"2024-09-07T03:34:41.231186+0000","last_clean":"2024-09-07T03:34:41.231186+0000","last_became_active":"2024-09-07T03:32:12.143209+0000","last_became_peered":"2024-09-07T03:32:12.143209+0000","last_unstale":"2024-09-07T03:34:41.231186+0000","last_undegraded":"2024-09-07T03:34:41.231186+0000","last_fullsized":"2024-09-07T03:34:41.231186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:31:58.691796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.944310+0000","last_change":"2024-09-07T03:32:14.124391+0000","last_active":"2024-09-07T03:35:23.944310+0000","last_peered":"2024-09-07T03:35:23.944310+0000","last_clean":"2024-09-07T03:35:23.944310+0000","last_became_active":"2024-09-07T03:32:14.124135+0000","last_became_peered":"2024-09-07T03:32:14.124135+0000","last_unstale":"2024-09-07T03:35:23.944310+0000","last_undegraded":"2024-09-07T03:35:23.944310+0000","last_fullsized":"2024-09-07T03:35:23.944310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:40.853544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'14","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806118+0000","last_change":"2024-09-07T03:32:14.109787+0000","last_active":"2024-09-07T03:35:23.806118+0000","last_peered":"2024-09-07T03:35:23.806118+0000","last_clean":"2024-09-07T03:35:23.806118+0000","last_became_active":"2024-09-07T03:32:14.109280+0000","last_became_peered":"2024-09-07T03:32:14.109280+0000","last_unstale":"2024-09-07T03:35:23.806118+0000","last_undegraded":"2024-09-07T03:35:23.806118+0000","last_fullsized":"2024-09-07T03:35:23.806118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473124+0000","last_change":"2024-09-07T03:32:12.136387+0000","last_active":"2024-09-07T03:32:50.473124+0000","last_peered":"2024-09-07T03:32:50.473124+0000","last_clean":"2024-09-07T03:32:50.473124+0000","last_became_active":"2024-09-07T03:32:12.134379+0000","last_became_peered":"2024-09-07T03:32:12.134379+0000","last_unstale":"2024-09-07T03:32:50.473124+0000","last_undegraded":"2024-09-07T03:32:50.473124+0000","last_fullsized":"2024-09-07T03:32:50.473124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:52:06.698087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843636+0000","last_change":"2024-09-07T03:32:14.112114+0000","last_active":"2024-09-07T03:35:23.843636+0000","last_peered":"2024-09-07T03:35:23.843636+0000","last_clean":"2024-09-07T03:35:23.843636+0000","last_became_active":"2024-09-07T03:32:14.111769+0000","last_became_peered":"2024-09-07T03:32:14.111769+0000","last_unstale":"2024-09-07T03:35:23.843636+0000","last_undegraded":"2024-09-07T03:35:23.843636+0000","last_fullsized":"2024-09-07T03:35:23.843636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.714226+0000","last_change":"2024-09-07T03:32:12.129681+0000","last_active":"2024-09-07T03:35:23.714226+0000","last_peered":"2024-09-07T03:35:23.714226+0000","last_clean":"2024-09-07T03:35:23.714226+0000","last_became_active":"2024-09-07T03:32:12.129310+0000","last_became_peered":"2024-09-07T03:32:12.129310+0000","last_unstale":"2024-09-07T03:35:23.714226+0000","last_undegraded":"2024-09-07T03:35:23.714226+0000","last_fullsized":"2024-09-07T03:35:23.714226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:31.913444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.590380+0000","last_change":"2024-09-07T03:32:14.109568+0000","last_active":"2024-09-07T03:35:23.590380+0000","last_peered":"2024-09-07T03:35:23.590380+0000","last_clean":"2024-09-07T03:35:23.590380+0000","last_became_active":"2024-09-07T03:32:14.109177+0000","last_became_peered":"2024-09-07T03:32:14.109177+0000","last_unstale":"2024-09-07T03:35:23.590380+0000","last_undegraded":"2024-09-07T03:35:23.590380+0000","last_fullsized":"2024-09-07T03:35:23.590380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:49:22.436331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281713+0000","last_change":"2024-09-07T03:32:12.121206+0000","last_active":"2024-09-07T03:32:50.281713+0000","last_peered":"2024-09-07T03:32:50.281713+0000","last_clean":"2024-09-07T03:32:50.281713+0000","last_became_active":"2024-09-07T03:32:12.120449+0000","last_became_peered":"2024-09-07T03:32:12.120449+0000","last_unstale":"2024-09-07T03:32:50.281713+0000","last_undegraded":"2024-09-07T03:32:50.281713+0000","last_fullsized":"2024-09-07T03:32:50.281713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:04:17.603683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731173+0000","last_change":"2024-09-07T03:32:14.125322+0000","last_active":"2024-09-07T03:35:23.731173+0000","last_peered":"2024-09-07T03:35:23.731173+0000","last_clean":"2024-09-07T03:35:23.731173+0000","last_became_active":"2024-09-07T03:32:14.125065+0000","last_became_peered":"2024-09-07T03:32:14.125065+0000","last_unstale":"2024-09-07T03:35:23.731173+0000","last_undegraded":"2024-09-07T03:35:23.731173+0000","last_fullsized":"2024-09-07T03:35:23.731173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.382792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279118+0000","last_change":"2024-09-07T03:32:12.125531+0000","last_active":"2024-09-07T03:32:50.279118+0000","last_peered":"2024-09-07T03:32:50.279118+0000","last_clean":"2024-09-07T03:32:50.279118+0000","last_became_active":"2024-09-07T03:32:12.124516+0000","last_became_peered":"2024-09-07T03:32:12.124516+0000","last_unstale":"2024-09-07T03:32:50.279118+0000","last_undegraded":"2024-09-07T03:32:50.279118+0000","last_fullsized":"2024-09-07T03:32:50.279118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:38.848848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:41.230770+0000","last_change":"2024-09-07T03:32:14.112755+0000","last_active":"2024-09-07T03:34:41.230770+0000","last_peered":"2024-09-07T03:34:41.230770+0000","last_clean":"2024-09-07T03:34:41.230770+0000","last_became_active":"2024-09-07T03:32:14.112477+0000","last_became_peered":"2024-09-07T03:32:14.112477+0000","last_unstale":"2024-09-07T03:34:41.230770+0000","last_undegraded":"2024-09-07T03:34:41.230770+0000","last_fullsized":"2024-09-07T03:34:41.230770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:41:15.350018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275444+0000","last_change":"2024-09-07T03:32:12.137178+0000","last_active":"2024-09-07T03:32:50.275444+0000","last_peered":"2024-09-07T03:32:50.275444+0000","last_clean":"2024-09-07T03:32:50.275444+0000","last_became_active":"2024-09-07T03:32:12.136801+0000","last_became_peered":"2024-09-07T03:32:12.136801+0000","last_unstale":"2024-09-07T03:32:50.275444+0000","last_undegraded":"2024-09-07T03:32:50.275444+0000","last_fullsized":"2024-09-07T03:32:50.275444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:14:59.894718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.850114+0000","last_change":"2024-09-07T03:32:14.109462+0000","last_active":"2024-09-07T03:35:23.850114+0000","last_peered":"2024-09-07T03:35:23.850114+0000","last_clean":"2024-09-07T03:35:23.850114+0000","last_became_active":"2024-09-07T03:32:14.109167+0000","last_became_peered":"2024-09-07T03:32:14.109167+0000","last_unstale":"2024-09-07T03:35:23.850114+0000","last_undegraded":"2024-09-07T03:35:23.850114+0000","last_fullsized":"2024-09-07T03:35:23.850114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:39.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272300+0000","last_change":"2024-09-07T03:32:12.138445+0000","last_active":"2024-09-07T03:32:50.272300+0000","last_peered":"2024-09-07T03:32:50.272300+0000","last_clean":"2024-09-07T03:32:50.272300+0000","last_became_active":"2024-09-07T03:32:12.138105+0000","last_became_peered":"2024-09-07T03:32:12.138105+0000","last_unstale":"2024-09-07T03:32:50.272300+0000","last_undegraded":"2024-09-07T03:32:50.272300+0000","last_fullsized":"2024-09-07T03:32:50.272300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.111018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.773106+0000","last_change":"2024-09-07T03:32:22.149626+0000","last_active":"2024-09-07T03:35:23.773106+0000","last_peered":"2024-09-07T03:35:23.773106+0000","last_clean":"2024-09-07T03:35:23.773106+0000","last_became_active":"2024-09-07T03:32:22.149337+0000","last_became_peered":"2024-09-07T03:32:22.149337+0000","last_unstale":"2024-09-07T03:35:23.773106+0000","last_undegraded":"2024-09-07T03:35:23.773106+0000","last_fullsized":"2024-09-07T03:35:23.773106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:00:45.310817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230587+0000","last_change":"2024-09-07T03:32:14.126524+0000","last_active":"2024-09-07T03:34:36.230587+0000","last_peered":"2024-09-07T03:34:36.230587+0000","last_clean":"2024-09-07T03:34:36.230587+0000","last_became_active":"2024-09-07T03:32:14.126222+0000","last_became_peered":"2024-09-07T03:32:14.126222+0000","last_unstale":"2024-09-07T03:34:36.230587+0000","last_undegraded":"2024-09-07T03:34:36.230587+0000","last_fullsized":"2024-09-07T03:34:36.230587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:51:09.670249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273573+0000","last_change":"2024-09-07T03:32:12.125232+0000","last_active":"2024-09-07T03:32:50.273573+0000","last_peered":"2024-09-07T03:32:50.273573+0000","last_clean":"2024-09-07T03:32:50.273573+0000","last_became_active":"2024-09-07T03:32:12.124815+0000","last_became_peered":"2024-09-07T03:32:12.124815+0000","last_unstale":"2024-09-07T03:32:50.273573+0000","last_undegraded":"2024-09-07T03:32:50.273573+0000","last_fullsized":"2024-09-07T03:32:50.273573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:23.041037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275282+0000","last_change":"2024-09-07T03:32:16.127792+0000","last_active":"2024-09-07T03:32:50.275282+0000","last_peered":"2024-09-07T03:32:50.275282+0000","last_clean":"2024-09-07T03:32:50.275282+0000","last_became_active":"2024-09-07T03:32:16.127430+0000","last_became_peered":"2024-09-07T03:32:16.127430+0000","last_unstale":"2024-09-07T03:32:50.275282+0000","last_undegraded":"2024-09-07T03:32:50.275282+0000","last_fullsized":"2024-09-07T03:32:50.275282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:46.752720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'42","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.193347+0000","last_change":"2024-09-07T03:32:18.130430+0000","last_active":"2024-09-07T03:34:21.193347+0000","last_peered":"2024-09-07T03:34:21.193347+0000","last_clean":"2024-09-07T03:34:21.193347+0000","last_became_active":"2024-09-07T03:32:18.130101+0000","last_became_peered":"2024-09-07T03:32:18.130101+0000","last_unstale":"2024-09-07T03:34:21.193347+0000","last_undegraded":"2024-09-07T03:34:21.193347+0000","last_fullsized":"2024-09-07T03:34:21.193347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:55.756545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280723+0000","last_change":"2024-09-07T03:32:20.147157+0000","last_active":"2024-09-07T03:32:50.280723+0000","last_peered":"2024-09-07T03:32:50.280723+0000","last_clean":"2024-09-07T03:32:50.280723+0000","last_became_active":"2024-09-07T03:32:20.146716+0000","last_became_peered":"2024-09-07T03:32:20.146716+0000","last_unstale":"2024-09-07T03:32:50.280723+0000","last_undegraded":"2024-09-07T03:32:50.280723+0000","last_fullsized":"2024-09-07T03:32:50.280723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:23.679745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"36'9","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.982420+0000","last_change":"2024-09-07T03:32:22.143355+0000","last_active":"2024-09-07T03:33:38.982420+0000","last_peered":"2024-09-07T03:33:38.982420+0000","last_clean":"2024-09-07T03:33:38.982420+0000","last_became_active":"2024-09-07T03:32:22.143092+0000","last_became_peered":"2024-09-07T03:32:22.143092+0000","last_unstale":"2024-09-07T03:33:38.982420+0000","last_undegraded":"2024-09-07T03:33:38.982420+0000","last_fullsized":"2024-09-07T03:33:38.982420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:30:18.450771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'8","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843638+0000","last_change":"2024-09-07T03:32:14.122327+0000","last_active":"2024-09-07T03:35:23.843638+0000","last_peered":"2024-09-07T03:35:23.843638+0000","last_clean":"2024-09-07T03:35:23.843638+0000","last_became_active":"2024-09-07T03:32:14.121998+0000","last_became_peered":"2024-09-07T03:32:14.121998+0000","last_unstale":"2024-09-07T03:35:23.843638+0000","last_undegraded":"2024-09-07T03:35:23.843638+0000","last_fullsized":"2024-09-07T03:35:23.843638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432032+0000","last_change":"2024-09-07T03:32:12.130331+0000","last_active":"2024-09-07T03:32:55.432032+0000","last_peered":"2024-09-07T03:32:55.432032+0000","last_clean":"2024-09-07T03:32:55.432032+0000","last_became_active":"2024-09-07T03:32:12.129979+0000","last_became_peered":"2024-09-07T03:32:12.129979+0000","last_unstale":"2024-09-07T03:32:55.432032+0000","last_undegraded":"2024-09-07T03:32:55.432032+0000","last_fullsized":"2024-09-07T03:32:55.432032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:15.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275223+0000","last_change":"2024-09-07T03:32:16.126421+0000","last_active":"2024-09-07T03:32:50.275223+0000","last_peered":"2024-09-07T03:32:50.275223+0000","last_clean":"2024-09-07T03:32:50.275223+0000","last_became_active":"2024-09-07T03:32:16.126116+0000","last_became_peered":"2024-09-07T03:32:16.126116+0000","last_unstale":"2024-09-07T03:32:50.275223+0000","last_undegraded":"2024-09-07T03:32:50.275223+0000","last_fullsized":"2024-09-07T03:32:50.275223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:07:32.152302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472267+0000","last_change":"2024-09-07T03:32:18.132461+0000","last_active":"2024-09-07T03:32:50.472267+0000","last_peered":"2024-09-07T03:32:50.472267+0000","last_clean":"2024-09-07T03:32:50.472267+0000","last_became_active":"2024-09-07T03:32:18.132152+0000","last_became_peered":"2024-09-07T03:32:18.132152+0000","last_unstale":"2024-09-07T03:32:50.472267+0000","last_undegraded":"2024-09-07T03:32:50.472267+0000","last_fullsized":"2024-09-07T03:32:50.472267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:45:42.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280341+0000","last_change":"2024-09-07T03:32:20.146991+0000","last_active":"2024-09-07T03:32:50.280341+0000","last_peered":"2024-09-07T03:32:50.280341+0000","last_clean":"2024-09-07T03:32:50.280341+0000","last_became_active":"2024-09-07T03:32:20.146457+0000","last_became_peered":"2024-09-07T03:32:20.146457+0000","last_unstale":"2024-09-07T03:32:50.280341+0000","last_undegraded":"2024-09-07T03:32:50.280341+0000","last_fullsized":"2024-09-07T03:32:50.280341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.222346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"36'10","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.807540+0000","last_change":"2024-09-07T03:32:22.144066+0000","last_active":"2024-09-07T03:35:23.807540+0000","last_peered":"2024-09-07T03:35:23.807540+0000","last_clean":"2024-09-07T03:35:23.807540+0000","last_became_active":"2024-09-07T03:32:22.143751+0000","last_became_peered":"2024-09-07T03:32:22.143751+0000","last_unstale":"2024-09-07T03:35:23.807540+0000","last_undegraded":"2024-09-07T03:35:23.807540+0000","last_fullsized":"2024-09-07T03:35:23.807540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:14.926443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"36'20","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731193+0000","last_change":"2024-09-07T03:32:14.130832+0000","last_active":"2024-09-07T03:35:23.731193+0000","last_peered":"2024-09-07T03:35:23.731193+0000","last_clean":"2024-09-07T03:35:23.731193+0000","last_became_active":"2024-09-07T03:32:14.130544+0000","last_became_peered":"2024-09-07T03:32:14.130544+0000","last_unstale":"2024-09-07T03:35:23.731193+0000","last_undegraded":"2024-09-07T03:35:23.731193+0000","last_fullsized":"2024-09-07T03:35:23.731193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278167+0000","last_change":"2024-09-07T03:32:12.125233+0000","last_active":"2024-09-07T03:32:50.278167+0000","last_peered":"2024-09-07T03:32:50.278167+0000","last_clean":"2024-09-07T03:32:50.278167+0000","last_became_active":"2024-09-07T03:32:12.124808+0000","last_became_peered":"2024-09-07T03:32:12.124808+0000","last_unstale":"2024-09-07T03:32:50.278167+0000","last_undegraded":"2024-09-07T03:32:50.278167+0000","last_fullsized":"2024-09-07T03:32:50.278167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:26.378096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276016+0000","last_change":"2024-09-07T03:32:16.126571+0000","last_active":"2024-09-07T03:32:50.276016+0000","last_peered":"2024-09-07T03:32:50.276016+0000","last_clean":"2024-09-07T03:32:50.276016+0000","last_became_active":"2024-09-07T03:32:16.126318+0000","last_became_peered":"2024-09-07T03:32:16.126318+0000","last_unstale":"2024-09-07T03:32:50.276016+0000","last_undegraded":"2024-09-07T03:32:50.276016+0000","last_fullsized":"2024-09-07T03:32:50.276016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:51.962540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275774+0000","last_change":"2024-09-07T03:32:18.128687+0000","last_active":"2024-09-07T03:32:50.275774+0000","last_peered":"2024-09-07T03:32:50.275774+0000","last_clean":"2024-09-07T03:32:50.275774+0000","last_became_active":"2024-09-07T03:32:18.128391+0000","last_became_peered":"2024-09-07T03:32:18.128391+0000","last_unstale":"2024-09-07T03:32:50.275774+0000","last_undegraded":"2024-09-07T03:32:50.275774+0000","last_fullsized":"2024-09-07T03:32:50.275774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:50:24.989266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":416,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.848195+0000","last_change":"2024-09-07T03:32:20.140796+0000","last_active":"2024-09-07T03:35:23.848195+0000","last_peered":"2024-09-07T03:35:23.848195+0000","last_clean":"2024-09-07T03:35:23.848195+0000","last_became_active":"2024-09-07T03:32:20.140249+0000","last_became_peered":"2024-09-07T03:32:20.140249+0000","last_unstale":"2024-09-07T03:35:23.848195+0000","last_undegraded":"2024-09-07T03:35:23.848195+0000","last_fullsized":"2024-09-07T03:35:23.848195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:12.918865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274799+0000","last_change":"2024-09-07T03:32:22.141118+0000","last_active":"2024-09-07T03:32:50.274799+0000","last_peered":"2024-09-07T03:32:50.274799+0000","last_clean":"2024-09-07T03:32:50.274799+0000","last_became_active":"2024-09-07T03:32:22.139829+0000","last_became_peered":"2024-09-07T03:32:22.139829+0000","last_unstale":"2024-09-07T03:32:50.274799+0000","last_undegraded":"2024-09-07T03:32:50.274799+0000","last_fullsized":"2024-09-07T03:32:50.274799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:55:30.425595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587735+0000","last_change":"2024-09-07T03:32:14.126517+0000","last_active":"2024-09-07T03:35:23.587735+0000","last_peered":"2024-09-07T03:35:23.587735+0000","last_clean":"2024-09-07T03:35:23.587735+0000","last_became_active":"2024-09-07T03:32:14.126140+0000","last_became_peered":"2024-09-07T03:32:14.126140+0000","last_unstale":"2024-09-07T03:35:23.587735+0000","last_undegraded":"2024-09-07T03:35:23.587735+0000","last_fullsized":"2024-09-07T03:35:23.587735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277837+0000","last_change":"2024-09-07T03:32:12.133946+0000","last_active":"2024-09-07T03:32:50.277837+0000","last_peered":"2024-09-07T03:32:50.277837+0000","last_clean":"2024-09-07T03:32:50.277837+0000","last_became_active":"2024-09-07T03:32:12.133270+0000","last_became_peered":"2024-09-07T03:32:12.133270+0000","last_unstale":"2024-09-07T03:32:50.277837+0000","last_undegraded":"2024-09-07T03:32:50.277837+0000","last_fullsized":"2024-09-07T03:32:50.277837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:56.372379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281906+0000","last_change":"2024-09-07T03:32:16.117091+0000","last_active":"2024-09-07T03:32:50.281906+0000","last_peered":"2024-09-07T03:32:50.281906+0000","last_clean":"2024-09-07T03:32:50.281906+0000","last_became_active":"2024-09-07T03:32:16.116761+0000","last_became_peered":"2024-09-07T03:32:16.116761+0000","last_unstale":"2024-09-07T03:32:50.281906+0000","last_undegraded":"2024-09-07T03:32:50.281906+0000","last_fullsized":"2024-09-07T03:32:50.281906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:07:07.674647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'38","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:46.233146+0000","last_change":"2024-09-07T03:32:18.129567+0000","last_active":"2024-09-07T03:34:46.233146+0000","last_peered":"2024-09-07T03:34:46.233146+0000","last_clean":"2024-09-07T03:34:46.233146+0000","last_became_active":"2024-09-07T03:32:18.128901+0000","last_became_peered":"2024-09-07T03:32:18.128901+0000","last_unstale":"2024-09-07T03:34:46.233146+0000","last_undegraded":"2024-09-07T03:34:46.233146+0000","last_fullsized":"2024-09-07T03:34:46.233146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:42:21.711836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":425,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.846585+0000","last_change":"2024-09-07T03:32:20.142693+0000","last_active":"2024-09-07T03:35:23.846585+0000","last_peered":"2024-09-07T03:35:23.846585+0000","last_clean":"2024-09-07T03:35:23.846585+0000","last_became_active":"2024-09-07T03:32:20.142390+0000","last_became_peered":"2024-09-07T03:32:20.142390+0000","last_unstale":"2024-09-07T03:35:23.846585+0000","last_undegraded":"2024-09-07T03:35:23.846585+0000","last_fullsized":"2024-09-07T03:35:23.846585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:51:20.882177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272814+0000","last_change":"2024-09-07T03:32:14.123300+0000","last_active":"2024-09-07T03:32:50.272814+0000","last_peered":"2024-09-07T03:32:50.272814+0000","last_clean":"2024-09-07T03:32:50.272814+0000","last_became_active":"2024-09-07T03:32:14.122806+0000","last_became_peered":"2024-09-07T03:32:14.122806+0000","last_unstale":"2024-09-07T03:32:50.272814+0000","last_undegraded":"2024-09-07T03:32:50.272814+0000","last_fullsized":"2024-09-07T03:32:50.272814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:12.527168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.458084+0000","last_change":"2024-09-07T03:32:12.125001+0000","last_active":"2024-09-07T03:35:23.458084+0000","last_peered":"2024-09-07T03:35:23.458084+0000","last_clean":"2024-09-07T03:35:23.458084+0000","last_became_active":"2024-09-07T03:32:12.124564+0000","last_became_peered":"2024-09-07T03:32:12.124564+0000","last_unstale":"2024-09-07T03:35:23.458084+0000","last_undegraded":"2024-09-07T03:35:23.458084+0000","last_fullsized":"2024-09-07T03:35:23.458084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:13:15.055699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470518+0000","last_change":"2024-09-07T03:32:16.128785+0000","last_active":"2024-09-07T03:32:50.470518+0000","last_peered":"2024-09-07T03:32:50.470518+0000","last_clean":"2024-09-07T03:32:50.470518+0000","last_became_active":"2024-09-07T03:32:16.128519+0000","last_became_peered":"2024-09-07T03:32:16.128519+0000","last_unstale":"2024-09-07T03:32:50.470518+0000","last_undegraded":"2024-09-07T03:32:50.470518+0000","last_fullsized":"2024-09-07T03:32:50.470518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:31.864367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'46","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.197586+0000","last_change":"2024-09-07T03:32:18.133115+0000","last_active":"2024-09-07T03:34:21.197586+0000","last_peered":"2024-09-07T03:34:21.197586+0000","last_clean":"2024-09-07T03:34:21.197586+0000","last_became_active":"2024-09-07T03:32:18.132867+0000","last_became_peered":"2024-09-07T03:32:18.132867+0000","last_unstale":"2024-09-07T03:34:21.197586+0000","last_undegraded":"2024-09-07T03:34:21.197586+0000","last_fullsized":"2024-09-07T03:34:21.197586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:21.167694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470403+0000","last_change":"2024-09-07T03:32:20.140261+0000","last_active":"2024-09-07T03:32:50.470403+0000","last_peered":"2024-09-07T03:32:50.470403+0000","last_clean":"2024-09-07T03:32:50.470403+0000","last_became_active":"2024-09-07T03:32:20.139806+0000","last_became_peered":"2024-09-07T03:32:20.139806+0000","last_unstale":"2024-09-07T03:32:50.470403+0000","last_undegraded":"2024-09-07T03:32:50.470403+0000","last_fullsized":"2024-09-07T03:32:50.470403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:38:36.923114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.784797+0000","last_change":"2024-09-07T03:32:22.148464+0000","last_active":"2024-09-07T03:35:23.784797+0000","last_peered":"2024-09-07T03:35:23.784797+0000","last_clean":"2024-09-07T03:35:23.784797+0000","last_became_active":"2024-09-07T03:32:22.148149+0000","last_became_peered":"2024-09-07T03:32:22.148149+0000","last_unstale":"2024-09-07T03:35:23.784797+0000","last_undegraded":"2024-09-07T03:35:23.784797+0000","last_fullsized":"2024-09-07T03:35:23.784797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:22.630172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806003+0000","last_change":"2024-09-07T03:32:50.281567+0000","last_active":"2024-09-07T03:35:23.806003+0000","last_peered":"2024-09-07T03:35:23.806003+0000","last_clean":"2024-09-07T03:35:23.806003+0000","last_became_active":"2024-09-07T03:32:50.279097+0000","last_became_peered":"2024-09-07T03:32:50.279097+0000","last_unstale":"2024-09-07T03:35:23.806003+0000","last_undegraded":"2024-09-07T03:35:23.806003+0000","last_fullsized":"2024-09-07T03:35:23.806003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:31:29.966121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.432175+0000","last_change":"2024-09-07T03:32:12.124416+0000","last_active":"2024-09-07T03:35:23.432175+0000","last_peered":"2024-09-07T03:35:23.432175+0000","last_clean":"2024-09-07T03:35:23.432175+0000","last_became_active":"2024-09-07T03:32:12.123895+0000","last_became_peered":"2024-09-07T03:32:12.123895+0000","last_unstale":"2024-09-07T03:35:23.432175+0000","last_undegraded":"2024-09-07T03:35:23.432175+0000","last_fullsized":"2024-09-07T03:35:23.432175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:03.158393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274777+0000","last_change":"2024-09-07T03:32:16.129022+0000","last_active":"2024-09-07T03:32:50.274777+0000","last_peered":"2024-09-07T03:32:50.274777+0000","last_clean":"2024-09-07T03:32:50.274777+0000","last_became_active":"2024-09-07T03:32:16.128471+0000","last_became_peered":"2024-09-07T03:32:16.128471+0000","last_unstale":"2024-09-07T03:32:50.274777+0000","last_undegraded":"2024-09-07T03:32:50.274777+0000","last_fullsized":"2024-09-07T03:32:50.274777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:29.378625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.177260+0000","last_change":"2024-09-07T03:32:18.127995+0000","last_active":"2024-09-07T03:34:21.177260+0000","last_peered":"2024-09-07T03:34:21.177260+0000","last_clean":"2024-09-07T03:34:21.177260+0000","last_became_active":"2024-09-07T03:32:18.127674+0000","last_became_peered":"2024-09-07T03:32:18.127674+0000","last_unstale":"2024-09-07T03:34:21.177260+0000","last_undegraded":"2024-09-07T03:34:21.177260+0000","last_fullsized":"2024-09-07T03:34:21.177260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:39:30.847124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272008+0000","last_change":"2024-09-07T03:32:20.142615+0000","last_active":"2024-09-07T03:32:50.272008+0000","last_peered":"2024-09-07T03:32:50.272008+0000","last_clean":"2024-09-07T03:32:50.272008+0000","last_became_active":"2024-09-07T03:32:20.142322+0000","last_became_peered":"2024-09-07T03:32:20.142322+0000","last_unstale":"2024-09-07T03:32:50.272008+0000","last_undegraded":"2024-09-07T03:32:50.272008+0000","last_fullsized":"2024-09-07T03:32:50.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:20:24.113543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:33.274480+0000","last_change":"2024-09-07T03:32:22.140060+0000","last_active":"2024-09-07T03:33:33.274480+0000","last_peered":"2024-09-07T03:33:33.274480+0000","last_clean":"2024-09-07T03:33:33.274480+0000","last_became_active":"2024-09-07T03:32:22.139771+0000","last_became_peered":"2024-09-07T03:32:22.139771+0000","last_unstale":"2024-09-07T03:33:33.274480+0000","last_undegraded":"2024-09-07T03:33:33.274480+0000","last_fullsized":"2024-09-07T03:33:33.274480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:32:56.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963274+0000","last_change":"2024-09-07T03:32:14.122499+0000","last_active":"2024-09-07T03:34:22.963274+0000","last_peered":"2024-09-07T03:34:22.963274+0000","last_clean":"2024-09-07T03:34:22.963274+0000","last_became_active":"2024-09-07T03:32:14.122182+0000","last_became_peered":"2024-09-07T03:32:14.122182+0000","last_unstale":"2024-09-07T03:34:22.963274+0000","last_undegraded":"2024-09-07T03:34:22.963274+0000","last_fullsized":"2024-09-07T03:34:22.963274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.940422+0000","last_change":"2024-09-07T03:32:12.120934+0000","last_active":"2024-09-07T03:34:22.940422+0000","last_peered":"2024-09-07T03:34:22.940422+0000","last_clean":"2024-09-07T03:34:22.940422+0000","last_became_active":"2024-09-07T03:32:12.120464+0000","last_became_peered":"2024-09-07T03:32:12.120464+0000","last_unstale":"2024-09-07T03:34:22.940422+0000","last_undegraded":"2024-09-07T03:34:22.940422+0000","last_fullsized":"2024-09-07T03:34:22.940422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:35:47.814978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275521+0000","last_change":"2024-09-07T03:32:16.124913+0000","last_active":"2024-09-07T03:32:50.275521+0000","last_peered":"2024-09-07T03:32:50.275521+0000","last_clean":"2024-09-07T03:32:50.275521+0000","last_became_active":"2024-09-07T03:32:16.124297+0000","last_became_peered":"2024-09-07T03:32:16.124297+0000","last_unstale":"2024-09-07T03:32:50.275521+0000","last_undegraded":"2024-09-07T03:32:50.275521+0000","last_fullsized":"2024-09-07T03:32:50.275521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:34.327180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'49","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.965656+0000","last_change":"2024-09-07T03:32:18.130149+0000","last_active":"2024-09-07T03:34:22.965656+0000","last_peered":"2024-09-07T03:34:22.965656+0000","last_clean":"2024-09-07T03:34:22.965656+0000","last_became_active":"2024-09-07T03:32:18.129944+0000","last_became_peered":"2024-09-07T03:32:18.129944+0000","last_unstale":"2024-09-07T03:34:22.965656+0000","last_undegraded":"2024-09-07T03:34:22.965656+0000","last_fullsized":"2024-09-07T03:34:22.965656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:27:30.361760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":349,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.114461+0000","last_change":"2024-09-07T03:32:20.144523+0000","last_active":"2024-09-07T03:35:24.114461+0000","last_peered":"2024-09-07T03:35:24.114461+0000","last_clean":"2024-09-07T03:35:24.114461+0000","last_became_active":"2024-09-07T03:32:20.144077+0000","last_became_peered":"2024-09-07T03:32:20.144077+0000","last_unstale":"2024-09-07T03:35:24.114461+0000","last_undegraded":"2024-09-07T03:35:24.114461+0000","last_fullsized":"2024-09-07T03:35:24.114461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:25.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471098+0000","last_change":"2024-09-07T03:32:22.146228+0000","last_active":"2024-09-07T03:32:50.471098+0000","last_peered":"2024-09-07T03:32:50.471098+0000","last_clean":"2024-09-07T03:32:50.471098+0000","last_became_active":"2024-09-07T03:32:22.145690+0000","last_became_peered":"2024-09-07T03:32:22.145690+0000","last_unstale":"2024-09-07T03:32:50.471098+0000","last_undegraded":"2024-09-07T03:32:50.471098+0000","last_fullsized":"2024-09-07T03:32:50.471098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:59:34.851122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'7","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.483958+0000","last_change":"2024-09-07T03:32:14.113637+0000","last_active":"2024-09-07T03:35:23.483958+0000","last_peered":"2024-09-07T03:35:23.483958+0000","last_clean":"2024-09-07T03:35:23.483958+0000","last_became_active":"2024-09-07T03:32:14.113104+0000","last_became_peered":"2024-09-07T03:32:14.113104+0000","last_unstale":"2024-09-07T03:35:23.483958+0000","last_undegraded":"2024-09-07T03:35:23.483958+0000","last_fullsized":"2024-09-07T03:35:23.483958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:46:15.552973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278855+0000","last_change":"2024-09-07T03:32:12.125878+0000","last_active":"2024-09-07T03:32:50.278855+0000","last_peered":"2024-09-07T03:32:50.278855+0000","last_clean":"2024-09-07T03:32:50.278855+0000","last_became_active":"2024-09-07T03:32:12.125172+0000","last_became_peered":"2024-09-07T03:32:12.125172+0000","last_unstale":"2024-09-07T03:32:50.278855+0000","last_undegraded":"2024-09-07T03:32:50.278855+0000","last_fullsized":"2024-09-07T03:32:50.278855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:36:10.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278236+0000","last_change":"2024-09-07T03:32:16.125904+0000","last_active":"2024-09-07T03:32:50.278236+0000","last_peered":"2024-09-07T03:32:50.278236+0000","last_clean":"2024-09-07T03:32:50.278236+0000","last_became_active":"2024-09-07T03:32:16.125618+0000","last_became_peered":"2024-09-07T03:32:16.125618+0000","last_unstale":"2024-09-07T03:32:50.278236+0000","last_undegraded":"2024-09-07T03:32:50.278236+0000","last_fullsized":"2024-09-07T03:32:50.278236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:06.494089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'66","reported_seq":135,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.201697+0000","last_change":"2024-09-07T03:32:18.134274+0000","last_active":"2024-09-07T03:34:21.201697+0000","last_peered":"2024-09-07T03:34:21.201697+0000","last_clean":"2024-09-07T03:34:21.201697+0000","last_became_active":"2024-09-07T03:32:18.134005+0000","last_became_peered":"2024-09-07T03:32:18.134005+0000","last_unstale":"2024-09-07T03:34:21.201697+0000","last_undegraded":"2024-09-07T03:34:21.201697+0000","last_fullsized":"2024-09-07T03:34:21.201697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:07.792695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274382+0000","last_change":"2024-09-07T03:32:20.145524+0000","last_active":"2024-09-07T03:32:50.274382+0000","last_peered":"2024-09-07T03:32:50.274382+0000","last_clean":"2024-09-07T03:32:50.274382+0000","last_became_active":"2024-09-07T03:32:20.145119+0000","last_became_peered":"2024-09-07T03:32:20.145119+0000","last_unstale":"2024-09-07T03:32:50.274382+0000","last_undegraded":"2024-09-07T03:32:50.274382+0000","last_fullsized":"2024-09-07T03:32:50.274382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:21.410162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.058175+0000","last_change":"2024-09-07T03:32:22.149484+0000","last_active":"2024-09-07T03:35:24.058175+0000","last_peered":"2024-09-07T03:35:24.058175+0000","last_clean":"2024-09-07T03:35:24.058175+0000","last_became_active":"2024-09-07T03:32:22.149203+0000","last_became_peered":"2024-09-07T03:32:22.149203+0000","last_unstale":"2024-09-07T03:35:24.058175+0000","last_undegraded":"2024-09-07T03:35:24.058175+0000","last_fullsized":"2024-09-07T03:35:24.058175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:33.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230163+0000","last_change":"2024-09-07T03:32:14.124704+0000","last_active":"2024-09-07T03:34:28.230163+0000","last_peered":"2024-09-07T03:34:28.230163+0000","last_clean":"2024-09-07T03:34:28.230163+0000","last_became_active":"2024-09-07T03:32:14.124120+0000","last_became_peered":"2024-09-07T03:32:14.124120+0000","last_unstale":"2024-09-07T03:34:28.230163+0000","last_undegraded":"2024-09-07T03:34:28.230163+0000","last_fullsized":"2024-09-07T03:34:28.230163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:15:18.554790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273263+0000","last_change":"2024-09-07T03:32:12.133844+0000","last_active":"2024-09-07T03:32:50.273263+0000","last_peered":"2024-09-07T03:32:50.273263+0000","last_clean":"2024-09-07T03:32:50.273263+0000","last_became_active":"2024-09-07T03:32:12.133434+0000","last_became_peered":"2024-09-07T03:32:12.133434+0000","last_unstale":"2024-09-07T03:32:50.273263+0000","last_undegraded":"2024-09-07T03:32:50.273263+0000","last_fullsized":"2024-09-07T03:32:50.273263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:56:28.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277527+0000","last_change":"2024-09-07T03:32:16.121534+0000","last_active":"2024-09-07T03:32:50.277527+0000","last_peered":"2024-09-07T03:32:50.277527+0000","last_clean":"2024-09-07T03:32:50.277527+0000","last_became_active":"2024-09-07T03:32:16.121256+0000","last_became_peered":"2024-09-07T03:32:16.121256+0000","last_unstale":"2024-09-07T03:32:50.277527+0000","last_undegraded":"2024-09-07T03:32:50.277527+0000","last_fullsized":"2024-09-07T03:32:50.277527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:19.973036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.181400+0000","last_change":"2024-09-07T03:32:18.128938+0000","last_active":"2024-09-07T03:34:21.181400+0000","last_peered":"2024-09-07T03:34:21.181400+0000","last_clean":"2024-09-07T03:34:21.181400+0000","last_became_active":"2024-09-07T03:32:18.128470+0000","last_became_peered":"2024-09-07T03:32:18.128470+0000","last_unstale":"2024-09-07T03:34:21.181400+0000","last_undegraded":"2024-09-07T03:34:21.181400+0000","last_fullsized":"2024-09-07T03:34:21.181400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:15:06.767791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276446+0000","last_change":"2024-09-07T03:32:20.136526+0000","last_active":"2024-09-07T03:32:50.276446+0000","last_peered":"2024-09-07T03:32:50.276446+0000","last_clean":"2024-09-07T03:32:50.276446+0000","last_became_active":"2024-09-07T03:32:20.134892+0000","last_became_peered":"2024-09-07T03:32:20.134892+0000","last_unstale":"2024-09-07T03:32:50.276446+0000","last_undegraded":"2024-09-07T03:32:50.276446+0000","last_fullsized":"2024-09-07T03:32:50.276446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:28.142767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228166+0000","last_change":"2024-09-07T03:32:22.153373+0000","last_active":"2024-09-07T03:34:21.228166+0000","last_peered":"2024-09-07T03:34:21.228166+0000","last_clean":"2024-09-07T03:34:21.228166+0000","last_became_active":"2024-09-07T03:32:22.153134+0000","last_became_peered":"2024-09-07T03:32:22.153134+0000","last_unstale":"2024-09-07T03:34:21.228166+0000","last_undegraded":"2024-09-07T03:34:21.228166+0000","last_fullsized":"2024-09-07T03:34:21.228166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:54.932378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435691+0000","last_change":"2024-09-07T03:32:14.113575+0000","last_active":"2024-09-07T03:34:19.435691+0000","last_peered":"2024-09-07T03:34:19.435691+0000","last_clean":"2024-09-07T03:34:19.435691+0000","last_became_active":"2024-09-07T03:32:14.113243+0000","last_became_peered":"2024-09-07T03:32:14.113243+0000","last_unstale":"2024-09-07T03:34:19.435691+0000","last_undegraded":"2024-09-07T03:34:19.435691+0000","last_fullsized":"2024-09-07T03:34:19.435691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:14.596869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.723676+0000","last_change":"2024-09-07T03:32:12.120954+0000","last_active":"2024-09-07T03:35:23.723676+0000","last_peered":"2024-09-07T03:35:23.723676+0000","last_clean":"2024-09-07T03:35:23.723676+0000","last_became_active":"2024-09-07T03:32:12.120531+0000","last_became_peered":"2024-09-07T03:32:12.120531+0000","last_unstale":"2024-09-07T03:35:23.723676+0000","last_undegraded":"2024-09-07T03:35:23.723676+0000","last_fullsized":"2024-09-07T03:35:23.723676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:11.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470958+0000","last_change":"2024-09-07T03:32:16.124431+0000","last_active":"2024-09-07T03:32:50.470958+0000","last_peered":"2024-09-07T03:32:50.470958+0000","last_clean":"2024-09-07T03:32:50.470958+0000","last_became_active":"2024-09-07T03:32:16.124100+0000","last_became_peered":"2024-09-07T03:32:16.124100+0000","last_unstale":"2024-09-07T03:32:50.470958+0000","last_undegraded":"2024-09-07T03:32:50.470958+0000","last_fullsized":"2024-09-07T03:32:50.470958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:20:34.634089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'36","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.208205+0000","last_change":"2024-09-07T03:32:18.130376+0000","last_active":"2024-09-07T03:34:21.208205+0000","last_peered":"2024-09-07T03:34:21.208205+0000","last_clean":"2024-09-07T03:34:21.208205+0000","last_became_active":"2024-09-07T03:32:18.130120+0000","last_became_peered":"2024-09-07T03:32:18.130120+0000","last_unstale":"2024-09-07T03:34:21.208205+0000","last_undegraded":"2024-09-07T03:34:21.208205+0000","last_fullsized":"2024-09-07T03:34:21.208205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:03.978153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.062094+0000","last_change":"2024-09-07T03:32:20.146795+0000","last_active":"2024-09-07T03:35:24.062094+0000","last_peered":"2024-09-07T03:35:24.062094+0000","last_clean":"2024-09-07T03:35:24.062094+0000","last_became_active":"2024-09-07T03:32:20.146408+0000","last_became_peered":"2024-09-07T03:32:20.146408+0000","last_unstale":"2024-09-07T03:35:24.062094+0000","last_undegraded":"2024-09-07T03:35:24.062094+0000","last_fullsized":"2024-09-07T03:35:24.062094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:41.611972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'14","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230053+0000","last_change":"2024-09-07T03:32:22.147032+0000","last_active":"2024-09-07T03:34:28.230053+0000","last_peered":"2024-09-07T03:34:28.230053+0000","last_clean":"2024-09-07T03:34:28.230053+0000","last_became_active":"2024-09-07T03:32:22.145911+0000","last_became_peered":"2024-09-07T03:32:22.145911+0000","last_unstale":"2024-09-07T03:34:28.230053+0000","last_undegraded":"2024-09-07T03:34:28.230053+0000","last_fullsized":"2024-09-07T03:34:28.230053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:59:11.588353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278589+0000","last_change":"2024-09-07T03:32:14.112827+0000","last_active":"2024-09-07T03:32:50.278589+0000","last_peered":"2024-09-07T03:32:50.278589+0000","last_clean":"2024-09-07T03:32:50.278589+0000","last_became_active":"2024-09-07T03:32:14.112499+0000","last_became_peered":"2024-09-07T03:32:14.112499+0000","last_unstale":"2024-09-07T03:32:50.278589+0000","last_undegraded":"2024-09-07T03:32:50.278589+0000","last_fullsized":"2024-09-07T03:32:50.278589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:47:55.234769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432136+0000","last_change":"2024-09-07T03:32:12.132816+0000","last_active":"2024-09-07T03:32:55.432136+0000","last_peered":"2024-09-07T03:32:55.432136+0000","last_clean":"2024-09-07T03:32:55.432136+0000","last_became_active":"2024-09-07T03:32:12.132462+0000","last_became_peered":"2024-09-07T03:32:12.132462+0000","last_unstale":"2024-09-07T03:32:55.432136+0000","last_undegraded":"2024-09-07T03:32:55.432136+0000","last_fullsized":"2024-09-07T03:32:55.432136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:53:07.085389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":611,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.296793+0000","last_change":"2024-09-07T03:32:16.124805+0000","last_active":"2024-09-07T03:34:22.296793+0000","last_peered":"2024-09-07T03:34:22.296793+0000","last_clean":"2024-09-07T03:34:22.296793+0000","last_became_active":"2024-09-07T03:32:16.124500+0000","last_became_peered":"2024-09-07T03:32:16.124500+0000","last_unstale":"2024-09-07T03:34:22.296793+0000","last_undegraded":"2024-09-07T03:34:22.296793+0000","last_fullsized":"2024-09-07T03:34:22.296793+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:21:20.333446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":679,"num_read_kb":679,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'11","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230563+0000","last_change":"2024-09-07T03:32:50.286792+0000","last_active":"2024-09-07T03:34:36.230563+0000","last_peered":"2024-09-07T03:34:36.230563+0000","last_clean":"2024-09-07T03:34:36.230563+0000","last_became_active":"2024-09-07T03:32:50.278739+0000","last_became_peered":"2024-09-07T03:32:50.278739+0000","last_unstale":"2024-09-07T03:34:36.230563+0000","last_undegraded":"2024-09-07T03:34:36.230563+0000","last_fullsized":"2024-09-07T03:34:36.230563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:41.377209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":464,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.088738+0000","last_change":"2024-09-07T03:32:20.140656+0000","last_active":"2024-09-07T03:35:24.088738+0000","last_peered":"2024-09-07T03:35:24.088738+0000","last_clean":"2024-09-07T03:35:24.088738+0000","last_became_active":"2024-09-07T03:32:20.140148+0000","last_became_peered":"2024-09-07T03:32:20.140148+0000","last_unstale":"2024-09-07T03:35:24.088738+0000","last_undegraded":"2024-09-07T03:35:24.088738+0000","last_fullsized":"2024-09-07T03:35:24.088738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:10.352295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.602934+0000","last_change":"2024-09-07T03:32:22.147355+0000","last_active":"2024-09-07T03:34:22.602934+0000","last_peered":"2024-09-07T03:34:22.602934+0000","last_clean":"2024-09-07T03:34:22.602934+0000","last_became_active":"2024-09-07T03:32:22.147049+0000","last_became_peered":"2024-09-07T03:32:22.147049+0000","last_unstale":"2024-09-07T03:34:22.602934+0000","last_undegraded":"2024-09-07T03:34:22.602934+0000","last_fullsized":"2024-09-07T03:34:22.602934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:16.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'5","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230226+0000","last_change":"2024-09-07T03:32:14.124366+0000","last_active":"2024-09-07T03:34:28.230226+0000","last_peered":"2024-09-07T03:34:28.230226+0000","last_clean":"2024-09-07T03:34:28.230226+0000","last_became_active":"2024-09-07T03:32:14.124083+0000","last_became_peered":"2024-09-07T03:32:14.124083+0000","last_unstale":"2024-09-07T03:34:28.230226+0000","last_undegraded":"2024-09-07T03:34:28.230226+0000","last_fullsized":"2024-09-07T03:34:28.230226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.448249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'1","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228208+0000","last_change":"2024-09-07T03:32:12.141656+0000","last_active":"2024-09-07T03:34:21.228208+0000","last_peered":"2024-09-07T03:34:21.228208+0000","last_clean":"2024-09-07T03:34:21.228208+0000","last_became_active":"2024-09-07T03:32:12.141314+0000","last_became_peered":"2024-09-07T03:32:12.141314+0000","last_unstale":"2024-09-07T03:34:21.228208+0000","last_undegraded":"2024-09-07T03:34:21.228208+0000","last_fullsized":"2024-09-07T03:34:21.228208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:48:41.251471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276435+0000","last_change":"2024-09-07T03:32:16.128496+0000","last_active":"2024-09-07T03:32:50.276435+0000","last_peered":"2024-09-07T03:32:50.276435+0000","last_clean":"2024-09-07T03:32:50.276435+0000","last_became_active":"2024-09-07T03:32:16.128099+0000","last_became_peered":"2024-09-07T03:32:16.128099+0000","last_unstale":"2024-09-07T03:32:50.276435+0000","last_undegraded":"2024-09-07T03:32:50.276435+0000","last_fullsized":"2024-09-07T03:32:50.276435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:54:04.786020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.194364+0000","last_change":"2024-09-07T03:32:18.129264+0000","last_active":"2024-09-07T03:34:21.194364+0000","last_peered":"2024-09-07T03:34:21.194364+0000","last_clean":"2024-09-07T03:34:21.194364+0000","last_became_active":"2024-09-07T03:32:18.128679+0000","last_became_peered":"2024-09-07T03:32:18.128679+0000","last_unstale":"2024-09-07T03:34:21.194364+0000","last_undegraded":"2024-09-07T03:34:21.194364+0000","last_fullsized":"2024-09-07T03:34:21.194364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:04.595879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280409+0000","last_change":"2024-09-07T03:32:20.132823+0000","last_active":"2024-09-07T03:32:50.280409+0000","last_peered":"2024-09-07T03:32:50.280409+0000","last_clean":"2024-09-07T03:32:50.280409+0000","last_became_active":"2024-09-07T03:32:20.132479+0000","last_became_peered":"2024-09-07T03:32:20.132479+0000","last_unstale":"2024-09-07T03:32:50.280409+0000","last_undegraded":"2024-09-07T03:32:50.280409+0000","last_fullsized":"2024-09-07T03:32:50.280409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:52.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.060147+0000","last_change":"2024-09-07T03:32:22.140676+0000","last_active":"2024-09-07T03:35:24.060147+0000","last_peered":"2024-09-07T03:35:24.060147+0000","last_clean":"2024-09-07T03:35:24.060147+0000","last_became_active":"2024-09-07T03:32:22.140389+0000","last_became_peered":"2024-09-07T03:32:22.140389+0000","last_unstale":"2024-09-07T03:35:24.060147+0000","last_undegraded":"2024-09-07T03:35:24.060147+0000","last_fullsized":"2024-09-07T03:35:24.060147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:12:54.218779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.024887+0000","last_change":"2024-09-07T03:32:14.113244+0000","last_active":"2024-09-07T03:32:57.024887+0000","last_peered":"2024-09-07T03:32:57.024887+0000","last_clean":"2024-09-07T03:32:57.024887+0000","last_became_active":"2024-09-07T03:32:14.112612+0000","last_became_peered":"2024-09-07T03:32:14.112612+0000","last_unstale":"2024-09-07T03:32:57.024887+0000","last_undegraded":"2024-09-07T03:32:57.024887+0000","last_fullsized":"2024-09-07T03:32:57.024887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:24.044336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469899+0000","last_change":"2024-09-07T03:31:58.568783+0000","last_active":"2024-09-07T03:32:50.469899+0000","last_peered":"2024-09-07T03:32:50.469899+0000","last_clean":"2024-09-07T03:32:50.469899+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:32:50.469899+0000","last_undegraded":"2024-09-07T03:32:50.469899+0000","last_fullsized":"2024-09-07T03:32:50.469899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_clean_scrub_stamp":"2024-09-07T03:31:57.501815+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:54.736044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278835+0000","last_change":"2024-09-07T03:32:04.539297+0000","last_active":"2024-09-07T03:32:50.278835+0000","last_peered":"2024-09-07T03:32:50.278835+0000","last_clean":"2024-09-07T03:32:50.278835+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:32:50.278835+0000","last_undegraded":"2024-09-07T03:32:50.278835+0000","last_fullsized":"2024-09-07T03:32:50.278835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:06.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.838441+0000","last_change":"2024-09-07T03:32:12.130687+0000","last_active":"2024-09-07T03:35:23.838441+0000","last_peered":"2024-09-07T03:35:23.838441+0000","last_clean":"2024-09-07T03:35:23.838441+0000","last_became_active":"2024-09-07T03:32:12.130323+0000","last_became_peered":"2024-09-07T03:32:12.130323+0000","last_unstale":"2024-09-07T03:35:23.838441+0000","last_undegraded":"2024-09-07T03:35:23.838441+0000","last_fullsized":"2024-09-07T03:35:23.838441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:45.892639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471096+0000","last_change":"2024-09-07T03:32:16.127232+0000","last_active":"2024-09-07T03:32:50.471096+0000","last_peered":"2024-09-07T03:32:50.471096+0000","last_clean":"2024-09-07T03:32:50.471096+0000","last_became_active":"2024-09-07T03:32:16.126915+0000","last_became_peered":"2024-09-07T03:32:16.126915+0000","last_unstale":"2024-09-07T03:32:50.471096+0000","last_undegraded":"2024-09-07T03:32:50.471096+0000","last_fullsized":"2024-09-07T03:32:50.471096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:52:36.603646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'84","reported_seq":160,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.206217+0000","last_change":"2024-09-07T03:32:18.129530+0000","last_active":"2024-09-07T03:34:21.206217+0000","last_peered":"2024-09-07T03:34:21.206217+0000","last_clean":"2024-09-07T03:34:21.206217+0000","last_became_active":"2024-09-07T03:32:18.129224+0000","last_became_peered":"2024-09-07T03:32:18.129224+0000","last_unstale":"2024-09-07T03:34:21.206217+0000","last_undegraded":"2024-09-07T03:34:21.206217+0000","last_fullsized":"2024-09-07T03:34:21.206217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:25:57.912545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":84,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275577+0000","last_change":"2024-09-07T03:32:20.135113+0000","last_active":"2024-09-07T03:32:50.275577+0000","last_peered":"2024-09-07T03:32:50.275577+0000","last_clean":"2024-09-07T03:32:50.275577+0000","last_became_active":"2024-09-07T03:32:20.134819+0000","last_became_peered":"2024-09-07T03:32:20.134819+0000","last_unstale":"2024-09-07T03:32:50.275577+0000","last_undegraded":"2024-09-07T03:32:50.275577+0000","last_fullsized":"2024-09-07T03:32:50.275577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:30.829289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'84","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.852849+0000","last_change":"2024-09-07T03:32:22.152124+0000","last_active":"2024-09-07T03:35:23.852849+0000","last_peered":"2024-09-07T03:35:23.852849+0000","last_clean":"2024-09-07T03:35:23.852849+0000","last_became_active":"2024-09-07T03:32:22.151817+0000","last_became_peered":"2024-09-07T03:32:22.151817+0000","last_unstale":"2024-09-07T03:35:23.852849+0000","last_undegraded":"2024-09-07T03:35:23.852849+0000","last_fullsized":"2024-09-07T03:35:23.852849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:00.353389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'16","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843497+0000","last_change":"2024-09-07T03:32:14.130827+0000","last_active":"2024-09-07T03:35:23.843497+0000","last_peered":"2024-09-07T03:35:23.843497+0000","last_clean":"2024-09-07T03:35:23.843497+0000","last_became_active":"2024-09-07T03:32:14.130484+0000","last_became_peered":"2024-09-07T03:32:14.130484+0000","last_unstale":"2024-09-07T03:35:23.843497+0000","last_undegraded":"2024-09-07T03:35:23.843497+0000","last_fullsized":"2024-09-07T03:35:23.843497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279322+0000","last_change":"2024-09-07T03:32:04.539038+0000","last_active":"2024-09-07T03:32:50.279322+0000","last_peered":"2024-09-07T03:32:50.279322+0000","last_clean":"2024-09-07T03:32:50.279322+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:32:50.279322+0000","last_undegraded":"2024-09-07T03:32:50.279322+0000","last_fullsized":"2024-09-07T03:32:50.279322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:11.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470907+0000","last_change":"2024-09-07T03:32:12.124849+0000","last_active":"2024-09-07T03:32:50.470907+0000","last_peered":"2024-09-07T03:32:50.470907+0000","last_clean":"2024-09-07T03:32:50.470907+0000","last_became_active":"2024-09-07T03:32:12.124522+0000","last_became_peered":"2024-09-07T03:32:12.124522+0000","last_unstale":"2024-09-07T03:32:50.470907+0000","last_undegraded":"2024-09-07T03:32:50.470907+0000","last_fullsized":"2024-09-07T03:32:50.470907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:46:14.653854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282885+0000","last_change":"2024-09-07T03:32:16.124594+0000","last_active":"2024-09-07T03:32:50.282885+0000","last_peered":"2024-09-07T03:32:50.282885+0000","last_clean":"2024-09-07T03:32:50.282885+0000","last_became_active":"2024-09-07T03:32:16.124243+0000","last_became_peered":"2024-09-07T03:32:16.124243+0000","last_unstale":"2024-09-07T03:32:50.282885+0000","last_undegraded":"2024-09-07T03:32:50.282885+0000","last_fullsized":"2024-09-07T03:32:50.282885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:00:23.883657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'279","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206669+0000","last_change":"2024-09-07T03:32:18.132880+0000","last_active":"2024-09-07T03:35:21.206669+0000","last_peered":"2024-09-07T03:35:21.206669+0000","last_clean":"2024-09-07T03:35:21.206669+0000","last_became_active":"2024-09-07T03:32:18.132579+0000","last_became_peered":"2024-09-07T03:32:18.132579+0000","last_unstale":"2024-09-07T03:35:21.206669+0000","last_undegraded":"2024-09-07T03:35:21.206669+0000","last_fullsized":"2024-09-07T03:35:21.206669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:11:51.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272567+0000","last_change":"2024-09-07T03:32:20.141318+0000","last_active":"2024-09-07T03:32:50.272567+0000","last_peered":"2024-09-07T03:32:50.272567+0000","last_clean":"2024-09-07T03:32:50.272567+0000","last_became_active":"2024-09-07T03:32:20.141044+0000","last_became_peered":"2024-09-07T03:32:20.141044+0000","last_unstale":"2024-09-07T03:32:50.272567+0000","last_undegraded":"2024-09-07T03:32:50.272567+0000","last_fullsized":"2024-09-07T03:32:50.272567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:09:44.169617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.806191+0000","last_change":"2024-09-07T03:32:22.143631+0000","last_active":"2024-09-07T03:33:38.806191+0000","last_peered":"2024-09-07T03:33:38.806191+0000","last_clean":"2024-09-07T03:33:38.806191+0000","last_became_active":"2024-09-07T03:32:22.143337+0000","last_became_peered":"2024-09-07T03:32:22.143337+0000","last_unstale":"2024-09-07T03:33:38.806191+0000","last_undegraded":"2024-09-07T03:33:38.806191+0000","last_fullsized":"2024-09-07T03:33:38.806191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:30.421368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":64,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570852+0000","last_change":"2024-09-07T03:32:14.128064+0000","last_active":"2024-09-07T03:32:56.570852+0000","last_peered":"2024-09-07T03:32:56.570852+0000","last_clean":"2024-09-07T03:32:56.570852+0000","last_became_active":"2024-09-07T03:32:14.127288+0000","last_became_peered":"2024-09-07T03:32:14.127288+0000","last_unstale":"2024-09-07T03:32:56.570852+0000","last_undegraded":"2024-09-07T03:32:56.570852+0000","last_fullsized":"2024-09-07T03:32:56.570852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:43.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274315+0000","last_change":"2024-09-07T03:32:04.537641+0000","last_active":"2024-09-07T03:32:50.274315+0000","last_peered":"2024-09-07T03:32:50.274315+0000","last_clean":"2024-09-07T03:32:50.274315+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:32:50.274315+0000","last_undegraded":"2024-09-07T03:32:50.274315+0000","last_fullsized":"2024-09-07T03:32:50.274315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.563922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.975371+0000","last_change":"2024-09-07T03:32:12.139855+0000","last_active":"2024-09-07T03:33:38.975371+0000","last_peered":"2024-09-07T03:33:38.975371+0000","last_clean":"2024-09-07T03:33:38.975371+0000","last_became_active":"2024-09-07T03:32:12.139224+0000","last_became_peered":"2024-09-07T03:32:12.139224+0000","last_unstale":"2024-09-07T03:33:38.975371+0000","last_undegraded":"2024-09-07T03:33:38.975371+0000","last_fullsized":"2024-09-07T03:33:38.975371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:34.147142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279225+0000","last_change":"2024-09-07T03:32:16.122151+0000","last_active":"2024-09-07T03:32:50.279225+0000","last_peered":"2024-09-07T03:32:50.279225+0000","last_clean":"2024-09-07T03:32:50.279225+0000","last_became_active":"2024-09-07T03:32:16.121817+0000","last_became_peered":"2024-09-07T03:32:16.121817+0000","last_unstale":"2024-09-07T03:32:50.279225+0000","last_undegraded":"2024-09-07T03:32:50.279225+0000","last_fullsized":"2024-09-07T03:32:50.279225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:15.023249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206736+0000","last_change":"2024-09-07T03:32:18.129607+0000","last_active":"2024-09-07T03:35:21.206736+0000","last_peered":"2024-09-07T03:35:21.206736+0000","last_clean":"2024-09-07T03:35:21.206736+0000","last_became_active":"2024-09-07T03:32:18.129264+0000","last_became_peered":"2024-09-07T03:32:18.129264+0000","last_unstale":"2024-09-07T03:35:21.206736+0000","last_undegraded":"2024-09-07T03:35:21.206736+0000","last_fullsized":"2024-09-07T03:35:21.206736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:52:54.317892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472271+0000","last_change":"2024-09-07T03:32:20.143074+0000","last_active":"2024-09-07T03:32:50.472271+0000","last_peered":"2024-09-07T03:32:50.472271+0000","last_clean":"2024-09-07T03:32:50.472271+0000","last_became_active":"2024-09-07T03:32:20.142764+0000","last_became_peered":"2024-09-07T03:32:20.142764+0000","last_unstale":"2024-09-07T03:32:50.472271+0000","last_undegraded":"2024-09-07T03:32:50.472271+0000","last_fullsized":"2024-09-07T03:32:50.472271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:36.484446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272193+0000","last_change":"2024-09-07T03:32:22.147788+0000","last_active":"2024-09-07T03:32:50.272193+0000","last_peered":"2024-09-07T03:32:50.272193+0000","last_clean":"2024-09-07T03:32:50.272193+0000","last_became_active":"2024-09-07T03:32:22.147510+0000","last_became_peered":"2024-09-07T03:32:22.147510+0000","last_unstale":"2024-09-07T03:32:50.272193+0000","last_undegraded":"2024-09-07T03:32:50.272193+0000","last_fullsized":"2024-09-07T03:32:50.272193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:37.758327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473250+0000","last_change":"2024-09-07T03:32:14.114315+0000","last_active":"2024-09-07T03:32:50.473250+0000","last_peered":"2024-09-07T03:32:50.473250+0000","last_clean":"2024-09-07T03:32:50.473250+0000","last_became_active":"2024-09-07T03:32:14.113700+0000","last_became_peered":"2024-09-07T03:32:14.113700+0000","last_unstale":"2024-09-07T03:32:50.473250+0000","last_undegraded":"2024-09-07T03:32:50.473250+0000","last_fullsized":"2024-09-07T03:32:50.473250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:56:02.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279568+0000","last_change":"2024-09-07T03:32:04.539644+0000","last_active":"2024-09-07T03:32:50.279568+0000","last_peered":"2024-09-07T03:32:50.279568+0000","last_clean":"2024-09-07T03:32:50.279568+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:32:50.279568+0000","last_undegraded":"2024-09-07T03:32:50.279568+0000","last_fullsized":"2024-09-07T03:32:50.279568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:43.880721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.720142+0000","last_change":"2024-09-07T03:32:12.125645+0000","last_active":"2024-09-07T03:35:23.720142+0000","last_peered":"2024-09-07T03:35:23.720142+0000","last_clean":"2024-09-07T03:35:23.720142+0000","last_became_active":"2024-09-07T03:32:12.124390+0000","last_became_peered":"2024-09-07T03:32:12.124390+0000","last_unstale":"2024-09-07T03:35:23.720142+0000","last_undegraded":"2024-09-07T03:35:23.720142+0000","last_fullsized":"2024-09-07T03:35:23.720142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:47:53.230073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472348+0000","last_change":"2024-09-07T03:32:16.122130+0000","last_active":"2024-09-07T03:32:50.472348+0000","last_peered":"2024-09-07T03:32:50.472348+0000","last_clean":"2024-09-07T03:32:50.472348+0000","last_became_active":"2024-09-07T03:32:16.120933+0000","last_became_peered":"2024-09-07T03:32:16.120933+0000","last_unstale":"2024-09-07T03:32:50.472348+0000","last_undegraded":"2024-09-07T03:32:50.472348+0000","last_fullsized":"2024-09-07T03:32:50.472348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:16.466896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.988572+0000","last_change":"2024-09-07T03:32:18.130861+0000","last_active":"2024-09-07T03:35:22.988572+0000","last_peered":"2024-09-07T03:35:22.988572+0000","last_clean":"2024-09-07T03:35:22.988572+0000","last_became_active":"2024-09-07T03:32:18.130557+0000","last_became_peered":"2024-09-07T03:32:18.130557+0000","last_unstale":"2024-09-07T03:35:22.988572+0000","last_undegraded":"2024-09-07T03:35:22.988572+0000","last_fullsized":"2024-09-07T03:35:22.988572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:23:58.249870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276706+0000","last_change":"2024-09-07T03:32:20.143006+0000","last_active":"2024-09-07T03:32:50.276706+0000","last_peered":"2024-09-07T03:32:50.276706+0000","last_clean":"2024-09-07T03:32:50.276706+0000","last_became_active":"2024-09-07T03:32:20.142650+0000","last_became_peered":"2024-09-07T03:32:20.142650+0000","last_unstale":"2024-09-07T03:32:50.276706+0000","last_undegraded":"2024-09-07T03:32:50.276706+0000","last_fullsized":"2024-09-07T03:32:50.276706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:47.155034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.532509+0000","last_change":"2024-09-07T03:32:22.151470+0000","last_active":"2024-09-07T03:34:22.532509+0000","last_peered":"2024-09-07T03:34:22.532509+0000","last_clean":"2024-09-07T03:34:22.532509+0000","last_became_active":"2024-09-07T03:32:22.150981+0000","last_became_peered":"2024-09-07T03:32:22.150981+0000","last_unstale":"2024-09-07T03:34:22.532509+0000","last_undegraded":"2024-09-07T03:34:22.532509+0000","last_fullsized":"2024-09-07T03:34:22.532509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:09.757277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731323+0000","last_change":"2024-09-07T03:32:50.282510+0000","last_active":"2024-09-07T03:35:23.731323+0000","last_peered":"2024-09-07T03:35:23.731323+0000","last_clean":"2024-09-07T03:35:23.731323+0000","last_became_active":"2024-09-07T03:32:50.282108+0000","last_became_peered":"2024-09-07T03:32:50.282108+0000","last_unstale":"2024-09-07T03:35:23.731323+0000","last_undegraded":"2024-09-07T03:35:23.731323+0000","last_fullsized":"2024-09-07T03:35:23.731323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:00:33.202265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.561631+0000","last_change":"2024-09-07T03:32:12.121500+0000","last_active":"2024-09-07T03:32:56.561631+0000","last_peered":"2024-09-07T03:32:56.561631+0000","last_clean":"2024-09-07T03:32:56.561631+0000","last_became_active":"2024-09-07T03:32:12.121179+0000","last_became_peered":"2024-09-07T03:32:12.121179+0000","last_unstale":"2024-09-07T03:32:56.561631+0000","last_undegraded":"2024-09-07T03:32:56.561631+0000","last_fullsized":"2024-09-07T03:32:56.561631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:27:51.832052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472095+0000","last_change":"2024-09-07T03:32:04.541917+0000","last_active":"2024-09-07T03:32:50.472095+0000","last_peered":"2024-09-07T03:32:50.472095+0000","last_clean":"2024-09-07T03:32:50.472095+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:32:50.472095+0000","last_undegraded":"2024-09-07T03:32:50.472095+0000","last_fullsized":"2024-09-07T03:32:50.472095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:39:36.959986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.227451+0000","last_change":"2024-09-07T03:32:16.126538+0000","last_active":"2024-09-07T03:34:21.227451+0000","last_peered":"2024-09-07T03:34:21.227451+0000","last_clean":"2024-09-07T03:34:21.227451+0000","last_became_active":"2024-09-07T03:32:16.126273+0000","last_became_peered":"2024-09-07T03:32:16.126273+0000","last_unstale":"2024-09-07T03:34:21.227451+0000","last_undegraded":"2024-09-07T03:34:21.227451+0000","last_fullsized":"2024-09-07T03:34:21.227451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:12:07.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'74","reported_seq":146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.207266+0000","last_change":"2024-09-07T03:32:18.132985+0000","last_active":"2024-09-07T03:34:21.207266+0000","last_peered":"2024-09-07T03:34:21.207266+0000","last_clean":"2024-09-07T03:34:21.207266+0000","last_became_active":"2024-09-07T03:32:18.132654+0000","last_became_peered":"2024-09-07T03:32:18.132654+0000","last_unstale":"2024-09-07T03:34:21.207266+0000","last_undegraded":"2024-09-07T03:34:21.207266+0000","last_fullsized":"2024-09-07T03:34:21.207266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:58.124761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278034+0000","last_change":"2024-09-07T03:32:20.140348+0000","last_active":"2024-09-07T03:32:50.278034+0000","last_peered":"2024-09-07T03:32:50.278034+0000","last_clean":"2024-09-07T03:32:50.278034+0000","last_became_active":"2024-09-07T03:32:20.140025+0000","last_became_peered":"2024-09-07T03:32:20.140025+0000","last_unstale":"2024-09-07T03:32:50.278034+0000","last_undegraded":"2024-09-07T03:32:50.278034+0000","last_fullsized":"2024-09-07T03:32:50.278034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:18:53.690582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'13","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.873538+0000","last_change":"2024-09-07T03:32:22.140343+0000","last_active":"2024-09-07T03:34:22.873538+0000","last_peered":"2024-09-07T03:34:22.873538+0000","last_clean":"2024-09-07T03:34:22.873538+0000","last_became_active":"2024-09-07T03:32:22.140043+0000","last_became_peered":"2024-09-07T03:32:22.140043+0000","last_unstale":"2024-09-07T03:34:22.873538+0000","last_undegraded":"2024-09-07T03:34:22.873538+0000","last_fullsized":"2024-09-07T03:34:22.873538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:55.502696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'12","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806308+0000","last_change":"2024-09-07T03:32:14.126934+0000","last_active":"2024-09-07T03:35:23.806308+0000","last_peered":"2024-09-07T03:35:23.806308+0000","last_clean":"2024-09-07T03:35:23.806308+0000","last_became_active":"2024-09-07T03:32:14.126663+0000","last_became_peered":"2024-09-07T03:32:14.126663+0000","last_unstale":"2024-09-07T03:35:23.806308+0000","last_undegraded":"2024-09-07T03:35:23.806308+0000","last_fullsized":"2024-09-07T03:35:23.806308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:58:27.663426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"36'1","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:18.228700+0000","last_change":"2024-09-07T03:32:12.134479+0000","last_active":"2024-09-07T03:34:18.228700+0000","last_peered":"2024-09-07T03:34:18.228700+0000","last_clean":"2024-09-07T03:34:18.228700+0000","last_became_active":"2024-09-07T03:32:12.133974+0000","last_became_peered":"2024-09-07T03:32:12.133974+0000","last_unstale":"2024-09-07T03:34:18.228700+0000","last_undegraded":"2024-09-07T03:34:18.228700+0000","last_fullsized":"2024-09-07T03:34:18.228700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:03:12.017360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281965+0000","last_change":"2024-09-07T03:32:04.539029+0000","last_active":"2024-09-07T03:32:50.281965+0000","last_peered":"2024-09-07T03:32:50.281965+0000","last_clean":"2024-09-07T03:32:50.281965+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:32:50.281965+0000","last_undegraded":"2024-09-07T03:32:50.281965+0000","last_fullsized":"2024-09-07T03:32:50.281965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:37:36.714209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278673+0000","last_change":"2024-09-07T03:32:16.122232+0000","last_active":"2024-09-07T03:32:50.278673+0000","last_peered":"2024-09-07T03:32:50.278673+0000","last_clean":"2024-09-07T03:32:50.278673+0000","last_became_active":"2024-09-07T03:32:16.121921+0000","last_became_peered":"2024-09-07T03:32:16.121921+0000","last_unstale":"2024-09-07T03:32:50.278673+0000","last_undegraded":"2024-09-07T03:32:50.278673+0000","last_fullsized":"2024-09-07T03:32:50.278673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:01:24.806960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469770+0000","last_change":"2024-09-07T03:32:18.134018+0000","last_active":"2024-09-07T03:32:50.469770+0000","last_peered":"2024-09-07T03:32:50.469770+0000","last_clean":"2024-09-07T03:32:50.469770+0000","last_became_active":"2024-09-07T03:32:18.133689+0000","last_became_peered":"2024-09-07T03:32:18.133689+0000","last_unstale":"2024-09-07T03:32:50.469770+0000","last_undegraded":"2024-09-07T03:32:50.469770+0000","last_fullsized":"2024-09-07T03:32:50.469770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:16.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":347,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206656+0000","last_change":"2024-09-07T03:32:20.143562+0000","last_active":"2024-09-07T03:35:21.206656+0000","last_peered":"2024-09-07T03:35:21.206656+0000","last_clean":"2024-09-07T03:35:21.206656+0000","last_became_active":"2024-09-07T03:32:20.143293+0000","last_became_peered":"2024-09-07T03:32:20.143293+0000","last_unstale":"2024-09-07T03:35:21.206656+0000","last_undegraded":"2024-09-07T03:35:21.206656+0000","last_fullsized":"2024-09-07T03:35:21.206656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:51.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273729+0000","last_change":"2024-09-07T03:32:22.147306+0000","last_active":"2024-09-07T03:32:50.273729+0000","last_peered":"2024-09-07T03:32:50.273729+0000","last_clean":"2024-09-07T03:32:50.273729+0000","last_became_active":"2024-09-07T03:32:22.147036+0000","last_became_peered":"2024-09-07T03:32:22.147036+0000","last_unstale":"2024-09-07T03:32:50.273729+0000","last_undegraded":"2024-09-07T03:32:50.273729+0000","last_fullsized":"2024-09-07T03:32:50.273729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:02.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.477342+0000","last_change":"2024-09-07T03:32:14.127131+0000","last_active":"2024-09-07T03:35:23.477342+0000","last_peered":"2024-09-07T03:35:23.477342+0000","last_clean":"2024-09-07T03:35:23.477342+0000","last_became_active":"2024-09-07T03:32:14.126350+0000","last_became_peered":"2024-09-07T03:32:14.126350+0000","last_unstale":"2024-09-07T03:35:23.477342+0000","last_undegraded":"2024-09-07T03:35:23.477342+0000","last_fullsized":"2024-09-07T03:35:23.477342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:48:39.075361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276350+0000","last_change":"2024-09-07T03:32:12.130912+0000","last_active":"2024-09-07T03:32:50.276350+0000","last_peered":"2024-09-07T03:32:50.276350+0000","last_clean":"2024-09-07T03:32:50.276350+0000","last_became_active":"2024-09-07T03:32:12.130058+0000","last_became_peered":"2024-09-07T03:32:12.130058+0000","last_unstale":"2024-09-07T03:32:50.276350+0000","last_undegraded":"2024-09-07T03:32:50.276350+0000","last_fullsized":"2024-09-07T03:32:50.276350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:39:14.276282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472091+0000","last_change":"2024-09-07T03:32:04.542033+0000","last_active":"2024-09-07T03:32:50.472091+0000","last_peered":"2024-09-07T03:32:50.472091+0000","last_clean":"2024-09-07T03:32:50.472091+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:32:50.472091+0000","last_undegraded":"2024-09-07T03:32:50.472091+0000","last_fullsized":"2024-09-07T03:32:50.472091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:18:29.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279335+0000","last_change":"2024-09-07T03:32:16.117328+0000","last_active":"2024-09-07T03:32:50.279335+0000","last_peered":"2024-09-07T03:32:50.279335+0000","last_clean":"2024-09-07T03:32:50.279335+0000","last_became_active":"2024-09-07T03:32:16.117025+0000","last_became_peered":"2024-09-07T03:32:16.117025+0000","last_unstale":"2024-09-07T03:32:50.279335+0000","last_undegraded":"2024-09-07T03:32:50.279335+0000","last_fullsized":"2024-09-07T03:32:50.279335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:43:01.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273099+0000","last_change":"2024-09-07T03:32:18.124974+0000","last_active":"2024-09-07T03:32:50.273099+0000","last_peered":"2024-09-07T03:32:50.273099+0000","last_clean":"2024-09-07T03:32:50.273099+0000","last_became_active":"2024-09-07T03:32:18.124641+0000","last_became_peered":"2024-09-07T03:32:18.124641+0000","last_unstale":"2024-09-07T03:32:50.273099+0000","last_undegraded":"2024-09-07T03:32:50.273099+0000","last_fullsized":"2024-09-07T03:32:50.273099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:36:49.839182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":390,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.058717+0000","last_change":"2024-09-07T03:32:20.149232+0000","last_active":"2024-09-07T03:35:24.058717+0000","last_peered":"2024-09-07T03:35:24.058717+0000","last_clean":"2024-09-07T03:35:24.058717+0000","last_became_active":"2024-09-07T03:32:20.148768+0000","last_became_peered":"2024-09-07T03:32:20.148768+0000","last_unstale":"2024-09-07T03:35:24.058717+0000","last_undegraded":"2024-09-07T03:35:24.058717+0000","last_fullsized":"2024-09-07T03:35:24.058717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:15:20.986169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470656+0000","last_change":"2024-09-07T03:32:22.148714+0000","last_active":"2024-09-07T03:32:50.470656+0000","last_peered":"2024-09-07T03:32:50.470656+0000","last_clean":"2024-09-07T03:32:50.470656+0000","last_became_active":"2024-09-07T03:32:22.148444+0000","last_became_peered":"2024-09-07T03:32:22.148444+0000","last_unstale":"2024-09-07T03:32:50.470656+0000","last_undegraded":"2024-09-07T03:32:50.470656+0000","last_fullsized":"2024-09-07T03:32:50.470656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:23.271638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.588175+0000","last_change":"2024-09-07T03:32:14.113991+0000","last_active":"2024-09-07T03:35:23.588175+0000","last_peered":"2024-09-07T03:35:23.588175+0000","last_clean":"2024-09-07T03:35:23.588175+0000","last_became_active":"2024-09-07T03:32:14.113077+0000","last_became_peered":"2024-09-07T03:32:14.113077+0000","last_unstale":"2024-09-07T03:35:23.588175+0000","last_undegraded":"2024-09-07T03:35:23.588175+0000","last_fullsized":"2024-09-07T03:35:23.588175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:14:51.585905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.717209+0000","last_change":"2024-09-07T03:32:12.124748+0000","last_active":"2024-09-07T03:35:23.717209+0000","last_peered":"2024-09-07T03:35:23.717209+0000","last_clean":"2024-09-07T03:35:23.717209+0000","last_became_active":"2024-09-07T03:32:12.124398+0000","last_became_peered":"2024-09-07T03:32:12.124398+0000","last_unstale":"2024-09-07T03:35:23.717209+0000","last_undegraded":"2024-09-07T03:35:23.717209+0000","last_fullsized":"2024-09-07T03:35:23.717209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:59:37.231002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282690+0000","last_change":"2024-09-07T03:32:04.539724+0000","last_active":"2024-09-07T03:32:50.282690+0000","last_peered":"2024-09-07T03:32:50.282690+0000","last_clean":"2024-09-07T03:32:50.282690+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:32:50.282690+0000","last_undegraded":"2024-09-07T03:32:50.282690+0000","last_fullsized":"2024-09-07T03:32:50.282690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:55:55.896127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273091+0000","last_change":"2024-09-07T03:32:16.130854+0000","last_active":"2024-09-07T03:32:50.273091+0000","last_peered":"2024-09-07T03:32:50.273091+0000","last_clean":"2024-09-07T03:32:50.273091+0000","last_became_active":"2024-09-07T03:32:16.130091+0000","last_became_peered":"2024-09-07T03:32:16.130091+0000","last_unstale":"2024-09-07T03:32:50.273091+0000","last_undegraded":"2024-09-07T03:32:50.273091+0000","last_fullsized":"2024-09-07T03:32:50.273091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:20.097492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'88","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.192213+0000","last_change":"2024-09-07T03:32:18.132376+0000","last_active":"2024-09-07T03:34:21.192213+0000","last_peered":"2024-09-07T03:34:21.192213+0000","last_clean":"2024-09-07T03:34:21.192213+0000","last_became_active":"2024-09-07T03:32:18.132111+0000","last_became_peered":"2024-09-07T03:32:18.132111+0000","last_unstale":"2024-09-07T03:34:21.192213+0000","last_undegraded":"2024-09-07T03:34:21.192213+0000","last_fullsized":"2024-09-07T03:34:21.192213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272816+0000","last_change":"2024-09-07T03:32:20.143405+0000","last_active":"2024-09-07T03:32:50.272816+0000","last_peered":"2024-09-07T03:32:50.272816+0000","last_clean":"2024-09-07T03:32:50.272816+0000","last_became_active":"2024-09-07T03:32:20.143072+0000","last_became_peered":"2024-09-07T03:32:20.143072+0000","last_unstale":"2024-09-07T03:32:50.272816+0000","last_undegraded":"2024-09-07T03:32:50.272816+0000","last_fullsized":"2024-09-07T03:32:50.272816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:35:06.275781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276617+0000","last_change":"2024-09-07T03:32:22.139462+0000","last_active":"2024-09-07T03:32:50.276617+0000","last_peered":"2024-09-07T03:32:50.276617+0000","last_clean":"2024-09-07T03:32:50.276617+0000","last_became_active":"2024-09-07T03:32:22.139150+0000","last_became_peered":"2024-09-07T03:32:22.139150+0000","last_unstale":"2024-09-07T03:32:50.276617+0000","last_undegraded":"2024-09-07T03:32:50.276617+0000","last_fullsized":"2024-09-07T03:32:50.276617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:16:29.302047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275974+0000","last_change":"2024-09-07T03:32:22.138596+0000","last_active":"2024-09-07T03:32:50.275974+0000","last_peered":"2024-09-07T03:32:50.275974+0000","last_clean":"2024-09-07T03:32:50.275974+0000","last_became_active":"2024-09-07T03:32:22.138315+0000","last_became_peered":"2024-09-07T03:32:22.138315+0000","last_unstale":"2024-09-07T03:32:50.275974+0000","last_undegraded":"2024-09-07T03:32:50.275974+0000","last_fullsized":"2024-09-07T03:32:50.275974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:54:59.992625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435487+0000","last_change":"2024-09-07T03:32:14.113374+0000","last_active":"2024-09-07T03:34:19.435487+0000","last_peered":"2024-09-07T03:34:19.435487+0000","last_clean":"2024-09-07T03:34:19.435487+0000","last_became_active":"2024-09-07T03:32:14.112744+0000","last_became_peered":"2024-09-07T03:32:14.112744+0000","last_unstale":"2024-09-07T03:34:19.435487+0000","last_undegraded":"2024-09-07T03:34:19.435487+0000","last_fullsized":"2024-09-07T03:34:19.435487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:58.377074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'5","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.790736+0000","last_change":"2024-09-07T03:32:12.133214+0000","last_active":"2024-09-07T03:33:38.790736+0000","last_peered":"2024-09-07T03:33:38.790736+0000","last_clean":"2024-09-07T03:33:38.790736+0000","last_became_active":"2024-09-07T03:32:12.132715+0000","last_became_peered":"2024-09-07T03:32:12.132715+0000","last_unstale":"2024-09-07T03:33:38.790736+0000","last_undegraded":"2024-09-07T03:33:38.790736+0000","last_fullsized":"2024-09-07T03:33:38.790736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:43.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470337+0000","last_change":"2024-09-07T03:32:16.125307+0000","last_active":"2024-09-07T03:32:50.470337+0000","last_peered":"2024-09-07T03:32:50.470337+0000","last_clean":"2024-09-07T03:32:50.470337+0000","last_became_active":"2024-09-07T03:32:16.124681+0000","last_became_peered":"2024-09-07T03:32:16.124681+0000","last_unstale":"2024-09-07T03:32:50.470337+0000","last_undegraded":"2024-09-07T03:32:50.470337+0000","last_fullsized":"2024-09-07T03:32:50.470337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:30.622001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.198553+0000","last_change":"2024-09-07T03:32:18.134183+0000","last_active":"2024-09-07T03:34:21.198553+0000","last_peered":"2024-09-07T03:34:21.198553+0000","last_clean":"2024-09-07T03:34:21.198553+0000","last_became_active":"2024-09-07T03:32:18.133844+0000","last_became_peered":"2024-09-07T03:32:18.133844+0000","last_unstale":"2024-09-07T03:34:21.198553+0000","last_undegraded":"2024-09-07T03:34:21.198553+0000","last_fullsized":"2024-09-07T03:34:21.198553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:10:39.060137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271616+0000","last_change":"2024-09-07T03:32:20.149175+0000","last_active":"2024-09-07T03:32:50.271616+0000","last_peered":"2024-09-07T03:32:50.271616+0000","last_clean":"2024-09-07T03:32:50.271616+0000","last_became_active":"2024-09-07T03:32:20.148900+0000","last_became_peered":"2024-09-07T03:32:20.148900+0000","last_unstale":"2024-09-07T03:32:50.271616+0000","last_undegraded":"2024-09-07T03:32:50.271616+0000","last_fullsized":"2024-09-07T03:32:50.271616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:25.130015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:20.895399+0000","last_change":"2024-09-07T03:32:22.150451+0000","last_active":"2024-09-07T03:34:20.895399+0000","last_peered":"2024-09-07T03:34:20.895399+0000","last_clean":"2024-09-07T03:34:20.895399+0000","last_became_active":"2024-09-07T03:32:22.150168+0000","last_became_peered":"2024-09-07T03:32:22.150168+0000","last_unstale":"2024-09-07T03:34:20.895399+0000","last_undegraded":"2024-09-07T03:34:20.895399+0000","last_fullsized":"2024-09-07T03:34:20.895399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:01:52.113292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985573+0000","last_change":"2024-09-07T03:32:14.111906+0000","last_active":"2024-09-07T03:33:38.985573+0000","last_peered":"2024-09-07T03:33:38.985573+0000","last_clean":"2024-09-07T03:33:38.985573+0000","last_became_active":"2024-09-07T03:32:14.111499+0000","last_became_peered":"2024-09-07T03:32:14.111499+0000","last_unstale":"2024-09-07T03:33:38.985573+0000","last_undegraded":"2024-09-07T03:33:38.985573+0000","last_fullsized":"2024-09-07T03:33:38.985573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:32.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276787+0000","last_change":"2024-09-07T03:32:12.129260+0000","last_active":"2024-09-07T03:32:50.276787+0000","last_peered":"2024-09-07T03:32:50.276787+0000","last_clean":"2024-09-07T03:32:50.276787+0000","last_became_active":"2024-09-07T03:32:12.128737+0000","last_became_peered":"2024-09-07T03:32:12.128737+0000","last_unstale":"2024-09-07T03:32:50.276787+0000","last_undegraded":"2024-09-07T03:32:50.276787+0000","last_fullsized":"2024-09-07T03:32:50.276787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:32.673872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272857+0000","last_change":"2024-09-07T03:32:16.125714+0000","last_active":"2024-09-07T03:32:50.272857+0000","last_peered":"2024-09-07T03:32:50.272857+0000","last_clean":"2024-09-07T03:32:50.272857+0000","last_became_active":"2024-09-07T03:32:16.125418+0000","last_became_peered":"2024-09-07T03:32:16.125418+0000","last_unstale":"2024-09-07T03:32:50.272857+0000","last_undegraded":"2024-09-07T03:32:50.272857+0000","last_fullsized":"2024-09-07T03:32:50.272857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:50:42.403817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.992476+0000","last_change":"2024-09-07T03:32:18.134208+0000","last_active":"2024-09-07T03:35:22.992476+0000","last_peered":"2024-09-07T03:35:22.992476+0000","last_clean":"2024-09-07T03:35:22.992476+0000","last_became_active":"2024-09-07T03:32:18.133770+0000","last_became_peered":"2024-09-07T03:32:18.133770+0000","last_unstale":"2024-09-07T03:35:22.992476+0000","last_undegraded":"2024-09-07T03:35:22.992476+0000","last_fullsized":"2024-09-07T03:35:22.992476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:01:16.182582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276619+0000","last_change":"2024-09-07T03:32:20.142736+0000","last_active":"2024-09-07T03:32:50.276619+0000","last_peered":"2024-09-07T03:32:50.276619+0000","last_clean":"2024-09-07T03:32:50.276619+0000","last_became_active":"2024-09-07T03:32:20.140729+0000","last_became_peered":"2024-09-07T03:32:20.140729+0000","last_unstale":"2024-09-07T03:32:50.276619+0000","last_undegraded":"2024-09-07T03:32:50.276619+0000","last_fullsized":"2024-09-07T03:32:50.276619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:48:10.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471241+0000","last_change":"2024-09-07T03:32:22.147660+0000","last_active":"2024-09-07T03:32:50.471241+0000","last_peered":"2024-09-07T03:32:50.471241+0000","last_clean":"2024-09-07T03:32:50.471241+0000","last_became_active":"2024-09-07T03:32:22.147374+0000","last_became_peered":"2024-09-07T03:32:22.147374+0000","last_unstale":"2024-09-07T03:32:50.471241+0000","last_undegraded":"2024-09-07T03:32:50.471241+0000","last_fullsized":"2024-09-07T03:32:50.471241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:06.728131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843420+0000","last_change":"2024-09-07T03:32:14.123487+0000","last_active":"2024-09-07T03:35:23.843420+0000","last_peered":"2024-09-07T03:35:23.843420+0000","last_clean":"2024-09-07T03:35:23.843420+0000","last_became_active":"2024-09-07T03:32:14.123172+0000","last_became_peered":"2024-09-07T03:32:14.123172+0000","last_unstale":"2024-09-07T03:35:23.843420+0000","last_undegraded":"2024-09-07T03:35:23.843420+0000","last_fullsized":"2024-09-07T03:35:23.843420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.426207+0000","last_change":"2024-09-07T03:32:12.125531+0000","last_active":"2024-09-07T03:34:19.426207+0000","last_peered":"2024-09-07T03:34:19.426207+0000","last_clean":"2024-09-07T03:34:19.426207+0000","last_became_active":"2024-09-07T03:32:12.124180+0000","last_became_peered":"2024-09-07T03:32:12.124180+0000","last_unstale":"2024-09-07T03:34:19.426207+0000","last_undegraded":"2024-09-07T03:34:19.426207+0000","last_fullsized":"2024-09-07T03:34:19.426207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:41.435390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277690+0000","last_change":"2024-09-07T03:32:16.124337+0000","last_active":"2024-09-07T03:32:50.277690+0000","last_peered":"2024-09-07T03:32:50.277690+0000","last_clean":"2024-09-07T03:32:50.277690+0000","last_became_active":"2024-09-07T03:32:16.123695+0000","last_became_peered":"2024-09-07T03:32:16.123695+0000","last_unstale":"2024-09-07T03:32:50.277690+0000","last_undegraded":"2024-09-07T03:32:50.277690+0000","last_fullsized":"2024-09-07T03:32:50.277690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:12:34.370044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'41","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.224381+0000","last_change":"2024-09-07T03:32:18.129794+0000","last_active":"2024-09-07T03:35:23.224381+0000","last_peered":"2024-09-07T03:35:23.224381+0000","last_clean":"2024-09-07T03:35:23.224381+0000","last_became_active":"2024-09-07T03:32:18.129502+0000","last_became_peered":"2024-09-07T03:32:18.129502+0000","last_unstale":"2024-09-07T03:35:23.224381+0000","last_undegraded":"2024-09-07T03:35:23.224381+0000","last_fullsized":"2024-09-07T03:35:23.224381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:35:55.771599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":65,"num_write":48,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470189+0000","last_change":"2024-09-07T03:32:20.147965+0000","last_active":"2024-09-07T03:32:50.470189+0000","last_peered":"2024-09-07T03:32:50.470189+0000","last_clean":"2024-09-07T03:32:50.470189+0000","last_became_active":"2024-09-07T03:32:20.147588+0000","last_became_peered":"2024-09-07T03:32:20.147588+0000","last_unstale":"2024-09-07T03:32:50.470189+0000","last_undegraded":"2024-09-07T03:32:50.470189+0000","last_fullsized":"2024-09-07T03:32:50.470189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:33:20.522441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.433021+0000","last_change":"2024-09-07T03:32:22.146381+0000","last_active":"2024-09-07T03:34:19.433021+0000","last_peered":"2024-09-07T03:34:19.433021+0000","last_clean":"2024-09-07T03:34:19.433021+0000","last_became_active":"2024-09-07T03:32:22.146106+0000","last_became_peered":"2024-09-07T03:32:22.146106+0000","last_unstale":"2024-09-07T03:34:19.433021+0000","last_undegraded":"2024-09-07T03:34:19.433021+0000","last_fullsized":"2024-09-07T03:34:19.433021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:05:28.655126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.025001+0000","last_change":"2024-09-07T03:32:14.128094+0000","last_active":"2024-09-07T03:32:57.025001+0000","last_peered":"2024-09-07T03:32:57.025001+0000","last_clean":"2024-09-07T03:32:57.025001+0000","last_became_active":"2024-09-07T03:32:14.127334+0000","last_became_peered":"2024-09-07T03:32:14.127334+0000","last_unstale":"2024-09-07T03:32:57.025001+0000","last_undegraded":"2024-09-07T03:32:57.025001+0000","last_fullsized":"2024-09-07T03:32:57.025001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:23:03.931202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472920+0000","last_change":"2024-09-07T03:32:12.138270+0000","last_active":"2024-09-07T03:32:50.472920+0000","last_peered":"2024-09-07T03:32:50.472920+0000","last_clean":"2024-09-07T03:32:50.472920+0000","last_became_active":"2024-09-07T03:32:12.134823+0000","last_became_peered":"2024-09-07T03:32:12.134823+0000","last_unstale":"2024-09-07T03:32:50.472920+0000","last_undegraded":"2024-09-07T03:32:50.472920+0000","last_fullsized":"2024-09-07T03:32:50.472920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:01:11.999538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271764+0000","last_change":"2024-09-07T03:32:16.127981+0000","last_active":"2024-09-07T03:32:50.271764+0000","last_peered":"2024-09-07T03:32:50.271764+0000","last_clean":"2024-09-07T03:32:50.271764+0000","last_became_active":"2024-09-07T03:32:16.127615+0000","last_became_peered":"2024-09-07T03:32:16.127615+0000","last_unstale":"2024-09-07T03:32:50.271764+0000","last_undegraded":"2024-09-07T03:32:50.271764+0000","last_fullsized":"2024-09-07T03:32:50.271764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:04.434836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'31","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:41.232348+0000","last_change":"2024-09-07T03:32:18.130169+0000","last_active":"2024-09-07T03:34:41.232348+0000","last_peered":"2024-09-07T03:34:41.232348+0000","last_clean":"2024-09-07T03:34:41.232348+0000","last_became_active":"2024-09-07T03:32:18.129919+0000","last_became_peered":"2024-09-07T03:32:18.129919+0000","last_unstale":"2024-09-07T03:34:41.232348+0000","last_undegraded":"2024-09-07T03:34:41.232348+0000","last_fullsized":"2024-09-07T03:34:41.232348+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:09.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275040+0000","last_change":"2024-09-07T03:32:20.145306+0000","last_active":"2024-09-07T03:32:50.275040+0000","last_peered":"2024-09-07T03:32:50.275040+0000","last_clean":"2024-09-07T03:32:50.275040+0000","last_became_active":"2024-09-07T03:32:20.143640+0000","last_became_peered":"2024-09-07T03:32:20.143640+0000","last_unstale":"2024-09-07T03:32:50.275040+0000","last_undegraded":"2024-09-07T03:32:50.275040+0000","last_fullsized":"2024-09-07T03:32:50.275040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:24:26.189411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282148+0000","last_change":"2024-09-07T03:32:14.123340+0000","last_active":"2024-09-07T03:32:50.282148+0000","last_peered":"2024-09-07T03:32:50.282148+0000","last_clean":"2024-09-07T03:32:50.282148+0000","last_became_active":"2024-09-07T03:32:14.123017+0000","last_became_peered":"2024-09-07T03:32:14.123017+0000","last_unstale":"2024-09-07T03:32:50.282148+0000","last_undegraded":"2024-09-07T03:32:50.282148+0000","last_fullsized":"2024-09-07T03:32:50.282148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:08.821201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271902+0000","last_change":"2024-09-07T03:32:12.144026+0000","last_active":"2024-09-07T03:32:50.271902+0000","last_peered":"2024-09-07T03:32:50.271902+0000","last_clean":"2024-09-07T03:32:50.271902+0000","last_became_active":"2024-09-07T03:32:12.143142+0000","last_became_peered":"2024-09-07T03:32:12.143142+0000","last_unstale":"2024-09-07T03:32:50.271902+0000","last_undegraded":"2024-09-07T03:32:50.271902+0000","last_fullsized":"2024-09-07T03:32:50.271902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:13:08.497889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471726+0000","last_change":"2024-09-07T03:32:16.124471+0000","last_active":"2024-09-07T03:32:50.471726+0000","last_peered":"2024-09-07T03:32:50.471726+0000","last_clean":"2024-09-07T03:32:50.471726+0000","last_became_active":"2024-09-07T03:32:16.124188+0000","last_became_peered":"2024-09-07T03:32:16.124188+0000","last_unstale":"2024-09-07T03:32:50.471726+0000","last_undegraded":"2024-09-07T03:32:50.471726+0000","last_fullsized":"2024-09-07T03:32:50.471726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:20.601144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'60","reported_seq":123,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.205167+0000","last_change":"2024-09-07T03:32:18.127241+0000","last_active":"2024-09-07T03:34:21.205167+0000","last_peered":"2024-09-07T03:34:21.205167+0000","last_clean":"2024-09-07T03:34:21.205167+0000","last_became_active":"2024-09-07T03:32:18.126946+0000","last_became_peered":"2024-09-07T03:32:18.126946+0000","last_unstale":"2024-09-07T03:34:21.205167+0000","last_undegraded":"2024-09-07T03:34:21.205167+0000","last_fullsized":"2024-09-07T03:34:21.205167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:12:23.096494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275569+0000","last_change":"2024-09-07T03:32:20.144697+0000","last_active":"2024-09-07T03:32:50.275569+0000","last_peered":"2024-09-07T03:32:50.275569+0000","last_clean":"2024-09-07T03:32:50.275569+0000","last_became_active":"2024-09-07T03:32:20.144417+0000","last_became_peered":"2024-09-07T03:32:20.144417+0000","last_unstale":"2024-09-07T03:32:50.275569+0000","last_undegraded":"2024-09-07T03:32:50.275569+0000","last_fullsized":"2024-09-07T03:32:50.275569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:37:54.709062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'16","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.592808+0000","last_change":"2024-09-07T03:32:22.149726+0000","last_active":"2024-09-07T03:35:23.592808+0000","last_peered":"2024-09-07T03:35:23.592808+0000","last_clean":"2024-09-07T03:35:23.592808+0000","last_became_active":"2024-09-07T03:32:22.149442+0000","last_became_peered":"2024-09-07T03:32:22.149442+0000","last_unstale":"2024-09-07T03:35:23.592808+0000","last_undegraded":"2024-09-07T03:35:23.592808+0000","last_fullsized":"2024-09-07T03:35:23.592808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:25.687323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'9","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.849698+0000","last_change":"2024-09-07T03:32:14.114246+0000","last_active":"2024-09-07T03:35:23.849698+0000","last_peered":"2024-09-07T03:35:23.849698+0000","last_clean":"2024-09-07T03:35:23.849698+0000","last_became_active":"2024-09-07T03:32:14.111795+0000","last_became_peered":"2024-09-07T03:32:14.111795+0000","last_unstale":"2024-09-07T03:35:23.849698+0000","last_undegraded":"2024-09-07T03:35:23.849698+0000","last_fullsized":"2024-09-07T03:35:23.849698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:41:31.009147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470018+0000","last_change":"2024-09-07T03:32:12.136641+0000","last_active":"2024-09-07T03:32:50.470018+0000","last_peered":"2024-09-07T03:32:50.470018+0000","last_clean":"2024-09-07T03:32:50.470018+0000","last_became_active":"2024-09-07T03:32:12.136258+0000","last_became_peered":"2024-09-07T03:32:12.136258+0000","last_unstale":"2024-09-07T03:32:50.470018+0000","last_undegraded":"2024-09-07T03:32:50.470018+0000","last_fullsized":"2024-09-07T03:32:50.470018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:19:06.594103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281863+0000","last_change":"2024-09-07T03:32:16.122569+0000","last_active":"2024-09-07T03:32:50.281863+0000","last_peered":"2024-09-07T03:32:50.281863+0000","last_clean":"2024-09-07T03:32:50.281863+0000","last_became_active":"2024-09-07T03:32:16.122316+0000","last_became_peered":"2024-09-07T03:32:16.122316+0000","last_unstale":"2024-09-07T03:32:50.281863+0000","last_undegraded":"2024-09-07T03:32:50.281863+0000","last_fullsized":"2024-09-07T03:32:50.281863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:09:15.334063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.184504+0000","last_change":"2024-09-07T03:32:18.132401+0000","last_active":"2024-09-07T03:34:21.184504+0000","last_peered":"2024-09-07T03:34:21.184504+0000","last_clean":"2024-09-07T03:34:21.184504+0000","last_became_active":"2024-09-07T03:32:18.132084+0000","last_became_peered":"2024-09-07T03:32:18.132084+0000","last_unstale":"2024-09-07T03:34:21.184504+0000","last_undegraded":"2024-09-07T03:34:21.184504+0000","last_fullsized":"2024-09-07T03:34:21.184504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:21:08.328913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471012+0000","last_change":"2024-09-07T03:32:20.143643+0000","last_active":"2024-09-07T03:32:50.471012+0000","last_peered":"2024-09-07T03:32:50.471012+0000","last_clean":"2024-09-07T03:32:50.471012+0000","last_became_active":"2024-09-07T03:32:20.143377+0000","last_became_peered":"2024-09-07T03:32:20.143377+0000","last_unstale":"2024-09-07T03:32:50.471012+0000","last_undegraded":"2024-09-07T03:32:50.471012+0000","last_fullsized":"2024-09-07T03:32:50.471012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:11.431453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278297+0000","last_change":"2024-09-07T03:32:22.146527+0000","last_active":"2024-09-07T03:32:50.278297+0000","last_peered":"2024-09-07T03:32:50.278297+0000","last_clean":"2024-09-07T03:32:50.278297+0000","last_became_active":"2024-09-07T03:32:22.146237+0000","last_became_peered":"2024-09-07T03:32:22.146237+0000","last_unstale":"2024-09-07T03:32:50.278297+0000","last_undegraded":"2024-09-07T03:32:50.278297+0000","last_fullsized":"2024-09-07T03:32:50.278297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:13:05.478773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570991+0000","last_change":"2024-09-07T03:32:14.126016+0000","last_active":"2024-09-07T03:32:56.570991+0000","last_peered":"2024-09-07T03:32:56.570991+0000","last_clean":"2024-09-07T03:32:56.570991+0000","last_became_active":"2024-09-07T03:32:14.125706+0000","last_became_peered":"2024-09-07T03:32:14.125706+0000","last_unstale":"2024-09-07T03:32:56.570991+0000","last_undegraded":"2024-09-07T03:32:56.570991+0000","last_fullsized":"2024-09-07T03:32:56.570991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.726613+0000","last_change":"2024-09-07T03:32:12.126028+0000","last_active":"2024-09-07T03:35:23.726613+0000","last_peered":"2024-09-07T03:35:23.726613+0000","last_clean":"2024-09-07T03:35:23.726613+0000","last_became_active":"2024-09-07T03:32:12.125261+0000","last_became_peered":"2024-09-07T03:32:12.125261+0000","last_unstale":"2024-09-07T03:35:23.726613+0000","last_undegraded":"2024-09-07T03:35:23.726613+0000","last_fullsized":"2024-09-07T03:35:23.726613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:30.313501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280234+0000","last_change":"2024-09-07T03:32:16.124615+0000","last_active":"2024-09-07T03:32:50.280234+0000","last_peered":"2024-09-07T03:32:50.280234+0000","last_clean":"2024-09-07T03:32:50.280234+0000","last_became_active":"2024-09-07T03:32:16.124314+0000","last_became_peered":"2024-09-07T03:32:16.124314+0000","last_unstale":"2024-09-07T03:32:50.280234+0000","last_undegraded":"2024-09-07T03:32:50.280234+0000","last_fullsized":"2024-09-07T03:32:50.280234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:44:43.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'38","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.202886+0000","last_change":"2024-09-07T03:32:18.129996+0000","last_active":"2024-09-07T03:34:21.202886+0000","last_peered":"2024-09-07T03:34:21.202886+0000","last_clean":"2024-09-07T03:34:21.202886+0000","last_became_active":"2024-09-07T03:32:18.129700+0000","last_became_peered":"2024-09-07T03:32:18.129700+0000","last_unstale":"2024-09-07T03:34:21.202886+0000","last_undegraded":"2024-09-07T03:34:21.202886+0000","last_fullsized":"2024-09-07T03:34:21.202886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:38:03.778044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471615+0000","last_change":"2024-09-07T03:32:20.142983+0000","last_active":"2024-09-07T03:32:50.471615+0000","last_peered":"2024-09-07T03:32:50.471615+0000","last_clean":"2024-09-07T03:32:50.471615+0000","last_became_active":"2024-09-07T03:32:20.142695+0000","last_became_peered":"2024-09-07T03:32:20.142695+0000","last_unstale":"2024-09-07T03:32:50.471615+0000","last_undegraded":"2024-09-07T03:32:50.471615+0000","last_fullsized":"2024-09-07T03:32:50.471615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:29.846270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.959036+0000","last_change":"2024-09-07T03:32:22.143270+0000","last_active":"2024-09-07T03:34:22.959036+0000","last_peered":"2024-09-07T03:34:22.959036+0000","last_clean":"2024-09-07T03:34:22.959036+0000","last_became_active":"2024-09-07T03:32:22.143053+0000","last_became_peered":"2024-09-07T03:32:22.143053+0000","last_unstale":"2024-09-07T03:34:22.959036+0000","last_undegraded":"2024-09-07T03:34:22.959036+0000","last_fullsized":"2024-09-07T03:34:22.959036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:05:14.463803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'12","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843581+0000","last_change":"2024-09-07T03:32:14.117890+0000","last_active":"2024-09-07T03:35:23.843581+0000","last_peered":"2024-09-07T03:35:23.843581+0000","last_clean":"2024-09-07T03:35:23.843581+0000","last_became_active":"2024-09-07T03:32:14.117608+0000","last_became_peered":"2024-09-07T03:32:14.117608+0000","last_unstale":"2024-09-07T03:35:23.843581+0000","last_undegraded":"2024-09-07T03:35:23.843581+0000","last_fullsized":"2024-09-07T03:35:23.843581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:50:58.423715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275329+0000","last_change":"2024-09-07T03:32:12.135875+0000","last_active":"2024-09-07T03:32:50.275329+0000","last_peered":"2024-09-07T03:32:50.275329+0000","last_clean":"2024-09-07T03:32:50.275329+0000","last_became_active":"2024-09-07T03:32:12.135523+0000","last_became_peered":"2024-09-07T03:32:12.135523+0000","last_unstale":"2024-09-07T03:32:50.275329+0000","last_undegraded":"2024-09-07T03:32:50.275329+0000","last_fullsized":"2024-09-07T03:32:50.275329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:35.883059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:51.215438+0000","last_change":"2024-09-07T03:32:50.279386+0000","last_active":"2024-09-07T03:32:51.215438+0000","last_peered":"2024-09-07T03:32:51.215438+0000","last_clean":"2024-09-07T03:32:51.215438+0000","last_became_active":"2024-09-07T03:32:50.279004+0000","last_became_peered":"2024-09-07T03:32:50.279004+0000","last_unstale":"2024-09-07T03:32:51.215438+0000","last_undegraded":"2024-09-07T03:32:51.215438+0000","last_fullsized":"2024-09-07T03:32:51.215438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:52.172562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"34'18","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273667+0000","last_change":"2024-09-07T03:32:18.127389+0000","last_active":"2024-09-07T03:32:50.273667+0000","last_peered":"2024-09-07T03:32:50.273667+0000","last_clean":"2024-09-07T03:32:50.273667+0000","last_became_active":"2024-09-07T03:32:18.127007+0000","last_became_peered":"2024-09-07T03:32:18.127007+0000","last_unstale":"2024-09-07T03:32:50.273667+0000","last_undegraded":"2024-09-07T03:32:50.273667+0000","last_fullsized":"2024-09-07T03:32:50.273667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:32:04.955651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":367,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206613+0000","last_change":"2024-09-07T03:32:20.147075+0000","last_active":"2024-09-07T03:35:21.206613+0000","last_peered":"2024-09-07T03:35:21.206613+0000","last_clean":"2024-09-07T03:35:21.206613+0000","last_became_active":"2024-09-07T03:32:20.146738+0000","last_became_peered":"2024-09-07T03:32:20.146738+0000","last_unstale":"2024-09-07T03:35:21.206613+0000","last_undegraded":"2024-09-07T03:35:21.206613+0000","last_fullsized":"2024-09-07T03:35:21.206613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:39.886530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.568340+0000","last_change":"2024-09-07T03:32:22.151158+0000","last_active":"2024-09-07T03:32:56.568340+0000","last_peered":"2024-09-07T03:32:56.568340+0000","last_clean":"2024-09-07T03:32:56.568340+0000","last_became_active":"2024-09-07T03:32:22.150886+0000","last_became_peered":"2024-09-07T03:32:22.150886+0000","last_unstale":"2024-09-07T03:32:56.568340+0000","last_undegraded":"2024-09-07T03:32:56.568340+0000","last_fullsized":"2024-09-07T03:32:56.568340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:57:06.666886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'18","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843569+0000","last_change":"2024-09-07T03:32:14.127180+0000","last_active":"2024-09-07T03:35:23.843569+0000","last_peered":"2024-09-07T03:35:23.843569+0000","last_clean":"2024-09-07T03:35:23.843569+0000","last_became_active":"2024-09-07T03:32:14.126901+0000","last_became_peered":"2024-09-07T03:32:14.126901+0000","last_unstale":"2024-09-07T03:35:23.843569+0000","last_undegraded":"2024-09-07T03:35:23.843569+0000","last_fullsized":"2024-09-07T03:35:23.843569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:14.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473031+0000","last_change":"2024-09-07T03:32:12.134765+0000","last_active":"2024-09-07T03:32:50.473031+0000","last_peered":"2024-09-07T03:32:50.473031+0000","last_clean":"2024-09-07T03:32:50.473031+0000","last_became_active":"2024-09-07T03:32:12.133876+0000","last_became_peered":"2024-09-07T03:32:12.133876+0000","last_unstale":"2024-09-07T03:32:50.473031+0000","last_undegraded":"2024-09-07T03:32:50.473031+0000","last_fullsized":"2024-09-07T03:32:50.473031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:01.450719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'1","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.297081+0000","last_change":"2024-09-07T03:32:16.122534+0000","last_active":"2024-09-07T03:34:22.297081+0000","last_peered":"2024-09-07T03:34:22.297081+0000","last_clean":"2024-09-07T03:34:22.297081+0000","last_became_active":"2024-09-07T03:32:16.120952+0000","last_became_peered":"2024-09-07T03:32:16.120952+0000","last_unstale":"2024-09-07T03:34:22.297081+0000","last_undegraded":"2024-09-07T03:34:22.297081+0000","last_fullsized":"2024-09-07T03:34:22.297081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:35.686701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'63","reported_seq":133,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.175225+0000","last_change":"2024-09-07T03:32:18.133969+0000","last_active":"2024-09-07T03:34:21.175225+0000","last_peered":"2024-09-07T03:34:21.175225+0000","last_clean":"2024-09-07T03:34:21.175225+0000","last_became_active":"2024-09-07T03:32:18.133705+0000","last_became_peered":"2024-09-07T03:32:18.133705+0000","last_unstale":"2024-09-07T03:34:21.175225+0000","last_undegraded":"2024-09-07T03:34:21.175225+0000","last_fullsized":"2024-09-07T03:34:21.175225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:02.433602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271613+0000","last_change":"2024-09-07T03:32:20.137011+0000","last_active":"2024-09-07T03:32:50.271613+0000","last_peered":"2024-09-07T03:32:50.271613+0000","last_clean":"2024-09-07T03:32:50.271613+0000","last_became_active":"2024-09-07T03:32:20.135211+0000","last_became_peered":"2024-09-07T03:32:20.135211+0000","last_unstale":"2024-09-07T03:32:50.271613+0000","last_undegraded":"2024-09-07T03:32:50.271613+0000","last_fullsized":"2024-09-07T03:32:50.271613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:33.033993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.028862+0000","last_change":"2024-09-07T03:32:22.141840+0000","last_active":"2024-09-07T03:32:57.028862+0000","last_peered":"2024-09-07T03:32:57.028862+0000","last_clean":"2024-09-07T03:32:57.028862+0000","last_became_active":"2024-09-07T03:32:22.141533+0000","last_became_peered":"2024-09-07T03:32:22.141533+0000","last_unstale":"2024-09-07T03:32:57.028862+0000","last_undegraded":"2024-09-07T03:32:57.028862+0000","last_fullsized":"2024-09-07T03:32:57.028862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:32:37.743868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'20","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806061+0000","last_change":"2024-09-07T03:32:14.123194+0000","last_active":"2024-09-07T03:35:23.806061+0000","last_peered":"2024-09-07T03:35:23.806061+0000","last_clean":"2024-09-07T03:35:23.806061+0000","last_became_active":"2024-09-07T03:32:14.122929+0000","last_became_peered":"2024-09-07T03:32:14.122929+0000","last_unstale":"2024-09-07T03:35:23.806061+0000","last_undegraded":"2024-09-07T03:35:23.806061+0000","last_fullsized":"2024-09-07T03:35:23.806061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:27:08.474145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281523+0000","last_change":"2024-09-07T03:32:12.125302+0000","last_active":"2024-09-07T03:32:50.281523+0000","last_peered":"2024-09-07T03:32:50.281523+0000","last_clean":"2024-09-07T03:32:50.281523+0000","last_became_active":"2024-09-07T03:32:12.124610+0000","last_became_peered":"2024-09-07T03:32:12.124610+0000","last_unstale":"2024-09-07T03:32:50.281523+0000","last_undegraded":"2024-09-07T03:32:50.281523+0000","last_fullsized":"2024-09-07T03:32:50.281523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:41:42.237332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278654+0000","last_change":"2024-09-07T03:32:16.116613+0000","last_active":"2024-09-07T03:32:50.278654+0000","last_peered":"2024-09-07T03:32:50.278654+0000","last_clean":"2024-09-07T03:32:50.278654+0000","last_became_active":"2024-09-07T03:32:16.116296+0000","last_became_peered":"2024-09-07T03:32:16.116296+0000","last_unstale":"2024-09-07T03:32:50.278654+0000","last_undegraded":"2024-09-07T03:32:50.278654+0000","last_fullsized":"2024-09-07T03:32:50.278654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:40:46.166456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'37","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.176212+0000","last_change":"2024-09-07T03:32:18.134892+0000","last_active":"2024-09-07T03:34:21.176212+0000","last_peered":"2024-09-07T03:34:21.176212+0000","last_clean":"2024-09-07T03:34:21.176212+0000","last_became_active":"2024-09-07T03:32:18.134533+0000","last_became_peered":"2024-09-07T03:32:18.134533+0000","last_unstale":"2024-09-07T03:34:21.176212+0000","last_undegraded":"2024-09-07T03:34:21.176212+0000","last_fullsized":"2024-09-07T03:34:21.176212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:15:18.375395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278010+0000","last_change":"2024-09-07T03:32:20.146986+0000","last_active":"2024-09-07T03:32:50.278010+0000","last_peered":"2024-09-07T03:32:50.278010+0000","last_clean":"2024-09-07T03:32:50.278010+0000","last_became_active":"2024-09-07T03:32:20.146631+0000","last_became_peered":"2024-09-07T03:32:20.146631+0000","last_unstale":"2024-09-07T03:32:50.278010+0000","last_undegraded":"2024-09-07T03:32:50.278010+0000","last_fullsized":"2024-09-07T03:32:50.278010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:56.243102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275464+0000","last_change":"2024-09-07T03:32:22.152021+0000","last_active":"2024-09-07T03:32:50.275464+0000","last_peered":"2024-09-07T03:32:50.275464+0000","last_clean":"2024-09-07T03:32:50.275464+0000","last_became_active":"2024-09-07T03:32:22.151709+0000","last_became_peered":"2024-09-07T03:32:22.151709+0000","last_unstale":"2024-09-07T03:32:50.275464+0000","last_undegraded":"2024-09-07T03:32:50.275464+0000","last_fullsized":"2024-09-07T03:32:50.275464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:01.162547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963490+0000","last_change":"2024-09-07T03:32:14.127708+0000","last_active":"2024-09-07T03:34:22.963490+0000","last_peered":"2024-09-07T03:34:22.963490+0000","last_clean":"2024-09-07T03:34:22.963490+0000","last_became_active":"2024-09-07T03:32:14.127451+0000","last_became_peered":"2024-09-07T03:32:14.127451+0000","last_unstale":"2024-09-07T03:34:22.963490+0000","last_undegraded":"2024-09-07T03:34:22.963490+0000","last_fullsized":"2024-09-07T03:34:22.963490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:19.822962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273816+0000","last_change":"2024-09-07T03:32:12.125466+0000","last_active":"2024-09-07T03:32:50.273816+0000","last_peered":"2024-09-07T03:32:50.273816+0000","last_clean":"2024-09-07T03:32:50.273816+0000","last_became_active":"2024-09-07T03:32:12.124552+0000","last_became_peered":"2024-09-07T03:32:12.124552+0000","last_unstale":"2024-09-07T03:32:50.273816+0000","last_undegraded":"2024-09-07T03:32:50.273816+0000","last_fullsized":"2024-09-07T03:32:50.273816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:13:53.582954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469800+0000","last_change":"2024-09-07T03:32:16.125669+0000","last_active":"2024-09-07T03:32:50.469800+0000","last_peered":"2024-09-07T03:32:50.469800+0000","last_clean":"2024-09-07T03:32:50.469800+0000","last_became_active":"2024-09-07T03:32:16.123423+0000","last_became_peered":"2024-09-07T03:32:16.123423+0000","last_unstale":"2024-09-07T03:32:50.469800+0000","last_undegraded":"2024-09-07T03:32:50.469800+0000","last_fullsized":"2024-09-07T03:32:50.469800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:06:37.923895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'32","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.200778+0000","last_change":"2024-09-07T03:32:18.129106+0000","last_active":"2024-09-07T03:34:21.200778+0000","last_peered":"2024-09-07T03:34:21.200778+0000","last_clean":"2024-09-07T03:34:21.200778+0000","last_became_active":"2024-09-07T03:32:18.128812+0000","last_became_peered":"2024-09-07T03:32:18.128812+0000","last_unstale":"2024-09-07T03:34:21.200778+0000","last_undegraded":"2024-09-07T03:34:21.200778+0000","last_fullsized":"2024-09-07T03:34:21.200778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:51.897402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279344+0000","last_change":"2024-09-07T03:32:20.132779+0000","last_active":"2024-09-07T03:32:50.279344+0000","last_peered":"2024-09-07T03:32:50.279344+0000","last_clean":"2024-09-07T03:32:50.279344+0000","last_became_active":"2024-09-07T03:32:20.132396+0000","last_became_peered":"2024-09-07T03:32:20.132396+0000","last_unstale":"2024-09-07T03:32:50.279344+0000","last_undegraded":"2024-09-07T03:32:50.279344+0000","last_fullsized":"2024-09-07T03:32:50.279344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:29:30.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.210747+0000","last_change":"2024-09-07T03:32:22.152253+0000","last_active":"2024-09-07T03:34:21.210747+0000","last_peered":"2024-09-07T03:34:21.210747+0000","last_clean":"2024-09-07T03:34:21.210747+0000","last_became_active":"2024-09-07T03:32:22.151697+0000","last_became_peered":"2024-09-07T03:32:22.151697+0000","last_unstale":"2024-09-07T03:34:21.210747+0000","last_undegraded":"2024-09-07T03:34:21.210747+0000","last_fullsized":"2024-09-07T03:34:21.210747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:12:47.655977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806035+0000","last_change":"2024-09-07T03:32:14.113037+0000","last_active":"2024-09-07T03:35:23.806035+0000","last_peered":"2024-09-07T03:35:23.806035+0000","last_clean":"2024-09-07T03:35:23.806035+0000","last_became_active":"2024-09-07T03:32:14.112336+0000","last_became_peered":"2024-09-07T03:32:14.112336+0000","last_unstale":"2024-09-07T03:35:23.806035+0000","last_undegraded":"2024-09-07T03:35:23.806035+0000","last_fullsized":"2024-09-07T03:35:23.806035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.767629+0000","last_change":"2024-09-07T03:32:12.138565+0000","last_active":"2024-09-07T03:34:22.767629+0000","last_peered":"2024-09-07T03:34:22.767629+0000","last_clean":"2024-09-07T03:34:22.767629+0000","last_became_active":"2024-09-07T03:32:12.136020+0000","last_became_peered":"2024-09-07T03:32:12.136020+0000","last_unstale":"2024-09-07T03:34:22.767629+0000","last_undegraded":"2024-09-07T03:34:22.767629+0000","last_fullsized":"2024-09-07T03:34:22.767629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:57:08.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.817388+0000","last_change":"2024-09-07T03:32:16.129863+0000","last_active":"2024-09-07T03:34:19.817388+0000","last_peered":"2024-09-07T03:34:19.817388+0000","last_clean":"2024-09-07T03:34:19.817388+0000","last_became_active":"2024-09-07T03:32:16.129161+0000","last_became_peered":"2024-09-07T03:32:16.129161+0000","last_unstale":"2024-09-07T03:34:19.817388+0000","last_undegraded":"2024-09-07T03:34:19.817388+0000","last_fullsized":"2024-09-07T03:34:19.817388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:08:23.197757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'45","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.018384+0000","last_change":"2024-09-07T03:32:18.132380+0000","last_active":"2024-09-07T03:35:23.018384+0000","last_peered":"2024-09-07T03:35:23.018384+0000","last_clean":"2024-09-07T03:35:23.018384+0000","last_became_active":"2024-09-07T03:32:18.132072+0000","last_became_peered":"2024-09-07T03:32:18.132072+0000","last_unstale":"2024-09-07T03:35:23.018384+0000","last_undegraded":"2024-09-07T03:35:23.018384+0000","last_fullsized":"2024-09-07T03:35:23.018384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:37.568436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274904+0000","last_change":"2024-09-07T03:32:20.145649+0000","last_active":"2024-09-07T03:32:50.274904+0000","last_peered":"2024-09-07T03:32:50.274904+0000","last_clean":"2024-09-07T03:32:50.274904+0000","last_became_active":"2024-09-07T03:32:20.144977+0000","last_became_peered":"2024-09-07T03:32:20.144977+0000","last_unstale":"2024-09-07T03:32:50.274904+0000","last_undegraded":"2024-09-07T03:32:50.274904+0000","last_fullsized":"2024-09-07T03:32:50.274904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:56.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.213631+0000","last_change":"2024-09-07T03:32:22.141987+0000","last_active":"2024-09-07T03:34:21.213631+0000","last_peered":"2024-09-07T03:34:21.213631+0000","last_clean":"2024-09-07T03:34:21.213631+0000","last_became_active":"2024-09-07T03:32:22.141633+0000","last_became_peered":"2024-09-07T03:32:22.141633+0000","last_unstale":"2024-09-07T03:34:21.213631+0000","last_undegraded":"2024-09-07T03:34:21.213631+0000","last_fullsized":"2024-09-07T03:34:21.213631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:45.392294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.478248+0000","last_change":"2024-09-07T03:32:14.114021+0000","last_active":"2024-09-07T03:35:23.478248+0000","last_peered":"2024-09-07T03:35:23.478248+0000","last_clean":"2024-09-07T03:35:23.478248+0000","last_became_active":"2024-09-07T03:32:14.111950+0000","last_became_peered":"2024-09-07T03:32:14.111950+0000","last_unstale":"2024-09-07T03:35:23.478248+0000","last_undegraded":"2024-09-07T03:35:23.478248+0000","last_fullsized":"2024-09-07T03:35:23.478248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:42:20.068850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274043+0000","last_change":"2024-09-07T03:32:12.133214+0000","last_active":"2024-09-07T03:32:50.274043+0000","last_peered":"2024-09-07T03:32:50.274043+0000","last_clean":"2024-09-07T03:32:50.274043+0000","last_became_active":"2024-09-07T03:32:12.132814+0000","last_became_peered":"2024-09-07T03:32:12.132814+0000","last_unstale":"2024-09-07T03:32:50.274043+0000","last_undegraded":"2024-09-07T03:32:50.274043+0000","last_fullsized":"2024-09-07T03:32:50.274043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:53.987362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843863+0000","last_change":"2024-09-07T03:32:14.115342+0000","last_active":"2024-09-07T03:35:23.843863+0000","last_peered":"2024-09-07T03:35:23.843863+0000","last_clean":"2024-09-07T03:35:23.843863+0000","last_became_active":"2024-09-07T03:32:14.114966+0000","last_became_peered":"2024-09-07T03:32:14.114966+0000","last_unstale":"2024-09-07T03:35:23.843863+0000","last_undegraded":"2024-09-07T03:35:23.843863+0000","last_fullsized":"2024-09-07T03:35:23.843863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:07:27.478728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:16.226772+0000","last_change":"2024-09-07T03:32:12.134634+0000","last_active":"2024-09-07T03:34:16.226772+0000","last_peered":"2024-09-07T03:34:16.226772+0000","last_clean":"2024-09-07T03:34:16.226772+0000","last_became_active":"2024-09-07T03:32:12.132662+0000","last_became_peered":"2024-09-07T03:32:12.132662+0000","last_unstale":"2024-09-07T03:34:16.226772+0000","last_undegraded":"2024-09-07T03:34:16.226772+0000","last_fullsized":"2024-09-07T03:34:16.226772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:00:50.432167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.739589+0000","last_change":"2024-09-07T03:32:14.122593+0000","last_active":"2024-09-07T03:35:23.739589+0000","last_peered":"2024-09-07T03:35:23.739589+0000","last_clean":"2024-09-07T03:35:23.739589+0000","last_became_active":"2024-09-07T03:32:14.122301+0000","last_became_peered":"2024-09-07T03:32:14.122301+0000","last_unstale":"2024-09-07T03:35:23.739589+0000","last_undegraded":"2024-09-07T03:35:23.739589+0000","last_fullsized":"2024-09-07T03:35:23.739589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272108+0000","last_change":"2024-09-07T03:32:12.138037+0000","last_active":"2024-09-07T03:32:50.272108+0000","last_peered":"2024-09-07T03:32:50.272108+0000","last_clean":"2024-09-07T03:32:50.272108+0000","last_became_active":"2024-09-07T03:32:12.137561+0000","last_became_peered":"2024-09-07T03:32:12.137561+0000","last_unstale":"2024-09-07T03:32:50.272108+0000","last_undegraded":"2024-09-07T03:32:50.272108+0000","last_fullsized":"2024-09-07T03:32:50.272108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:59.055476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435902+0000","last_change":"2024-09-07T03:32:14.114337+0000","last_active":"2024-09-07T03:34:19.435902+0000","last_peered":"2024-09-07T03:34:19.435902+0000","last_clean":"2024-09-07T03:34:19.435902+0000","last_became_active":"2024-09-07T03:32:14.114055+0000","last_became_peered":"2024-09-07T03:32:14.114055+0000","last_unstale":"2024-09-07T03:34:19.435902+0000","last_undegraded":"2024-09-07T03:34:19.435902+0000","last_fullsized":"2024-09-07T03:34:19.435902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:55:05.807784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.728015+0000","last_change":"2024-09-07T03:32:12.132824+0000","last_active":"2024-09-07T03:34:22.728015+0000","last_peered":"2024-09-07T03:34:22.728015+0000","last_clean":"2024-09-07T03:34:22.728015+0000","last_became_active":"2024-09-07T03:32:12.132471+0000","last_became_peered":"2024-09-07T03:32:12.132471+0000","last_unstale":"2024-09-07T03:34:22.728015+0000","last_undegraded":"2024-09-07T03:34:22.728015+0000","last_fullsized":"2024-09-07T03:34:22.728015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:04:57.476630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803876+0000","last_change":"2024-09-07T03:32:50.285566+0000","last_active":"2024-09-07T03:35:23.803876+0000","last_peered":"2024-09-07T03:35:23.803876+0000","last_clean":"2024-09-07T03:35:23.803876+0000","last_became_active":"2024-09-07T03:32:50.280656+0000","last_became_peered":"2024-09-07T03:32:50.280656+0000","last_unstale":"2024-09-07T03:35:23.803876+0000","last_undegraded":"2024-09-07T03:35:23.803876+0000","last_fullsized":"2024-09-07T03:35:23.803876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:19:49.958031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.429207+0000","last_change":"2024-09-07T03:32:12.140756+0000","last_active":"2024-09-07T03:32:55.429207+0000","last_peered":"2024-09-07T03:32:55.429207+0000","last_clean":"2024-09-07T03:32:55.429207+0000","last_became_active":"2024-09-07T03:32:12.140393+0000","last_became_peered":"2024-09-07T03:32:12.140393+0000","last_unstale":"2024-09-07T03:32:55.429207+0000","last_undegraded":"2024-09-07T03:32:55.429207+0000","last_fullsized":"2024-09-07T03:32:55.429207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:23.691202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"36'10","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803631+0000","last_change":"2024-09-07T03:32:14.114468+0000","last_active":"2024-09-07T03:35:23.803631+0000","last_peered":"2024-09-07T03:35:23.803631+0000","last_clean":"2024-09-07T03:35:23.803631+0000","last_became_active":"2024-09-07T03:32:14.113830+0000","last_became_peered":"2024-09-07T03:32:14.113830+0000","last_unstale":"2024-09-07T03:35:23.803631+0000","last_undegraded":"2024-09-07T03:35:23.803631+0000","last_fullsized":"2024-09-07T03:35:23.803631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:00.736940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471745+0000","last_change":"2024-09-07T03:32:12.134769+0000","last_active":"2024-09-07T03:32:50.471745+0000","last_peered":"2024-09-07T03:32:50.471745+0000","last_clean":"2024-09-07T03:32:50.471745+0000","last_became_active":"2024-09-07T03:32:12.134287+0000","last_became_peered":"2024-09-07T03:32:12.134287+0000","last_unstale":"2024-09-07T03:32:50.471745+0000","last_undegraded":"2024-09-07T03:32:50.471745+0000","last_fullsized":"2024-09-07T03:32:50.471745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:29:37.829617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'17","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228255+0000","last_change":"2024-09-07T03:32:14.126278+0000","last_active":"2024-09-07T03:34:21.228255+0000","last_peered":"2024-09-07T03:34:21.228255+0000","last_clean":"2024-09-07T03:34:21.228255+0000","last_became_active":"2024-09-07T03:32:14.125990+0000","last_became_peered":"2024-09-07T03:32:14.125990+0000","last_unstale":"2024-09-07T03:34:21.228255+0000","last_undegraded":"2024-09-07T03:34:21.228255+0000","last_fullsized":"2024-09-07T03:34:21.228255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:31:20.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278552+0000","last_change":"2024-09-07T03:32:12.129933+0000","last_active":"2024-09-07T03:32:50.278552+0000","last_peered":"2024-09-07T03:32:50.278552+0000","last_clean":"2024-09-07T03:32:50.278552+0000","last_became_active":"2024-09-07T03:32:12.128807+0000","last_became_peered":"2024-09-07T03:32:12.128807+0000","last_unstale":"2024-09-07T03:32:50.278552+0000","last_undegraded":"2024-09-07T03:32:50.278552+0000","last_fullsized":"2024-09-07T03:32:50.278552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:14:03.821714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806043+0000","last_change":"2024-09-07T03:32:14.110088+0000","last_active":"2024-09-07T03:35:23.806043+0000","last_peered":"2024-09-07T03:35:23.806043+0000","last_clean":"2024-09-07T03:35:23.806043+0000","last_became_active":"2024-09-07T03:32:14.109799+0000","last_became_peered":"2024-09-07T03:32:14.109799+0000","last_unstale":"2024-09-07T03:35:23.806043+0000","last_undegraded":"2024-09-07T03:35:23.806043+0000","last_fullsized":"2024-09-07T03:35:23.806043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276544+0000","last_change":"2024-09-07T03:32:12.131240+0000","last_active":"2024-09-07T03:32:50.276544+0000","last_peered":"2024-09-07T03:32:50.276544+0000","last_clean":"2024-09-07T03:32:50.276544+0000","last_became_active":"2024-09-07T03:32:12.130563+0000","last_became_peered":"2024-09-07T03:32:12.130563+0000","last_unstale":"2024-09-07T03:32:50.276544+0000","last_undegraded":"2024-09-07T03:32:50.276544+0000","last_fullsized":"2024-09-07T03:32:50.276544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:35.973387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806088+0000","last_change":"2024-09-07T03:32:14.115326+0000","last_active":"2024-09-07T03:35:23.806088+0000","last_peered":"2024-09-07T03:35:23.806088+0000","last_clean":"2024-09-07T03:35:23.806088+0000","last_became_active":"2024-09-07T03:32:14.115000+0000","last_became_peered":"2024-09-07T03:32:14.115000+0000","last_unstale":"2024-09-07T03:35:23.806088+0000","last_undegraded":"2024-09-07T03:35:23.806088+0000","last_fullsized":"2024-09-07T03:35:23.806088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:20.852806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272042+0000","last_change":"2024-09-07T03:32:12.142672+0000","last_active":"2024-09-07T03:32:50.272042+0000","last_peered":"2024-09-07T03:32:50.272042+0000","last_clean":"2024-09-07T03:32:50.272042+0000","last_became_active":"2024-09-07T03:32:12.142315+0000","last_became_peered":"2024-09-07T03:32:12.142315+0000","last_unstale":"2024-09-07T03:32:50.272042+0000","last_undegraded":"2024-09-07T03:32:50.272042+0000","last_fullsized":"2024-09-07T03:32:50.272042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:04:31.049755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276218+0000","last_change":"2024-09-07T03:32:14.127846+0000","last_active":"2024-09-07T03:32:50.276218+0000","last_peered":"2024-09-07T03:32:50.276218+0000","last_clean":"2024-09-07T03:32:50.276218+0000","last_became_active":"2024-09-07T03:32:14.127560+0000","last_became_peered":"2024-09-07T03:32:14.127560+0000","last_unstale":"2024-09-07T03:32:50.276218+0000","last_undegraded":"2024-09-07T03:32:50.276218+0000","last_fullsized":"2024-09-07T03:32:50.276218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432265+0000","last_change":"2024-09-07T03:32:12.139702+0000","last_active":"2024-09-07T03:32:55.432265+0000","last_peered":"2024-09-07T03:32:55.432265+0000","last_clean":"2024-09-07T03:32:55.432265+0000","last_became_active":"2024-09-07T03:32:12.138745+0000","last_became_peered":"2024-09-07T03:32:12.138745+0000","last_unstale":"2024-09-07T03:32:55.432265+0000","last_undegraded":"2024-09-07T03:32:55.432265+0000","last_fullsized":"2024-09-07T03:32:55.432265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:58:53.427065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.805976+0000","last_change":"2024-09-07T03:32:14.123012+0000","last_active":"2024-09-07T03:35:23.805976+0000","last_peered":"2024-09-07T03:35:23.805976+0000","last_clean":"2024-09-07T03:35:23.805976+0000","last_became_active":"2024-09-07T03:32:14.122699+0000","last_became_peered":"2024-09-07T03:32:14.122699+0000","last_unstale":"2024-09-07T03:35:23.805976+0000","last_undegraded":"2024-09-07T03:35:23.805976+0000","last_fullsized":"2024-09-07T03:35:23.805976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:12.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280233+0000","last_change":"2024-09-07T03:32:12.133952+0000","last_active":"2024-09-07T03:32:50.280233+0000","last_peered":"2024-09-07T03:32:50.280233+0000","last_clean":"2024-09-07T03:32:50.280233+0000","last_became_active":"2024-09-07T03:32:12.133145+0000","last_became_peered":"2024-09-07T03:32:12.133145+0000","last_unstale":"2024-09-07T03:32:50.280233+0000","last_undegraded":"2024-09-07T03:32:50.280233+0000","last_fullsized":"2024-09-07T03:32:50.280233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:02.480411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"36'16","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587715+0000","last_change":"2024-09-07T03:32:14.112126+0000","last_active":"2024-09-07T03:35:23.587715+0000","last_peered":"2024-09-07T03:35:23.587715+0000","last_clean":"2024-09-07T03:35:23.587715+0000","last_became_active":"2024-09-07T03:32:14.111759+0000","last_became_peered":"2024-09-07T03:32:14.111759+0000","last_unstale":"2024-09-07T03:35:23.587715+0000","last_undegraded":"2024-09-07T03:35:23.587715+0000","last_fullsized":"2024-09-07T03:35:23.587715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:14.003758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":44,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'1","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230117+0000","last_change":"2024-09-07T03:32:12.134868+0000","last_active":"2024-09-07T03:34:28.230117+0000","last_peered":"2024-09-07T03:34:28.230117+0000","last_clean":"2024-09-07T03:34:28.230117+0000","last_became_active":"2024-09-07T03:32:12.134151+0000","last_became_peered":"2024-09-07T03:32:12.134151+0000","last_unstale":"2024-09-07T03:34:28.230117+0000","last_undegraded":"2024-09-07T03:34:28.230117+0000","last_fullsized":"2024-09-07T03:34:28.230117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:08:24.817906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'30","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731159+0000","last_change":"2024-09-07T03:32:14.124493+0000","last_active":"2024-09-07T03:35:23.731159+0000","last_peered":"2024-09-07T03:35:23.731159+0000","last_clean":"2024-09-07T03:35:23.731159+0000","last_became_active":"2024-09-07T03:32:14.124258+0000","last_became_peered":"2024-09-07T03:32:14.124258+0000","last_unstale":"2024-09-07T03:35:23.731159+0000","last_undegraded":"2024-09-07T03:35:23.731159+0000","last_fullsized":"2024-09-07T03:35:23.731159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":111,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273399+0000","last_change":"2024-09-07T03:32:12.140618+0000","last_active":"2024-09-07T03:32:50.273399+0000","last_peered":"2024-09-07T03:32:50.273399+0000","last_clean":"2024-09-07T03:32:50.273399+0000","last_became_active":"2024-09-07T03:32:12.140243+0000","last_became_peered":"2024-09-07T03:32:12.140243+0000","last_unstale":"2024-09-07T03:32:50.273399+0000","last_undegraded":"2024-09-07T03:32:50.273399+0000","last_fullsized":"2024-09-07T03:32:50.273399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:41.435390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570857+0000","last_change":"2024-09-07T03:32:14.113597+0000","last_active":"2024-09-07T03:32:56.570857+0000","last_peered":"2024-09-07T03:32:56.570857+0000","last_clean":"2024-09-07T03:32:56.570857+0000","last_became_active":"2024-09-07T03:32:14.113016+0000","last_became_peered":"2024-09-07T03:32:14.113016+0000","last_unstale":"2024-09-07T03:32:56.570857+0000","last_undegraded":"2024-09-07T03:32:56.570857+0000","last_fullsized":"2024-09-07T03:32:56.570857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:38:17.720862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272704+0000","last_change":"2024-09-07T03:32:12.136273+0000","last_active":"2024-09-07T03:32:50.272704+0000","last_peered":"2024-09-07T03:32:50.272704+0000","last_clean":"2024-09-07T03:32:50.272704+0000","last_became_active":"2024-09-07T03:32:12.135936+0000","last_became_peered":"2024-09-07T03:32:12.135936+0000","last_unstale":"2024-09-07T03:32:50.272704+0000","last_undegraded":"2024-09-07T03:32:50.272704+0000","last_fullsized":"2024-09-07T03:32:50.272704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:55.875414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731153+0000","last_change":"2024-09-07T03:32:14.128701+0000","last_active":"2024-09-07T03:35:23.731153+0000","last_peered":"2024-09-07T03:35:23.731153+0000","last_clean":"2024-09-07T03:35:23.731153+0000","last_became_active":"2024-09-07T03:32:14.127982+0000","last_became_peered":"2024-09-07T03:32:14.127982+0000","last_unstale":"2024-09-07T03:35:23.731153+0000","last_undegraded":"2024-09-07T03:35:23.731153+0000","last_fullsized":"2024-09-07T03:35:23.731153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278674+0000","last_change":"2024-09-07T03:32:12.134111+0000","last_active":"2024-09-07T03:32:50.278674+0000","last_peered":"2024-09-07T03:32:50.278674+0000","last_clean":"2024-09-07T03:32:50.278674+0000","last_became_active":"2024-09-07T03:32:12.133720+0000","last_became_peered":"2024-09-07T03:32:12.133720+0000","last_unstale":"2024-09-07T03:32:50.278674+0000","last_undegraded":"2024-09-07T03:32:50.278674+0000","last_fullsized":"2024-09-07T03:32:50.278674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:57:03.239693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843615+0000","last_change":"2024-09-07T03:32:14.124677+0000","last_active":"2024-09-07T03:35:23.843615+0000","last_peered":"2024-09-07T03:35:23.843615+0000","last_clean":"2024-09-07T03:35:23.843615+0000","last_became_active":"2024-09-07T03:32:14.124462+0000","last_became_peered":"2024-09-07T03:32:14.124462+0000","last_unstale":"2024-09-07T03:35:23.843615+0000","last_undegraded":"2024-09-07T03:35:23.843615+0000","last_fullsized":"2024-09-07T03:35:23.843615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.907020+0000","last_change":"2024-09-07T03:32:12.141303+0000","last_active":"2024-09-07T03:34:22.907020+0000","last_peered":"2024-09-07T03:34:22.907020+0000","last_clean":"2024-09-07T03:34:22.907020+0000","last_became_active":"2024-09-07T03:32:12.140957+0000","last_became_peered":"2024-09-07T03:32:12.140957+0000","last_unstale":"2024-09-07T03:34:22.907020+0000","last_undegraded":"2024-09-07T03:34:22.907020+0000","last_fullsized":"2024-09-07T03:34:22.907020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:19:10.920973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278119+0000","last_change":"2024-09-07T03:32:12.133925+0000","last_active":"2024-09-07T03:32:50.278119+0000","last_peered":"2024-09-07T03:32:50.278119+0000","last_clean":"2024-09-07T03:32:50.278119+0000","last_became_active":"2024-09-07T03:32:12.133460+0000","last_became_peered":"2024-09-07T03:32:12.133460+0000","last_unstale":"2024-09-07T03:32:50.278119+0000","last_undegraded":"2024-09-07T03:32:50.278119+0000","last_fullsized":"2024-09-07T03:32:50.278119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:50:56.419019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435937+0000","last_change":"2024-09-07T03:32:14.123815+0000","last_active":"2024-09-07T03:34:19.435937+0000","last_peered":"2024-09-07T03:34:19.435937+0000","last_clean":"2024-09-07T03:34:19.435937+0000","last_became_active":"2024-09-07T03:32:14.123554+0000","last_became_peered":"2024-09-07T03:32:14.123554+0000","last_unstale":"2024-09-07T03:34:19.435937+0000","last_undegraded":"2024-09-07T03:34:19.435937+0000","last_fullsized":"2024-09-07T03:34:19.435937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:12:13.928369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470165+0000","last_change":"2024-09-07T03:32:12.135828+0000","last_active":"2024-09-07T03:32:50.470165+0000","last_peered":"2024-09-07T03:32:50.470165+0000","last_clean":"2024-09-07T03:32:50.470165+0000","last_became_active":"2024-09-07T03:32:12.134650+0000","last_became_peered":"2024-09-07T03:32:12.134650+0000","last_unstale":"2024-09-07T03:32:50.470165+0000","last_undegraded":"2024-09-07T03:32:50.470165+0000","last_fullsized":"2024-09-07T03:32:50.470165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:30:53.762992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843565+0000","last_change":"2024-09-07T03:32:14.127747+0000","last_active":"2024-09-07T03:35:23.843565+0000","last_peered":"2024-09-07T03:35:23.843565+0000","last_clean":"2024-09-07T03:35:23.843565+0000","last_became_active":"2024-09-07T03:32:14.127493+0000","last_became_peered":"2024-09-07T03:32:14.127493+0000","last_unstale":"2024-09-07T03:35:23.843565+0000","last_undegraded":"2024-09-07T03:35:23.843565+0000","last_fullsized":"2024-09-07T03:35:23.843565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:45:11.748356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1691,"num_read_kb":1445,"num_write":725,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1471,"ondisk_log_size":1471,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1666,"num_read_kb":1556,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44188,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327652,"statfs":{"total":96636764160,"available":96591515648,"internally_reserved":0,"allocated":9056256,"data_stored":8761516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48896,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322944,"statfs":{"total":96636764160,"available":96586694656,"internally_reserved":0,"allocated":9617408,"data_stored":9352078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640303,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48408,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323432,"statfs":{"total":96636764160,"available":96587194368,"internally_reserved":0,"allocated":9117696,"data_stored":8765423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48964,"kb_used_data":9460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322876,"statfs":{"total":96636764160,"available":96586625024,"internally_reserved":0,"allocated":9687040,"data_stored":9353945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":4533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:35:31.069 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:35:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.187+0000 7fa878364640 1 Processor -- start 2024-09-07T03:35:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.187+0000 7fa878364640 1 -- start start 2024-09-07T03:35:31.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.187+0000 7fa878364640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa870112730 0x7fa870112b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:31.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.187+0000 7fa878364640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87006dc00 con 0x7fa870113050 2024-09-07T03:35:31.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.187+0000 7fa878364640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fa870113c00 con 0x7fa870112730 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.188+0000 7fa876100640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa870112730 0x7fa870112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.188+0000 7fa8758ff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa870113050 0x7fa870122180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57206/0 (socket says 172.21.15.104:57206) 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.188+0000 7fa8758ff640 1 -- 172.21.15.104:0/31201200 learned_addr learned my addr 172.21.15.104:0/31201200 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.188+0000 7fa876100640 1 -- 172.21.15.104:0/31201200 >> v1:172.21.15.104:6789/0 conn(0x7fa870113050 legacy=0x7fa870122180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.188+0000 7fa8750fe640 1 -- 172.21.15.104:0/31201200 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425203260 0 0) 0x7fa87006dc00 con 0x7fa870113050 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.188+0000 7fa876100640 1 -- 172.21.15.104:0/31201200 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa870073a70 con 0x7fa870112730 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.188+0000 7fa876100640 1 --2- 172.21.15.104:0/31201200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 0x7fa870112b10 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009d90 tx=0x7fa86c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b49ea967669931e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa8750fe640 1 -- 172.21.15.104:0/31201200 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c007670 con 0x7fa870112730 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa8750fe640 1 -- 172.21.15.104:0/31201200 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c007810 con 0x7fa870112730 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa8750fe640 1 -- 172.21.15.104:0/31201200 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c007b10 con 0x7fa870112730 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa878364640 1 -- 172.21.15.104:0/31201200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 msgr2=0x7fa870112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa878364640 1 --2- 172.21.15.104:0/31201200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 0x7fa870112b10 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009d90 tx=0x7fa86c02a660 comp rx=0 tx=0).stop 2024-09-07T03:35:31.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa878364640 1 -- 172.21.15.104:0/31201200 shutdown_connections 2024-09-07T03:35:31.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa878364640 1 --2- 172.21.15.104:0/31201200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 0x7fa870112b10 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa878364640 1 -- 172.21.15.104:0/31201200 >> 172.21.15.104:0/31201200 conn(0x7fa870070850 msgr2=0x7fa870072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:31.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa878364640 1 -- 172.21.15.104:0/31201200 shutdown_connections 2024-09-07T03:35:31.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.189+0000 7fa878364640 1 -- 172.21.15.104:0/31201200 wait complete. 2024-09-07T03:35:31.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.190+0000 7fa878364640 1 Processor -- start 2024-09-07T03:35:31.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.190+0000 7fa878364640 1 -- start start 2024-09-07T03:35:31.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.190+0000 7fa878364640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 0x7fa870115270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:31.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.190+0000 7fa878364640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa870122a10 con 0x7fa870112730 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa876100640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 0x7fa870115270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa876100640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 0x7fa870115270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50612/0 (socket says 172.21.15.104:50612) 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa876100640 1 -- 172.21.15.104:0/2674131985 learned_addr learned my addr 172.21.15.104:0/2674131985 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa876100640 1 -- 172.21.15.104:0/2674131985 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa870116c30 con 0x7fa870112730 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa876100640 1 --2- 172.21.15.104:0/2674131985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 0x7fa870115270 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009d90 tx=0x7fa86c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa866ffd640 1 -- 172.21.15.104:0/2674131985 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c040070 con 0x7fa870112730 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa866ffd640 1 -- 172.21.15.104:0/2674131985 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86c031b10 con 0x7fa870112730 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa870116f10 con 0x7fa870112730 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa866ffd640 1 -- 172.21.15.104:0/2674131985 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c031e30 con 0x7fa870112730 2024-09-07T03:35:31.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.191+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa870111800 con 0x7fa870112730 2024-09-07T03:35:31.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.192+0000 7fa866ffd640 1 -- 172.21.15.104:0/2674131985 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa86c039040 con 0x7fa870112730 2024-09-07T03:35:31.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.192+0000 7fa866ffd640 1 --2- 172.21.15.104:0/2674131985 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa85403dec0 0x7fa854040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:31.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.192+0000 7fa866ffd640 1 -- 172.21.15.104:0/2674131985 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa86c02ae00 con 0x7fa870112730 2024-09-07T03:35:31.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.192+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa870111ec0 con 0x7fa870112730 2024-09-07T03:35:31.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.192+0000 7fa8758ff640 1 --2- 172.21.15.104:0/2674131985 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa85403dec0 0x7fa854040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:31.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.193+0000 7fa8758ff640 1 --2- 172.21.15.104:0/2674131985 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa85403dec0 0x7fa854040380 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa860001220 tx=0x7fa8600078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:31.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.197+0000 7fa866ffd640 1 -- 172.21.15.104:0/2674131985 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fa86c03cc70 con 0x7fa870112730 2024-09-07T03:35:31.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.369+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa870122f50 con 0x7fa85403dec0 2024-09-07T03:35:31.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.379+0000 7fa866ffd640 1 -- 172.21.15.104:0/2674131985 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665993 (secure 0 0 0) 0x7fa870122f50 con 0x7fa85403dec0 2024-09-07T03:35:31.388 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:35:31.393 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:35:31.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa85403dec0 msgr2=0x7fa854040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 --2- 172.21.15.104:0/2674131985 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa85403dec0 0x7fa854040380 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa860001220 tx=0x7fa8600078f0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 msgr2=0x7fa870115270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 --2- 172.21.15.104:0/2674131985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 0x7fa870115270 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009d90 tx=0x7fa86c004a40 comp rx=0 tx=0).stop 2024-09-07T03:35:31.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 shutdown_connections 2024-09-07T03:35:31.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 --2- 172.21.15.104:0/2674131985 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fa85403dec0 0x7fa854040380 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 --2- 172.21.15.104:0/2674131985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa870112730 0x7fa870115270 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 >> 172.21.15.104:0/2674131985 conn(0x7fa870070850 msgr2=0x7fa87012a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:31.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 shutdown_connections 2024-09-07T03:35:31.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.384+0000 7fa878364640 1 -- 172.21.15.104:0/2674131985 wait complete. 2024-09-07T03:35:31.396 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-07T03:35:31.262441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5464162,"num_objects":256,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256,"num_whiteouts":0,"num_read":5380,"num_read_kb":4936,"num_write":2301,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4733,"ondisk_log_size":4733,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":169404,"kb_used_data":11380,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377317956,"statfs":{"total":386547056640,"available":386373586944,"internally_reserved":0,"allocated":11653120,"data_stored":10412452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4863033,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":702,"num_read_kb":663,"num_write":445,"num_write_kb":29375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004194"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281796+0000","last_change":"2024-09-07T03:32:12.133842+0000","last_active":"2024-09-07T03:32:50.281796+0000","last_peered":"2024-09-07T03:32:50.281796+0000","last_clean":"2024-09-07T03:32:50.281796+0000","last_became_active":"2024-09-07T03:32:12.133110+0000","last_became_peered":"2024-09-07T03:32:12.133110+0000","last_unstale":"2024-09-07T03:32:50.281796+0000","last_undegraded":"2024-09-07T03:32:50.281796+0000","last_fullsized":"2024-09-07T03:32:50.281796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:21:24.282602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985450+0000","last_change":"2024-09-07T03:32:14.110006+0000","last_active":"2024-09-07T03:33:38.985450+0000","last_peered":"2024-09-07T03:33:38.985450+0000","last_clean":"2024-09-07T03:33:38.985450+0000","last_became_active":"2024-09-07T03:32:14.109379+0000","last_became_peered":"2024-09-07T03:32:14.109379+0000","last_unstale":"2024-09-07T03:33:38.985450+0000","last_undegraded":"2024-09-07T03:33:38.985450+0000","last_fullsized":"2024-09-07T03:33:38.985450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472145+0000","last_change":"2024-09-07T03:32:12.137021+0000","last_active":"2024-09-07T03:32:50.472145+0000","last_peered":"2024-09-07T03:32:50.472145+0000","last_clean":"2024-09-07T03:32:50.472145+0000","last_became_active":"2024-09-07T03:32:12.135945+0000","last_became_peered":"2024-09-07T03:32:12.135945+0000","last_unstale":"2024-09-07T03:32:50.472145+0000","last_undegraded":"2024-09-07T03:32:50.472145+0000","last_fullsized":"2024-09-07T03:32:50.472145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:24.882510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'18","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.476438+0000","last_change":"2024-09-07T03:32:50.283523+0000","last_active":"2024-09-07T03:35:23.476438+0000","last_peered":"2024-09-07T03:35:23.476438+0000","last_clean":"2024-09-07T03:35:23.476438+0000","last_became_active":"2024-09-07T03:32:50.279755+0000","last_became_peered":"2024-09-07T03:32:50.279755+0000","last_unstale":"2024-09-07T03:35:23.476438+0000","last_undegraded":"2024-09-07T03:35:23.476438+0000","last_fullsized":"2024-09-07T03:35:23.476438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:00:27.065883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.664376+0000","last_change":"2024-09-07T03:32:12.138579+0000","last_active":"2024-09-07T03:35:30.664376+0000","last_peered":"2024-09-07T03:35:30.664376+0000","last_clean":"2024-09-07T03:35:30.664376+0000","last_became_active":"2024-09-07T03:32:12.138176+0000","last_became_peered":"2024-09-07T03:32:12.138176+0000","last_unstale":"2024-09-07T03:35:30.664376+0000","last_undegraded":"2024-09-07T03:35:30.664376+0000","last_fullsized":"2024-09-07T03:35:30.664376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:43.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.299808+0000","last_change":"2024-09-07T03:32:50.282415+0000","last_active":"2024-09-07T03:32:56.299808+0000","last_peered":"2024-09-07T03:32:56.299808+0000","last_clean":"2024-09-07T03:32:56.299808+0000","last_became_active":"2024-09-07T03:32:50.282086+0000","last_became_peered":"2024-09-07T03:32:50.282086+0000","last_unstale":"2024-09-07T03:32:56.299808+0000","last_undegraded":"2024-09-07T03:32:56.299808+0000","last_fullsized":"2024-09-07T03:32:56.299808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:57:14.202152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275899+0000","last_change":"2024-09-07T03:32:12.129351+0000","last_active":"2024-09-07T03:32:50.275899+0000","last_peered":"2024-09-07T03:32:50.275899+0000","last_clean":"2024-09-07T03:32:50.275899+0000","last_became_active":"2024-09-07T03:32:12.128937+0000","last_became_peered":"2024-09-07T03:32:12.128937+0000","last_unstale":"2024-09-07T03:32:50.275899+0000","last_undegraded":"2024-09-07T03:32:50.275899+0000","last_fullsized":"2024-09-07T03:32:50.275899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:28:44.222642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963439+0000","last_change":"2024-09-07T03:32:14.123290+0000","last_active":"2024-09-07T03:34:22.963439+0000","last_peered":"2024-09-07T03:34:22.963439+0000","last_clean":"2024-09-07T03:34:22.963439+0000","last_became_active":"2024-09-07T03:32:14.122611+0000","last_became_peered":"2024-09-07T03:32:14.122611+0000","last_unstale":"2024-09-07T03:34:22.963439+0000","last_undegraded":"2024-09-07T03:34:22.963439+0000","last_fullsized":"2024-09-07T03:34:22.963439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279185+0000","last_change":"2024-09-07T03:32:12.124716+0000","last_active":"2024-09-07T03:32:50.279185+0000","last_peered":"2024-09-07T03:32:50.279185+0000","last_clean":"2024-09-07T03:32:50.279185+0000","last_became_active":"2024-09-07T03:32:12.123986+0000","last_became_peered":"2024-09-07T03:32:12.123986+0000","last_unstale":"2024-09-07T03:32:50.279185+0000","last_undegraded":"2024-09-07T03:32:50.279185+0000","last_fullsized":"2024-09-07T03:32:50.279185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:10.648401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.597575+0000","last_change":"2024-09-07T03:32:14.124801+0000","last_active":"2024-09-07T03:35:23.597575+0000","last_peered":"2024-09-07T03:35:23.597575+0000","last_clean":"2024-09-07T03:35:23.597575+0000","last_became_active":"2024-09-07T03:32:14.124523+0000","last_became_peered":"2024-09-07T03:32:14.124523+0000","last_unstale":"2024-09-07T03:35:23.597575+0000","last_undegraded":"2024-09-07T03:35:23.597575+0000","last_fullsized":"2024-09-07T03:35:23.597575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:39.133433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.558996+0000","last_change":"2024-09-07T03:32:12.133960+0000","last_active":"2024-09-07T03:32:56.558996+0000","last_peered":"2024-09-07T03:32:56.558996+0000","last_clean":"2024-09-07T03:32:56.558996+0000","last_became_active":"2024-09-07T03:32:12.133597+0000","last_became_peered":"2024-09-07T03:32:12.133597+0000","last_unstale":"2024-09-07T03:32:56.558996+0000","last_undegraded":"2024-09-07T03:32:56.558996+0000","last_fullsized":"2024-09-07T03:32:56.558996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:16:06.544105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.571091+0000","last_change":"2024-09-07T03:32:14.113584+0000","last_active":"2024-09-07T03:32:56.571091+0000","last_peered":"2024-09-07T03:32:56.571091+0000","last_clean":"2024-09-07T03:32:56.571091+0000","last_became_active":"2024-09-07T03:32:14.112622+0000","last_became_peered":"2024-09-07T03:32:14.112622+0000","last_unstale":"2024-09-07T03:32:56.571091+0000","last_undegraded":"2024-09-07T03:32:56.571091+0000","last_fullsized":"2024-09-07T03:32:56.571091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:52.320086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273279+0000","last_change":"2024-09-07T03:32:12.140541+0000","last_active":"2024-09-07T03:32:50.273279+0000","last_peered":"2024-09-07T03:32:50.273279+0000","last_clean":"2024-09-07T03:32:50.273279+0000","last_became_active":"2024-09-07T03:32:12.140221+0000","last_became_peered":"2024-09-07T03:32:12.140221+0000","last_unstale":"2024-09-07T03:32:50.273279+0000","last_undegraded":"2024-09-07T03:32:50.273279+0000","last_fullsized":"2024-09-07T03:32:50.273279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:56.248253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.300068+0000","last_change":"2024-09-07T03:32:14.114929+0000","last_active":"2024-09-07T03:32:56.300068+0000","last_peered":"2024-09-07T03:32:56.300068+0000","last_clean":"2024-09-07T03:32:56.300068+0000","last_became_active":"2024-09-07T03:32:14.114529+0000","last_became_peered":"2024-09-07T03:32:14.114529+0000","last_unstale":"2024-09-07T03:32:56.300068+0000","last_undegraded":"2024-09-07T03:32:56.300068+0000","last_fullsized":"2024-09-07T03:32:56.300068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.398335+0000","last_change":"2024-09-07T03:32:12.143568+0000","last_active":"2024-09-07T03:35:23.398335+0000","last_peered":"2024-09-07T03:35:23.398335+0000","last_clean":"2024-09-07T03:35:23.398335+0000","last_became_active":"2024-09-07T03:32:12.143209+0000","last_became_peered":"2024-09-07T03:32:12.143209+0000","last_unstale":"2024-09-07T03:35:23.398335+0000","last_undegraded":"2024-09-07T03:35:23.398335+0000","last_fullsized":"2024-09-07T03:35:23.398335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:31:58.691796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.944310+0000","last_change":"2024-09-07T03:32:14.124391+0000","last_active":"2024-09-07T03:35:23.944310+0000","last_peered":"2024-09-07T03:35:23.944310+0000","last_clean":"2024-09-07T03:35:23.944310+0000","last_became_active":"2024-09-07T03:32:14.124135+0000","last_became_peered":"2024-09-07T03:32:14.124135+0000","last_unstale":"2024-09-07T03:35:23.944310+0000","last_undegraded":"2024-09-07T03:35:23.944310+0000","last_fullsized":"2024-09-07T03:35:23.944310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:40.853544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'14","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806118+0000","last_change":"2024-09-07T03:32:14.109787+0000","last_active":"2024-09-07T03:35:23.806118+0000","last_peered":"2024-09-07T03:35:23.806118+0000","last_clean":"2024-09-07T03:35:23.806118+0000","last_became_active":"2024-09-07T03:32:14.109280+0000","last_became_peered":"2024-09-07T03:32:14.109280+0000","last_unstale":"2024-09-07T03:35:23.806118+0000","last_undegraded":"2024-09-07T03:35:23.806118+0000","last_fullsized":"2024-09-07T03:35:23.806118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473124+0000","last_change":"2024-09-07T03:32:12.136387+0000","last_active":"2024-09-07T03:32:50.473124+0000","last_peered":"2024-09-07T03:32:50.473124+0000","last_clean":"2024-09-07T03:32:50.473124+0000","last_became_active":"2024-09-07T03:32:12.134379+0000","last_became_peered":"2024-09-07T03:32:12.134379+0000","last_unstale":"2024-09-07T03:32:50.473124+0000","last_undegraded":"2024-09-07T03:32:50.473124+0000","last_fullsized":"2024-09-07T03:32:50.473124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:52:06.698087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843636+0000","last_change":"2024-09-07T03:32:14.112114+0000","last_active":"2024-09-07T03:35:23.843636+0000","last_peered":"2024-09-07T03:35:23.843636+0000","last_clean":"2024-09-07T03:35:23.843636+0000","last_became_active":"2024-09-07T03:32:14.111769+0000","last_became_peered":"2024-09-07T03:32:14.111769+0000","last_unstale":"2024-09-07T03:35:23.843636+0000","last_undegraded":"2024-09-07T03:35:23.843636+0000","last_fullsized":"2024-09-07T03:35:23.843636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.714226+0000","last_change":"2024-09-07T03:32:12.129681+0000","last_active":"2024-09-07T03:35:23.714226+0000","last_peered":"2024-09-07T03:35:23.714226+0000","last_clean":"2024-09-07T03:35:23.714226+0000","last_became_active":"2024-09-07T03:32:12.129310+0000","last_became_peered":"2024-09-07T03:32:12.129310+0000","last_unstale":"2024-09-07T03:35:23.714226+0000","last_undegraded":"2024-09-07T03:35:23.714226+0000","last_fullsized":"2024-09-07T03:35:23.714226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:31.913444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.590380+0000","last_change":"2024-09-07T03:32:14.109568+0000","last_active":"2024-09-07T03:35:23.590380+0000","last_peered":"2024-09-07T03:35:23.590380+0000","last_clean":"2024-09-07T03:35:23.590380+0000","last_became_active":"2024-09-07T03:32:14.109177+0000","last_became_peered":"2024-09-07T03:32:14.109177+0000","last_unstale":"2024-09-07T03:35:23.590380+0000","last_undegraded":"2024-09-07T03:35:23.590380+0000","last_fullsized":"2024-09-07T03:35:23.590380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:49:22.436331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281713+0000","last_change":"2024-09-07T03:32:12.121206+0000","last_active":"2024-09-07T03:32:50.281713+0000","last_peered":"2024-09-07T03:32:50.281713+0000","last_clean":"2024-09-07T03:32:50.281713+0000","last_became_active":"2024-09-07T03:32:12.120449+0000","last_became_peered":"2024-09-07T03:32:12.120449+0000","last_unstale":"2024-09-07T03:32:50.281713+0000","last_undegraded":"2024-09-07T03:32:50.281713+0000","last_fullsized":"2024-09-07T03:32:50.281713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:04:17.603683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731173+0000","last_change":"2024-09-07T03:32:14.125322+0000","last_active":"2024-09-07T03:35:23.731173+0000","last_peered":"2024-09-07T03:35:23.731173+0000","last_clean":"2024-09-07T03:35:23.731173+0000","last_became_active":"2024-09-07T03:32:14.125065+0000","last_became_peered":"2024-09-07T03:32:14.125065+0000","last_unstale":"2024-09-07T03:35:23.731173+0000","last_undegraded":"2024-09-07T03:35:23.731173+0000","last_fullsized":"2024-09-07T03:35:23.731173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.382792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279118+0000","last_change":"2024-09-07T03:32:12.125531+0000","last_active":"2024-09-07T03:32:50.279118+0000","last_peered":"2024-09-07T03:32:50.279118+0000","last_clean":"2024-09-07T03:32:50.279118+0000","last_became_active":"2024-09-07T03:32:12.124516+0000","last_became_peered":"2024-09-07T03:32:12.124516+0000","last_unstale":"2024-09-07T03:32:50.279118+0000","last_undegraded":"2024-09-07T03:32:50.279118+0000","last_fullsized":"2024-09-07T03:32:50.279118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:38.848848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:41.230770+0000","last_change":"2024-09-07T03:32:14.112755+0000","last_active":"2024-09-07T03:34:41.230770+0000","last_peered":"2024-09-07T03:34:41.230770+0000","last_clean":"2024-09-07T03:34:41.230770+0000","last_became_active":"2024-09-07T03:32:14.112477+0000","last_became_peered":"2024-09-07T03:32:14.112477+0000","last_unstale":"2024-09-07T03:34:41.230770+0000","last_undegraded":"2024-09-07T03:34:41.230770+0000","last_fullsized":"2024-09-07T03:34:41.230770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:41:15.350018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275444+0000","last_change":"2024-09-07T03:32:12.137178+0000","last_active":"2024-09-07T03:32:50.275444+0000","last_peered":"2024-09-07T03:32:50.275444+0000","last_clean":"2024-09-07T03:32:50.275444+0000","last_became_active":"2024-09-07T03:32:12.136801+0000","last_became_peered":"2024-09-07T03:32:12.136801+0000","last_unstale":"2024-09-07T03:32:50.275444+0000","last_undegraded":"2024-09-07T03:32:50.275444+0000","last_fullsized":"2024-09-07T03:32:50.275444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:14:59.894718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.850114+0000","last_change":"2024-09-07T03:32:14.109462+0000","last_active":"2024-09-07T03:35:23.850114+0000","last_peered":"2024-09-07T03:35:23.850114+0000","last_clean":"2024-09-07T03:35:23.850114+0000","last_became_active":"2024-09-07T03:32:14.109167+0000","last_became_peered":"2024-09-07T03:32:14.109167+0000","last_unstale":"2024-09-07T03:35:23.850114+0000","last_undegraded":"2024-09-07T03:35:23.850114+0000","last_fullsized":"2024-09-07T03:35:23.850114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:39.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272300+0000","last_change":"2024-09-07T03:32:12.138445+0000","last_active":"2024-09-07T03:32:50.272300+0000","last_peered":"2024-09-07T03:32:50.272300+0000","last_clean":"2024-09-07T03:32:50.272300+0000","last_became_active":"2024-09-07T03:32:12.138105+0000","last_became_peered":"2024-09-07T03:32:12.138105+0000","last_unstale":"2024-09-07T03:32:50.272300+0000","last_undegraded":"2024-09-07T03:32:50.272300+0000","last_fullsized":"2024-09-07T03:32:50.272300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.111018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.773106+0000","last_change":"2024-09-07T03:32:22.149626+0000","last_active":"2024-09-07T03:35:23.773106+0000","last_peered":"2024-09-07T03:35:23.773106+0000","last_clean":"2024-09-07T03:35:23.773106+0000","last_became_active":"2024-09-07T03:32:22.149337+0000","last_became_peered":"2024-09-07T03:32:22.149337+0000","last_unstale":"2024-09-07T03:35:23.773106+0000","last_undegraded":"2024-09-07T03:35:23.773106+0000","last_fullsized":"2024-09-07T03:35:23.773106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:00:45.310817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230587+0000","last_change":"2024-09-07T03:32:14.126524+0000","last_active":"2024-09-07T03:34:36.230587+0000","last_peered":"2024-09-07T03:34:36.230587+0000","last_clean":"2024-09-07T03:34:36.230587+0000","last_became_active":"2024-09-07T03:32:14.126222+0000","last_became_peered":"2024-09-07T03:32:14.126222+0000","last_unstale":"2024-09-07T03:34:36.230587+0000","last_undegraded":"2024-09-07T03:34:36.230587+0000","last_fullsized":"2024-09-07T03:34:36.230587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:51:09.670249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273573+0000","last_change":"2024-09-07T03:32:12.125232+0000","last_active":"2024-09-07T03:32:50.273573+0000","last_peered":"2024-09-07T03:32:50.273573+0000","last_clean":"2024-09-07T03:32:50.273573+0000","last_became_active":"2024-09-07T03:32:12.124815+0000","last_became_peered":"2024-09-07T03:32:12.124815+0000","last_unstale":"2024-09-07T03:32:50.273573+0000","last_undegraded":"2024-09-07T03:32:50.273573+0000","last_fullsized":"2024-09-07T03:32:50.273573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:23.041037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275282+0000","last_change":"2024-09-07T03:32:16.127792+0000","last_active":"2024-09-07T03:32:50.275282+0000","last_peered":"2024-09-07T03:32:50.275282+0000","last_clean":"2024-09-07T03:32:50.275282+0000","last_became_active":"2024-09-07T03:32:16.127430+0000","last_became_peered":"2024-09-07T03:32:16.127430+0000","last_unstale":"2024-09-07T03:32:50.275282+0000","last_undegraded":"2024-09-07T03:32:50.275282+0000","last_fullsized":"2024-09-07T03:32:50.275282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:46.752720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.588157+0000","last_change":"2024-09-07T03:32:18.130430+0000","last_active":"2024-09-07T03:35:30.588157+0000","last_peered":"2024-09-07T03:35:30.588157+0000","last_clean":"2024-09-07T03:35:30.588157+0000","last_became_active":"2024-09-07T03:32:18.130101+0000","last_became_peered":"2024-09-07T03:32:18.130101+0000","last_unstale":"2024-09-07T03:35:30.588157+0000","last_undegraded":"2024-09-07T03:35:30.588157+0000","last_fullsized":"2024-09-07T03:35:30.588157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:55.756545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280723+0000","last_change":"2024-09-07T03:32:20.147157+0000","last_active":"2024-09-07T03:32:50.280723+0000","last_peered":"2024-09-07T03:32:50.280723+0000","last_clean":"2024-09-07T03:32:50.280723+0000","last_became_active":"2024-09-07T03:32:20.146716+0000","last_became_peered":"2024-09-07T03:32:20.146716+0000","last_unstale":"2024-09-07T03:32:50.280723+0000","last_undegraded":"2024-09-07T03:32:50.280723+0000","last_fullsized":"2024-09-07T03:32:50.280723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:23.679745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"36'9","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.982420+0000","last_change":"2024-09-07T03:32:22.143355+0000","last_active":"2024-09-07T03:33:38.982420+0000","last_peered":"2024-09-07T03:33:38.982420+0000","last_clean":"2024-09-07T03:33:38.982420+0000","last_became_active":"2024-09-07T03:32:22.143092+0000","last_became_peered":"2024-09-07T03:32:22.143092+0000","last_unstale":"2024-09-07T03:33:38.982420+0000","last_undegraded":"2024-09-07T03:33:38.982420+0000","last_fullsized":"2024-09-07T03:33:38.982420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:30:18.450771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'8","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843638+0000","last_change":"2024-09-07T03:32:14.122327+0000","last_active":"2024-09-07T03:35:23.843638+0000","last_peered":"2024-09-07T03:35:23.843638+0000","last_clean":"2024-09-07T03:35:23.843638+0000","last_became_active":"2024-09-07T03:32:14.121998+0000","last_became_peered":"2024-09-07T03:32:14.121998+0000","last_unstale":"2024-09-07T03:35:23.843638+0000","last_undegraded":"2024-09-07T03:35:23.843638+0000","last_fullsized":"2024-09-07T03:35:23.843638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432032+0000","last_change":"2024-09-07T03:32:12.130331+0000","last_active":"2024-09-07T03:32:55.432032+0000","last_peered":"2024-09-07T03:32:55.432032+0000","last_clean":"2024-09-07T03:32:55.432032+0000","last_became_active":"2024-09-07T03:32:12.129979+0000","last_became_peered":"2024-09-07T03:32:12.129979+0000","last_unstale":"2024-09-07T03:32:55.432032+0000","last_undegraded":"2024-09-07T03:32:55.432032+0000","last_fullsized":"2024-09-07T03:32:55.432032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:15.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275223+0000","last_change":"2024-09-07T03:32:16.126421+0000","last_active":"2024-09-07T03:32:50.275223+0000","last_peered":"2024-09-07T03:32:50.275223+0000","last_clean":"2024-09-07T03:32:50.275223+0000","last_became_active":"2024-09-07T03:32:16.126116+0000","last_became_peered":"2024-09-07T03:32:16.126116+0000","last_unstale":"2024-09-07T03:32:50.275223+0000","last_undegraded":"2024-09-07T03:32:50.275223+0000","last_fullsized":"2024-09-07T03:32:50.275223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:07:32.152302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472267+0000","last_change":"2024-09-07T03:32:18.132461+0000","last_active":"2024-09-07T03:32:50.472267+0000","last_peered":"2024-09-07T03:32:50.472267+0000","last_clean":"2024-09-07T03:32:50.472267+0000","last_became_active":"2024-09-07T03:32:18.132152+0000","last_became_peered":"2024-09-07T03:32:18.132152+0000","last_unstale":"2024-09-07T03:32:50.472267+0000","last_undegraded":"2024-09-07T03:32:50.472267+0000","last_fullsized":"2024-09-07T03:32:50.472267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:45:42.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280341+0000","last_change":"2024-09-07T03:32:20.146991+0000","last_active":"2024-09-07T03:32:50.280341+0000","last_peered":"2024-09-07T03:32:50.280341+0000","last_clean":"2024-09-07T03:32:50.280341+0000","last_became_active":"2024-09-07T03:32:20.146457+0000","last_became_peered":"2024-09-07T03:32:20.146457+0000","last_unstale":"2024-09-07T03:32:50.280341+0000","last_undegraded":"2024-09-07T03:32:50.280341+0000","last_fullsized":"2024-09-07T03:32:50.280341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.222346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"36'10","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.807540+0000","last_change":"2024-09-07T03:32:22.144066+0000","last_active":"2024-09-07T03:35:23.807540+0000","last_peered":"2024-09-07T03:35:23.807540+0000","last_clean":"2024-09-07T03:35:23.807540+0000","last_became_active":"2024-09-07T03:32:22.143751+0000","last_became_peered":"2024-09-07T03:32:22.143751+0000","last_unstale":"2024-09-07T03:35:23.807540+0000","last_undegraded":"2024-09-07T03:35:23.807540+0000","last_fullsized":"2024-09-07T03:35:23.807540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:14.926443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"36'20","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731193+0000","last_change":"2024-09-07T03:32:14.130832+0000","last_active":"2024-09-07T03:35:23.731193+0000","last_peered":"2024-09-07T03:35:23.731193+0000","last_clean":"2024-09-07T03:35:23.731193+0000","last_became_active":"2024-09-07T03:32:14.130544+0000","last_became_peered":"2024-09-07T03:32:14.130544+0000","last_unstale":"2024-09-07T03:35:23.731193+0000","last_undegraded":"2024-09-07T03:35:23.731193+0000","last_fullsized":"2024-09-07T03:35:23.731193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278167+0000","last_change":"2024-09-07T03:32:12.125233+0000","last_active":"2024-09-07T03:32:50.278167+0000","last_peered":"2024-09-07T03:32:50.278167+0000","last_clean":"2024-09-07T03:32:50.278167+0000","last_became_active":"2024-09-07T03:32:12.124808+0000","last_became_peered":"2024-09-07T03:32:12.124808+0000","last_unstale":"2024-09-07T03:32:50.278167+0000","last_undegraded":"2024-09-07T03:32:50.278167+0000","last_fullsized":"2024-09-07T03:32:50.278167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:26.378096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276016+0000","last_change":"2024-09-07T03:32:16.126571+0000","last_active":"2024-09-07T03:32:50.276016+0000","last_peered":"2024-09-07T03:32:50.276016+0000","last_clean":"2024-09-07T03:32:50.276016+0000","last_became_active":"2024-09-07T03:32:16.126318+0000","last_became_peered":"2024-09-07T03:32:16.126318+0000","last_unstale":"2024-09-07T03:32:50.276016+0000","last_undegraded":"2024-09-07T03:32:50.276016+0000","last_fullsized":"2024-09-07T03:32:50.276016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:51.962540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275774+0000","last_change":"2024-09-07T03:32:18.128687+0000","last_active":"2024-09-07T03:32:50.275774+0000","last_peered":"2024-09-07T03:32:50.275774+0000","last_clean":"2024-09-07T03:32:50.275774+0000","last_became_active":"2024-09-07T03:32:18.128391+0000","last_became_peered":"2024-09-07T03:32:18.128391+0000","last_unstale":"2024-09-07T03:32:50.275774+0000","last_undegraded":"2024-09-07T03:32:50.275774+0000","last_fullsized":"2024-09-07T03:32:50.275774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:50:24.989266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.539513+0000","last_change":"2024-09-07T03:32:20.140796+0000","last_active":"2024-09-07T03:35:30.539513+0000","last_peered":"2024-09-07T03:35:30.539513+0000","last_clean":"2024-09-07T03:35:30.539513+0000","last_became_active":"2024-09-07T03:32:20.140249+0000","last_became_peered":"2024-09-07T03:32:20.140249+0000","last_unstale":"2024-09-07T03:35:30.539513+0000","last_undegraded":"2024-09-07T03:35:30.539513+0000","last_fullsized":"2024-09-07T03:35:30.539513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:12.918865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274799+0000","last_change":"2024-09-07T03:32:22.141118+0000","last_active":"2024-09-07T03:32:50.274799+0000","last_peered":"2024-09-07T03:32:50.274799+0000","last_clean":"2024-09-07T03:32:50.274799+0000","last_became_active":"2024-09-07T03:32:22.139829+0000","last_became_peered":"2024-09-07T03:32:22.139829+0000","last_unstale":"2024-09-07T03:32:50.274799+0000","last_undegraded":"2024-09-07T03:32:50.274799+0000","last_fullsized":"2024-09-07T03:32:50.274799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:55:30.425595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587735+0000","last_change":"2024-09-07T03:32:14.126517+0000","last_active":"2024-09-07T03:35:23.587735+0000","last_peered":"2024-09-07T03:35:23.587735+0000","last_clean":"2024-09-07T03:35:23.587735+0000","last_became_active":"2024-09-07T03:32:14.126140+0000","last_became_peered":"2024-09-07T03:32:14.126140+0000","last_unstale":"2024-09-07T03:35:23.587735+0000","last_undegraded":"2024-09-07T03:35:23.587735+0000","last_fullsized":"2024-09-07T03:35:23.587735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277837+0000","last_change":"2024-09-07T03:32:12.133946+0000","last_active":"2024-09-07T03:32:50.277837+0000","last_peered":"2024-09-07T03:32:50.277837+0000","last_clean":"2024-09-07T03:32:50.277837+0000","last_became_active":"2024-09-07T03:32:12.133270+0000","last_became_peered":"2024-09-07T03:32:12.133270+0000","last_unstale":"2024-09-07T03:32:50.277837+0000","last_undegraded":"2024-09-07T03:32:50.277837+0000","last_fullsized":"2024-09-07T03:32:50.277837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:56.372379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281906+0000","last_change":"2024-09-07T03:32:16.117091+0000","last_active":"2024-09-07T03:32:50.281906+0000","last_peered":"2024-09-07T03:32:50.281906+0000","last_clean":"2024-09-07T03:32:50.281906+0000","last_became_active":"2024-09-07T03:32:16.116761+0000","last_became_peered":"2024-09-07T03:32:16.116761+0000","last_unstale":"2024-09-07T03:32:50.281906+0000","last_undegraded":"2024-09-07T03:32:50.281906+0000","last_fullsized":"2024-09-07T03:32:50.281906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:07:07.674647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'41","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.680636+0000","last_change":"2024-09-07T03:32:18.129567+0000","last_active":"2024-09-07T03:35:30.680636+0000","last_peered":"2024-09-07T03:35:30.680636+0000","last_clean":"2024-09-07T03:35:30.680636+0000","last_became_active":"2024-09-07T03:32:18.128901+0000","last_became_peered":"2024-09-07T03:32:18.128901+0000","last_unstale":"2024-09-07T03:35:30.680636+0000","last_undegraded":"2024-09-07T03:35:30.680636+0000","last_fullsized":"2024-09-07T03:35:30.680636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:42:21.711836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.545527+0000","last_change":"2024-09-07T03:32:20.142693+0000","last_active":"2024-09-07T03:35:30.545527+0000","last_peered":"2024-09-07T03:35:30.545527+0000","last_clean":"2024-09-07T03:35:30.545527+0000","last_became_active":"2024-09-07T03:32:20.142390+0000","last_became_peered":"2024-09-07T03:32:20.142390+0000","last_unstale":"2024-09-07T03:35:30.545527+0000","last_undegraded":"2024-09-07T03:35:30.545527+0000","last_fullsized":"2024-09-07T03:35:30.545527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:51:20.882177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272814+0000","last_change":"2024-09-07T03:32:14.123300+0000","last_active":"2024-09-07T03:32:50.272814+0000","last_peered":"2024-09-07T03:32:50.272814+0000","last_clean":"2024-09-07T03:32:50.272814+0000","last_became_active":"2024-09-07T03:32:14.122806+0000","last_became_peered":"2024-09-07T03:32:14.122806+0000","last_unstale":"2024-09-07T03:32:50.272814+0000","last_undegraded":"2024-09-07T03:32:50.272814+0000","last_fullsized":"2024-09-07T03:32:50.272814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:12.527168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.458084+0000","last_change":"2024-09-07T03:32:12.125001+0000","last_active":"2024-09-07T03:35:23.458084+0000","last_peered":"2024-09-07T03:35:23.458084+0000","last_clean":"2024-09-07T03:35:23.458084+0000","last_became_active":"2024-09-07T03:32:12.124564+0000","last_became_peered":"2024-09-07T03:32:12.124564+0000","last_unstale":"2024-09-07T03:35:23.458084+0000","last_undegraded":"2024-09-07T03:35:23.458084+0000","last_fullsized":"2024-09-07T03:35:23.458084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:13:15.055699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470518+0000","last_change":"2024-09-07T03:32:16.128785+0000","last_active":"2024-09-07T03:32:50.470518+0000","last_peered":"2024-09-07T03:32:50.470518+0000","last_clean":"2024-09-07T03:32:50.470518+0000","last_became_active":"2024-09-07T03:32:16.128519+0000","last_became_peered":"2024-09-07T03:32:16.128519+0000","last_unstale":"2024-09-07T03:32:50.470518+0000","last_undegraded":"2024-09-07T03:32:50.470518+0000","last_fullsized":"2024-09-07T03:32:50.470518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:31.864367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'49","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.600626+0000","last_change":"2024-09-07T03:32:18.133115+0000","last_active":"2024-09-07T03:35:30.600626+0000","last_peered":"2024-09-07T03:35:30.600626+0000","last_clean":"2024-09-07T03:35:30.600626+0000","last_became_active":"2024-09-07T03:32:18.132867+0000","last_became_peered":"2024-09-07T03:32:18.132867+0000","last_unstale":"2024-09-07T03:35:30.600626+0000","last_undegraded":"2024-09-07T03:35:30.600626+0000","last_fullsized":"2024-09-07T03:35:30.600626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:21.167694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470403+0000","last_change":"2024-09-07T03:32:20.140261+0000","last_active":"2024-09-07T03:32:50.470403+0000","last_peered":"2024-09-07T03:32:50.470403+0000","last_clean":"2024-09-07T03:32:50.470403+0000","last_became_active":"2024-09-07T03:32:20.139806+0000","last_became_peered":"2024-09-07T03:32:20.139806+0000","last_unstale":"2024-09-07T03:32:50.470403+0000","last_undegraded":"2024-09-07T03:32:50.470403+0000","last_fullsized":"2024-09-07T03:32:50.470403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:38:36.923114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.784797+0000","last_change":"2024-09-07T03:32:22.148464+0000","last_active":"2024-09-07T03:35:23.784797+0000","last_peered":"2024-09-07T03:35:23.784797+0000","last_clean":"2024-09-07T03:35:23.784797+0000","last_became_active":"2024-09-07T03:32:22.148149+0000","last_became_peered":"2024-09-07T03:32:22.148149+0000","last_unstale":"2024-09-07T03:35:23.784797+0000","last_undegraded":"2024-09-07T03:35:23.784797+0000","last_fullsized":"2024-09-07T03:35:23.784797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:22.630172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806003+0000","last_change":"2024-09-07T03:32:50.281567+0000","last_active":"2024-09-07T03:35:23.806003+0000","last_peered":"2024-09-07T03:35:23.806003+0000","last_clean":"2024-09-07T03:35:23.806003+0000","last_became_active":"2024-09-07T03:32:50.279097+0000","last_became_peered":"2024-09-07T03:32:50.279097+0000","last_unstale":"2024-09-07T03:35:23.806003+0000","last_undegraded":"2024-09-07T03:35:23.806003+0000","last_fullsized":"2024-09-07T03:35:23.806003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:31:29.966121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.432175+0000","last_change":"2024-09-07T03:32:12.124416+0000","last_active":"2024-09-07T03:35:23.432175+0000","last_peered":"2024-09-07T03:35:23.432175+0000","last_clean":"2024-09-07T03:35:23.432175+0000","last_became_active":"2024-09-07T03:32:12.123895+0000","last_became_peered":"2024-09-07T03:32:12.123895+0000","last_unstale":"2024-09-07T03:35:23.432175+0000","last_undegraded":"2024-09-07T03:35:23.432175+0000","last_fullsized":"2024-09-07T03:35:23.432175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:03.158393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274777+0000","last_change":"2024-09-07T03:32:16.129022+0000","last_active":"2024-09-07T03:32:50.274777+0000","last_peered":"2024-09-07T03:32:50.274777+0000","last_clean":"2024-09-07T03:32:50.274777+0000","last_became_active":"2024-09-07T03:32:16.128471+0000","last_became_peered":"2024-09-07T03:32:16.128471+0000","last_unstale":"2024-09-07T03:32:50.274777+0000","last_undegraded":"2024-09-07T03:32:50.274777+0000","last_fullsized":"2024-09-07T03:32:50.274777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:29.378625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'39","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.641623+0000","last_change":"2024-09-07T03:32:18.127995+0000","last_active":"2024-09-07T03:35:30.641623+0000","last_peered":"2024-09-07T03:35:30.641623+0000","last_clean":"2024-09-07T03:35:30.641623+0000","last_became_active":"2024-09-07T03:32:18.127674+0000","last_became_peered":"2024-09-07T03:32:18.127674+0000","last_unstale":"2024-09-07T03:35:30.641623+0000","last_undegraded":"2024-09-07T03:35:30.641623+0000","last_fullsized":"2024-09-07T03:35:30.641623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:39:30.847124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272008+0000","last_change":"2024-09-07T03:32:20.142615+0000","last_active":"2024-09-07T03:32:50.272008+0000","last_peered":"2024-09-07T03:32:50.272008+0000","last_clean":"2024-09-07T03:32:50.272008+0000","last_became_active":"2024-09-07T03:32:20.142322+0000","last_became_peered":"2024-09-07T03:32:20.142322+0000","last_unstale":"2024-09-07T03:32:50.272008+0000","last_undegraded":"2024-09-07T03:32:50.272008+0000","last_fullsized":"2024-09-07T03:32:50.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:20:24.113543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:33.274480+0000","last_change":"2024-09-07T03:32:22.140060+0000","last_active":"2024-09-07T03:33:33.274480+0000","last_peered":"2024-09-07T03:33:33.274480+0000","last_clean":"2024-09-07T03:33:33.274480+0000","last_became_active":"2024-09-07T03:32:22.139771+0000","last_became_peered":"2024-09-07T03:32:22.139771+0000","last_unstale":"2024-09-07T03:33:33.274480+0000","last_undegraded":"2024-09-07T03:33:33.274480+0000","last_fullsized":"2024-09-07T03:33:33.274480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:32:56.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963274+0000","last_change":"2024-09-07T03:32:14.122499+0000","last_active":"2024-09-07T03:34:22.963274+0000","last_peered":"2024-09-07T03:34:22.963274+0000","last_clean":"2024-09-07T03:34:22.963274+0000","last_became_active":"2024-09-07T03:32:14.122182+0000","last_became_peered":"2024-09-07T03:32:14.122182+0000","last_unstale":"2024-09-07T03:34:22.963274+0000","last_undegraded":"2024-09-07T03:34:22.963274+0000","last_fullsized":"2024-09-07T03:34:22.963274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.940422+0000","last_change":"2024-09-07T03:32:12.120934+0000","last_active":"2024-09-07T03:34:22.940422+0000","last_peered":"2024-09-07T03:34:22.940422+0000","last_clean":"2024-09-07T03:34:22.940422+0000","last_became_active":"2024-09-07T03:32:12.120464+0000","last_became_peered":"2024-09-07T03:32:12.120464+0000","last_unstale":"2024-09-07T03:34:22.940422+0000","last_undegraded":"2024-09-07T03:34:22.940422+0000","last_fullsized":"2024-09-07T03:34:22.940422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:35:47.814978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275521+0000","last_change":"2024-09-07T03:32:16.124913+0000","last_active":"2024-09-07T03:32:50.275521+0000","last_peered":"2024-09-07T03:32:50.275521+0000","last_clean":"2024-09-07T03:32:50.275521+0000","last_became_active":"2024-09-07T03:32:16.124297+0000","last_became_peered":"2024-09-07T03:32:16.124297+0000","last_unstale":"2024-09-07T03:32:50.275521+0000","last_undegraded":"2024-09-07T03:32:50.275521+0000","last_fullsized":"2024-09-07T03:32:50.275521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:34.327180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'52","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.607217+0000","last_change":"2024-09-07T03:32:18.130149+0000","last_active":"2024-09-07T03:35:30.607217+0000","last_peered":"2024-09-07T03:35:30.607217+0000","last_clean":"2024-09-07T03:35:30.607217+0000","last_became_active":"2024-09-07T03:32:18.129944+0000","last_became_peered":"2024-09-07T03:32:18.129944+0000","last_unstale":"2024-09-07T03:35:30.607217+0000","last_undegraded":"2024-09-07T03:35:30.607217+0000","last_fullsized":"2024-09-07T03:35:30.607217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:27:30.361760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":352,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.546808+0000","last_change":"2024-09-07T03:32:20.144523+0000","last_active":"2024-09-07T03:35:30.546808+0000","last_peered":"2024-09-07T03:35:30.546808+0000","last_clean":"2024-09-07T03:35:30.546808+0000","last_became_active":"2024-09-07T03:32:20.144077+0000","last_became_peered":"2024-09-07T03:32:20.144077+0000","last_unstale":"2024-09-07T03:35:30.546808+0000","last_undegraded":"2024-09-07T03:35:30.546808+0000","last_fullsized":"2024-09-07T03:35:30.546808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:25.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471098+0000","last_change":"2024-09-07T03:32:22.146228+0000","last_active":"2024-09-07T03:32:50.471098+0000","last_peered":"2024-09-07T03:32:50.471098+0000","last_clean":"2024-09-07T03:32:50.471098+0000","last_became_active":"2024-09-07T03:32:22.145690+0000","last_became_peered":"2024-09-07T03:32:22.145690+0000","last_unstale":"2024-09-07T03:32:50.471098+0000","last_undegraded":"2024-09-07T03:32:50.471098+0000","last_fullsized":"2024-09-07T03:32:50.471098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:59:34.851122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'7","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.483958+0000","last_change":"2024-09-07T03:32:14.113637+0000","last_active":"2024-09-07T03:35:23.483958+0000","last_peered":"2024-09-07T03:35:23.483958+0000","last_clean":"2024-09-07T03:35:23.483958+0000","last_became_active":"2024-09-07T03:32:14.113104+0000","last_became_peered":"2024-09-07T03:32:14.113104+0000","last_unstale":"2024-09-07T03:35:23.483958+0000","last_undegraded":"2024-09-07T03:35:23.483958+0000","last_fullsized":"2024-09-07T03:35:23.483958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:46:15.552973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278855+0000","last_change":"2024-09-07T03:32:12.125878+0000","last_active":"2024-09-07T03:32:50.278855+0000","last_peered":"2024-09-07T03:32:50.278855+0000","last_clean":"2024-09-07T03:32:50.278855+0000","last_became_active":"2024-09-07T03:32:12.125172+0000","last_became_peered":"2024-09-07T03:32:12.125172+0000","last_unstale":"2024-09-07T03:32:50.278855+0000","last_undegraded":"2024-09-07T03:32:50.278855+0000","last_fullsized":"2024-09-07T03:32:50.278855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:36:10.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278236+0000","last_change":"2024-09-07T03:32:16.125904+0000","last_active":"2024-09-07T03:32:50.278236+0000","last_peered":"2024-09-07T03:32:50.278236+0000","last_clean":"2024-09-07T03:32:50.278236+0000","last_became_active":"2024-09-07T03:32:16.125618+0000","last_became_peered":"2024-09-07T03:32:16.125618+0000","last_unstale":"2024-09-07T03:32:50.278236+0000","last_undegraded":"2024-09-07T03:32:50.278236+0000","last_fullsized":"2024-09-07T03:32:50.278236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:06.494089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'72","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.650570+0000","last_change":"2024-09-07T03:32:18.134274+0000","last_active":"2024-09-07T03:35:30.650570+0000","last_peered":"2024-09-07T03:35:30.650570+0000","last_clean":"2024-09-07T03:35:30.650570+0000","last_became_active":"2024-09-07T03:32:18.134005+0000","last_became_peered":"2024-09-07T03:32:18.134005+0000","last_unstale":"2024-09-07T03:35:30.650570+0000","last_undegraded":"2024-09-07T03:35:30.650570+0000","last_fullsized":"2024-09-07T03:35:30.650570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:07.792695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274382+0000","last_change":"2024-09-07T03:32:20.145524+0000","last_active":"2024-09-07T03:32:50.274382+0000","last_peered":"2024-09-07T03:32:50.274382+0000","last_clean":"2024-09-07T03:32:50.274382+0000","last_became_active":"2024-09-07T03:32:20.145119+0000","last_became_peered":"2024-09-07T03:32:20.145119+0000","last_unstale":"2024-09-07T03:32:50.274382+0000","last_undegraded":"2024-09-07T03:32:50.274382+0000","last_fullsized":"2024-09-07T03:32:50.274382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:21.410162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.058175+0000","last_change":"2024-09-07T03:32:22.149484+0000","last_active":"2024-09-07T03:35:24.058175+0000","last_peered":"2024-09-07T03:35:24.058175+0000","last_clean":"2024-09-07T03:35:24.058175+0000","last_became_active":"2024-09-07T03:32:22.149203+0000","last_became_peered":"2024-09-07T03:32:22.149203+0000","last_unstale":"2024-09-07T03:35:24.058175+0000","last_undegraded":"2024-09-07T03:35:24.058175+0000","last_fullsized":"2024-09-07T03:35:24.058175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:33.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230163+0000","last_change":"2024-09-07T03:32:14.124704+0000","last_active":"2024-09-07T03:34:28.230163+0000","last_peered":"2024-09-07T03:34:28.230163+0000","last_clean":"2024-09-07T03:34:28.230163+0000","last_became_active":"2024-09-07T03:32:14.124120+0000","last_became_peered":"2024-09-07T03:32:14.124120+0000","last_unstale":"2024-09-07T03:34:28.230163+0000","last_undegraded":"2024-09-07T03:34:28.230163+0000","last_fullsized":"2024-09-07T03:34:28.230163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:15:18.554790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273263+0000","last_change":"2024-09-07T03:32:12.133844+0000","last_active":"2024-09-07T03:32:50.273263+0000","last_peered":"2024-09-07T03:32:50.273263+0000","last_clean":"2024-09-07T03:32:50.273263+0000","last_became_active":"2024-09-07T03:32:12.133434+0000","last_became_peered":"2024-09-07T03:32:12.133434+0000","last_unstale":"2024-09-07T03:32:50.273263+0000","last_undegraded":"2024-09-07T03:32:50.273263+0000","last_fullsized":"2024-09-07T03:32:50.273263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:56:28.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277527+0000","last_change":"2024-09-07T03:32:16.121534+0000","last_active":"2024-09-07T03:32:50.277527+0000","last_peered":"2024-09-07T03:32:50.277527+0000","last_clean":"2024-09-07T03:32:50.277527+0000","last_became_active":"2024-09-07T03:32:16.121256+0000","last_became_peered":"2024-09-07T03:32:16.121256+0000","last_unstale":"2024-09-07T03:32:50.277527+0000","last_undegraded":"2024-09-07T03:32:50.277527+0000","last_fullsized":"2024-09-07T03:32:50.277527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:19.973036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.654116+0000","last_change":"2024-09-07T03:32:18.128938+0000","last_active":"2024-09-07T03:35:30.654116+0000","last_peered":"2024-09-07T03:35:30.654116+0000","last_clean":"2024-09-07T03:35:30.654116+0000","last_became_active":"2024-09-07T03:32:18.128470+0000","last_became_peered":"2024-09-07T03:32:18.128470+0000","last_unstale":"2024-09-07T03:35:30.654116+0000","last_undegraded":"2024-09-07T03:35:30.654116+0000","last_fullsized":"2024-09-07T03:35:30.654116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:15:06.767791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276446+0000","last_change":"2024-09-07T03:32:20.136526+0000","last_active":"2024-09-07T03:32:50.276446+0000","last_peered":"2024-09-07T03:32:50.276446+0000","last_clean":"2024-09-07T03:32:50.276446+0000","last_became_active":"2024-09-07T03:32:20.134892+0000","last_became_peered":"2024-09-07T03:32:20.134892+0000","last_unstale":"2024-09-07T03:32:50.276446+0000","last_undegraded":"2024-09-07T03:32:50.276446+0000","last_fullsized":"2024-09-07T03:32:50.276446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:28.142767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228166+0000","last_change":"2024-09-07T03:32:22.153373+0000","last_active":"2024-09-07T03:34:21.228166+0000","last_peered":"2024-09-07T03:34:21.228166+0000","last_clean":"2024-09-07T03:34:21.228166+0000","last_became_active":"2024-09-07T03:32:22.153134+0000","last_became_peered":"2024-09-07T03:32:22.153134+0000","last_unstale":"2024-09-07T03:34:21.228166+0000","last_undegraded":"2024-09-07T03:34:21.228166+0000","last_fullsized":"2024-09-07T03:34:21.228166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:54.932378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435691+0000","last_change":"2024-09-07T03:32:14.113575+0000","last_active":"2024-09-07T03:34:19.435691+0000","last_peered":"2024-09-07T03:34:19.435691+0000","last_clean":"2024-09-07T03:34:19.435691+0000","last_became_active":"2024-09-07T03:32:14.113243+0000","last_became_peered":"2024-09-07T03:32:14.113243+0000","last_unstale":"2024-09-07T03:34:19.435691+0000","last_undegraded":"2024-09-07T03:34:19.435691+0000","last_fullsized":"2024-09-07T03:34:19.435691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:14.596869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.723676+0000","last_change":"2024-09-07T03:32:12.120954+0000","last_active":"2024-09-07T03:35:23.723676+0000","last_peered":"2024-09-07T03:35:23.723676+0000","last_clean":"2024-09-07T03:35:23.723676+0000","last_became_active":"2024-09-07T03:32:12.120531+0000","last_became_peered":"2024-09-07T03:32:12.120531+0000","last_unstale":"2024-09-07T03:35:23.723676+0000","last_undegraded":"2024-09-07T03:35:23.723676+0000","last_fullsized":"2024-09-07T03:35:23.723676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:11.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470958+0000","last_change":"2024-09-07T03:32:16.124431+0000","last_active":"2024-09-07T03:32:50.470958+0000","last_peered":"2024-09-07T03:32:50.470958+0000","last_clean":"2024-09-07T03:32:50.470958+0000","last_became_active":"2024-09-07T03:32:16.124100+0000","last_became_peered":"2024-09-07T03:32:16.124100+0000","last_unstale":"2024-09-07T03:32:50.470958+0000","last_undegraded":"2024-09-07T03:32:50.470958+0000","last_fullsized":"2024-09-07T03:32:50.470958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:20:34.634089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.632033+0000","last_change":"2024-09-07T03:32:18.130376+0000","last_active":"2024-09-07T03:35:30.632033+0000","last_peered":"2024-09-07T03:35:30.632033+0000","last_clean":"2024-09-07T03:35:30.632033+0000","last_became_active":"2024-09-07T03:32:18.130120+0000","last_became_peered":"2024-09-07T03:32:18.130120+0000","last_unstale":"2024-09-07T03:35:30.632033+0000","last_undegraded":"2024-09-07T03:35:30.632033+0000","last_fullsized":"2024-09-07T03:35:30.632033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:03.978153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.540272+0000","last_change":"2024-09-07T03:32:20.146795+0000","last_active":"2024-09-07T03:35:30.540272+0000","last_peered":"2024-09-07T03:35:30.540272+0000","last_clean":"2024-09-07T03:35:30.540272+0000","last_became_active":"2024-09-07T03:32:20.146408+0000","last_became_peered":"2024-09-07T03:32:20.146408+0000","last_unstale":"2024-09-07T03:35:30.540272+0000","last_undegraded":"2024-09-07T03:35:30.540272+0000","last_fullsized":"2024-09-07T03:35:30.540272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:41.611972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'14","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230053+0000","last_change":"2024-09-07T03:32:22.147032+0000","last_active":"2024-09-07T03:34:28.230053+0000","last_peered":"2024-09-07T03:34:28.230053+0000","last_clean":"2024-09-07T03:34:28.230053+0000","last_became_active":"2024-09-07T03:32:22.145911+0000","last_became_peered":"2024-09-07T03:32:22.145911+0000","last_unstale":"2024-09-07T03:34:28.230053+0000","last_undegraded":"2024-09-07T03:34:28.230053+0000","last_fullsized":"2024-09-07T03:34:28.230053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:59:11.588353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278589+0000","last_change":"2024-09-07T03:32:14.112827+0000","last_active":"2024-09-07T03:32:50.278589+0000","last_peered":"2024-09-07T03:32:50.278589+0000","last_clean":"2024-09-07T03:32:50.278589+0000","last_became_active":"2024-09-07T03:32:14.112499+0000","last_became_peered":"2024-09-07T03:32:14.112499+0000","last_unstale":"2024-09-07T03:32:50.278589+0000","last_undegraded":"2024-09-07T03:32:50.278589+0000","last_fullsized":"2024-09-07T03:32:50.278589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:47:55.234769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432136+0000","last_change":"2024-09-07T03:32:12.132816+0000","last_active":"2024-09-07T03:32:55.432136+0000","last_peered":"2024-09-07T03:32:55.432136+0000","last_clean":"2024-09-07T03:32:55.432136+0000","last_became_active":"2024-09-07T03:32:12.132462+0000","last_became_peered":"2024-09-07T03:32:12.132462+0000","last_unstale":"2024-09-07T03:32:55.432136+0000","last_undegraded":"2024-09-07T03:32:55.432136+0000","last_fullsized":"2024-09-07T03:32:55.432136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:53:07.085389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":617,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.522508+0000","last_change":"2024-09-07T03:32:16.124805+0000","last_active":"2024-09-07T03:35:30.522508+0000","last_peered":"2024-09-07T03:35:30.522508+0000","last_clean":"2024-09-07T03:35:30.522508+0000","last_became_active":"2024-09-07T03:32:16.124500+0000","last_became_peered":"2024-09-07T03:32:16.124500+0000","last_unstale":"2024-09-07T03:35:30.522508+0000","last_undegraded":"2024-09-07T03:35:30.522508+0000","last_fullsized":"2024-09-07T03:35:30.522508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:21:20.333446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'11","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230563+0000","last_change":"2024-09-07T03:32:50.286792+0000","last_active":"2024-09-07T03:34:36.230563+0000","last_peered":"2024-09-07T03:34:36.230563+0000","last_clean":"2024-09-07T03:34:36.230563+0000","last_became_active":"2024-09-07T03:32:50.278739+0000","last_became_peered":"2024-09-07T03:32:50.278739+0000","last_unstale":"2024-09-07T03:34:36.230563+0000","last_undegraded":"2024-09-07T03:34:36.230563+0000","last_fullsized":"2024-09-07T03:34:36.230563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:41.377209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.541844+0000","last_change":"2024-09-07T03:32:20.140656+0000","last_active":"2024-09-07T03:35:30.541844+0000","last_peered":"2024-09-07T03:35:30.541844+0000","last_clean":"2024-09-07T03:35:30.541844+0000","last_became_active":"2024-09-07T03:32:20.140148+0000","last_became_peered":"2024-09-07T03:32:20.140148+0000","last_unstale":"2024-09-07T03:35:30.541844+0000","last_undegraded":"2024-09-07T03:35:30.541844+0000","last_fullsized":"2024-09-07T03:35:30.541844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:10.352295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.602934+0000","last_change":"2024-09-07T03:32:22.147355+0000","last_active":"2024-09-07T03:34:22.602934+0000","last_peered":"2024-09-07T03:34:22.602934+0000","last_clean":"2024-09-07T03:34:22.602934+0000","last_became_active":"2024-09-07T03:32:22.147049+0000","last_became_peered":"2024-09-07T03:32:22.147049+0000","last_unstale":"2024-09-07T03:34:22.602934+0000","last_undegraded":"2024-09-07T03:34:22.602934+0000","last_fullsized":"2024-09-07T03:34:22.602934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:16.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'5","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230226+0000","last_change":"2024-09-07T03:32:14.124366+0000","last_active":"2024-09-07T03:34:28.230226+0000","last_peered":"2024-09-07T03:34:28.230226+0000","last_clean":"2024-09-07T03:34:28.230226+0000","last_became_active":"2024-09-07T03:32:14.124083+0000","last_became_peered":"2024-09-07T03:32:14.124083+0000","last_unstale":"2024-09-07T03:34:28.230226+0000","last_undegraded":"2024-09-07T03:34:28.230226+0000","last_fullsized":"2024-09-07T03:34:28.230226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.448249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.384212+0000","last_change":"2024-09-07T03:32:12.141656+0000","last_active":"2024-09-07T03:35:23.384212+0000","last_peered":"2024-09-07T03:35:23.384212+0000","last_clean":"2024-09-07T03:35:23.384212+0000","last_became_active":"2024-09-07T03:32:12.141314+0000","last_became_peered":"2024-09-07T03:32:12.141314+0000","last_unstale":"2024-09-07T03:35:23.384212+0000","last_undegraded":"2024-09-07T03:35:23.384212+0000","last_fullsized":"2024-09-07T03:35:23.384212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:48:41.251471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276435+0000","last_change":"2024-09-07T03:32:16.128496+0000","last_active":"2024-09-07T03:32:50.276435+0000","last_peered":"2024-09-07T03:32:50.276435+0000","last_clean":"2024-09-07T03:32:50.276435+0000","last_became_active":"2024-09-07T03:32:16.128099+0000","last_became_peered":"2024-09-07T03:32:16.128099+0000","last_unstale":"2024-09-07T03:32:50.276435+0000","last_undegraded":"2024-09-07T03:32:50.276435+0000","last_fullsized":"2024-09-07T03:32:50.276435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:54:04.786020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'41","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.591142+0000","last_change":"2024-09-07T03:32:18.129264+0000","last_active":"2024-09-07T03:35:30.591142+0000","last_peered":"2024-09-07T03:35:30.591142+0000","last_clean":"2024-09-07T03:35:30.591142+0000","last_became_active":"2024-09-07T03:32:18.128679+0000","last_became_peered":"2024-09-07T03:32:18.128679+0000","last_unstale":"2024-09-07T03:35:30.591142+0000","last_undegraded":"2024-09-07T03:35:30.591142+0000","last_fullsized":"2024-09-07T03:35:30.591142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:04.595879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280409+0000","last_change":"2024-09-07T03:32:20.132823+0000","last_active":"2024-09-07T03:32:50.280409+0000","last_peered":"2024-09-07T03:32:50.280409+0000","last_clean":"2024-09-07T03:32:50.280409+0000","last_became_active":"2024-09-07T03:32:20.132479+0000","last_became_peered":"2024-09-07T03:32:20.132479+0000","last_unstale":"2024-09-07T03:32:50.280409+0000","last_undegraded":"2024-09-07T03:32:50.280409+0000","last_fullsized":"2024-09-07T03:32:50.280409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:52.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.060147+0000","last_change":"2024-09-07T03:32:22.140676+0000","last_active":"2024-09-07T03:35:24.060147+0000","last_peered":"2024-09-07T03:35:24.060147+0000","last_clean":"2024-09-07T03:35:24.060147+0000","last_became_active":"2024-09-07T03:32:22.140389+0000","last_became_peered":"2024-09-07T03:32:22.140389+0000","last_unstale":"2024-09-07T03:35:24.060147+0000","last_undegraded":"2024-09-07T03:35:24.060147+0000","last_fullsized":"2024-09-07T03:35:24.060147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:12:54.218779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.024887+0000","last_change":"2024-09-07T03:32:14.113244+0000","last_active":"2024-09-07T03:32:57.024887+0000","last_peered":"2024-09-07T03:32:57.024887+0000","last_clean":"2024-09-07T03:32:57.024887+0000","last_became_active":"2024-09-07T03:32:14.112612+0000","last_became_peered":"2024-09-07T03:32:14.112612+0000","last_unstale":"2024-09-07T03:32:57.024887+0000","last_undegraded":"2024-09-07T03:32:57.024887+0000","last_fullsized":"2024-09-07T03:32:57.024887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:24.044336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469899+0000","last_change":"2024-09-07T03:31:58.568783+0000","last_active":"2024-09-07T03:32:50.469899+0000","last_peered":"2024-09-07T03:32:50.469899+0000","last_clean":"2024-09-07T03:32:50.469899+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:32:50.469899+0000","last_undegraded":"2024-09-07T03:32:50.469899+0000","last_fullsized":"2024-09-07T03:32:50.469899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_clean_scrub_stamp":"2024-09-07T03:31:57.501815+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:54.736044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278835+0000","last_change":"2024-09-07T03:32:04.539297+0000","last_active":"2024-09-07T03:32:50.278835+0000","last_peered":"2024-09-07T03:32:50.278835+0000","last_clean":"2024-09-07T03:32:50.278835+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:32:50.278835+0000","last_undegraded":"2024-09-07T03:32:50.278835+0000","last_fullsized":"2024-09-07T03:32:50.278835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:06.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.838441+0000","last_change":"2024-09-07T03:32:12.130687+0000","last_active":"2024-09-07T03:35:23.838441+0000","last_peered":"2024-09-07T03:35:23.838441+0000","last_clean":"2024-09-07T03:35:23.838441+0000","last_became_active":"2024-09-07T03:32:12.130323+0000","last_became_peered":"2024-09-07T03:32:12.130323+0000","last_unstale":"2024-09-07T03:35:23.838441+0000","last_undegraded":"2024-09-07T03:35:23.838441+0000","last_fullsized":"2024-09-07T03:35:23.838441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:45.892639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471096+0000","last_change":"2024-09-07T03:32:16.127232+0000","last_active":"2024-09-07T03:32:50.471096+0000","last_peered":"2024-09-07T03:32:50.471096+0000","last_clean":"2024-09-07T03:32:50.471096+0000","last_became_active":"2024-09-07T03:32:16.126915+0000","last_became_peered":"2024-09-07T03:32:16.126915+0000","last_unstale":"2024-09-07T03:32:50.471096+0000","last_undegraded":"2024-09-07T03:32:50.471096+0000","last_fullsized":"2024-09-07T03:32:50.471096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:52:36.603646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'93","reported_seq":181,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.689595+0000","last_change":"2024-09-07T03:32:18.129530+0000","last_active":"2024-09-07T03:35:30.689595+0000","last_peered":"2024-09-07T03:35:30.689595+0000","last_clean":"2024-09-07T03:35:30.689595+0000","last_became_active":"2024-09-07T03:32:18.129224+0000","last_became_peered":"2024-09-07T03:32:18.129224+0000","last_unstale":"2024-09-07T03:35:30.689595+0000","last_undegraded":"2024-09-07T03:35:30.689595+0000","last_fullsized":"2024-09-07T03:35:30.689595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:25:57.912545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275577+0000","last_change":"2024-09-07T03:32:20.135113+0000","last_active":"2024-09-07T03:32:50.275577+0000","last_peered":"2024-09-07T03:32:50.275577+0000","last_clean":"2024-09-07T03:32:50.275577+0000","last_became_active":"2024-09-07T03:32:20.134819+0000","last_became_peered":"2024-09-07T03:32:20.134819+0000","last_unstale":"2024-09-07T03:32:50.275577+0000","last_undegraded":"2024-09-07T03:32:50.275577+0000","last_fullsized":"2024-09-07T03:32:50.275577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:30.829289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'84","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.852849+0000","last_change":"2024-09-07T03:32:22.152124+0000","last_active":"2024-09-07T03:35:23.852849+0000","last_peered":"2024-09-07T03:35:23.852849+0000","last_clean":"2024-09-07T03:35:23.852849+0000","last_became_active":"2024-09-07T03:32:22.151817+0000","last_became_peered":"2024-09-07T03:32:22.151817+0000","last_unstale":"2024-09-07T03:35:23.852849+0000","last_undegraded":"2024-09-07T03:35:23.852849+0000","last_fullsized":"2024-09-07T03:35:23.852849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:00.353389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'16","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843497+0000","last_change":"2024-09-07T03:32:14.130827+0000","last_active":"2024-09-07T03:35:23.843497+0000","last_peered":"2024-09-07T03:35:23.843497+0000","last_clean":"2024-09-07T03:35:23.843497+0000","last_became_active":"2024-09-07T03:32:14.130484+0000","last_became_peered":"2024-09-07T03:32:14.130484+0000","last_unstale":"2024-09-07T03:35:23.843497+0000","last_undegraded":"2024-09-07T03:35:23.843497+0000","last_fullsized":"2024-09-07T03:35:23.843497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279322+0000","last_change":"2024-09-07T03:32:04.539038+0000","last_active":"2024-09-07T03:32:50.279322+0000","last_peered":"2024-09-07T03:32:50.279322+0000","last_clean":"2024-09-07T03:32:50.279322+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:32:50.279322+0000","last_undegraded":"2024-09-07T03:32:50.279322+0000","last_fullsized":"2024-09-07T03:32:50.279322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:11.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470907+0000","last_change":"2024-09-07T03:32:12.124849+0000","last_active":"2024-09-07T03:32:50.470907+0000","last_peered":"2024-09-07T03:32:50.470907+0000","last_clean":"2024-09-07T03:32:50.470907+0000","last_became_active":"2024-09-07T03:32:12.124522+0000","last_became_peered":"2024-09-07T03:32:12.124522+0000","last_unstale":"2024-09-07T03:32:50.470907+0000","last_undegraded":"2024-09-07T03:32:50.470907+0000","last_fullsized":"2024-09-07T03:32:50.470907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:46:14.653854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282885+0000","last_change":"2024-09-07T03:32:16.124594+0000","last_active":"2024-09-07T03:32:50.282885+0000","last_peered":"2024-09-07T03:32:50.282885+0000","last_clean":"2024-09-07T03:32:50.282885+0000","last_became_active":"2024-09-07T03:32:16.124243+0000","last_became_peered":"2024-09-07T03:32:16.124243+0000","last_unstale":"2024-09-07T03:32:50.282885+0000","last_undegraded":"2024-09-07T03:32:50.282885+0000","last_fullsized":"2024-09-07T03:32:50.282885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:00:23.883657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'279","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206669+0000","last_change":"2024-09-07T03:32:18.132880+0000","last_active":"2024-09-07T03:35:21.206669+0000","last_peered":"2024-09-07T03:35:21.206669+0000","last_clean":"2024-09-07T03:35:21.206669+0000","last_became_active":"2024-09-07T03:32:18.132579+0000","last_became_peered":"2024-09-07T03:32:18.132579+0000","last_unstale":"2024-09-07T03:35:21.206669+0000","last_undegraded":"2024-09-07T03:35:21.206669+0000","last_fullsized":"2024-09-07T03:35:21.206669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:11:51.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272567+0000","last_change":"2024-09-07T03:32:20.141318+0000","last_active":"2024-09-07T03:32:50.272567+0000","last_peered":"2024-09-07T03:32:50.272567+0000","last_clean":"2024-09-07T03:32:50.272567+0000","last_became_active":"2024-09-07T03:32:20.141044+0000","last_became_peered":"2024-09-07T03:32:20.141044+0000","last_unstale":"2024-09-07T03:32:50.272567+0000","last_undegraded":"2024-09-07T03:32:50.272567+0000","last_fullsized":"2024-09-07T03:32:50.272567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:09:44.169617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.806191+0000","last_change":"2024-09-07T03:32:22.143631+0000","last_active":"2024-09-07T03:33:38.806191+0000","last_peered":"2024-09-07T03:33:38.806191+0000","last_clean":"2024-09-07T03:33:38.806191+0000","last_became_active":"2024-09-07T03:32:22.143337+0000","last_became_peered":"2024-09-07T03:32:22.143337+0000","last_unstale":"2024-09-07T03:33:38.806191+0000","last_undegraded":"2024-09-07T03:33:38.806191+0000","last_fullsized":"2024-09-07T03:33:38.806191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:30.421368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":64,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570852+0000","last_change":"2024-09-07T03:32:14.128064+0000","last_active":"2024-09-07T03:32:56.570852+0000","last_peered":"2024-09-07T03:32:56.570852+0000","last_clean":"2024-09-07T03:32:56.570852+0000","last_became_active":"2024-09-07T03:32:14.127288+0000","last_became_peered":"2024-09-07T03:32:14.127288+0000","last_unstale":"2024-09-07T03:32:56.570852+0000","last_undegraded":"2024-09-07T03:32:56.570852+0000","last_fullsized":"2024-09-07T03:32:56.570852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:43.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274315+0000","last_change":"2024-09-07T03:32:04.537641+0000","last_active":"2024-09-07T03:32:50.274315+0000","last_peered":"2024-09-07T03:32:50.274315+0000","last_clean":"2024-09-07T03:32:50.274315+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:32:50.274315+0000","last_undegraded":"2024-09-07T03:32:50.274315+0000","last_fullsized":"2024-09-07T03:32:50.274315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.563922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.975371+0000","last_change":"2024-09-07T03:32:12.139855+0000","last_active":"2024-09-07T03:33:38.975371+0000","last_peered":"2024-09-07T03:33:38.975371+0000","last_clean":"2024-09-07T03:33:38.975371+0000","last_became_active":"2024-09-07T03:32:12.139224+0000","last_became_peered":"2024-09-07T03:32:12.139224+0000","last_unstale":"2024-09-07T03:33:38.975371+0000","last_undegraded":"2024-09-07T03:33:38.975371+0000","last_fullsized":"2024-09-07T03:33:38.975371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:34.147142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279225+0000","last_change":"2024-09-07T03:32:16.122151+0000","last_active":"2024-09-07T03:32:50.279225+0000","last_peered":"2024-09-07T03:32:50.279225+0000","last_clean":"2024-09-07T03:32:50.279225+0000","last_became_active":"2024-09-07T03:32:16.121817+0000","last_became_peered":"2024-09-07T03:32:16.121817+0000","last_unstale":"2024-09-07T03:32:50.279225+0000","last_undegraded":"2024-09-07T03:32:50.279225+0000","last_fullsized":"2024-09-07T03:32:50.279225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:15.023249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206736+0000","last_change":"2024-09-07T03:32:18.129607+0000","last_active":"2024-09-07T03:35:21.206736+0000","last_peered":"2024-09-07T03:35:21.206736+0000","last_clean":"2024-09-07T03:35:21.206736+0000","last_became_active":"2024-09-07T03:32:18.129264+0000","last_became_peered":"2024-09-07T03:32:18.129264+0000","last_unstale":"2024-09-07T03:35:21.206736+0000","last_undegraded":"2024-09-07T03:35:21.206736+0000","last_fullsized":"2024-09-07T03:35:21.206736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:52:54.317892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472271+0000","last_change":"2024-09-07T03:32:20.143074+0000","last_active":"2024-09-07T03:32:50.472271+0000","last_peered":"2024-09-07T03:32:50.472271+0000","last_clean":"2024-09-07T03:32:50.472271+0000","last_became_active":"2024-09-07T03:32:20.142764+0000","last_became_peered":"2024-09-07T03:32:20.142764+0000","last_unstale":"2024-09-07T03:32:50.472271+0000","last_undegraded":"2024-09-07T03:32:50.472271+0000","last_fullsized":"2024-09-07T03:32:50.472271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:36.484446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272193+0000","last_change":"2024-09-07T03:32:22.147788+0000","last_active":"2024-09-07T03:32:50.272193+0000","last_peered":"2024-09-07T03:32:50.272193+0000","last_clean":"2024-09-07T03:32:50.272193+0000","last_became_active":"2024-09-07T03:32:22.147510+0000","last_became_peered":"2024-09-07T03:32:22.147510+0000","last_unstale":"2024-09-07T03:32:50.272193+0000","last_undegraded":"2024-09-07T03:32:50.272193+0000","last_fullsized":"2024-09-07T03:32:50.272193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:37.758327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473250+0000","last_change":"2024-09-07T03:32:14.114315+0000","last_active":"2024-09-07T03:32:50.473250+0000","last_peered":"2024-09-07T03:32:50.473250+0000","last_clean":"2024-09-07T03:32:50.473250+0000","last_became_active":"2024-09-07T03:32:14.113700+0000","last_became_peered":"2024-09-07T03:32:14.113700+0000","last_unstale":"2024-09-07T03:32:50.473250+0000","last_undegraded":"2024-09-07T03:32:50.473250+0000","last_fullsized":"2024-09-07T03:32:50.473250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:56:02.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279568+0000","last_change":"2024-09-07T03:32:04.539644+0000","last_active":"2024-09-07T03:32:50.279568+0000","last_peered":"2024-09-07T03:32:50.279568+0000","last_clean":"2024-09-07T03:32:50.279568+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:32:50.279568+0000","last_undegraded":"2024-09-07T03:32:50.279568+0000","last_fullsized":"2024-09-07T03:32:50.279568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:43.880721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.720142+0000","last_change":"2024-09-07T03:32:12.125645+0000","last_active":"2024-09-07T03:35:23.720142+0000","last_peered":"2024-09-07T03:35:23.720142+0000","last_clean":"2024-09-07T03:35:23.720142+0000","last_became_active":"2024-09-07T03:32:12.124390+0000","last_became_peered":"2024-09-07T03:32:12.124390+0000","last_unstale":"2024-09-07T03:35:23.720142+0000","last_undegraded":"2024-09-07T03:35:23.720142+0000","last_fullsized":"2024-09-07T03:35:23.720142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:47:53.230073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472348+0000","last_change":"2024-09-07T03:32:16.122130+0000","last_active":"2024-09-07T03:32:50.472348+0000","last_peered":"2024-09-07T03:32:50.472348+0000","last_clean":"2024-09-07T03:32:50.472348+0000","last_became_active":"2024-09-07T03:32:16.120933+0000","last_became_peered":"2024-09-07T03:32:16.120933+0000","last_unstale":"2024-09-07T03:32:50.472348+0000","last_undegraded":"2024-09-07T03:32:50.472348+0000","last_fullsized":"2024-09-07T03:32:50.472348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:16.466896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.988572+0000","last_change":"2024-09-07T03:32:18.130861+0000","last_active":"2024-09-07T03:35:22.988572+0000","last_peered":"2024-09-07T03:35:22.988572+0000","last_clean":"2024-09-07T03:35:22.988572+0000","last_became_active":"2024-09-07T03:32:18.130557+0000","last_became_peered":"2024-09-07T03:32:18.130557+0000","last_unstale":"2024-09-07T03:35:22.988572+0000","last_undegraded":"2024-09-07T03:35:22.988572+0000","last_fullsized":"2024-09-07T03:35:22.988572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:23:58.249870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276706+0000","last_change":"2024-09-07T03:32:20.143006+0000","last_active":"2024-09-07T03:32:50.276706+0000","last_peered":"2024-09-07T03:32:50.276706+0000","last_clean":"2024-09-07T03:32:50.276706+0000","last_became_active":"2024-09-07T03:32:20.142650+0000","last_became_peered":"2024-09-07T03:32:20.142650+0000","last_unstale":"2024-09-07T03:32:50.276706+0000","last_undegraded":"2024-09-07T03:32:50.276706+0000","last_fullsized":"2024-09-07T03:32:50.276706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:47.155034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.532509+0000","last_change":"2024-09-07T03:32:22.151470+0000","last_active":"2024-09-07T03:34:22.532509+0000","last_peered":"2024-09-07T03:34:22.532509+0000","last_clean":"2024-09-07T03:34:22.532509+0000","last_became_active":"2024-09-07T03:32:22.150981+0000","last_became_peered":"2024-09-07T03:32:22.150981+0000","last_unstale":"2024-09-07T03:34:22.532509+0000","last_undegraded":"2024-09-07T03:34:22.532509+0000","last_fullsized":"2024-09-07T03:34:22.532509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:09.757277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731323+0000","last_change":"2024-09-07T03:32:50.282510+0000","last_active":"2024-09-07T03:35:23.731323+0000","last_peered":"2024-09-07T03:35:23.731323+0000","last_clean":"2024-09-07T03:35:23.731323+0000","last_became_active":"2024-09-07T03:32:50.282108+0000","last_became_peered":"2024-09-07T03:32:50.282108+0000","last_unstale":"2024-09-07T03:35:23.731323+0000","last_undegraded":"2024-09-07T03:35:23.731323+0000","last_fullsized":"2024-09-07T03:35:23.731323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:00:33.202265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.561631+0000","last_change":"2024-09-07T03:32:12.121500+0000","last_active":"2024-09-07T03:32:56.561631+0000","last_peered":"2024-09-07T03:32:56.561631+0000","last_clean":"2024-09-07T03:32:56.561631+0000","last_became_active":"2024-09-07T03:32:12.121179+0000","last_became_peered":"2024-09-07T03:32:12.121179+0000","last_unstale":"2024-09-07T03:32:56.561631+0000","last_undegraded":"2024-09-07T03:32:56.561631+0000","last_fullsized":"2024-09-07T03:32:56.561631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:27:51.832052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472095+0000","last_change":"2024-09-07T03:32:04.541917+0000","last_active":"2024-09-07T03:32:50.472095+0000","last_peered":"2024-09-07T03:32:50.472095+0000","last_clean":"2024-09-07T03:32:50.472095+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:32:50.472095+0000","last_undegraded":"2024-09-07T03:32:50.472095+0000","last_fullsized":"2024-09-07T03:32:50.472095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:39:36.959986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.113878+0000","last_change":"2024-09-07T03:32:16.126538+0000","last_active":"2024-09-07T03:35:24.113878+0000","last_peered":"2024-09-07T03:35:24.113878+0000","last_clean":"2024-09-07T03:35:24.113878+0000","last_became_active":"2024-09-07T03:32:16.126273+0000","last_became_peered":"2024-09-07T03:32:16.126273+0000","last_unstale":"2024-09-07T03:35:24.113878+0000","last_undegraded":"2024-09-07T03:35:24.113878+0000","last_fullsized":"2024-09-07T03:35:24.113878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:12:07.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'74","reported_seq":146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.207266+0000","last_change":"2024-09-07T03:32:18.132985+0000","last_active":"2024-09-07T03:34:21.207266+0000","last_peered":"2024-09-07T03:34:21.207266+0000","last_clean":"2024-09-07T03:34:21.207266+0000","last_became_active":"2024-09-07T03:32:18.132654+0000","last_became_peered":"2024-09-07T03:32:18.132654+0000","last_unstale":"2024-09-07T03:34:21.207266+0000","last_undegraded":"2024-09-07T03:34:21.207266+0000","last_fullsized":"2024-09-07T03:34:21.207266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:58.124761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278034+0000","last_change":"2024-09-07T03:32:20.140348+0000","last_active":"2024-09-07T03:32:50.278034+0000","last_peered":"2024-09-07T03:32:50.278034+0000","last_clean":"2024-09-07T03:32:50.278034+0000","last_became_active":"2024-09-07T03:32:20.140025+0000","last_became_peered":"2024-09-07T03:32:20.140025+0000","last_unstale":"2024-09-07T03:32:50.278034+0000","last_undegraded":"2024-09-07T03:32:50.278034+0000","last_fullsized":"2024-09-07T03:32:50.278034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:18:53.690582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'13","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.873538+0000","last_change":"2024-09-07T03:32:22.140343+0000","last_active":"2024-09-07T03:34:22.873538+0000","last_peered":"2024-09-07T03:34:22.873538+0000","last_clean":"2024-09-07T03:34:22.873538+0000","last_became_active":"2024-09-07T03:32:22.140043+0000","last_became_peered":"2024-09-07T03:32:22.140043+0000","last_unstale":"2024-09-07T03:34:22.873538+0000","last_undegraded":"2024-09-07T03:34:22.873538+0000","last_fullsized":"2024-09-07T03:34:22.873538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:55.502696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'12","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806308+0000","last_change":"2024-09-07T03:32:14.126934+0000","last_active":"2024-09-07T03:35:23.806308+0000","last_peered":"2024-09-07T03:35:23.806308+0000","last_clean":"2024-09-07T03:35:23.806308+0000","last_became_active":"2024-09-07T03:32:14.126663+0000","last_became_peered":"2024-09-07T03:32:14.126663+0000","last_unstale":"2024-09-07T03:35:23.806308+0000","last_undegraded":"2024-09-07T03:35:23.806308+0000","last_fullsized":"2024-09-07T03:35:23.806308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:58:27.663426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"36'1","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:18.228700+0000","last_change":"2024-09-07T03:32:12.134479+0000","last_active":"2024-09-07T03:34:18.228700+0000","last_peered":"2024-09-07T03:34:18.228700+0000","last_clean":"2024-09-07T03:34:18.228700+0000","last_became_active":"2024-09-07T03:32:12.133974+0000","last_became_peered":"2024-09-07T03:32:12.133974+0000","last_unstale":"2024-09-07T03:34:18.228700+0000","last_undegraded":"2024-09-07T03:34:18.228700+0000","last_fullsized":"2024-09-07T03:34:18.228700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:03:12.017360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281965+0000","last_change":"2024-09-07T03:32:04.539029+0000","last_active":"2024-09-07T03:32:50.281965+0000","last_peered":"2024-09-07T03:32:50.281965+0000","last_clean":"2024-09-07T03:32:50.281965+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:32:50.281965+0000","last_undegraded":"2024-09-07T03:32:50.281965+0000","last_fullsized":"2024-09-07T03:32:50.281965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:37:36.714209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278673+0000","last_change":"2024-09-07T03:32:16.122232+0000","last_active":"2024-09-07T03:32:50.278673+0000","last_peered":"2024-09-07T03:32:50.278673+0000","last_clean":"2024-09-07T03:32:50.278673+0000","last_became_active":"2024-09-07T03:32:16.121921+0000","last_became_peered":"2024-09-07T03:32:16.121921+0000","last_unstale":"2024-09-07T03:32:50.278673+0000","last_undegraded":"2024-09-07T03:32:50.278673+0000","last_fullsized":"2024-09-07T03:32:50.278673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:01:24.806960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469770+0000","last_change":"2024-09-07T03:32:18.134018+0000","last_active":"2024-09-07T03:32:50.469770+0000","last_peered":"2024-09-07T03:32:50.469770+0000","last_clean":"2024-09-07T03:32:50.469770+0000","last_became_active":"2024-09-07T03:32:18.133689+0000","last_became_peered":"2024-09-07T03:32:18.133689+0000","last_unstale":"2024-09-07T03:32:50.469770+0000","last_undegraded":"2024-09-07T03:32:50.469770+0000","last_fullsized":"2024-09-07T03:32:50.469770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:16.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":347,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206656+0000","last_change":"2024-09-07T03:32:20.143562+0000","last_active":"2024-09-07T03:35:21.206656+0000","last_peered":"2024-09-07T03:35:21.206656+0000","last_clean":"2024-09-07T03:35:21.206656+0000","last_became_active":"2024-09-07T03:32:20.143293+0000","last_became_peered":"2024-09-07T03:32:20.143293+0000","last_unstale":"2024-09-07T03:35:21.206656+0000","last_undegraded":"2024-09-07T03:35:21.206656+0000","last_fullsized":"2024-09-07T03:35:21.206656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:51.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273729+0000","last_change":"2024-09-07T03:32:22.147306+0000","last_active":"2024-09-07T03:32:50.273729+0000","last_peered":"2024-09-07T03:32:50.273729+0000","last_clean":"2024-09-07T03:32:50.273729+0000","last_became_active":"2024-09-07T03:32:22.147036+0000","last_became_peered":"2024-09-07T03:32:22.147036+0000","last_unstale":"2024-09-07T03:32:50.273729+0000","last_undegraded":"2024-09-07T03:32:50.273729+0000","last_fullsized":"2024-09-07T03:32:50.273729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:02.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.477342+0000","last_change":"2024-09-07T03:32:14.127131+0000","last_active":"2024-09-07T03:35:23.477342+0000","last_peered":"2024-09-07T03:35:23.477342+0000","last_clean":"2024-09-07T03:35:23.477342+0000","last_became_active":"2024-09-07T03:32:14.126350+0000","last_became_peered":"2024-09-07T03:32:14.126350+0000","last_unstale":"2024-09-07T03:35:23.477342+0000","last_undegraded":"2024-09-07T03:35:23.477342+0000","last_fullsized":"2024-09-07T03:35:23.477342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:48:39.075361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276350+0000","last_change":"2024-09-07T03:32:12.130912+0000","last_active":"2024-09-07T03:32:50.276350+0000","last_peered":"2024-09-07T03:32:50.276350+0000","last_clean":"2024-09-07T03:32:50.276350+0000","last_became_active":"2024-09-07T03:32:12.130058+0000","last_became_peered":"2024-09-07T03:32:12.130058+0000","last_unstale":"2024-09-07T03:32:50.276350+0000","last_undegraded":"2024-09-07T03:32:50.276350+0000","last_fullsized":"2024-09-07T03:32:50.276350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:39:14.276282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472091+0000","last_change":"2024-09-07T03:32:04.542033+0000","last_active":"2024-09-07T03:32:50.472091+0000","last_peered":"2024-09-07T03:32:50.472091+0000","last_clean":"2024-09-07T03:32:50.472091+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:32:50.472091+0000","last_undegraded":"2024-09-07T03:32:50.472091+0000","last_fullsized":"2024-09-07T03:32:50.472091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:18:29.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279335+0000","last_change":"2024-09-07T03:32:16.117328+0000","last_active":"2024-09-07T03:32:50.279335+0000","last_peered":"2024-09-07T03:32:50.279335+0000","last_clean":"2024-09-07T03:32:50.279335+0000","last_became_active":"2024-09-07T03:32:16.117025+0000","last_became_peered":"2024-09-07T03:32:16.117025+0000","last_unstale":"2024-09-07T03:32:50.279335+0000","last_undegraded":"2024-09-07T03:32:50.279335+0000","last_fullsized":"2024-09-07T03:32:50.279335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:43:01.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273099+0000","last_change":"2024-09-07T03:32:18.124974+0000","last_active":"2024-09-07T03:32:50.273099+0000","last_peered":"2024-09-07T03:32:50.273099+0000","last_clean":"2024-09-07T03:32:50.273099+0000","last_became_active":"2024-09-07T03:32:18.124641+0000","last_became_peered":"2024-09-07T03:32:18.124641+0000","last_unstale":"2024-09-07T03:32:50.273099+0000","last_undegraded":"2024-09-07T03:32:50.273099+0000","last_fullsized":"2024-09-07T03:32:50.273099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:36:49.839182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.544102+0000","last_change":"2024-09-07T03:32:20.149232+0000","last_active":"2024-09-07T03:35:30.544102+0000","last_peered":"2024-09-07T03:35:30.544102+0000","last_clean":"2024-09-07T03:35:30.544102+0000","last_became_active":"2024-09-07T03:32:20.148768+0000","last_became_peered":"2024-09-07T03:32:20.148768+0000","last_unstale":"2024-09-07T03:35:30.544102+0000","last_undegraded":"2024-09-07T03:35:30.544102+0000","last_fullsized":"2024-09-07T03:35:30.544102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:15:20.986169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470656+0000","last_change":"2024-09-07T03:32:22.148714+0000","last_active":"2024-09-07T03:32:50.470656+0000","last_peered":"2024-09-07T03:32:50.470656+0000","last_clean":"2024-09-07T03:32:50.470656+0000","last_became_active":"2024-09-07T03:32:22.148444+0000","last_became_peered":"2024-09-07T03:32:22.148444+0000","last_unstale":"2024-09-07T03:32:50.470656+0000","last_undegraded":"2024-09-07T03:32:50.470656+0000","last_fullsized":"2024-09-07T03:32:50.470656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:23.271638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.588175+0000","last_change":"2024-09-07T03:32:14.113991+0000","last_active":"2024-09-07T03:35:23.588175+0000","last_peered":"2024-09-07T03:35:23.588175+0000","last_clean":"2024-09-07T03:35:23.588175+0000","last_became_active":"2024-09-07T03:32:14.113077+0000","last_became_peered":"2024-09-07T03:32:14.113077+0000","last_unstale":"2024-09-07T03:35:23.588175+0000","last_undegraded":"2024-09-07T03:35:23.588175+0000","last_fullsized":"2024-09-07T03:35:23.588175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:14:51.585905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.717209+0000","last_change":"2024-09-07T03:32:12.124748+0000","last_active":"2024-09-07T03:35:23.717209+0000","last_peered":"2024-09-07T03:35:23.717209+0000","last_clean":"2024-09-07T03:35:23.717209+0000","last_became_active":"2024-09-07T03:32:12.124398+0000","last_became_peered":"2024-09-07T03:32:12.124398+0000","last_unstale":"2024-09-07T03:35:23.717209+0000","last_undegraded":"2024-09-07T03:35:23.717209+0000","last_fullsized":"2024-09-07T03:35:23.717209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:59:37.231002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282690+0000","last_change":"2024-09-07T03:32:04.539724+0000","last_active":"2024-09-07T03:32:50.282690+0000","last_peered":"2024-09-07T03:32:50.282690+0000","last_clean":"2024-09-07T03:32:50.282690+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:32:50.282690+0000","last_undegraded":"2024-09-07T03:32:50.282690+0000","last_fullsized":"2024-09-07T03:32:50.282690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:55:55.896127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273091+0000","last_change":"2024-09-07T03:32:16.130854+0000","last_active":"2024-09-07T03:32:50.273091+0000","last_peered":"2024-09-07T03:32:50.273091+0000","last_clean":"2024-09-07T03:32:50.273091+0000","last_became_active":"2024-09-07T03:32:16.130091+0000","last_became_peered":"2024-09-07T03:32:16.130091+0000","last_unstale":"2024-09-07T03:32:50.273091+0000","last_undegraded":"2024-09-07T03:32:50.273091+0000","last_fullsized":"2024-09-07T03:32:50.273091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:20.097492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.692496+0000","last_change":"2024-09-07T03:32:18.132376+0000","last_active":"2024-09-07T03:35:30.692496+0000","last_peered":"2024-09-07T03:35:30.692496+0000","last_clean":"2024-09-07T03:35:30.692496+0000","last_became_active":"2024-09-07T03:32:18.132111+0000","last_became_peered":"2024-09-07T03:32:18.132111+0000","last_unstale":"2024-09-07T03:35:30.692496+0000","last_undegraded":"2024-09-07T03:35:30.692496+0000","last_fullsized":"2024-09-07T03:35:30.692496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272816+0000","last_change":"2024-09-07T03:32:20.143405+0000","last_active":"2024-09-07T03:32:50.272816+0000","last_peered":"2024-09-07T03:32:50.272816+0000","last_clean":"2024-09-07T03:32:50.272816+0000","last_became_active":"2024-09-07T03:32:20.143072+0000","last_became_peered":"2024-09-07T03:32:20.143072+0000","last_unstale":"2024-09-07T03:32:50.272816+0000","last_undegraded":"2024-09-07T03:32:50.272816+0000","last_fullsized":"2024-09-07T03:32:50.272816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:35:06.275781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276617+0000","last_change":"2024-09-07T03:32:22.139462+0000","last_active":"2024-09-07T03:32:50.276617+0000","last_peered":"2024-09-07T03:32:50.276617+0000","last_clean":"2024-09-07T03:32:50.276617+0000","last_became_active":"2024-09-07T03:32:22.139150+0000","last_became_peered":"2024-09-07T03:32:22.139150+0000","last_unstale":"2024-09-07T03:32:50.276617+0000","last_undegraded":"2024-09-07T03:32:50.276617+0000","last_fullsized":"2024-09-07T03:32:50.276617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:16:29.302047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275974+0000","last_change":"2024-09-07T03:32:22.138596+0000","last_active":"2024-09-07T03:32:50.275974+0000","last_peered":"2024-09-07T03:32:50.275974+0000","last_clean":"2024-09-07T03:32:50.275974+0000","last_became_active":"2024-09-07T03:32:22.138315+0000","last_became_peered":"2024-09-07T03:32:22.138315+0000","last_unstale":"2024-09-07T03:32:50.275974+0000","last_undegraded":"2024-09-07T03:32:50.275974+0000","last_fullsized":"2024-09-07T03:32:50.275974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:54:59.992625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435487+0000","last_change":"2024-09-07T03:32:14.113374+0000","last_active":"2024-09-07T03:34:19.435487+0000","last_peered":"2024-09-07T03:34:19.435487+0000","last_clean":"2024-09-07T03:34:19.435487+0000","last_became_active":"2024-09-07T03:32:14.112744+0000","last_became_peered":"2024-09-07T03:32:14.112744+0000","last_unstale":"2024-09-07T03:34:19.435487+0000","last_undegraded":"2024-09-07T03:34:19.435487+0000","last_fullsized":"2024-09-07T03:34:19.435487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:58.377074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'5","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.790736+0000","last_change":"2024-09-07T03:32:12.133214+0000","last_active":"2024-09-07T03:33:38.790736+0000","last_peered":"2024-09-07T03:33:38.790736+0000","last_clean":"2024-09-07T03:33:38.790736+0000","last_became_active":"2024-09-07T03:32:12.132715+0000","last_became_peered":"2024-09-07T03:32:12.132715+0000","last_unstale":"2024-09-07T03:33:38.790736+0000","last_undegraded":"2024-09-07T03:33:38.790736+0000","last_fullsized":"2024-09-07T03:33:38.790736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:43.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470337+0000","last_change":"2024-09-07T03:32:16.125307+0000","last_active":"2024-09-07T03:32:50.470337+0000","last_peered":"2024-09-07T03:32:50.470337+0000","last_clean":"2024-09-07T03:32:50.470337+0000","last_became_active":"2024-09-07T03:32:16.124681+0000","last_became_peered":"2024-09-07T03:32:16.124681+0000","last_unstale":"2024-09-07T03:32:50.470337+0000","last_undegraded":"2024-09-07T03:32:50.470337+0000","last_fullsized":"2024-09-07T03:32:50.470337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:30.622001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.603642+0000","last_change":"2024-09-07T03:32:18.134183+0000","last_active":"2024-09-07T03:35:30.603642+0000","last_peered":"2024-09-07T03:35:30.603642+0000","last_clean":"2024-09-07T03:35:30.603642+0000","last_became_active":"2024-09-07T03:32:18.133844+0000","last_became_peered":"2024-09-07T03:32:18.133844+0000","last_unstale":"2024-09-07T03:35:30.603642+0000","last_undegraded":"2024-09-07T03:35:30.603642+0000","last_fullsized":"2024-09-07T03:35:30.603642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:10:39.060137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271616+0000","last_change":"2024-09-07T03:32:20.149175+0000","last_active":"2024-09-07T03:32:50.271616+0000","last_peered":"2024-09-07T03:32:50.271616+0000","last_clean":"2024-09-07T03:32:50.271616+0000","last_became_active":"2024-09-07T03:32:20.148900+0000","last_became_peered":"2024-09-07T03:32:20.148900+0000","last_unstale":"2024-09-07T03:32:50.271616+0000","last_undegraded":"2024-09-07T03:32:50.271616+0000","last_fullsized":"2024-09-07T03:32:50.271616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:25.130015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:20.895399+0000","last_change":"2024-09-07T03:32:22.150451+0000","last_active":"2024-09-07T03:34:20.895399+0000","last_peered":"2024-09-07T03:34:20.895399+0000","last_clean":"2024-09-07T03:34:20.895399+0000","last_became_active":"2024-09-07T03:32:22.150168+0000","last_became_peered":"2024-09-07T03:32:22.150168+0000","last_unstale":"2024-09-07T03:34:20.895399+0000","last_undegraded":"2024-09-07T03:34:20.895399+0000","last_fullsized":"2024-09-07T03:34:20.895399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:01:52.113292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985573+0000","last_change":"2024-09-07T03:32:14.111906+0000","last_active":"2024-09-07T03:33:38.985573+0000","last_peered":"2024-09-07T03:33:38.985573+0000","last_clean":"2024-09-07T03:33:38.985573+0000","last_became_active":"2024-09-07T03:32:14.111499+0000","last_became_peered":"2024-09-07T03:32:14.111499+0000","last_unstale":"2024-09-07T03:33:38.985573+0000","last_undegraded":"2024-09-07T03:33:38.985573+0000","last_fullsized":"2024-09-07T03:33:38.985573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:32.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276787+0000","last_change":"2024-09-07T03:32:12.129260+0000","last_active":"2024-09-07T03:32:50.276787+0000","last_peered":"2024-09-07T03:32:50.276787+0000","last_clean":"2024-09-07T03:32:50.276787+0000","last_became_active":"2024-09-07T03:32:12.128737+0000","last_became_peered":"2024-09-07T03:32:12.128737+0000","last_unstale":"2024-09-07T03:32:50.276787+0000","last_undegraded":"2024-09-07T03:32:50.276787+0000","last_fullsized":"2024-09-07T03:32:50.276787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:32.673872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272857+0000","last_change":"2024-09-07T03:32:16.125714+0000","last_active":"2024-09-07T03:32:50.272857+0000","last_peered":"2024-09-07T03:32:50.272857+0000","last_clean":"2024-09-07T03:32:50.272857+0000","last_became_active":"2024-09-07T03:32:16.125418+0000","last_became_peered":"2024-09-07T03:32:16.125418+0000","last_unstale":"2024-09-07T03:32:50.272857+0000","last_undegraded":"2024-09-07T03:32:50.272857+0000","last_fullsized":"2024-09-07T03:32:50.272857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:50:42.403817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.992476+0000","last_change":"2024-09-07T03:32:18.134208+0000","last_active":"2024-09-07T03:35:22.992476+0000","last_peered":"2024-09-07T03:35:22.992476+0000","last_clean":"2024-09-07T03:35:22.992476+0000","last_became_active":"2024-09-07T03:32:18.133770+0000","last_became_peered":"2024-09-07T03:32:18.133770+0000","last_unstale":"2024-09-07T03:35:22.992476+0000","last_undegraded":"2024-09-07T03:35:22.992476+0000","last_fullsized":"2024-09-07T03:35:22.992476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:01:16.182582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276619+0000","last_change":"2024-09-07T03:32:20.142736+0000","last_active":"2024-09-07T03:32:50.276619+0000","last_peered":"2024-09-07T03:32:50.276619+0000","last_clean":"2024-09-07T03:32:50.276619+0000","last_became_active":"2024-09-07T03:32:20.140729+0000","last_became_peered":"2024-09-07T03:32:20.140729+0000","last_unstale":"2024-09-07T03:32:50.276619+0000","last_undegraded":"2024-09-07T03:32:50.276619+0000","last_fullsized":"2024-09-07T03:32:50.276619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:48:10.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471241+0000","last_change":"2024-09-07T03:32:22.147660+0000","last_active":"2024-09-07T03:32:50.471241+0000","last_peered":"2024-09-07T03:32:50.471241+0000","last_clean":"2024-09-07T03:32:50.471241+0000","last_became_active":"2024-09-07T03:32:22.147374+0000","last_became_peered":"2024-09-07T03:32:22.147374+0000","last_unstale":"2024-09-07T03:32:50.471241+0000","last_undegraded":"2024-09-07T03:32:50.471241+0000","last_fullsized":"2024-09-07T03:32:50.471241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:06.728131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843420+0000","last_change":"2024-09-07T03:32:14.123487+0000","last_active":"2024-09-07T03:35:23.843420+0000","last_peered":"2024-09-07T03:35:23.843420+0000","last_clean":"2024-09-07T03:35:23.843420+0000","last_became_active":"2024-09-07T03:32:14.123172+0000","last_became_peered":"2024-09-07T03:32:14.123172+0000","last_unstale":"2024-09-07T03:35:23.843420+0000","last_undegraded":"2024-09-07T03:35:23.843420+0000","last_fullsized":"2024-09-07T03:35:23.843420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.426207+0000","last_change":"2024-09-07T03:32:12.125531+0000","last_active":"2024-09-07T03:34:19.426207+0000","last_peered":"2024-09-07T03:34:19.426207+0000","last_clean":"2024-09-07T03:34:19.426207+0000","last_became_active":"2024-09-07T03:32:12.124180+0000","last_became_peered":"2024-09-07T03:32:12.124180+0000","last_unstale":"2024-09-07T03:34:19.426207+0000","last_undegraded":"2024-09-07T03:34:19.426207+0000","last_fullsized":"2024-09-07T03:34:19.426207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:41.435390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277690+0000","last_change":"2024-09-07T03:32:16.124337+0000","last_active":"2024-09-07T03:32:50.277690+0000","last_peered":"2024-09-07T03:32:50.277690+0000","last_clean":"2024-09-07T03:32:50.277690+0000","last_became_active":"2024-09-07T03:32:16.123695+0000","last_became_peered":"2024-09-07T03:32:16.123695+0000","last_unstale":"2024-09-07T03:32:50.277690+0000","last_undegraded":"2024-09-07T03:32:50.277690+0000","last_fullsized":"2024-09-07T03:32:50.277690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:12:34.370044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'44","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.677944+0000","last_change":"2024-09-07T03:32:18.129794+0000","last_active":"2024-09-07T03:35:30.677944+0000","last_peered":"2024-09-07T03:35:30.677944+0000","last_clean":"2024-09-07T03:35:30.677944+0000","last_became_active":"2024-09-07T03:32:18.129502+0000","last_became_peered":"2024-09-07T03:32:18.129502+0000","last_unstale":"2024-09-07T03:35:30.677944+0000","last_undegraded":"2024-09-07T03:35:30.677944+0000","last_fullsized":"2024-09-07T03:35:30.677944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:35:55.771599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470189+0000","last_change":"2024-09-07T03:32:20.147965+0000","last_active":"2024-09-07T03:32:50.470189+0000","last_peered":"2024-09-07T03:32:50.470189+0000","last_clean":"2024-09-07T03:32:50.470189+0000","last_became_active":"2024-09-07T03:32:20.147588+0000","last_became_peered":"2024-09-07T03:32:20.147588+0000","last_unstale":"2024-09-07T03:32:50.470189+0000","last_undegraded":"2024-09-07T03:32:50.470189+0000","last_fullsized":"2024-09-07T03:32:50.470189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:33:20.522441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.433021+0000","last_change":"2024-09-07T03:32:22.146381+0000","last_active":"2024-09-07T03:34:19.433021+0000","last_peered":"2024-09-07T03:34:19.433021+0000","last_clean":"2024-09-07T03:34:19.433021+0000","last_became_active":"2024-09-07T03:32:22.146106+0000","last_became_peered":"2024-09-07T03:32:22.146106+0000","last_unstale":"2024-09-07T03:34:19.433021+0000","last_undegraded":"2024-09-07T03:34:19.433021+0000","last_fullsized":"2024-09-07T03:34:19.433021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:05:28.655126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.025001+0000","last_change":"2024-09-07T03:32:14.128094+0000","last_active":"2024-09-07T03:32:57.025001+0000","last_peered":"2024-09-07T03:32:57.025001+0000","last_clean":"2024-09-07T03:32:57.025001+0000","last_became_active":"2024-09-07T03:32:14.127334+0000","last_became_peered":"2024-09-07T03:32:14.127334+0000","last_unstale":"2024-09-07T03:32:57.025001+0000","last_undegraded":"2024-09-07T03:32:57.025001+0000","last_fullsized":"2024-09-07T03:32:57.025001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:23:03.931202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472920+0000","last_change":"2024-09-07T03:32:12.138270+0000","last_active":"2024-09-07T03:32:50.472920+0000","last_peered":"2024-09-07T03:32:50.472920+0000","last_clean":"2024-09-07T03:32:50.472920+0000","last_became_active":"2024-09-07T03:32:12.134823+0000","last_became_peered":"2024-09-07T03:32:12.134823+0000","last_unstale":"2024-09-07T03:32:50.472920+0000","last_undegraded":"2024-09-07T03:32:50.472920+0000","last_fullsized":"2024-09-07T03:32:50.472920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:01:11.999538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271764+0000","last_change":"2024-09-07T03:32:16.127981+0000","last_active":"2024-09-07T03:32:50.271764+0000","last_peered":"2024-09-07T03:32:50.271764+0000","last_clean":"2024-09-07T03:32:50.271764+0000","last_became_active":"2024-09-07T03:32:16.127615+0000","last_became_peered":"2024-09-07T03:32:16.127615+0000","last_unstale":"2024-09-07T03:32:50.271764+0000","last_undegraded":"2024-09-07T03:32:50.271764+0000","last_fullsized":"2024-09-07T03:32:50.271764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:04.434836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'35","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.669249+0000","last_change":"2024-09-07T03:32:18.130169+0000","last_active":"2024-09-07T03:35:30.669249+0000","last_peered":"2024-09-07T03:35:30.669249+0000","last_clean":"2024-09-07T03:35:30.669249+0000","last_became_active":"2024-09-07T03:32:18.129919+0000","last_became_peered":"2024-09-07T03:32:18.129919+0000","last_unstale":"2024-09-07T03:35:30.669249+0000","last_undegraded":"2024-09-07T03:35:30.669249+0000","last_fullsized":"2024-09-07T03:35:30.669249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:09.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275040+0000","last_change":"2024-09-07T03:32:20.145306+0000","last_active":"2024-09-07T03:32:50.275040+0000","last_peered":"2024-09-07T03:32:50.275040+0000","last_clean":"2024-09-07T03:32:50.275040+0000","last_became_active":"2024-09-07T03:32:20.143640+0000","last_became_peered":"2024-09-07T03:32:20.143640+0000","last_unstale":"2024-09-07T03:32:50.275040+0000","last_undegraded":"2024-09-07T03:32:50.275040+0000","last_fullsized":"2024-09-07T03:32:50.275040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:24:26.189411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282148+0000","last_change":"2024-09-07T03:32:14.123340+0000","last_active":"2024-09-07T03:32:50.282148+0000","last_peered":"2024-09-07T03:32:50.282148+0000","last_clean":"2024-09-07T03:32:50.282148+0000","last_became_active":"2024-09-07T03:32:14.123017+0000","last_became_peered":"2024-09-07T03:32:14.123017+0000","last_unstale":"2024-09-07T03:32:50.282148+0000","last_undegraded":"2024-09-07T03:32:50.282148+0000","last_fullsized":"2024-09-07T03:32:50.282148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:08.821201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271902+0000","last_change":"2024-09-07T03:32:12.144026+0000","last_active":"2024-09-07T03:32:50.271902+0000","last_peered":"2024-09-07T03:32:50.271902+0000","last_clean":"2024-09-07T03:32:50.271902+0000","last_became_active":"2024-09-07T03:32:12.143142+0000","last_became_peered":"2024-09-07T03:32:12.143142+0000","last_unstale":"2024-09-07T03:32:50.271902+0000","last_undegraded":"2024-09-07T03:32:50.271902+0000","last_fullsized":"2024-09-07T03:32:50.271902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:13:08.497889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471726+0000","last_change":"2024-09-07T03:32:16.124471+0000","last_active":"2024-09-07T03:32:50.471726+0000","last_peered":"2024-09-07T03:32:50.471726+0000","last_clean":"2024-09-07T03:32:50.471726+0000","last_became_active":"2024-09-07T03:32:16.124188+0000","last_became_peered":"2024-09-07T03:32:16.124188+0000","last_unstale":"2024-09-07T03:32:50.471726+0000","last_undegraded":"2024-09-07T03:32:50.471726+0000","last_fullsized":"2024-09-07T03:32:50.471726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:20.601144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'60","reported_seq":123,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.205167+0000","last_change":"2024-09-07T03:32:18.127241+0000","last_active":"2024-09-07T03:34:21.205167+0000","last_peered":"2024-09-07T03:34:21.205167+0000","last_clean":"2024-09-07T03:34:21.205167+0000","last_became_active":"2024-09-07T03:32:18.126946+0000","last_became_peered":"2024-09-07T03:32:18.126946+0000","last_unstale":"2024-09-07T03:34:21.205167+0000","last_undegraded":"2024-09-07T03:34:21.205167+0000","last_fullsized":"2024-09-07T03:34:21.205167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:12:23.096494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275569+0000","last_change":"2024-09-07T03:32:20.144697+0000","last_active":"2024-09-07T03:32:50.275569+0000","last_peered":"2024-09-07T03:32:50.275569+0000","last_clean":"2024-09-07T03:32:50.275569+0000","last_became_active":"2024-09-07T03:32:20.144417+0000","last_became_peered":"2024-09-07T03:32:20.144417+0000","last_unstale":"2024-09-07T03:32:50.275569+0000","last_undegraded":"2024-09-07T03:32:50.275569+0000","last_fullsized":"2024-09-07T03:32:50.275569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:37:54.709062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'16","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.592808+0000","last_change":"2024-09-07T03:32:22.149726+0000","last_active":"2024-09-07T03:35:23.592808+0000","last_peered":"2024-09-07T03:35:23.592808+0000","last_clean":"2024-09-07T03:35:23.592808+0000","last_became_active":"2024-09-07T03:32:22.149442+0000","last_became_peered":"2024-09-07T03:32:22.149442+0000","last_unstale":"2024-09-07T03:35:23.592808+0000","last_undegraded":"2024-09-07T03:35:23.592808+0000","last_fullsized":"2024-09-07T03:35:23.592808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:25.687323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'9","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.849698+0000","last_change":"2024-09-07T03:32:14.114246+0000","last_active":"2024-09-07T03:35:23.849698+0000","last_peered":"2024-09-07T03:35:23.849698+0000","last_clean":"2024-09-07T03:35:23.849698+0000","last_became_active":"2024-09-07T03:32:14.111795+0000","last_became_peered":"2024-09-07T03:32:14.111795+0000","last_unstale":"2024-09-07T03:35:23.849698+0000","last_undegraded":"2024-09-07T03:35:23.849698+0000","last_fullsized":"2024-09-07T03:35:23.849698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:41:31.009147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470018+0000","last_change":"2024-09-07T03:32:12.136641+0000","last_active":"2024-09-07T03:32:50.470018+0000","last_peered":"2024-09-07T03:32:50.470018+0000","last_clean":"2024-09-07T03:32:50.470018+0000","last_became_active":"2024-09-07T03:32:12.136258+0000","last_became_peered":"2024-09-07T03:32:12.136258+0000","last_unstale":"2024-09-07T03:32:50.470018+0000","last_undegraded":"2024-09-07T03:32:50.470018+0000","last_fullsized":"2024-09-07T03:32:50.470018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:19:06.594103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281863+0000","last_change":"2024-09-07T03:32:16.122569+0000","last_active":"2024-09-07T03:32:50.281863+0000","last_peered":"2024-09-07T03:32:50.281863+0000","last_clean":"2024-09-07T03:32:50.281863+0000","last_became_active":"2024-09-07T03:32:16.122316+0000","last_became_peered":"2024-09-07T03:32:16.122316+0000","last_unstale":"2024-09-07T03:32:50.281863+0000","last_undegraded":"2024-09-07T03:32:50.281863+0000","last_fullsized":"2024-09-07T03:32:50.281863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:09:15.334063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.672169+0000","last_change":"2024-09-07T03:32:18.132401+0000","last_active":"2024-09-07T03:35:30.672169+0000","last_peered":"2024-09-07T03:35:30.672169+0000","last_clean":"2024-09-07T03:35:30.672169+0000","last_became_active":"2024-09-07T03:32:18.132084+0000","last_became_peered":"2024-09-07T03:32:18.132084+0000","last_unstale":"2024-09-07T03:35:30.672169+0000","last_undegraded":"2024-09-07T03:35:30.672169+0000","last_fullsized":"2024-09-07T03:35:30.672169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:21:08.328913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471012+0000","last_change":"2024-09-07T03:32:20.143643+0000","last_active":"2024-09-07T03:32:50.471012+0000","last_peered":"2024-09-07T03:32:50.471012+0000","last_clean":"2024-09-07T03:32:50.471012+0000","last_became_active":"2024-09-07T03:32:20.143377+0000","last_became_peered":"2024-09-07T03:32:20.143377+0000","last_unstale":"2024-09-07T03:32:50.471012+0000","last_undegraded":"2024-09-07T03:32:50.471012+0000","last_fullsized":"2024-09-07T03:32:50.471012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:11.431453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278297+0000","last_change":"2024-09-07T03:32:22.146527+0000","last_active":"2024-09-07T03:32:50.278297+0000","last_peered":"2024-09-07T03:32:50.278297+0000","last_clean":"2024-09-07T03:32:50.278297+0000","last_became_active":"2024-09-07T03:32:22.146237+0000","last_became_peered":"2024-09-07T03:32:22.146237+0000","last_unstale":"2024-09-07T03:32:50.278297+0000","last_undegraded":"2024-09-07T03:32:50.278297+0000","last_fullsized":"2024-09-07T03:32:50.278297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:13:05.478773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570991+0000","last_change":"2024-09-07T03:32:14.126016+0000","last_active":"2024-09-07T03:32:56.570991+0000","last_peered":"2024-09-07T03:32:56.570991+0000","last_clean":"2024-09-07T03:32:56.570991+0000","last_became_active":"2024-09-07T03:32:14.125706+0000","last_became_peered":"2024-09-07T03:32:14.125706+0000","last_unstale":"2024-09-07T03:32:56.570991+0000","last_undegraded":"2024-09-07T03:32:56.570991+0000","last_fullsized":"2024-09-07T03:32:56.570991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.726613+0000","last_change":"2024-09-07T03:32:12.126028+0000","last_active":"2024-09-07T03:35:23.726613+0000","last_peered":"2024-09-07T03:35:23.726613+0000","last_clean":"2024-09-07T03:35:23.726613+0000","last_became_active":"2024-09-07T03:32:12.125261+0000","last_became_peered":"2024-09-07T03:32:12.125261+0000","last_unstale":"2024-09-07T03:35:23.726613+0000","last_undegraded":"2024-09-07T03:35:23.726613+0000","last_fullsized":"2024-09-07T03:35:23.726613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:30.313501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280234+0000","last_change":"2024-09-07T03:32:16.124615+0000","last_active":"2024-09-07T03:32:50.280234+0000","last_peered":"2024-09-07T03:32:50.280234+0000","last_clean":"2024-09-07T03:32:50.280234+0000","last_became_active":"2024-09-07T03:32:16.124314+0000","last_became_peered":"2024-09-07T03:32:16.124314+0000","last_unstale":"2024-09-07T03:32:50.280234+0000","last_undegraded":"2024-09-07T03:32:50.280234+0000","last_fullsized":"2024-09-07T03:32:50.280234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:44:43.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'41","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.616251+0000","last_change":"2024-09-07T03:32:18.129996+0000","last_active":"2024-09-07T03:35:30.616251+0000","last_peered":"2024-09-07T03:35:30.616251+0000","last_clean":"2024-09-07T03:35:30.616251+0000","last_became_active":"2024-09-07T03:32:18.129700+0000","last_became_peered":"2024-09-07T03:32:18.129700+0000","last_unstale":"2024-09-07T03:35:30.616251+0000","last_undegraded":"2024-09-07T03:35:30.616251+0000","last_fullsized":"2024-09-07T03:35:30.616251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:38:03.778044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471615+0000","last_change":"2024-09-07T03:32:20.142983+0000","last_active":"2024-09-07T03:32:50.471615+0000","last_peered":"2024-09-07T03:32:50.471615+0000","last_clean":"2024-09-07T03:32:50.471615+0000","last_became_active":"2024-09-07T03:32:20.142695+0000","last_became_peered":"2024-09-07T03:32:20.142695+0000","last_unstale":"2024-09-07T03:32:50.471615+0000","last_undegraded":"2024-09-07T03:32:50.471615+0000","last_fullsized":"2024-09-07T03:32:50.471615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:29.846270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.959036+0000","last_change":"2024-09-07T03:32:22.143270+0000","last_active":"2024-09-07T03:34:22.959036+0000","last_peered":"2024-09-07T03:34:22.959036+0000","last_clean":"2024-09-07T03:34:22.959036+0000","last_became_active":"2024-09-07T03:32:22.143053+0000","last_became_peered":"2024-09-07T03:32:22.143053+0000","last_unstale":"2024-09-07T03:34:22.959036+0000","last_undegraded":"2024-09-07T03:34:22.959036+0000","last_fullsized":"2024-09-07T03:34:22.959036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:05:14.463803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'12","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843581+0000","last_change":"2024-09-07T03:32:14.117890+0000","last_active":"2024-09-07T03:35:23.843581+0000","last_peered":"2024-09-07T03:35:23.843581+0000","last_clean":"2024-09-07T03:35:23.843581+0000","last_became_active":"2024-09-07T03:32:14.117608+0000","last_became_peered":"2024-09-07T03:32:14.117608+0000","last_unstale":"2024-09-07T03:35:23.843581+0000","last_undegraded":"2024-09-07T03:35:23.843581+0000","last_fullsized":"2024-09-07T03:35:23.843581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:50:58.423715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275329+0000","last_change":"2024-09-07T03:32:12.135875+0000","last_active":"2024-09-07T03:32:50.275329+0000","last_peered":"2024-09-07T03:32:50.275329+0000","last_clean":"2024-09-07T03:32:50.275329+0000","last_became_active":"2024-09-07T03:32:12.135523+0000","last_became_peered":"2024-09-07T03:32:12.135523+0000","last_unstale":"2024-09-07T03:32:50.275329+0000","last_undegraded":"2024-09-07T03:32:50.275329+0000","last_fullsized":"2024-09-07T03:32:50.275329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:35.883059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:51.215438+0000","last_change":"2024-09-07T03:32:50.279386+0000","last_active":"2024-09-07T03:32:51.215438+0000","last_peered":"2024-09-07T03:32:51.215438+0000","last_clean":"2024-09-07T03:32:51.215438+0000","last_became_active":"2024-09-07T03:32:50.279004+0000","last_became_peered":"2024-09-07T03:32:50.279004+0000","last_unstale":"2024-09-07T03:32:51.215438+0000","last_undegraded":"2024-09-07T03:32:51.215438+0000","last_fullsized":"2024-09-07T03:32:51.215438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:52.172562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"34'18","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273667+0000","last_change":"2024-09-07T03:32:18.127389+0000","last_active":"2024-09-07T03:32:50.273667+0000","last_peered":"2024-09-07T03:32:50.273667+0000","last_clean":"2024-09-07T03:32:50.273667+0000","last_became_active":"2024-09-07T03:32:18.127007+0000","last_became_peered":"2024-09-07T03:32:18.127007+0000","last_unstale":"2024-09-07T03:32:50.273667+0000","last_undegraded":"2024-09-07T03:32:50.273667+0000","last_fullsized":"2024-09-07T03:32:50.273667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:32:04.955651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":370,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.536750+0000","last_change":"2024-09-07T03:32:20.147075+0000","last_active":"2024-09-07T03:35:30.536750+0000","last_peered":"2024-09-07T03:35:30.536750+0000","last_clean":"2024-09-07T03:35:30.536750+0000","last_became_active":"2024-09-07T03:32:20.146738+0000","last_became_peered":"2024-09-07T03:32:20.146738+0000","last_unstale":"2024-09-07T03:35:30.536750+0000","last_undegraded":"2024-09-07T03:35:30.536750+0000","last_fullsized":"2024-09-07T03:35:30.536750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:39.886530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.568340+0000","last_change":"2024-09-07T03:32:22.151158+0000","last_active":"2024-09-07T03:32:56.568340+0000","last_peered":"2024-09-07T03:32:56.568340+0000","last_clean":"2024-09-07T03:32:56.568340+0000","last_became_active":"2024-09-07T03:32:22.150886+0000","last_became_peered":"2024-09-07T03:32:22.150886+0000","last_unstale":"2024-09-07T03:32:56.568340+0000","last_undegraded":"2024-09-07T03:32:56.568340+0000","last_fullsized":"2024-09-07T03:32:56.568340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:57:06.666886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'18","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843569+0000","last_change":"2024-09-07T03:32:14.127180+0000","last_active":"2024-09-07T03:35:23.843569+0000","last_peered":"2024-09-07T03:35:23.843569+0000","last_clean":"2024-09-07T03:35:23.843569+0000","last_became_active":"2024-09-07T03:32:14.126901+0000","last_became_peered":"2024-09-07T03:32:14.126901+0000","last_unstale":"2024-09-07T03:35:23.843569+0000","last_undegraded":"2024-09-07T03:35:23.843569+0000","last_fullsized":"2024-09-07T03:35:23.843569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:14.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473031+0000","last_change":"2024-09-07T03:32:12.134765+0000","last_active":"2024-09-07T03:32:50.473031+0000","last_peered":"2024-09-07T03:32:50.473031+0000","last_clean":"2024-09-07T03:32:50.473031+0000","last_became_active":"2024-09-07T03:32:12.133876+0000","last_became_peered":"2024-09-07T03:32:12.133876+0000","last_unstale":"2024-09-07T03:32:50.473031+0000","last_undegraded":"2024-09-07T03:32:50.473031+0000","last_fullsized":"2024-09-07T03:32:50.473031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:01.450719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'1","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.297081+0000","last_change":"2024-09-07T03:32:16.122534+0000","last_active":"2024-09-07T03:34:22.297081+0000","last_peered":"2024-09-07T03:34:22.297081+0000","last_clean":"2024-09-07T03:34:22.297081+0000","last_became_active":"2024-09-07T03:32:16.120952+0000","last_became_peered":"2024-09-07T03:32:16.120952+0000","last_unstale":"2024-09-07T03:34:22.297081+0000","last_undegraded":"2024-09-07T03:34:22.297081+0000","last_fullsized":"2024-09-07T03:34:22.297081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:35.686701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'66","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.635641+0000","last_change":"2024-09-07T03:32:18.133969+0000","last_active":"2024-09-07T03:35:30.635641+0000","last_peered":"2024-09-07T03:35:30.635641+0000","last_clean":"2024-09-07T03:35:30.635641+0000","last_became_active":"2024-09-07T03:32:18.133705+0000","last_became_peered":"2024-09-07T03:32:18.133705+0000","last_unstale":"2024-09-07T03:35:30.635641+0000","last_undegraded":"2024-09-07T03:35:30.635641+0000","last_fullsized":"2024-09-07T03:35:30.635641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:02.433602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271613+0000","last_change":"2024-09-07T03:32:20.137011+0000","last_active":"2024-09-07T03:32:50.271613+0000","last_peered":"2024-09-07T03:32:50.271613+0000","last_clean":"2024-09-07T03:32:50.271613+0000","last_became_active":"2024-09-07T03:32:20.135211+0000","last_became_peered":"2024-09-07T03:32:20.135211+0000","last_unstale":"2024-09-07T03:32:50.271613+0000","last_undegraded":"2024-09-07T03:32:50.271613+0000","last_fullsized":"2024-09-07T03:32:50.271613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:33.033993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.028862+0000","last_change":"2024-09-07T03:32:22.141840+0000","last_active":"2024-09-07T03:32:57.028862+0000","last_peered":"2024-09-07T03:32:57.028862+0000","last_clean":"2024-09-07T03:32:57.028862+0000","last_became_active":"2024-09-07T03:32:22.141533+0000","last_became_peered":"2024-09-07T03:32:22.141533+0000","last_unstale":"2024-09-07T03:32:57.028862+0000","last_undegraded":"2024-09-07T03:32:57.028862+0000","last_fullsized":"2024-09-07T03:32:57.028862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:32:37.743868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'20","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806061+0000","last_change":"2024-09-07T03:32:14.123194+0000","last_active":"2024-09-07T03:35:23.806061+0000","last_peered":"2024-09-07T03:35:23.806061+0000","last_clean":"2024-09-07T03:35:23.806061+0000","last_became_active":"2024-09-07T03:32:14.122929+0000","last_became_peered":"2024-09-07T03:32:14.122929+0000","last_unstale":"2024-09-07T03:35:23.806061+0000","last_undegraded":"2024-09-07T03:35:23.806061+0000","last_fullsized":"2024-09-07T03:35:23.806061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:27:08.474145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281523+0000","last_change":"2024-09-07T03:32:12.125302+0000","last_active":"2024-09-07T03:32:50.281523+0000","last_peered":"2024-09-07T03:32:50.281523+0000","last_clean":"2024-09-07T03:32:50.281523+0000","last_became_active":"2024-09-07T03:32:12.124610+0000","last_became_peered":"2024-09-07T03:32:12.124610+0000","last_unstale":"2024-09-07T03:32:50.281523+0000","last_undegraded":"2024-09-07T03:32:50.281523+0000","last_fullsized":"2024-09-07T03:32:50.281523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:41:42.237332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278654+0000","last_change":"2024-09-07T03:32:16.116613+0000","last_active":"2024-09-07T03:32:50.278654+0000","last_peered":"2024-09-07T03:32:50.278654+0000","last_clean":"2024-09-07T03:32:50.278654+0000","last_became_active":"2024-09-07T03:32:16.116296+0000","last_became_peered":"2024-09-07T03:32:16.116296+0000","last_unstale":"2024-09-07T03:32:50.278654+0000","last_undegraded":"2024-09-07T03:32:50.278654+0000","last_fullsized":"2024-09-07T03:32:50.278654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:40:46.166456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'40","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.638598+0000","last_change":"2024-09-07T03:32:18.134892+0000","last_active":"2024-09-07T03:35:30.638598+0000","last_peered":"2024-09-07T03:35:30.638598+0000","last_clean":"2024-09-07T03:35:30.638598+0000","last_became_active":"2024-09-07T03:32:18.134533+0000","last_became_peered":"2024-09-07T03:32:18.134533+0000","last_unstale":"2024-09-07T03:35:30.638598+0000","last_undegraded":"2024-09-07T03:35:30.638598+0000","last_fullsized":"2024-09-07T03:35:30.638598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:15:18.375395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278010+0000","last_change":"2024-09-07T03:32:20.146986+0000","last_active":"2024-09-07T03:32:50.278010+0000","last_peered":"2024-09-07T03:32:50.278010+0000","last_clean":"2024-09-07T03:32:50.278010+0000","last_became_active":"2024-09-07T03:32:20.146631+0000","last_became_peered":"2024-09-07T03:32:20.146631+0000","last_unstale":"2024-09-07T03:32:50.278010+0000","last_undegraded":"2024-09-07T03:32:50.278010+0000","last_fullsized":"2024-09-07T03:32:50.278010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:56.243102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275464+0000","last_change":"2024-09-07T03:32:22.152021+0000","last_active":"2024-09-07T03:32:50.275464+0000","last_peered":"2024-09-07T03:32:50.275464+0000","last_clean":"2024-09-07T03:32:50.275464+0000","last_became_active":"2024-09-07T03:32:22.151709+0000","last_became_peered":"2024-09-07T03:32:22.151709+0000","last_unstale":"2024-09-07T03:32:50.275464+0000","last_undegraded":"2024-09-07T03:32:50.275464+0000","last_fullsized":"2024-09-07T03:32:50.275464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:01.162547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963490+0000","last_change":"2024-09-07T03:32:14.127708+0000","last_active":"2024-09-07T03:34:22.963490+0000","last_peered":"2024-09-07T03:34:22.963490+0000","last_clean":"2024-09-07T03:34:22.963490+0000","last_became_active":"2024-09-07T03:32:14.127451+0000","last_became_peered":"2024-09-07T03:32:14.127451+0000","last_unstale":"2024-09-07T03:34:22.963490+0000","last_undegraded":"2024-09-07T03:34:22.963490+0000","last_fullsized":"2024-09-07T03:34:22.963490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:19.822962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273816+0000","last_change":"2024-09-07T03:32:12.125466+0000","last_active":"2024-09-07T03:32:50.273816+0000","last_peered":"2024-09-07T03:32:50.273816+0000","last_clean":"2024-09-07T03:32:50.273816+0000","last_became_active":"2024-09-07T03:32:12.124552+0000","last_became_peered":"2024-09-07T03:32:12.124552+0000","last_unstale":"2024-09-07T03:32:50.273816+0000","last_undegraded":"2024-09-07T03:32:50.273816+0000","last_fullsized":"2024-09-07T03:32:50.273816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:13:53.582954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469800+0000","last_change":"2024-09-07T03:32:16.125669+0000","last_active":"2024-09-07T03:32:50.469800+0000","last_peered":"2024-09-07T03:32:50.469800+0000","last_clean":"2024-09-07T03:32:50.469800+0000","last_became_active":"2024-09-07T03:32:16.123423+0000","last_became_peered":"2024-09-07T03:32:16.123423+0000","last_unstale":"2024-09-07T03:32:50.469800+0000","last_undegraded":"2024-09-07T03:32:50.469800+0000","last_fullsized":"2024-09-07T03:32:50.469800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:06:37.923895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'35","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.610398+0000","last_change":"2024-09-07T03:32:18.129106+0000","last_active":"2024-09-07T03:35:30.610398+0000","last_peered":"2024-09-07T03:35:30.610398+0000","last_clean":"2024-09-07T03:35:30.610398+0000","last_became_active":"2024-09-07T03:32:18.128812+0000","last_became_peered":"2024-09-07T03:32:18.128812+0000","last_unstale":"2024-09-07T03:35:30.610398+0000","last_undegraded":"2024-09-07T03:35:30.610398+0000","last_fullsized":"2024-09-07T03:35:30.610398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:51.897402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279344+0000","last_change":"2024-09-07T03:32:20.132779+0000","last_active":"2024-09-07T03:32:50.279344+0000","last_peered":"2024-09-07T03:32:50.279344+0000","last_clean":"2024-09-07T03:32:50.279344+0000","last_became_active":"2024-09-07T03:32:20.132396+0000","last_became_peered":"2024-09-07T03:32:20.132396+0000","last_unstale":"2024-09-07T03:32:50.279344+0000","last_undegraded":"2024-09-07T03:32:50.279344+0000","last_fullsized":"2024-09-07T03:32:50.279344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:29:30.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.210747+0000","last_change":"2024-09-07T03:32:22.152253+0000","last_active":"2024-09-07T03:34:21.210747+0000","last_peered":"2024-09-07T03:34:21.210747+0000","last_clean":"2024-09-07T03:34:21.210747+0000","last_became_active":"2024-09-07T03:32:22.151697+0000","last_became_peered":"2024-09-07T03:32:22.151697+0000","last_unstale":"2024-09-07T03:34:21.210747+0000","last_undegraded":"2024-09-07T03:34:21.210747+0000","last_fullsized":"2024-09-07T03:34:21.210747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:12:47.655977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806035+0000","last_change":"2024-09-07T03:32:14.113037+0000","last_active":"2024-09-07T03:35:23.806035+0000","last_peered":"2024-09-07T03:35:23.806035+0000","last_clean":"2024-09-07T03:35:23.806035+0000","last_became_active":"2024-09-07T03:32:14.112336+0000","last_became_peered":"2024-09-07T03:32:14.112336+0000","last_unstale":"2024-09-07T03:35:23.806035+0000","last_undegraded":"2024-09-07T03:35:23.806035+0000","last_fullsized":"2024-09-07T03:35:23.806035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.767629+0000","last_change":"2024-09-07T03:32:12.138565+0000","last_active":"2024-09-07T03:34:22.767629+0000","last_peered":"2024-09-07T03:34:22.767629+0000","last_clean":"2024-09-07T03:34:22.767629+0000","last_became_active":"2024-09-07T03:32:12.136020+0000","last_became_peered":"2024-09-07T03:32:12.136020+0000","last_unstale":"2024-09-07T03:34:22.767629+0000","last_undegraded":"2024-09-07T03:34:22.767629+0000","last_fullsized":"2024-09-07T03:34:22.767629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:57:08.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.817388+0000","last_change":"2024-09-07T03:32:16.129863+0000","last_active":"2024-09-07T03:34:19.817388+0000","last_peered":"2024-09-07T03:34:19.817388+0000","last_clean":"2024-09-07T03:34:19.817388+0000","last_became_active":"2024-09-07T03:32:16.129161+0000","last_became_peered":"2024-09-07T03:32:16.129161+0000","last_unstale":"2024-09-07T03:34:19.817388+0000","last_undegraded":"2024-09-07T03:34:19.817388+0000","last_fullsized":"2024-09-07T03:34:19.817388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:08:23.197757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'48","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.619879+0000","last_change":"2024-09-07T03:32:18.132380+0000","last_active":"2024-09-07T03:35:30.619879+0000","last_peered":"2024-09-07T03:35:30.619879+0000","last_clean":"2024-09-07T03:35:30.619879+0000","last_became_active":"2024-09-07T03:32:18.132072+0000","last_became_peered":"2024-09-07T03:32:18.132072+0000","last_unstale":"2024-09-07T03:35:30.619879+0000","last_undegraded":"2024-09-07T03:35:30.619879+0000","last_fullsized":"2024-09-07T03:35:30.619879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:37.568436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274904+0000","last_change":"2024-09-07T03:32:20.145649+0000","last_active":"2024-09-07T03:32:50.274904+0000","last_peered":"2024-09-07T03:32:50.274904+0000","last_clean":"2024-09-07T03:32:50.274904+0000","last_became_active":"2024-09-07T03:32:20.144977+0000","last_became_peered":"2024-09-07T03:32:20.144977+0000","last_unstale":"2024-09-07T03:32:50.274904+0000","last_undegraded":"2024-09-07T03:32:50.274904+0000","last_fullsized":"2024-09-07T03:32:50.274904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:56.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.213631+0000","last_change":"2024-09-07T03:32:22.141987+0000","last_active":"2024-09-07T03:34:21.213631+0000","last_peered":"2024-09-07T03:34:21.213631+0000","last_clean":"2024-09-07T03:34:21.213631+0000","last_became_active":"2024-09-07T03:32:22.141633+0000","last_became_peered":"2024-09-07T03:32:22.141633+0000","last_unstale":"2024-09-07T03:34:21.213631+0000","last_undegraded":"2024-09-07T03:34:21.213631+0000","last_fullsized":"2024-09-07T03:34:21.213631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:45.392294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.478248+0000","last_change":"2024-09-07T03:32:14.114021+0000","last_active":"2024-09-07T03:35:23.478248+0000","last_peered":"2024-09-07T03:35:23.478248+0000","last_clean":"2024-09-07T03:35:23.478248+0000","last_became_active":"2024-09-07T03:32:14.111950+0000","last_became_peered":"2024-09-07T03:32:14.111950+0000","last_unstale":"2024-09-07T03:35:23.478248+0000","last_undegraded":"2024-09-07T03:35:23.478248+0000","last_fullsized":"2024-09-07T03:35:23.478248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:42:20.068850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274043+0000","last_change":"2024-09-07T03:32:12.133214+0000","last_active":"2024-09-07T03:32:50.274043+0000","last_peered":"2024-09-07T03:32:50.274043+0000","last_clean":"2024-09-07T03:32:50.274043+0000","last_became_active":"2024-09-07T03:32:12.132814+0000","last_became_peered":"2024-09-07T03:32:12.132814+0000","last_unstale":"2024-09-07T03:32:50.274043+0000","last_undegraded":"2024-09-07T03:32:50.274043+0000","last_fullsized":"2024-09-07T03:32:50.274043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:53.987362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843863+0000","last_change":"2024-09-07T03:32:14.115342+0000","last_active":"2024-09-07T03:35:23.843863+0000","last_peered":"2024-09-07T03:35:23.843863+0000","last_clean":"2024-09-07T03:35:23.843863+0000","last_became_active":"2024-09-07T03:32:14.114966+0000","last_became_peered":"2024-09-07T03:32:14.114966+0000","last_unstale":"2024-09-07T03:35:23.843863+0000","last_undegraded":"2024-09-07T03:35:23.843863+0000","last_fullsized":"2024-09-07T03:35:23.843863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:07:27.478728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.346800+0000","last_change":"2024-09-07T03:32:12.134634+0000","last_active":"2024-09-07T03:35:23.346800+0000","last_peered":"2024-09-07T03:35:23.346800+0000","last_clean":"2024-09-07T03:35:23.346800+0000","last_became_active":"2024-09-07T03:32:12.132662+0000","last_became_peered":"2024-09-07T03:32:12.132662+0000","last_unstale":"2024-09-07T03:35:23.346800+0000","last_undegraded":"2024-09-07T03:35:23.346800+0000","last_fullsized":"2024-09-07T03:35:23.346800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:00:50.432167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.739589+0000","last_change":"2024-09-07T03:32:14.122593+0000","last_active":"2024-09-07T03:35:23.739589+0000","last_peered":"2024-09-07T03:35:23.739589+0000","last_clean":"2024-09-07T03:35:23.739589+0000","last_became_active":"2024-09-07T03:32:14.122301+0000","last_became_peered":"2024-09-07T03:32:14.122301+0000","last_unstale":"2024-09-07T03:35:23.739589+0000","last_undegraded":"2024-09-07T03:35:23.739589+0000","last_fullsized":"2024-09-07T03:35:23.739589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272108+0000","last_change":"2024-09-07T03:32:12.138037+0000","last_active":"2024-09-07T03:32:50.272108+0000","last_peered":"2024-09-07T03:32:50.272108+0000","last_clean":"2024-09-07T03:32:50.272108+0000","last_became_active":"2024-09-07T03:32:12.137561+0000","last_became_peered":"2024-09-07T03:32:12.137561+0000","last_unstale":"2024-09-07T03:32:50.272108+0000","last_undegraded":"2024-09-07T03:32:50.272108+0000","last_fullsized":"2024-09-07T03:32:50.272108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:59.055476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435902+0000","last_change":"2024-09-07T03:32:14.114337+0000","last_active":"2024-09-07T03:34:19.435902+0000","last_peered":"2024-09-07T03:34:19.435902+0000","last_clean":"2024-09-07T03:34:19.435902+0000","last_became_active":"2024-09-07T03:32:14.114055+0000","last_became_peered":"2024-09-07T03:32:14.114055+0000","last_unstale":"2024-09-07T03:34:19.435902+0000","last_undegraded":"2024-09-07T03:34:19.435902+0000","last_fullsized":"2024-09-07T03:34:19.435902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:55:05.807784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.728015+0000","last_change":"2024-09-07T03:32:12.132824+0000","last_active":"2024-09-07T03:34:22.728015+0000","last_peered":"2024-09-07T03:34:22.728015+0000","last_clean":"2024-09-07T03:34:22.728015+0000","last_became_active":"2024-09-07T03:32:12.132471+0000","last_became_peered":"2024-09-07T03:32:12.132471+0000","last_unstale":"2024-09-07T03:34:22.728015+0000","last_undegraded":"2024-09-07T03:34:22.728015+0000","last_fullsized":"2024-09-07T03:34:22.728015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:04:57.476630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803876+0000","last_change":"2024-09-07T03:32:50.285566+0000","last_active":"2024-09-07T03:35:23.803876+0000","last_peered":"2024-09-07T03:35:23.803876+0000","last_clean":"2024-09-07T03:35:23.803876+0000","last_became_active":"2024-09-07T03:32:50.280656+0000","last_became_peered":"2024-09-07T03:32:50.280656+0000","last_unstale":"2024-09-07T03:35:23.803876+0000","last_undegraded":"2024-09-07T03:35:23.803876+0000","last_fullsized":"2024-09-07T03:35:23.803876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:19:49.958031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.429207+0000","last_change":"2024-09-07T03:32:12.140756+0000","last_active":"2024-09-07T03:32:55.429207+0000","last_peered":"2024-09-07T03:32:55.429207+0000","last_clean":"2024-09-07T03:32:55.429207+0000","last_became_active":"2024-09-07T03:32:12.140393+0000","last_became_peered":"2024-09-07T03:32:12.140393+0000","last_unstale":"2024-09-07T03:32:55.429207+0000","last_undegraded":"2024-09-07T03:32:55.429207+0000","last_fullsized":"2024-09-07T03:32:55.429207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:23.691202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"36'10","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803631+0000","last_change":"2024-09-07T03:32:14.114468+0000","last_active":"2024-09-07T03:35:23.803631+0000","last_peered":"2024-09-07T03:35:23.803631+0000","last_clean":"2024-09-07T03:35:23.803631+0000","last_became_active":"2024-09-07T03:32:14.113830+0000","last_became_peered":"2024-09-07T03:32:14.113830+0000","last_unstale":"2024-09-07T03:35:23.803631+0000","last_undegraded":"2024-09-07T03:35:23.803631+0000","last_fullsized":"2024-09-07T03:35:23.803631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:00.736940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471745+0000","last_change":"2024-09-07T03:32:12.134769+0000","last_active":"2024-09-07T03:32:50.471745+0000","last_peered":"2024-09-07T03:32:50.471745+0000","last_clean":"2024-09-07T03:32:50.471745+0000","last_became_active":"2024-09-07T03:32:12.134287+0000","last_became_peered":"2024-09-07T03:32:12.134287+0000","last_unstale":"2024-09-07T03:32:50.471745+0000","last_undegraded":"2024-09-07T03:32:50.471745+0000","last_fullsized":"2024-09-07T03:32:50.471745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:29:37.829617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'17","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228255+0000","last_change":"2024-09-07T03:32:14.126278+0000","last_active":"2024-09-07T03:34:21.228255+0000","last_peered":"2024-09-07T03:34:21.228255+0000","last_clean":"2024-09-07T03:34:21.228255+0000","last_became_active":"2024-09-07T03:32:14.125990+0000","last_became_peered":"2024-09-07T03:32:14.125990+0000","last_unstale":"2024-09-07T03:34:21.228255+0000","last_undegraded":"2024-09-07T03:34:21.228255+0000","last_fullsized":"2024-09-07T03:34:21.228255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:31:20.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278552+0000","last_change":"2024-09-07T03:32:12.129933+0000","last_active":"2024-09-07T03:32:50.278552+0000","last_peered":"2024-09-07T03:32:50.278552+0000","last_clean":"2024-09-07T03:32:50.278552+0000","last_became_active":"2024-09-07T03:32:12.128807+0000","last_became_peered":"2024-09-07T03:32:12.128807+0000","last_unstale":"2024-09-07T03:32:50.278552+0000","last_undegraded":"2024-09-07T03:32:50.278552+0000","last_fullsized":"2024-09-07T03:32:50.278552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:14:03.821714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806043+0000","last_change":"2024-09-07T03:32:14.110088+0000","last_active":"2024-09-07T03:35:23.806043+0000","last_peered":"2024-09-07T03:35:23.806043+0000","last_clean":"2024-09-07T03:35:23.806043+0000","last_became_active":"2024-09-07T03:32:14.109799+0000","last_became_peered":"2024-09-07T03:32:14.109799+0000","last_unstale":"2024-09-07T03:35:23.806043+0000","last_undegraded":"2024-09-07T03:35:23.806043+0000","last_fullsized":"2024-09-07T03:35:23.806043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276544+0000","last_change":"2024-09-07T03:32:12.131240+0000","last_active":"2024-09-07T03:32:50.276544+0000","last_peered":"2024-09-07T03:32:50.276544+0000","last_clean":"2024-09-07T03:32:50.276544+0000","last_became_active":"2024-09-07T03:32:12.130563+0000","last_became_peered":"2024-09-07T03:32:12.130563+0000","last_unstale":"2024-09-07T03:32:50.276544+0000","last_undegraded":"2024-09-07T03:32:50.276544+0000","last_fullsized":"2024-09-07T03:32:50.276544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:35.973387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806088+0000","last_change":"2024-09-07T03:32:14.115326+0000","last_active":"2024-09-07T03:35:23.806088+0000","last_peered":"2024-09-07T03:35:23.806088+0000","last_clean":"2024-09-07T03:35:23.806088+0000","last_became_active":"2024-09-07T03:32:14.115000+0000","last_became_peered":"2024-09-07T03:32:14.115000+0000","last_unstale":"2024-09-07T03:35:23.806088+0000","last_undegraded":"2024-09-07T03:35:23.806088+0000","last_fullsized":"2024-09-07T03:35:23.806088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:20.852806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272042+0000","last_change":"2024-09-07T03:32:12.142672+0000","last_active":"2024-09-07T03:32:50.272042+0000","last_peered":"2024-09-07T03:32:50.272042+0000","last_clean":"2024-09-07T03:32:50.272042+0000","last_became_active":"2024-09-07T03:32:12.142315+0000","last_became_peered":"2024-09-07T03:32:12.142315+0000","last_unstale":"2024-09-07T03:32:50.272042+0000","last_undegraded":"2024-09-07T03:32:50.272042+0000","last_fullsized":"2024-09-07T03:32:50.272042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:04:31.049755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276218+0000","last_change":"2024-09-07T03:32:14.127846+0000","last_active":"2024-09-07T03:32:50.276218+0000","last_peered":"2024-09-07T03:32:50.276218+0000","last_clean":"2024-09-07T03:32:50.276218+0000","last_became_active":"2024-09-07T03:32:14.127560+0000","last_became_peered":"2024-09-07T03:32:14.127560+0000","last_unstale":"2024-09-07T03:32:50.276218+0000","last_undegraded":"2024-09-07T03:32:50.276218+0000","last_fullsized":"2024-09-07T03:32:50.276218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432265+0000","last_change":"2024-09-07T03:32:12.139702+0000","last_active":"2024-09-07T03:32:55.432265+0000","last_peered":"2024-09-07T03:32:55.432265+0000","last_clean":"2024-09-07T03:32:55.432265+0000","last_became_active":"2024-09-07T03:32:12.138745+0000","last_became_peered":"2024-09-07T03:32:12.138745+0000","last_unstale":"2024-09-07T03:32:55.432265+0000","last_undegraded":"2024-09-07T03:32:55.432265+0000","last_fullsized":"2024-09-07T03:32:55.432265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:58:53.427065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.805976+0000","last_change":"2024-09-07T03:32:14.123012+0000","last_active":"2024-09-07T03:35:23.805976+0000","last_peered":"2024-09-07T03:35:23.805976+0000","last_clean":"2024-09-07T03:35:23.805976+0000","last_became_active":"2024-09-07T03:32:14.122699+0000","last_became_peered":"2024-09-07T03:32:14.122699+0000","last_unstale":"2024-09-07T03:35:23.805976+0000","last_undegraded":"2024-09-07T03:35:23.805976+0000","last_fullsized":"2024-09-07T03:35:23.805976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:12.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280233+0000","last_change":"2024-09-07T03:32:12.133952+0000","last_active":"2024-09-07T03:32:50.280233+0000","last_peered":"2024-09-07T03:32:50.280233+0000","last_clean":"2024-09-07T03:32:50.280233+0000","last_became_active":"2024-09-07T03:32:12.133145+0000","last_became_peered":"2024-09-07T03:32:12.133145+0000","last_unstale":"2024-09-07T03:32:50.280233+0000","last_undegraded":"2024-09-07T03:32:50.280233+0000","last_fullsized":"2024-09-07T03:32:50.280233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:02.480411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"36'16","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587715+0000","last_change":"2024-09-07T03:32:14.112126+0000","last_active":"2024-09-07T03:35:23.587715+0000","last_peered":"2024-09-07T03:35:23.587715+0000","last_clean":"2024-09-07T03:35:23.587715+0000","last_became_active":"2024-09-07T03:32:14.111759+0000","last_became_peered":"2024-09-07T03:32:14.111759+0000","last_unstale":"2024-09-07T03:35:23.587715+0000","last_undegraded":"2024-09-07T03:35:23.587715+0000","last_fullsized":"2024-09-07T03:35:23.587715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:14.003758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":44,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'1","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230117+0000","last_change":"2024-09-07T03:32:12.134868+0000","last_active":"2024-09-07T03:34:28.230117+0000","last_peered":"2024-09-07T03:34:28.230117+0000","last_clean":"2024-09-07T03:34:28.230117+0000","last_became_active":"2024-09-07T03:32:12.134151+0000","last_became_peered":"2024-09-07T03:32:12.134151+0000","last_unstale":"2024-09-07T03:34:28.230117+0000","last_undegraded":"2024-09-07T03:34:28.230117+0000","last_fullsized":"2024-09-07T03:34:28.230117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:08:24.817906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'30","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731159+0000","last_change":"2024-09-07T03:32:14.124493+0000","last_active":"2024-09-07T03:35:23.731159+0000","last_peered":"2024-09-07T03:35:23.731159+0000","last_clean":"2024-09-07T03:35:23.731159+0000","last_became_active":"2024-09-07T03:32:14.124258+0000","last_became_peered":"2024-09-07T03:32:14.124258+0000","last_unstale":"2024-09-07T03:35:23.731159+0000","last_undegraded":"2024-09-07T03:35:23.731159+0000","last_fullsized":"2024-09-07T03:35:23.731159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":111,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273399+0000","last_change":"2024-09-07T03:32:12.140618+0000","last_active":"2024-09-07T03:32:50.273399+0000","last_peered":"2024-09-07T03:32:50.273399+0000","last_clean":"2024-09-07T03:32:50.273399+0000","last_became_active":"2024-09-07T03:32:12.140243+0000","last_became_peered":"2024-09-07T03:32:12.140243+0000","last_unstale":"2024-09-07T03:32:50.273399+0000","last_undegraded":"2024-09-07T03:32:50.273399+0000","last_fullsized":"2024-09-07T03:32:50.273399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:41.435390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570857+0000","last_change":"2024-09-07T03:32:14.113597+0000","last_active":"2024-09-07T03:32:56.570857+0000","last_peered":"2024-09-07T03:32:56.570857+0000","last_clean":"2024-09-07T03:32:56.570857+0000","last_became_active":"2024-09-07T03:32:14.113016+0000","last_became_peered":"2024-09-07T03:32:14.113016+0000","last_unstale":"2024-09-07T03:32:56.570857+0000","last_undegraded":"2024-09-07T03:32:56.570857+0000","last_fullsized":"2024-09-07T03:32:56.570857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:38:17.720862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272704+0000","last_change":"2024-09-07T03:32:12.136273+0000","last_active":"2024-09-07T03:32:50.272704+0000","last_peered":"2024-09-07T03:32:50.272704+0000","last_clean":"2024-09-07T03:32:50.272704+0000","last_became_active":"2024-09-07T03:32:12.135936+0000","last_became_peered":"2024-09-07T03:32:12.135936+0000","last_unstale":"2024-09-07T03:32:50.272704+0000","last_undegraded":"2024-09-07T03:32:50.272704+0000","last_fullsized":"2024-09-07T03:32:50.272704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:55.875414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731153+0000","last_change":"2024-09-07T03:32:14.128701+0000","last_active":"2024-09-07T03:35:23.731153+0000","last_peered":"2024-09-07T03:35:23.731153+0000","last_clean":"2024-09-07T03:35:23.731153+0000","last_became_active":"2024-09-07T03:32:14.127982+0000","last_became_peered":"2024-09-07T03:32:14.127982+0000","last_unstale":"2024-09-07T03:35:23.731153+0000","last_undegraded":"2024-09-07T03:35:23.731153+0000","last_fullsized":"2024-09-07T03:35:23.731153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278674+0000","last_change":"2024-09-07T03:32:12.134111+0000","last_active":"2024-09-07T03:32:50.278674+0000","last_peered":"2024-09-07T03:32:50.278674+0000","last_clean":"2024-09-07T03:32:50.278674+0000","last_became_active":"2024-09-07T03:32:12.133720+0000","last_became_peered":"2024-09-07T03:32:12.133720+0000","last_unstale":"2024-09-07T03:32:50.278674+0000","last_undegraded":"2024-09-07T03:32:50.278674+0000","last_fullsized":"2024-09-07T03:32:50.278674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:57:03.239693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843615+0000","last_change":"2024-09-07T03:32:14.124677+0000","last_active":"2024-09-07T03:35:23.843615+0000","last_peered":"2024-09-07T03:35:23.843615+0000","last_clean":"2024-09-07T03:35:23.843615+0000","last_became_active":"2024-09-07T03:32:14.124462+0000","last_became_peered":"2024-09-07T03:32:14.124462+0000","last_unstale":"2024-09-07T03:35:23.843615+0000","last_undegraded":"2024-09-07T03:35:23.843615+0000","last_fullsized":"2024-09-07T03:35:23.843615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.907020+0000","last_change":"2024-09-07T03:32:12.141303+0000","last_active":"2024-09-07T03:34:22.907020+0000","last_peered":"2024-09-07T03:34:22.907020+0000","last_clean":"2024-09-07T03:34:22.907020+0000","last_became_active":"2024-09-07T03:32:12.140957+0000","last_became_peered":"2024-09-07T03:32:12.140957+0000","last_unstale":"2024-09-07T03:34:22.907020+0000","last_undegraded":"2024-09-07T03:34:22.907020+0000","last_fullsized":"2024-09-07T03:34:22.907020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:19:10.920973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278119+0000","last_change":"2024-09-07T03:32:12.133925+0000","last_active":"2024-09-07T03:32:50.278119+0000","last_peered":"2024-09-07T03:32:50.278119+0000","last_clean":"2024-09-07T03:32:50.278119+0000","last_became_active":"2024-09-07T03:32:12.133460+0000","last_became_peered":"2024-09-07T03:32:12.133460+0000","last_unstale":"2024-09-07T03:32:50.278119+0000","last_undegraded":"2024-09-07T03:32:50.278119+0000","last_fullsized":"2024-09-07T03:32:50.278119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:50:56.419019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435937+0000","last_change":"2024-09-07T03:32:14.123815+0000","last_active":"2024-09-07T03:34:19.435937+0000","last_peered":"2024-09-07T03:34:19.435937+0000","last_clean":"2024-09-07T03:34:19.435937+0000","last_became_active":"2024-09-07T03:32:14.123554+0000","last_became_peered":"2024-09-07T03:32:14.123554+0000","last_unstale":"2024-09-07T03:34:19.435937+0000","last_undegraded":"2024-09-07T03:34:19.435937+0000","last_fullsized":"2024-09-07T03:34:19.435937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:12:13.928369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470165+0000","last_change":"2024-09-07T03:32:12.135828+0000","last_active":"2024-09-07T03:32:50.470165+0000","last_peered":"2024-09-07T03:32:50.470165+0000","last_clean":"2024-09-07T03:32:50.470165+0000","last_became_active":"2024-09-07T03:32:12.134650+0000","last_became_peered":"2024-09-07T03:32:12.134650+0000","last_unstale":"2024-09-07T03:32:50.470165+0000","last_undegraded":"2024-09-07T03:32:50.470165+0000","last_fullsized":"2024-09-07T03:32:50.470165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:30:53.762992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843565+0000","last_change":"2024-09-07T03:32:14.127747+0000","last_active":"2024-09-07T03:35:23.843565+0000","last_peered":"2024-09-07T03:35:23.843565+0000","last_clean":"2024-09-07T03:35:23.843565+0000","last_became_active":"2024-09-07T03:32:14.127493+0000","last_became_peered":"2024-09-07T03:32:14.127493+0000","last_unstale":"2024-09-07T03:35:23.843565+0000","last_undegraded":"2024-09-07T03:35:23.843565+0000","last_fullsized":"2024-09-07T03:35:23.843565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:45:11.748356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2277,"ondisk_log_size":2277,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1844,"num_read_kb":1609,"num_write":777,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1547,"ondisk_log_size":1547,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":969,"num_read_kb":969,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1666,"num_read_kb":1556,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":87,"num_write":314,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":450560,"data_stored":155820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640304,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1007616,"data_stored":744671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640304,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":507904,"data_stored":158016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48964,"kb_used_data":9460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322876,"statfs":{"total":96636764160,"available":96586625024,"internally_reserved":0,"allocated":9687040,"data_stored":9353945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:35:31.408 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-07T03:35:31.409 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:35:31.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.532+0000 7f6ea1a3c640 1 Processor -- start 2024-09-07T03:35:31.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.532+0000 7f6ea1a3c640 1 -- start start 2024-09-07T03:35:31.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.532+0000 7f6ea1a3c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6e9c112730 0x7f6e9c112b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:31.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.533+0000 7f6ea1a3c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9c06dc00 con 0x7f6e9c113050 2024-09-07T03:35:31.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.533+0000 7f6ea1a3c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9c113c00 con 0x7f6e9c112730 2024-09-07T03:35:31.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.533+0000 7f6e9affd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6e9c112730 0x7f6e9c112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:31.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.533+0000 7f6e9a7fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6e9c113050 0x7f6e9c122180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57210/0 (socket says 172.21.15.104:57210) 2024-09-07T03:35:31.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.533+0000 7f6e9a7fc640 1 -- 172.21.15.104:0/526255344 learned_addr learned my addr 172.21.15.104:0/526255344 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:31.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.533+0000 7f6e9affd640 1 -- 172.21.15.104:0/526255344 >> v1:172.21.15.104:6789/0 conn(0x7f6e9c113050 legacy=0x7f6e9c122180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.533+0000 7f6e9affd640 1 -- 172.21.15.104:0/526255344 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c073a70 con 0x7f6e9c112730 2024-09-07T03:35:31.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.533+0000 7f6e99ffb640 1 -- 172.21.15.104:0/526255344 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373353137 0 0) 0x7f6e9c06dc00 con 0x7f6e9c113050 2024-09-07T03:35:31.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6e9affd640 1 --2- 172.21.15.104:0/526255344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 0x7f6e9c112b10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009720 tx=0x7f6e8c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d17cd939747906 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:31.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6e99ffb640 1 -- 172.21.15.104:0/526255344 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e8c037070 con 0x7f6e9c112730 2024-09-07T03:35:31.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6e99ffb640 1 -- 172.21.15.104:0/526255344 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8c02ad90 con 0x7f6e9c112730 2024-09-07T03:35:31.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6e99ffb640 1 -- 172.21.15.104:0/526255344 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e8c032590 con 0x7f6e9c112730 2024-09-07T03:35:31.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/526255344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 msgr2=0x7f6e9c112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6ea1a3c640 1 --2- 172.21.15.104:0/526255344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 0x7f6e9c112b10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009720 tx=0x7f6e8c02a110 comp rx=0 tx=0).stop 2024-09-07T03:35:31.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/526255344 shutdown_connections 2024-09-07T03:35:31.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6ea1a3c640 1 --2- 172.21.15.104:0/526255344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 0x7f6e9c112b10 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/526255344 >> 172.21.15.104:0/526255344 conn(0x7f6e9c070850 msgr2=0x7f6e9c072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:31.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/526255344 shutdown_connections 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.534+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/526255344 wait complete. 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.535+0000 7f6ea1a3c640 1 Processor -- start 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.535+0000 7f6ea1a3c640 1 -- start start 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6ea1a3c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 0x7f6e9c1174d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6ea1a3c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c122a10 con 0x7f6e9c112730 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6e9affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 0x7f6e9c1174d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6e9affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 0x7f6e9c1174d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50624/0 (socket says 172.21.15.104:50624) 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6e9affd640 1 -- 172.21.15.104:0/962758802 learned_addr learned my addr 172.21.15.104:0/962758802 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6e9affd640 1 -- 172.21.15.104:0/962758802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c119a50 con 0x7f6e9c112730 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6e9affd640 1 --2- 172.21.15.104:0/962758802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 0x7f6e9c1174d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009720 tx=0x7f6e8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6e83fff640 1 -- 172.21.15.104:0/962758802 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e8c041070 con 0x7f6e9c112730 2024-09-07T03:35:31.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6e83fff640 1 -- 172.21.15.104:0/962758802 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8c03c460 con 0x7f6e9c112730 2024-09-07T03:35:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6e83fff640 1 -- 172.21.15.104:0/962758802 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e8c037040 con 0x7f6e9c112730 2024-09-07T03:35:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9c1196b0 con 0x7f6e9c112730 2024-09-07T03:35:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.536+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9c111f20 con 0x7f6e9c112730 2024-09-07T03:35:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.537+0000 7f6e83fff640 1 -- 172.21.15.104:0/962758802 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6e8c044070 con 0x7f6e9c112730 2024-09-07T03:35:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.537+0000 7f6e83fff640 1 --2- 172.21.15.104:0/962758802 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e8803de90 0x7f6e88040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.537+0000 7f6e83fff640 1 -- 172.21.15.104:0/962758802 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6e8c073790 con 0x7f6e9c112730 2024-09-07T03:35:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.537+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e9c122f50 con 0x7f6e9c112730 2024-09-07T03:35:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.538+0000 7f6e9a7fc640 1 --2- 172.21.15.104:0/962758802 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e8803de90 0x7f6e88040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:31.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.538+0000 7f6e9a7fc640 1 --2- 172.21.15.104:0/962758802 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e8803de90 0x7f6e88040350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000c00 tx=0x7f6e900078d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:31.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.542+0000 7f6e83fff640 1 -- 172.21.15.104:0/962758802 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f6e9c119a50 con 0x7f6e9c112730 2024-09-07T03:35:31.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.711+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e9c118f90 con 0x7f6e8803de90 2024-09-07T03:35:31.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.720+0000 7f6e83fff640 1 -- 172.21.15.104:0/962758802 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665993 (secure 0 0 0) 0x7f6e9c118f90 con 0x7f6e8803de90 2024-09-07T03:35:31.732 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:35:31.738 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:35:31.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e8803de90 msgr2=0x7f6e88040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 --2- 172.21.15.104:0/962758802 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e8803de90 0x7f6e88040350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000c00 tx=0x7f6e900078d0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 msgr2=0x7f6e9c1174d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 --2- 172.21.15.104:0/962758802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 0x7f6e9c1174d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009720 tx=0x7f6e8c0046c0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 shutdown_connections 2024-09-07T03:35:31.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 --2- 172.21.15.104:0/962758802 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f6e8803de90 0x7f6e88040350 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 --2- 172.21.15.104:0/962758802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e9c112730 0x7f6e9c1174d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 >> 172.21.15.104:0/962758802 conn(0x7f6e9c070850 msgr2=0x7f6e9c0719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:31.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 shutdown_connections 2024-09-07T03:35:31.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.725+0000 7f6ea1a3c640 1 -- 172.21.15.104:0/962758802 wait complete. 2024-09-07T03:35:31.741 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-07T03:35:31.262441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5464162,"num_objects":256,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":256,"num_whiteouts":0,"num_read":5380,"num_read_kb":4936,"num_write":2301,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4733,"ondisk_log_size":4733,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":169404,"kb_used_data":11380,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377317956,"statfs":{"total":386547056640,"available":386373586944,"internally_reserved":0,"allocated":11653120,"data_stored":10412452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4863033,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":702,"num_read_kb":663,"num_write":445,"num_write_kb":29375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004194"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281796+0000","last_change":"2024-09-07T03:32:12.133842+0000","last_active":"2024-09-07T03:32:50.281796+0000","last_peered":"2024-09-07T03:32:50.281796+0000","last_clean":"2024-09-07T03:32:50.281796+0000","last_became_active":"2024-09-07T03:32:12.133110+0000","last_became_peered":"2024-09-07T03:32:12.133110+0000","last_unstale":"2024-09-07T03:32:50.281796+0000","last_undegraded":"2024-09-07T03:32:50.281796+0000","last_fullsized":"2024-09-07T03:32:50.281796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:21:24.282602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985450+0000","last_change":"2024-09-07T03:32:14.110006+0000","last_active":"2024-09-07T03:33:38.985450+0000","last_peered":"2024-09-07T03:33:38.985450+0000","last_clean":"2024-09-07T03:33:38.985450+0000","last_became_active":"2024-09-07T03:32:14.109379+0000","last_became_peered":"2024-09-07T03:32:14.109379+0000","last_unstale":"2024-09-07T03:33:38.985450+0000","last_undegraded":"2024-09-07T03:33:38.985450+0000","last_fullsized":"2024-09-07T03:33:38.985450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472145+0000","last_change":"2024-09-07T03:32:12.137021+0000","last_active":"2024-09-07T03:32:50.472145+0000","last_peered":"2024-09-07T03:32:50.472145+0000","last_clean":"2024-09-07T03:32:50.472145+0000","last_became_active":"2024-09-07T03:32:12.135945+0000","last_became_peered":"2024-09-07T03:32:12.135945+0000","last_unstale":"2024-09-07T03:32:50.472145+0000","last_undegraded":"2024-09-07T03:32:50.472145+0000","last_fullsized":"2024-09-07T03:32:50.472145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:24.882510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'18","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.476438+0000","last_change":"2024-09-07T03:32:50.283523+0000","last_active":"2024-09-07T03:35:23.476438+0000","last_peered":"2024-09-07T03:35:23.476438+0000","last_clean":"2024-09-07T03:35:23.476438+0000","last_became_active":"2024-09-07T03:32:50.279755+0000","last_became_peered":"2024-09-07T03:32:50.279755+0000","last_unstale":"2024-09-07T03:35:23.476438+0000","last_undegraded":"2024-09-07T03:35:23.476438+0000","last_fullsized":"2024-09-07T03:35:23.476438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:00:27.065883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.664376+0000","last_change":"2024-09-07T03:32:12.138579+0000","last_active":"2024-09-07T03:35:30.664376+0000","last_peered":"2024-09-07T03:35:30.664376+0000","last_clean":"2024-09-07T03:35:30.664376+0000","last_became_active":"2024-09-07T03:32:12.138176+0000","last_became_peered":"2024-09-07T03:32:12.138176+0000","last_unstale":"2024-09-07T03:35:30.664376+0000","last_undegraded":"2024-09-07T03:35:30.664376+0000","last_fullsized":"2024-09-07T03:35:30.664376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:43.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.299808+0000","last_change":"2024-09-07T03:32:50.282415+0000","last_active":"2024-09-07T03:32:56.299808+0000","last_peered":"2024-09-07T03:32:56.299808+0000","last_clean":"2024-09-07T03:32:56.299808+0000","last_became_active":"2024-09-07T03:32:50.282086+0000","last_became_peered":"2024-09-07T03:32:50.282086+0000","last_unstale":"2024-09-07T03:32:56.299808+0000","last_undegraded":"2024-09-07T03:32:56.299808+0000","last_fullsized":"2024-09-07T03:32:56.299808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:57:14.202152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275899+0000","last_change":"2024-09-07T03:32:12.129351+0000","last_active":"2024-09-07T03:32:50.275899+0000","last_peered":"2024-09-07T03:32:50.275899+0000","last_clean":"2024-09-07T03:32:50.275899+0000","last_became_active":"2024-09-07T03:32:12.128937+0000","last_became_peered":"2024-09-07T03:32:12.128937+0000","last_unstale":"2024-09-07T03:32:50.275899+0000","last_undegraded":"2024-09-07T03:32:50.275899+0000","last_fullsized":"2024-09-07T03:32:50.275899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:28:44.222642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963439+0000","last_change":"2024-09-07T03:32:14.123290+0000","last_active":"2024-09-07T03:34:22.963439+0000","last_peered":"2024-09-07T03:34:22.963439+0000","last_clean":"2024-09-07T03:34:22.963439+0000","last_became_active":"2024-09-07T03:32:14.122611+0000","last_became_peered":"2024-09-07T03:32:14.122611+0000","last_unstale":"2024-09-07T03:34:22.963439+0000","last_undegraded":"2024-09-07T03:34:22.963439+0000","last_fullsized":"2024-09-07T03:34:22.963439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279185+0000","last_change":"2024-09-07T03:32:12.124716+0000","last_active":"2024-09-07T03:32:50.279185+0000","last_peered":"2024-09-07T03:32:50.279185+0000","last_clean":"2024-09-07T03:32:50.279185+0000","last_became_active":"2024-09-07T03:32:12.123986+0000","last_became_peered":"2024-09-07T03:32:12.123986+0000","last_unstale":"2024-09-07T03:32:50.279185+0000","last_undegraded":"2024-09-07T03:32:50.279185+0000","last_fullsized":"2024-09-07T03:32:50.279185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:10.648401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.597575+0000","last_change":"2024-09-07T03:32:14.124801+0000","last_active":"2024-09-07T03:35:23.597575+0000","last_peered":"2024-09-07T03:35:23.597575+0000","last_clean":"2024-09-07T03:35:23.597575+0000","last_became_active":"2024-09-07T03:32:14.124523+0000","last_became_peered":"2024-09-07T03:32:14.124523+0000","last_unstale":"2024-09-07T03:35:23.597575+0000","last_undegraded":"2024-09-07T03:35:23.597575+0000","last_fullsized":"2024-09-07T03:35:23.597575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:39.133433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.558996+0000","last_change":"2024-09-07T03:32:12.133960+0000","last_active":"2024-09-07T03:32:56.558996+0000","last_peered":"2024-09-07T03:32:56.558996+0000","last_clean":"2024-09-07T03:32:56.558996+0000","last_became_active":"2024-09-07T03:32:12.133597+0000","last_became_peered":"2024-09-07T03:32:12.133597+0000","last_unstale":"2024-09-07T03:32:56.558996+0000","last_undegraded":"2024-09-07T03:32:56.558996+0000","last_fullsized":"2024-09-07T03:32:56.558996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:16:06.544105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.571091+0000","last_change":"2024-09-07T03:32:14.113584+0000","last_active":"2024-09-07T03:32:56.571091+0000","last_peered":"2024-09-07T03:32:56.571091+0000","last_clean":"2024-09-07T03:32:56.571091+0000","last_became_active":"2024-09-07T03:32:14.112622+0000","last_became_peered":"2024-09-07T03:32:14.112622+0000","last_unstale":"2024-09-07T03:32:56.571091+0000","last_undegraded":"2024-09-07T03:32:56.571091+0000","last_fullsized":"2024-09-07T03:32:56.571091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:52.320086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273279+0000","last_change":"2024-09-07T03:32:12.140541+0000","last_active":"2024-09-07T03:32:50.273279+0000","last_peered":"2024-09-07T03:32:50.273279+0000","last_clean":"2024-09-07T03:32:50.273279+0000","last_became_active":"2024-09-07T03:32:12.140221+0000","last_became_peered":"2024-09-07T03:32:12.140221+0000","last_unstale":"2024-09-07T03:32:50.273279+0000","last_undegraded":"2024-09-07T03:32:50.273279+0000","last_fullsized":"2024-09-07T03:32:50.273279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:56.248253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.300068+0000","last_change":"2024-09-07T03:32:14.114929+0000","last_active":"2024-09-07T03:32:56.300068+0000","last_peered":"2024-09-07T03:32:56.300068+0000","last_clean":"2024-09-07T03:32:56.300068+0000","last_became_active":"2024-09-07T03:32:14.114529+0000","last_became_peered":"2024-09-07T03:32:14.114529+0000","last_unstale":"2024-09-07T03:32:56.300068+0000","last_undegraded":"2024-09-07T03:32:56.300068+0000","last_fullsized":"2024-09-07T03:32:56.300068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.398335+0000","last_change":"2024-09-07T03:32:12.143568+0000","last_active":"2024-09-07T03:35:23.398335+0000","last_peered":"2024-09-07T03:35:23.398335+0000","last_clean":"2024-09-07T03:35:23.398335+0000","last_became_active":"2024-09-07T03:32:12.143209+0000","last_became_peered":"2024-09-07T03:32:12.143209+0000","last_unstale":"2024-09-07T03:35:23.398335+0000","last_undegraded":"2024-09-07T03:35:23.398335+0000","last_fullsized":"2024-09-07T03:35:23.398335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:31:58.691796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.944310+0000","last_change":"2024-09-07T03:32:14.124391+0000","last_active":"2024-09-07T03:35:23.944310+0000","last_peered":"2024-09-07T03:35:23.944310+0000","last_clean":"2024-09-07T03:35:23.944310+0000","last_became_active":"2024-09-07T03:32:14.124135+0000","last_became_peered":"2024-09-07T03:32:14.124135+0000","last_unstale":"2024-09-07T03:35:23.944310+0000","last_undegraded":"2024-09-07T03:35:23.944310+0000","last_fullsized":"2024-09-07T03:35:23.944310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:40.853544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'14","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806118+0000","last_change":"2024-09-07T03:32:14.109787+0000","last_active":"2024-09-07T03:35:23.806118+0000","last_peered":"2024-09-07T03:35:23.806118+0000","last_clean":"2024-09-07T03:35:23.806118+0000","last_became_active":"2024-09-07T03:32:14.109280+0000","last_became_peered":"2024-09-07T03:32:14.109280+0000","last_unstale":"2024-09-07T03:35:23.806118+0000","last_undegraded":"2024-09-07T03:35:23.806118+0000","last_fullsized":"2024-09-07T03:35:23.806118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473124+0000","last_change":"2024-09-07T03:32:12.136387+0000","last_active":"2024-09-07T03:32:50.473124+0000","last_peered":"2024-09-07T03:32:50.473124+0000","last_clean":"2024-09-07T03:32:50.473124+0000","last_became_active":"2024-09-07T03:32:12.134379+0000","last_became_peered":"2024-09-07T03:32:12.134379+0000","last_unstale":"2024-09-07T03:32:50.473124+0000","last_undegraded":"2024-09-07T03:32:50.473124+0000","last_fullsized":"2024-09-07T03:32:50.473124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:52:06.698087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843636+0000","last_change":"2024-09-07T03:32:14.112114+0000","last_active":"2024-09-07T03:35:23.843636+0000","last_peered":"2024-09-07T03:35:23.843636+0000","last_clean":"2024-09-07T03:35:23.843636+0000","last_became_active":"2024-09-07T03:32:14.111769+0000","last_became_peered":"2024-09-07T03:32:14.111769+0000","last_unstale":"2024-09-07T03:35:23.843636+0000","last_undegraded":"2024-09-07T03:35:23.843636+0000","last_fullsized":"2024-09-07T03:35:23.843636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.714226+0000","last_change":"2024-09-07T03:32:12.129681+0000","last_active":"2024-09-07T03:35:23.714226+0000","last_peered":"2024-09-07T03:35:23.714226+0000","last_clean":"2024-09-07T03:35:23.714226+0000","last_became_active":"2024-09-07T03:32:12.129310+0000","last_became_peered":"2024-09-07T03:32:12.129310+0000","last_unstale":"2024-09-07T03:35:23.714226+0000","last_undegraded":"2024-09-07T03:35:23.714226+0000","last_fullsized":"2024-09-07T03:35:23.714226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:31.913444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.590380+0000","last_change":"2024-09-07T03:32:14.109568+0000","last_active":"2024-09-07T03:35:23.590380+0000","last_peered":"2024-09-07T03:35:23.590380+0000","last_clean":"2024-09-07T03:35:23.590380+0000","last_became_active":"2024-09-07T03:32:14.109177+0000","last_became_peered":"2024-09-07T03:32:14.109177+0000","last_unstale":"2024-09-07T03:35:23.590380+0000","last_undegraded":"2024-09-07T03:35:23.590380+0000","last_fullsized":"2024-09-07T03:35:23.590380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:49:22.436331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281713+0000","last_change":"2024-09-07T03:32:12.121206+0000","last_active":"2024-09-07T03:32:50.281713+0000","last_peered":"2024-09-07T03:32:50.281713+0000","last_clean":"2024-09-07T03:32:50.281713+0000","last_became_active":"2024-09-07T03:32:12.120449+0000","last_became_peered":"2024-09-07T03:32:12.120449+0000","last_unstale":"2024-09-07T03:32:50.281713+0000","last_undegraded":"2024-09-07T03:32:50.281713+0000","last_fullsized":"2024-09-07T03:32:50.281713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:04:17.603683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731173+0000","last_change":"2024-09-07T03:32:14.125322+0000","last_active":"2024-09-07T03:35:23.731173+0000","last_peered":"2024-09-07T03:35:23.731173+0000","last_clean":"2024-09-07T03:35:23.731173+0000","last_became_active":"2024-09-07T03:32:14.125065+0000","last_became_peered":"2024-09-07T03:32:14.125065+0000","last_unstale":"2024-09-07T03:35:23.731173+0000","last_undegraded":"2024-09-07T03:35:23.731173+0000","last_fullsized":"2024-09-07T03:35:23.731173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.382792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279118+0000","last_change":"2024-09-07T03:32:12.125531+0000","last_active":"2024-09-07T03:32:50.279118+0000","last_peered":"2024-09-07T03:32:50.279118+0000","last_clean":"2024-09-07T03:32:50.279118+0000","last_became_active":"2024-09-07T03:32:12.124516+0000","last_became_peered":"2024-09-07T03:32:12.124516+0000","last_unstale":"2024-09-07T03:32:50.279118+0000","last_undegraded":"2024-09-07T03:32:50.279118+0000","last_fullsized":"2024-09-07T03:32:50.279118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:38.848848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:41.230770+0000","last_change":"2024-09-07T03:32:14.112755+0000","last_active":"2024-09-07T03:34:41.230770+0000","last_peered":"2024-09-07T03:34:41.230770+0000","last_clean":"2024-09-07T03:34:41.230770+0000","last_became_active":"2024-09-07T03:32:14.112477+0000","last_became_peered":"2024-09-07T03:32:14.112477+0000","last_unstale":"2024-09-07T03:34:41.230770+0000","last_undegraded":"2024-09-07T03:34:41.230770+0000","last_fullsized":"2024-09-07T03:34:41.230770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:41:15.350018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275444+0000","last_change":"2024-09-07T03:32:12.137178+0000","last_active":"2024-09-07T03:32:50.275444+0000","last_peered":"2024-09-07T03:32:50.275444+0000","last_clean":"2024-09-07T03:32:50.275444+0000","last_became_active":"2024-09-07T03:32:12.136801+0000","last_became_peered":"2024-09-07T03:32:12.136801+0000","last_unstale":"2024-09-07T03:32:50.275444+0000","last_undegraded":"2024-09-07T03:32:50.275444+0000","last_fullsized":"2024-09-07T03:32:50.275444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:14:59.894718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.850114+0000","last_change":"2024-09-07T03:32:14.109462+0000","last_active":"2024-09-07T03:35:23.850114+0000","last_peered":"2024-09-07T03:35:23.850114+0000","last_clean":"2024-09-07T03:35:23.850114+0000","last_became_active":"2024-09-07T03:32:14.109167+0000","last_became_peered":"2024-09-07T03:32:14.109167+0000","last_unstale":"2024-09-07T03:35:23.850114+0000","last_undegraded":"2024-09-07T03:35:23.850114+0000","last_fullsized":"2024-09-07T03:35:23.850114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:39.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272300+0000","last_change":"2024-09-07T03:32:12.138445+0000","last_active":"2024-09-07T03:32:50.272300+0000","last_peered":"2024-09-07T03:32:50.272300+0000","last_clean":"2024-09-07T03:32:50.272300+0000","last_became_active":"2024-09-07T03:32:12.138105+0000","last_became_peered":"2024-09-07T03:32:12.138105+0000","last_unstale":"2024-09-07T03:32:50.272300+0000","last_undegraded":"2024-09-07T03:32:50.272300+0000","last_fullsized":"2024-09-07T03:32:50.272300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.111018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.773106+0000","last_change":"2024-09-07T03:32:22.149626+0000","last_active":"2024-09-07T03:35:23.773106+0000","last_peered":"2024-09-07T03:35:23.773106+0000","last_clean":"2024-09-07T03:35:23.773106+0000","last_became_active":"2024-09-07T03:32:22.149337+0000","last_became_peered":"2024-09-07T03:32:22.149337+0000","last_unstale":"2024-09-07T03:35:23.773106+0000","last_undegraded":"2024-09-07T03:35:23.773106+0000","last_fullsized":"2024-09-07T03:35:23.773106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:00:45.310817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230587+0000","last_change":"2024-09-07T03:32:14.126524+0000","last_active":"2024-09-07T03:34:36.230587+0000","last_peered":"2024-09-07T03:34:36.230587+0000","last_clean":"2024-09-07T03:34:36.230587+0000","last_became_active":"2024-09-07T03:32:14.126222+0000","last_became_peered":"2024-09-07T03:32:14.126222+0000","last_unstale":"2024-09-07T03:34:36.230587+0000","last_undegraded":"2024-09-07T03:34:36.230587+0000","last_fullsized":"2024-09-07T03:34:36.230587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:51:09.670249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273573+0000","last_change":"2024-09-07T03:32:12.125232+0000","last_active":"2024-09-07T03:32:50.273573+0000","last_peered":"2024-09-07T03:32:50.273573+0000","last_clean":"2024-09-07T03:32:50.273573+0000","last_became_active":"2024-09-07T03:32:12.124815+0000","last_became_peered":"2024-09-07T03:32:12.124815+0000","last_unstale":"2024-09-07T03:32:50.273573+0000","last_undegraded":"2024-09-07T03:32:50.273573+0000","last_fullsized":"2024-09-07T03:32:50.273573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:23.041037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275282+0000","last_change":"2024-09-07T03:32:16.127792+0000","last_active":"2024-09-07T03:32:50.275282+0000","last_peered":"2024-09-07T03:32:50.275282+0000","last_clean":"2024-09-07T03:32:50.275282+0000","last_became_active":"2024-09-07T03:32:16.127430+0000","last_became_peered":"2024-09-07T03:32:16.127430+0000","last_unstale":"2024-09-07T03:32:50.275282+0000","last_undegraded":"2024-09-07T03:32:50.275282+0000","last_fullsized":"2024-09-07T03:32:50.275282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:46.752720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.588157+0000","last_change":"2024-09-07T03:32:18.130430+0000","last_active":"2024-09-07T03:35:30.588157+0000","last_peered":"2024-09-07T03:35:30.588157+0000","last_clean":"2024-09-07T03:35:30.588157+0000","last_became_active":"2024-09-07T03:32:18.130101+0000","last_became_peered":"2024-09-07T03:32:18.130101+0000","last_unstale":"2024-09-07T03:35:30.588157+0000","last_undegraded":"2024-09-07T03:35:30.588157+0000","last_fullsized":"2024-09-07T03:35:30.588157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:55.756545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280723+0000","last_change":"2024-09-07T03:32:20.147157+0000","last_active":"2024-09-07T03:32:50.280723+0000","last_peered":"2024-09-07T03:32:50.280723+0000","last_clean":"2024-09-07T03:32:50.280723+0000","last_became_active":"2024-09-07T03:32:20.146716+0000","last_became_peered":"2024-09-07T03:32:20.146716+0000","last_unstale":"2024-09-07T03:32:50.280723+0000","last_undegraded":"2024-09-07T03:32:50.280723+0000","last_fullsized":"2024-09-07T03:32:50.280723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:23.679745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"36'9","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.982420+0000","last_change":"2024-09-07T03:32:22.143355+0000","last_active":"2024-09-07T03:33:38.982420+0000","last_peered":"2024-09-07T03:33:38.982420+0000","last_clean":"2024-09-07T03:33:38.982420+0000","last_became_active":"2024-09-07T03:32:22.143092+0000","last_became_peered":"2024-09-07T03:32:22.143092+0000","last_unstale":"2024-09-07T03:33:38.982420+0000","last_undegraded":"2024-09-07T03:33:38.982420+0000","last_fullsized":"2024-09-07T03:33:38.982420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:30:18.450771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'8","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843638+0000","last_change":"2024-09-07T03:32:14.122327+0000","last_active":"2024-09-07T03:35:23.843638+0000","last_peered":"2024-09-07T03:35:23.843638+0000","last_clean":"2024-09-07T03:35:23.843638+0000","last_became_active":"2024-09-07T03:32:14.121998+0000","last_became_peered":"2024-09-07T03:32:14.121998+0000","last_unstale":"2024-09-07T03:35:23.843638+0000","last_undegraded":"2024-09-07T03:35:23.843638+0000","last_fullsized":"2024-09-07T03:35:23.843638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432032+0000","last_change":"2024-09-07T03:32:12.130331+0000","last_active":"2024-09-07T03:32:55.432032+0000","last_peered":"2024-09-07T03:32:55.432032+0000","last_clean":"2024-09-07T03:32:55.432032+0000","last_became_active":"2024-09-07T03:32:12.129979+0000","last_became_peered":"2024-09-07T03:32:12.129979+0000","last_unstale":"2024-09-07T03:32:55.432032+0000","last_undegraded":"2024-09-07T03:32:55.432032+0000","last_fullsized":"2024-09-07T03:32:55.432032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:15.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275223+0000","last_change":"2024-09-07T03:32:16.126421+0000","last_active":"2024-09-07T03:32:50.275223+0000","last_peered":"2024-09-07T03:32:50.275223+0000","last_clean":"2024-09-07T03:32:50.275223+0000","last_became_active":"2024-09-07T03:32:16.126116+0000","last_became_peered":"2024-09-07T03:32:16.126116+0000","last_unstale":"2024-09-07T03:32:50.275223+0000","last_undegraded":"2024-09-07T03:32:50.275223+0000","last_fullsized":"2024-09-07T03:32:50.275223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:07:32.152302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472267+0000","last_change":"2024-09-07T03:32:18.132461+0000","last_active":"2024-09-07T03:32:50.472267+0000","last_peered":"2024-09-07T03:32:50.472267+0000","last_clean":"2024-09-07T03:32:50.472267+0000","last_became_active":"2024-09-07T03:32:18.132152+0000","last_became_peered":"2024-09-07T03:32:18.132152+0000","last_unstale":"2024-09-07T03:32:50.472267+0000","last_undegraded":"2024-09-07T03:32:50.472267+0000","last_fullsized":"2024-09-07T03:32:50.472267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:45:42.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280341+0000","last_change":"2024-09-07T03:32:20.146991+0000","last_active":"2024-09-07T03:32:50.280341+0000","last_peered":"2024-09-07T03:32:50.280341+0000","last_clean":"2024-09-07T03:32:50.280341+0000","last_became_active":"2024-09-07T03:32:20.146457+0000","last_became_peered":"2024-09-07T03:32:20.146457+0000","last_unstale":"2024-09-07T03:32:50.280341+0000","last_undegraded":"2024-09-07T03:32:50.280341+0000","last_fullsized":"2024-09-07T03:32:50.280341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.222346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"36'10","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.807540+0000","last_change":"2024-09-07T03:32:22.144066+0000","last_active":"2024-09-07T03:35:23.807540+0000","last_peered":"2024-09-07T03:35:23.807540+0000","last_clean":"2024-09-07T03:35:23.807540+0000","last_became_active":"2024-09-07T03:32:22.143751+0000","last_became_peered":"2024-09-07T03:32:22.143751+0000","last_unstale":"2024-09-07T03:35:23.807540+0000","last_undegraded":"2024-09-07T03:35:23.807540+0000","last_fullsized":"2024-09-07T03:35:23.807540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:14.926443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"36'20","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731193+0000","last_change":"2024-09-07T03:32:14.130832+0000","last_active":"2024-09-07T03:35:23.731193+0000","last_peered":"2024-09-07T03:35:23.731193+0000","last_clean":"2024-09-07T03:35:23.731193+0000","last_became_active":"2024-09-07T03:32:14.130544+0000","last_became_peered":"2024-09-07T03:32:14.130544+0000","last_unstale":"2024-09-07T03:35:23.731193+0000","last_undegraded":"2024-09-07T03:35:23.731193+0000","last_fullsized":"2024-09-07T03:35:23.731193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278167+0000","last_change":"2024-09-07T03:32:12.125233+0000","last_active":"2024-09-07T03:32:50.278167+0000","last_peered":"2024-09-07T03:32:50.278167+0000","last_clean":"2024-09-07T03:32:50.278167+0000","last_became_active":"2024-09-07T03:32:12.124808+0000","last_became_peered":"2024-09-07T03:32:12.124808+0000","last_unstale":"2024-09-07T03:32:50.278167+0000","last_undegraded":"2024-09-07T03:32:50.278167+0000","last_fullsized":"2024-09-07T03:32:50.278167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:26.378096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276016+0000","last_change":"2024-09-07T03:32:16.126571+0000","last_active":"2024-09-07T03:32:50.276016+0000","last_peered":"2024-09-07T03:32:50.276016+0000","last_clean":"2024-09-07T03:32:50.276016+0000","last_became_active":"2024-09-07T03:32:16.126318+0000","last_became_peered":"2024-09-07T03:32:16.126318+0000","last_unstale":"2024-09-07T03:32:50.276016+0000","last_undegraded":"2024-09-07T03:32:50.276016+0000","last_fullsized":"2024-09-07T03:32:50.276016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:51.962540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275774+0000","last_change":"2024-09-07T03:32:18.128687+0000","last_active":"2024-09-07T03:32:50.275774+0000","last_peered":"2024-09-07T03:32:50.275774+0000","last_clean":"2024-09-07T03:32:50.275774+0000","last_became_active":"2024-09-07T03:32:18.128391+0000","last_became_peered":"2024-09-07T03:32:18.128391+0000","last_unstale":"2024-09-07T03:32:50.275774+0000","last_undegraded":"2024-09-07T03:32:50.275774+0000","last_fullsized":"2024-09-07T03:32:50.275774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:50:24.989266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.539513+0000","last_change":"2024-09-07T03:32:20.140796+0000","last_active":"2024-09-07T03:35:30.539513+0000","last_peered":"2024-09-07T03:35:30.539513+0000","last_clean":"2024-09-07T03:35:30.539513+0000","last_became_active":"2024-09-07T03:32:20.140249+0000","last_became_peered":"2024-09-07T03:32:20.140249+0000","last_unstale":"2024-09-07T03:35:30.539513+0000","last_undegraded":"2024-09-07T03:35:30.539513+0000","last_fullsized":"2024-09-07T03:35:30.539513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:12.918865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274799+0000","last_change":"2024-09-07T03:32:22.141118+0000","last_active":"2024-09-07T03:32:50.274799+0000","last_peered":"2024-09-07T03:32:50.274799+0000","last_clean":"2024-09-07T03:32:50.274799+0000","last_became_active":"2024-09-07T03:32:22.139829+0000","last_became_peered":"2024-09-07T03:32:22.139829+0000","last_unstale":"2024-09-07T03:32:50.274799+0000","last_undegraded":"2024-09-07T03:32:50.274799+0000","last_fullsized":"2024-09-07T03:32:50.274799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:55:30.425595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587735+0000","last_change":"2024-09-07T03:32:14.126517+0000","last_active":"2024-09-07T03:35:23.587735+0000","last_peered":"2024-09-07T03:35:23.587735+0000","last_clean":"2024-09-07T03:35:23.587735+0000","last_became_active":"2024-09-07T03:32:14.126140+0000","last_became_peered":"2024-09-07T03:32:14.126140+0000","last_unstale":"2024-09-07T03:35:23.587735+0000","last_undegraded":"2024-09-07T03:35:23.587735+0000","last_fullsized":"2024-09-07T03:35:23.587735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277837+0000","last_change":"2024-09-07T03:32:12.133946+0000","last_active":"2024-09-07T03:32:50.277837+0000","last_peered":"2024-09-07T03:32:50.277837+0000","last_clean":"2024-09-07T03:32:50.277837+0000","last_became_active":"2024-09-07T03:32:12.133270+0000","last_became_peered":"2024-09-07T03:32:12.133270+0000","last_unstale":"2024-09-07T03:32:50.277837+0000","last_undegraded":"2024-09-07T03:32:50.277837+0000","last_fullsized":"2024-09-07T03:32:50.277837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:56.372379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281906+0000","last_change":"2024-09-07T03:32:16.117091+0000","last_active":"2024-09-07T03:32:50.281906+0000","last_peered":"2024-09-07T03:32:50.281906+0000","last_clean":"2024-09-07T03:32:50.281906+0000","last_became_active":"2024-09-07T03:32:16.116761+0000","last_became_peered":"2024-09-07T03:32:16.116761+0000","last_unstale":"2024-09-07T03:32:50.281906+0000","last_undegraded":"2024-09-07T03:32:50.281906+0000","last_fullsized":"2024-09-07T03:32:50.281906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:07:07.674647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'41","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.680636+0000","last_change":"2024-09-07T03:32:18.129567+0000","last_active":"2024-09-07T03:35:30.680636+0000","last_peered":"2024-09-07T03:35:30.680636+0000","last_clean":"2024-09-07T03:35:30.680636+0000","last_became_active":"2024-09-07T03:32:18.128901+0000","last_became_peered":"2024-09-07T03:32:18.128901+0000","last_unstale":"2024-09-07T03:35:30.680636+0000","last_undegraded":"2024-09-07T03:35:30.680636+0000","last_fullsized":"2024-09-07T03:35:30.680636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:42:21.711836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.545527+0000","last_change":"2024-09-07T03:32:20.142693+0000","last_active":"2024-09-07T03:35:30.545527+0000","last_peered":"2024-09-07T03:35:30.545527+0000","last_clean":"2024-09-07T03:35:30.545527+0000","last_became_active":"2024-09-07T03:32:20.142390+0000","last_became_peered":"2024-09-07T03:32:20.142390+0000","last_unstale":"2024-09-07T03:35:30.545527+0000","last_undegraded":"2024-09-07T03:35:30.545527+0000","last_fullsized":"2024-09-07T03:35:30.545527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:51:20.882177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272814+0000","last_change":"2024-09-07T03:32:14.123300+0000","last_active":"2024-09-07T03:32:50.272814+0000","last_peered":"2024-09-07T03:32:50.272814+0000","last_clean":"2024-09-07T03:32:50.272814+0000","last_became_active":"2024-09-07T03:32:14.122806+0000","last_became_peered":"2024-09-07T03:32:14.122806+0000","last_unstale":"2024-09-07T03:32:50.272814+0000","last_undegraded":"2024-09-07T03:32:50.272814+0000","last_fullsized":"2024-09-07T03:32:50.272814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:12.527168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.458084+0000","last_change":"2024-09-07T03:32:12.125001+0000","last_active":"2024-09-07T03:35:23.458084+0000","last_peered":"2024-09-07T03:35:23.458084+0000","last_clean":"2024-09-07T03:35:23.458084+0000","last_became_active":"2024-09-07T03:32:12.124564+0000","last_became_peered":"2024-09-07T03:32:12.124564+0000","last_unstale":"2024-09-07T03:35:23.458084+0000","last_undegraded":"2024-09-07T03:35:23.458084+0000","last_fullsized":"2024-09-07T03:35:23.458084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:13:15.055699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470518+0000","last_change":"2024-09-07T03:32:16.128785+0000","last_active":"2024-09-07T03:32:50.470518+0000","last_peered":"2024-09-07T03:32:50.470518+0000","last_clean":"2024-09-07T03:32:50.470518+0000","last_became_active":"2024-09-07T03:32:16.128519+0000","last_became_peered":"2024-09-07T03:32:16.128519+0000","last_unstale":"2024-09-07T03:32:50.470518+0000","last_undegraded":"2024-09-07T03:32:50.470518+0000","last_fullsized":"2024-09-07T03:32:50.470518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:31.864367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'49","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.600626+0000","last_change":"2024-09-07T03:32:18.133115+0000","last_active":"2024-09-07T03:35:30.600626+0000","last_peered":"2024-09-07T03:35:30.600626+0000","last_clean":"2024-09-07T03:35:30.600626+0000","last_became_active":"2024-09-07T03:32:18.132867+0000","last_became_peered":"2024-09-07T03:32:18.132867+0000","last_unstale":"2024-09-07T03:35:30.600626+0000","last_undegraded":"2024-09-07T03:35:30.600626+0000","last_fullsized":"2024-09-07T03:35:30.600626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:21.167694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470403+0000","last_change":"2024-09-07T03:32:20.140261+0000","last_active":"2024-09-07T03:32:50.470403+0000","last_peered":"2024-09-07T03:32:50.470403+0000","last_clean":"2024-09-07T03:32:50.470403+0000","last_became_active":"2024-09-07T03:32:20.139806+0000","last_became_peered":"2024-09-07T03:32:20.139806+0000","last_unstale":"2024-09-07T03:32:50.470403+0000","last_undegraded":"2024-09-07T03:32:50.470403+0000","last_fullsized":"2024-09-07T03:32:50.470403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:38:36.923114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.784797+0000","last_change":"2024-09-07T03:32:22.148464+0000","last_active":"2024-09-07T03:35:23.784797+0000","last_peered":"2024-09-07T03:35:23.784797+0000","last_clean":"2024-09-07T03:35:23.784797+0000","last_became_active":"2024-09-07T03:32:22.148149+0000","last_became_peered":"2024-09-07T03:32:22.148149+0000","last_unstale":"2024-09-07T03:35:23.784797+0000","last_undegraded":"2024-09-07T03:35:23.784797+0000","last_fullsized":"2024-09-07T03:35:23.784797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:22.630172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806003+0000","last_change":"2024-09-07T03:32:50.281567+0000","last_active":"2024-09-07T03:35:23.806003+0000","last_peered":"2024-09-07T03:35:23.806003+0000","last_clean":"2024-09-07T03:35:23.806003+0000","last_became_active":"2024-09-07T03:32:50.279097+0000","last_became_peered":"2024-09-07T03:32:50.279097+0000","last_unstale":"2024-09-07T03:35:23.806003+0000","last_undegraded":"2024-09-07T03:35:23.806003+0000","last_fullsized":"2024-09-07T03:35:23.806003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:31:29.966121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.432175+0000","last_change":"2024-09-07T03:32:12.124416+0000","last_active":"2024-09-07T03:35:23.432175+0000","last_peered":"2024-09-07T03:35:23.432175+0000","last_clean":"2024-09-07T03:35:23.432175+0000","last_became_active":"2024-09-07T03:32:12.123895+0000","last_became_peered":"2024-09-07T03:32:12.123895+0000","last_unstale":"2024-09-07T03:35:23.432175+0000","last_undegraded":"2024-09-07T03:35:23.432175+0000","last_fullsized":"2024-09-07T03:35:23.432175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:03.158393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274777+0000","last_change":"2024-09-07T03:32:16.129022+0000","last_active":"2024-09-07T03:32:50.274777+0000","last_peered":"2024-09-07T03:32:50.274777+0000","last_clean":"2024-09-07T03:32:50.274777+0000","last_became_active":"2024-09-07T03:32:16.128471+0000","last_became_peered":"2024-09-07T03:32:16.128471+0000","last_unstale":"2024-09-07T03:32:50.274777+0000","last_undegraded":"2024-09-07T03:32:50.274777+0000","last_fullsized":"2024-09-07T03:32:50.274777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:29.378625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'39","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.641623+0000","last_change":"2024-09-07T03:32:18.127995+0000","last_active":"2024-09-07T03:35:30.641623+0000","last_peered":"2024-09-07T03:35:30.641623+0000","last_clean":"2024-09-07T03:35:30.641623+0000","last_became_active":"2024-09-07T03:32:18.127674+0000","last_became_peered":"2024-09-07T03:32:18.127674+0000","last_unstale":"2024-09-07T03:35:30.641623+0000","last_undegraded":"2024-09-07T03:35:30.641623+0000","last_fullsized":"2024-09-07T03:35:30.641623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:39:30.847124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272008+0000","last_change":"2024-09-07T03:32:20.142615+0000","last_active":"2024-09-07T03:32:50.272008+0000","last_peered":"2024-09-07T03:32:50.272008+0000","last_clean":"2024-09-07T03:32:50.272008+0000","last_became_active":"2024-09-07T03:32:20.142322+0000","last_became_peered":"2024-09-07T03:32:20.142322+0000","last_unstale":"2024-09-07T03:32:50.272008+0000","last_undegraded":"2024-09-07T03:32:50.272008+0000","last_fullsized":"2024-09-07T03:32:50.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:20:24.113543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:33.274480+0000","last_change":"2024-09-07T03:32:22.140060+0000","last_active":"2024-09-07T03:33:33.274480+0000","last_peered":"2024-09-07T03:33:33.274480+0000","last_clean":"2024-09-07T03:33:33.274480+0000","last_became_active":"2024-09-07T03:32:22.139771+0000","last_became_peered":"2024-09-07T03:32:22.139771+0000","last_unstale":"2024-09-07T03:33:33.274480+0000","last_undegraded":"2024-09-07T03:33:33.274480+0000","last_fullsized":"2024-09-07T03:33:33.274480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:32:56.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963274+0000","last_change":"2024-09-07T03:32:14.122499+0000","last_active":"2024-09-07T03:34:22.963274+0000","last_peered":"2024-09-07T03:34:22.963274+0000","last_clean":"2024-09-07T03:34:22.963274+0000","last_became_active":"2024-09-07T03:32:14.122182+0000","last_became_peered":"2024-09-07T03:32:14.122182+0000","last_unstale":"2024-09-07T03:34:22.963274+0000","last_undegraded":"2024-09-07T03:34:22.963274+0000","last_fullsized":"2024-09-07T03:34:22.963274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.940422+0000","last_change":"2024-09-07T03:32:12.120934+0000","last_active":"2024-09-07T03:34:22.940422+0000","last_peered":"2024-09-07T03:34:22.940422+0000","last_clean":"2024-09-07T03:34:22.940422+0000","last_became_active":"2024-09-07T03:32:12.120464+0000","last_became_peered":"2024-09-07T03:32:12.120464+0000","last_unstale":"2024-09-07T03:34:22.940422+0000","last_undegraded":"2024-09-07T03:34:22.940422+0000","last_fullsized":"2024-09-07T03:34:22.940422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:35:47.814978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275521+0000","last_change":"2024-09-07T03:32:16.124913+0000","last_active":"2024-09-07T03:32:50.275521+0000","last_peered":"2024-09-07T03:32:50.275521+0000","last_clean":"2024-09-07T03:32:50.275521+0000","last_became_active":"2024-09-07T03:32:16.124297+0000","last_became_peered":"2024-09-07T03:32:16.124297+0000","last_unstale":"2024-09-07T03:32:50.275521+0000","last_undegraded":"2024-09-07T03:32:50.275521+0000","last_fullsized":"2024-09-07T03:32:50.275521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:34.327180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'52","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.607217+0000","last_change":"2024-09-07T03:32:18.130149+0000","last_active":"2024-09-07T03:35:30.607217+0000","last_peered":"2024-09-07T03:35:30.607217+0000","last_clean":"2024-09-07T03:35:30.607217+0000","last_became_active":"2024-09-07T03:32:18.129944+0000","last_became_peered":"2024-09-07T03:32:18.129944+0000","last_unstale":"2024-09-07T03:35:30.607217+0000","last_undegraded":"2024-09-07T03:35:30.607217+0000","last_fullsized":"2024-09-07T03:35:30.607217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:27:30.361760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":352,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.546808+0000","last_change":"2024-09-07T03:32:20.144523+0000","last_active":"2024-09-07T03:35:30.546808+0000","last_peered":"2024-09-07T03:35:30.546808+0000","last_clean":"2024-09-07T03:35:30.546808+0000","last_became_active":"2024-09-07T03:32:20.144077+0000","last_became_peered":"2024-09-07T03:32:20.144077+0000","last_unstale":"2024-09-07T03:35:30.546808+0000","last_undegraded":"2024-09-07T03:35:30.546808+0000","last_fullsized":"2024-09-07T03:35:30.546808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:25.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471098+0000","last_change":"2024-09-07T03:32:22.146228+0000","last_active":"2024-09-07T03:32:50.471098+0000","last_peered":"2024-09-07T03:32:50.471098+0000","last_clean":"2024-09-07T03:32:50.471098+0000","last_became_active":"2024-09-07T03:32:22.145690+0000","last_became_peered":"2024-09-07T03:32:22.145690+0000","last_unstale":"2024-09-07T03:32:50.471098+0000","last_undegraded":"2024-09-07T03:32:50.471098+0000","last_fullsized":"2024-09-07T03:32:50.471098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:59:34.851122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'7","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.483958+0000","last_change":"2024-09-07T03:32:14.113637+0000","last_active":"2024-09-07T03:35:23.483958+0000","last_peered":"2024-09-07T03:35:23.483958+0000","last_clean":"2024-09-07T03:35:23.483958+0000","last_became_active":"2024-09-07T03:32:14.113104+0000","last_became_peered":"2024-09-07T03:32:14.113104+0000","last_unstale":"2024-09-07T03:35:23.483958+0000","last_undegraded":"2024-09-07T03:35:23.483958+0000","last_fullsized":"2024-09-07T03:35:23.483958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:46:15.552973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278855+0000","last_change":"2024-09-07T03:32:12.125878+0000","last_active":"2024-09-07T03:32:50.278855+0000","last_peered":"2024-09-07T03:32:50.278855+0000","last_clean":"2024-09-07T03:32:50.278855+0000","last_became_active":"2024-09-07T03:32:12.125172+0000","last_became_peered":"2024-09-07T03:32:12.125172+0000","last_unstale":"2024-09-07T03:32:50.278855+0000","last_undegraded":"2024-09-07T03:32:50.278855+0000","last_fullsized":"2024-09-07T03:32:50.278855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:36:10.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278236+0000","last_change":"2024-09-07T03:32:16.125904+0000","last_active":"2024-09-07T03:32:50.278236+0000","last_peered":"2024-09-07T03:32:50.278236+0000","last_clean":"2024-09-07T03:32:50.278236+0000","last_became_active":"2024-09-07T03:32:16.125618+0000","last_became_peered":"2024-09-07T03:32:16.125618+0000","last_unstale":"2024-09-07T03:32:50.278236+0000","last_undegraded":"2024-09-07T03:32:50.278236+0000","last_fullsized":"2024-09-07T03:32:50.278236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:06.494089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'72","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.650570+0000","last_change":"2024-09-07T03:32:18.134274+0000","last_active":"2024-09-07T03:35:30.650570+0000","last_peered":"2024-09-07T03:35:30.650570+0000","last_clean":"2024-09-07T03:35:30.650570+0000","last_became_active":"2024-09-07T03:32:18.134005+0000","last_became_peered":"2024-09-07T03:32:18.134005+0000","last_unstale":"2024-09-07T03:35:30.650570+0000","last_undegraded":"2024-09-07T03:35:30.650570+0000","last_fullsized":"2024-09-07T03:35:30.650570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:07.792695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274382+0000","last_change":"2024-09-07T03:32:20.145524+0000","last_active":"2024-09-07T03:32:50.274382+0000","last_peered":"2024-09-07T03:32:50.274382+0000","last_clean":"2024-09-07T03:32:50.274382+0000","last_became_active":"2024-09-07T03:32:20.145119+0000","last_became_peered":"2024-09-07T03:32:20.145119+0000","last_unstale":"2024-09-07T03:32:50.274382+0000","last_undegraded":"2024-09-07T03:32:50.274382+0000","last_fullsized":"2024-09-07T03:32:50.274382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:21.410162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.058175+0000","last_change":"2024-09-07T03:32:22.149484+0000","last_active":"2024-09-07T03:35:24.058175+0000","last_peered":"2024-09-07T03:35:24.058175+0000","last_clean":"2024-09-07T03:35:24.058175+0000","last_became_active":"2024-09-07T03:32:22.149203+0000","last_became_peered":"2024-09-07T03:32:22.149203+0000","last_unstale":"2024-09-07T03:35:24.058175+0000","last_undegraded":"2024-09-07T03:35:24.058175+0000","last_fullsized":"2024-09-07T03:35:24.058175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:33.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230163+0000","last_change":"2024-09-07T03:32:14.124704+0000","last_active":"2024-09-07T03:34:28.230163+0000","last_peered":"2024-09-07T03:34:28.230163+0000","last_clean":"2024-09-07T03:34:28.230163+0000","last_became_active":"2024-09-07T03:32:14.124120+0000","last_became_peered":"2024-09-07T03:32:14.124120+0000","last_unstale":"2024-09-07T03:34:28.230163+0000","last_undegraded":"2024-09-07T03:34:28.230163+0000","last_fullsized":"2024-09-07T03:34:28.230163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:15:18.554790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273263+0000","last_change":"2024-09-07T03:32:12.133844+0000","last_active":"2024-09-07T03:32:50.273263+0000","last_peered":"2024-09-07T03:32:50.273263+0000","last_clean":"2024-09-07T03:32:50.273263+0000","last_became_active":"2024-09-07T03:32:12.133434+0000","last_became_peered":"2024-09-07T03:32:12.133434+0000","last_unstale":"2024-09-07T03:32:50.273263+0000","last_undegraded":"2024-09-07T03:32:50.273263+0000","last_fullsized":"2024-09-07T03:32:50.273263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:56:28.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277527+0000","last_change":"2024-09-07T03:32:16.121534+0000","last_active":"2024-09-07T03:32:50.277527+0000","last_peered":"2024-09-07T03:32:50.277527+0000","last_clean":"2024-09-07T03:32:50.277527+0000","last_became_active":"2024-09-07T03:32:16.121256+0000","last_became_peered":"2024-09-07T03:32:16.121256+0000","last_unstale":"2024-09-07T03:32:50.277527+0000","last_undegraded":"2024-09-07T03:32:50.277527+0000","last_fullsized":"2024-09-07T03:32:50.277527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:19.973036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.654116+0000","last_change":"2024-09-07T03:32:18.128938+0000","last_active":"2024-09-07T03:35:30.654116+0000","last_peered":"2024-09-07T03:35:30.654116+0000","last_clean":"2024-09-07T03:35:30.654116+0000","last_became_active":"2024-09-07T03:32:18.128470+0000","last_became_peered":"2024-09-07T03:32:18.128470+0000","last_unstale":"2024-09-07T03:35:30.654116+0000","last_undegraded":"2024-09-07T03:35:30.654116+0000","last_fullsized":"2024-09-07T03:35:30.654116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:15:06.767791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276446+0000","last_change":"2024-09-07T03:32:20.136526+0000","last_active":"2024-09-07T03:32:50.276446+0000","last_peered":"2024-09-07T03:32:50.276446+0000","last_clean":"2024-09-07T03:32:50.276446+0000","last_became_active":"2024-09-07T03:32:20.134892+0000","last_became_peered":"2024-09-07T03:32:20.134892+0000","last_unstale":"2024-09-07T03:32:50.276446+0000","last_undegraded":"2024-09-07T03:32:50.276446+0000","last_fullsized":"2024-09-07T03:32:50.276446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:28.142767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228166+0000","last_change":"2024-09-07T03:32:22.153373+0000","last_active":"2024-09-07T03:34:21.228166+0000","last_peered":"2024-09-07T03:34:21.228166+0000","last_clean":"2024-09-07T03:34:21.228166+0000","last_became_active":"2024-09-07T03:32:22.153134+0000","last_became_peered":"2024-09-07T03:32:22.153134+0000","last_unstale":"2024-09-07T03:34:21.228166+0000","last_undegraded":"2024-09-07T03:34:21.228166+0000","last_fullsized":"2024-09-07T03:34:21.228166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:54.932378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435691+0000","last_change":"2024-09-07T03:32:14.113575+0000","last_active":"2024-09-07T03:34:19.435691+0000","last_peered":"2024-09-07T03:34:19.435691+0000","last_clean":"2024-09-07T03:34:19.435691+0000","last_became_active":"2024-09-07T03:32:14.113243+0000","last_became_peered":"2024-09-07T03:32:14.113243+0000","last_unstale":"2024-09-07T03:34:19.435691+0000","last_undegraded":"2024-09-07T03:34:19.435691+0000","last_fullsized":"2024-09-07T03:34:19.435691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:14.596869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.723676+0000","last_change":"2024-09-07T03:32:12.120954+0000","last_active":"2024-09-07T03:35:23.723676+0000","last_peered":"2024-09-07T03:35:23.723676+0000","last_clean":"2024-09-07T03:35:23.723676+0000","last_became_active":"2024-09-07T03:32:12.120531+0000","last_became_peered":"2024-09-07T03:32:12.120531+0000","last_unstale":"2024-09-07T03:35:23.723676+0000","last_undegraded":"2024-09-07T03:35:23.723676+0000","last_fullsized":"2024-09-07T03:35:23.723676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:11.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470958+0000","last_change":"2024-09-07T03:32:16.124431+0000","last_active":"2024-09-07T03:32:50.470958+0000","last_peered":"2024-09-07T03:32:50.470958+0000","last_clean":"2024-09-07T03:32:50.470958+0000","last_became_active":"2024-09-07T03:32:16.124100+0000","last_became_peered":"2024-09-07T03:32:16.124100+0000","last_unstale":"2024-09-07T03:32:50.470958+0000","last_undegraded":"2024-09-07T03:32:50.470958+0000","last_fullsized":"2024-09-07T03:32:50.470958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:20:34.634089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.632033+0000","last_change":"2024-09-07T03:32:18.130376+0000","last_active":"2024-09-07T03:35:30.632033+0000","last_peered":"2024-09-07T03:35:30.632033+0000","last_clean":"2024-09-07T03:35:30.632033+0000","last_became_active":"2024-09-07T03:32:18.130120+0000","last_became_peered":"2024-09-07T03:32:18.130120+0000","last_unstale":"2024-09-07T03:35:30.632033+0000","last_undegraded":"2024-09-07T03:35:30.632033+0000","last_fullsized":"2024-09-07T03:35:30.632033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:03.978153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.540272+0000","last_change":"2024-09-07T03:32:20.146795+0000","last_active":"2024-09-07T03:35:30.540272+0000","last_peered":"2024-09-07T03:35:30.540272+0000","last_clean":"2024-09-07T03:35:30.540272+0000","last_became_active":"2024-09-07T03:32:20.146408+0000","last_became_peered":"2024-09-07T03:32:20.146408+0000","last_unstale":"2024-09-07T03:35:30.540272+0000","last_undegraded":"2024-09-07T03:35:30.540272+0000","last_fullsized":"2024-09-07T03:35:30.540272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:41.611972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'14","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230053+0000","last_change":"2024-09-07T03:32:22.147032+0000","last_active":"2024-09-07T03:34:28.230053+0000","last_peered":"2024-09-07T03:34:28.230053+0000","last_clean":"2024-09-07T03:34:28.230053+0000","last_became_active":"2024-09-07T03:32:22.145911+0000","last_became_peered":"2024-09-07T03:32:22.145911+0000","last_unstale":"2024-09-07T03:34:28.230053+0000","last_undegraded":"2024-09-07T03:34:28.230053+0000","last_fullsized":"2024-09-07T03:34:28.230053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:59:11.588353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278589+0000","last_change":"2024-09-07T03:32:14.112827+0000","last_active":"2024-09-07T03:32:50.278589+0000","last_peered":"2024-09-07T03:32:50.278589+0000","last_clean":"2024-09-07T03:32:50.278589+0000","last_became_active":"2024-09-07T03:32:14.112499+0000","last_became_peered":"2024-09-07T03:32:14.112499+0000","last_unstale":"2024-09-07T03:32:50.278589+0000","last_undegraded":"2024-09-07T03:32:50.278589+0000","last_fullsized":"2024-09-07T03:32:50.278589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:47:55.234769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432136+0000","last_change":"2024-09-07T03:32:12.132816+0000","last_active":"2024-09-07T03:32:55.432136+0000","last_peered":"2024-09-07T03:32:55.432136+0000","last_clean":"2024-09-07T03:32:55.432136+0000","last_became_active":"2024-09-07T03:32:12.132462+0000","last_became_peered":"2024-09-07T03:32:12.132462+0000","last_unstale":"2024-09-07T03:32:55.432136+0000","last_undegraded":"2024-09-07T03:32:55.432136+0000","last_fullsized":"2024-09-07T03:32:55.432136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:53:07.085389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":617,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.522508+0000","last_change":"2024-09-07T03:32:16.124805+0000","last_active":"2024-09-07T03:35:30.522508+0000","last_peered":"2024-09-07T03:35:30.522508+0000","last_clean":"2024-09-07T03:35:30.522508+0000","last_became_active":"2024-09-07T03:32:16.124500+0000","last_became_peered":"2024-09-07T03:32:16.124500+0000","last_unstale":"2024-09-07T03:35:30.522508+0000","last_undegraded":"2024-09-07T03:35:30.522508+0000","last_fullsized":"2024-09-07T03:35:30.522508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:21:20.333446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'11","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230563+0000","last_change":"2024-09-07T03:32:50.286792+0000","last_active":"2024-09-07T03:34:36.230563+0000","last_peered":"2024-09-07T03:34:36.230563+0000","last_clean":"2024-09-07T03:34:36.230563+0000","last_became_active":"2024-09-07T03:32:50.278739+0000","last_became_peered":"2024-09-07T03:32:50.278739+0000","last_unstale":"2024-09-07T03:34:36.230563+0000","last_undegraded":"2024-09-07T03:34:36.230563+0000","last_fullsized":"2024-09-07T03:34:36.230563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:41.377209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.541844+0000","last_change":"2024-09-07T03:32:20.140656+0000","last_active":"2024-09-07T03:35:30.541844+0000","last_peered":"2024-09-07T03:35:30.541844+0000","last_clean":"2024-09-07T03:35:30.541844+0000","last_became_active":"2024-09-07T03:32:20.140148+0000","last_became_peered":"2024-09-07T03:32:20.140148+0000","last_unstale":"2024-09-07T03:35:30.541844+0000","last_undegraded":"2024-09-07T03:35:30.541844+0000","last_fullsized":"2024-09-07T03:35:30.541844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:10.352295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.602934+0000","last_change":"2024-09-07T03:32:22.147355+0000","last_active":"2024-09-07T03:34:22.602934+0000","last_peered":"2024-09-07T03:34:22.602934+0000","last_clean":"2024-09-07T03:34:22.602934+0000","last_became_active":"2024-09-07T03:32:22.147049+0000","last_became_peered":"2024-09-07T03:32:22.147049+0000","last_unstale":"2024-09-07T03:34:22.602934+0000","last_undegraded":"2024-09-07T03:34:22.602934+0000","last_fullsized":"2024-09-07T03:34:22.602934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:16.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'5","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230226+0000","last_change":"2024-09-07T03:32:14.124366+0000","last_active":"2024-09-07T03:34:28.230226+0000","last_peered":"2024-09-07T03:34:28.230226+0000","last_clean":"2024-09-07T03:34:28.230226+0000","last_became_active":"2024-09-07T03:32:14.124083+0000","last_became_peered":"2024-09-07T03:32:14.124083+0000","last_unstale":"2024-09-07T03:34:28.230226+0000","last_undegraded":"2024-09-07T03:34:28.230226+0000","last_fullsized":"2024-09-07T03:34:28.230226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.448249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.384212+0000","last_change":"2024-09-07T03:32:12.141656+0000","last_active":"2024-09-07T03:35:23.384212+0000","last_peered":"2024-09-07T03:35:23.384212+0000","last_clean":"2024-09-07T03:35:23.384212+0000","last_became_active":"2024-09-07T03:32:12.141314+0000","last_became_peered":"2024-09-07T03:32:12.141314+0000","last_unstale":"2024-09-07T03:35:23.384212+0000","last_undegraded":"2024-09-07T03:35:23.384212+0000","last_fullsized":"2024-09-07T03:35:23.384212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:48:41.251471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276435+0000","last_change":"2024-09-07T03:32:16.128496+0000","last_active":"2024-09-07T03:32:50.276435+0000","last_peered":"2024-09-07T03:32:50.276435+0000","last_clean":"2024-09-07T03:32:50.276435+0000","last_became_active":"2024-09-07T03:32:16.128099+0000","last_became_peered":"2024-09-07T03:32:16.128099+0000","last_unstale":"2024-09-07T03:32:50.276435+0000","last_undegraded":"2024-09-07T03:32:50.276435+0000","last_fullsized":"2024-09-07T03:32:50.276435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:54:04.786020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'41","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.591142+0000","last_change":"2024-09-07T03:32:18.129264+0000","last_active":"2024-09-07T03:35:30.591142+0000","last_peered":"2024-09-07T03:35:30.591142+0000","last_clean":"2024-09-07T03:35:30.591142+0000","last_became_active":"2024-09-07T03:32:18.128679+0000","last_became_peered":"2024-09-07T03:32:18.128679+0000","last_unstale":"2024-09-07T03:35:30.591142+0000","last_undegraded":"2024-09-07T03:35:30.591142+0000","last_fullsized":"2024-09-07T03:35:30.591142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:04.595879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280409+0000","last_change":"2024-09-07T03:32:20.132823+0000","last_active":"2024-09-07T03:32:50.280409+0000","last_peered":"2024-09-07T03:32:50.280409+0000","last_clean":"2024-09-07T03:32:50.280409+0000","last_became_active":"2024-09-07T03:32:20.132479+0000","last_became_peered":"2024-09-07T03:32:20.132479+0000","last_unstale":"2024-09-07T03:32:50.280409+0000","last_undegraded":"2024-09-07T03:32:50.280409+0000","last_fullsized":"2024-09-07T03:32:50.280409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:52.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.060147+0000","last_change":"2024-09-07T03:32:22.140676+0000","last_active":"2024-09-07T03:35:24.060147+0000","last_peered":"2024-09-07T03:35:24.060147+0000","last_clean":"2024-09-07T03:35:24.060147+0000","last_became_active":"2024-09-07T03:32:22.140389+0000","last_became_peered":"2024-09-07T03:32:22.140389+0000","last_unstale":"2024-09-07T03:35:24.060147+0000","last_undegraded":"2024-09-07T03:35:24.060147+0000","last_fullsized":"2024-09-07T03:35:24.060147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:12:54.218779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.024887+0000","last_change":"2024-09-07T03:32:14.113244+0000","last_active":"2024-09-07T03:32:57.024887+0000","last_peered":"2024-09-07T03:32:57.024887+0000","last_clean":"2024-09-07T03:32:57.024887+0000","last_became_active":"2024-09-07T03:32:14.112612+0000","last_became_peered":"2024-09-07T03:32:14.112612+0000","last_unstale":"2024-09-07T03:32:57.024887+0000","last_undegraded":"2024-09-07T03:32:57.024887+0000","last_fullsized":"2024-09-07T03:32:57.024887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:24.044336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469899+0000","last_change":"2024-09-07T03:31:58.568783+0000","last_active":"2024-09-07T03:32:50.469899+0000","last_peered":"2024-09-07T03:32:50.469899+0000","last_clean":"2024-09-07T03:32:50.469899+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:32:50.469899+0000","last_undegraded":"2024-09-07T03:32:50.469899+0000","last_fullsized":"2024-09-07T03:32:50.469899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_clean_scrub_stamp":"2024-09-07T03:31:57.501815+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:54.736044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278835+0000","last_change":"2024-09-07T03:32:04.539297+0000","last_active":"2024-09-07T03:32:50.278835+0000","last_peered":"2024-09-07T03:32:50.278835+0000","last_clean":"2024-09-07T03:32:50.278835+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:32:50.278835+0000","last_undegraded":"2024-09-07T03:32:50.278835+0000","last_fullsized":"2024-09-07T03:32:50.278835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:06.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.838441+0000","last_change":"2024-09-07T03:32:12.130687+0000","last_active":"2024-09-07T03:35:23.838441+0000","last_peered":"2024-09-07T03:35:23.838441+0000","last_clean":"2024-09-07T03:35:23.838441+0000","last_became_active":"2024-09-07T03:32:12.130323+0000","last_became_peered":"2024-09-07T03:32:12.130323+0000","last_unstale":"2024-09-07T03:35:23.838441+0000","last_undegraded":"2024-09-07T03:35:23.838441+0000","last_fullsized":"2024-09-07T03:35:23.838441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:45.892639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471096+0000","last_change":"2024-09-07T03:32:16.127232+0000","last_active":"2024-09-07T03:32:50.471096+0000","last_peered":"2024-09-07T03:32:50.471096+0000","last_clean":"2024-09-07T03:32:50.471096+0000","last_became_active":"2024-09-07T03:32:16.126915+0000","last_became_peered":"2024-09-07T03:32:16.126915+0000","last_unstale":"2024-09-07T03:32:50.471096+0000","last_undegraded":"2024-09-07T03:32:50.471096+0000","last_fullsized":"2024-09-07T03:32:50.471096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:52:36.603646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'93","reported_seq":181,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.689595+0000","last_change":"2024-09-07T03:32:18.129530+0000","last_active":"2024-09-07T03:35:30.689595+0000","last_peered":"2024-09-07T03:35:30.689595+0000","last_clean":"2024-09-07T03:35:30.689595+0000","last_became_active":"2024-09-07T03:32:18.129224+0000","last_became_peered":"2024-09-07T03:32:18.129224+0000","last_unstale":"2024-09-07T03:35:30.689595+0000","last_undegraded":"2024-09-07T03:35:30.689595+0000","last_fullsized":"2024-09-07T03:35:30.689595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:25:57.912545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275577+0000","last_change":"2024-09-07T03:32:20.135113+0000","last_active":"2024-09-07T03:32:50.275577+0000","last_peered":"2024-09-07T03:32:50.275577+0000","last_clean":"2024-09-07T03:32:50.275577+0000","last_became_active":"2024-09-07T03:32:20.134819+0000","last_became_peered":"2024-09-07T03:32:20.134819+0000","last_unstale":"2024-09-07T03:32:50.275577+0000","last_undegraded":"2024-09-07T03:32:50.275577+0000","last_fullsized":"2024-09-07T03:32:50.275577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:30.829289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'84","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.852849+0000","last_change":"2024-09-07T03:32:22.152124+0000","last_active":"2024-09-07T03:35:23.852849+0000","last_peered":"2024-09-07T03:35:23.852849+0000","last_clean":"2024-09-07T03:35:23.852849+0000","last_became_active":"2024-09-07T03:32:22.151817+0000","last_became_peered":"2024-09-07T03:32:22.151817+0000","last_unstale":"2024-09-07T03:35:23.852849+0000","last_undegraded":"2024-09-07T03:35:23.852849+0000","last_fullsized":"2024-09-07T03:35:23.852849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:00.353389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'16","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843497+0000","last_change":"2024-09-07T03:32:14.130827+0000","last_active":"2024-09-07T03:35:23.843497+0000","last_peered":"2024-09-07T03:35:23.843497+0000","last_clean":"2024-09-07T03:35:23.843497+0000","last_became_active":"2024-09-07T03:32:14.130484+0000","last_became_peered":"2024-09-07T03:32:14.130484+0000","last_unstale":"2024-09-07T03:35:23.843497+0000","last_undegraded":"2024-09-07T03:35:23.843497+0000","last_fullsized":"2024-09-07T03:35:23.843497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279322+0000","last_change":"2024-09-07T03:32:04.539038+0000","last_active":"2024-09-07T03:32:50.279322+0000","last_peered":"2024-09-07T03:32:50.279322+0000","last_clean":"2024-09-07T03:32:50.279322+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:32:50.279322+0000","last_undegraded":"2024-09-07T03:32:50.279322+0000","last_fullsized":"2024-09-07T03:32:50.279322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:11.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470907+0000","last_change":"2024-09-07T03:32:12.124849+0000","last_active":"2024-09-07T03:32:50.470907+0000","last_peered":"2024-09-07T03:32:50.470907+0000","last_clean":"2024-09-07T03:32:50.470907+0000","last_became_active":"2024-09-07T03:32:12.124522+0000","last_became_peered":"2024-09-07T03:32:12.124522+0000","last_unstale":"2024-09-07T03:32:50.470907+0000","last_undegraded":"2024-09-07T03:32:50.470907+0000","last_fullsized":"2024-09-07T03:32:50.470907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:46:14.653854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282885+0000","last_change":"2024-09-07T03:32:16.124594+0000","last_active":"2024-09-07T03:32:50.282885+0000","last_peered":"2024-09-07T03:32:50.282885+0000","last_clean":"2024-09-07T03:32:50.282885+0000","last_became_active":"2024-09-07T03:32:16.124243+0000","last_became_peered":"2024-09-07T03:32:16.124243+0000","last_unstale":"2024-09-07T03:32:50.282885+0000","last_undegraded":"2024-09-07T03:32:50.282885+0000","last_fullsized":"2024-09-07T03:32:50.282885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:00:23.883657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'279","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206669+0000","last_change":"2024-09-07T03:32:18.132880+0000","last_active":"2024-09-07T03:35:21.206669+0000","last_peered":"2024-09-07T03:35:21.206669+0000","last_clean":"2024-09-07T03:35:21.206669+0000","last_became_active":"2024-09-07T03:32:18.132579+0000","last_became_peered":"2024-09-07T03:32:18.132579+0000","last_unstale":"2024-09-07T03:35:21.206669+0000","last_undegraded":"2024-09-07T03:35:21.206669+0000","last_fullsized":"2024-09-07T03:35:21.206669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:11:51.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272567+0000","last_change":"2024-09-07T03:32:20.141318+0000","last_active":"2024-09-07T03:32:50.272567+0000","last_peered":"2024-09-07T03:32:50.272567+0000","last_clean":"2024-09-07T03:32:50.272567+0000","last_became_active":"2024-09-07T03:32:20.141044+0000","last_became_peered":"2024-09-07T03:32:20.141044+0000","last_unstale":"2024-09-07T03:32:50.272567+0000","last_undegraded":"2024-09-07T03:32:50.272567+0000","last_fullsized":"2024-09-07T03:32:50.272567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:09:44.169617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.806191+0000","last_change":"2024-09-07T03:32:22.143631+0000","last_active":"2024-09-07T03:33:38.806191+0000","last_peered":"2024-09-07T03:33:38.806191+0000","last_clean":"2024-09-07T03:33:38.806191+0000","last_became_active":"2024-09-07T03:32:22.143337+0000","last_became_peered":"2024-09-07T03:32:22.143337+0000","last_unstale":"2024-09-07T03:33:38.806191+0000","last_undegraded":"2024-09-07T03:33:38.806191+0000","last_fullsized":"2024-09-07T03:33:38.806191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:30.421368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":64,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570852+0000","last_change":"2024-09-07T03:32:14.128064+0000","last_active":"2024-09-07T03:32:56.570852+0000","last_peered":"2024-09-07T03:32:56.570852+0000","last_clean":"2024-09-07T03:32:56.570852+0000","last_became_active":"2024-09-07T03:32:14.127288+0000","last_became_peered":"2024-09-07T03:32:14.127288+0000","last_unstale":"2024-09-07T03:32:56.570852+0000","last_undegraded":"2024-09-07T03:32:56.570852+0000","last_fullsized":"2024-09-07T03:32:56.570852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:43.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274315+0000","last_change":"2024-09-07T03:32:04.537641+0000","last_active":"2024-09-07T03:32:50.274315+0000","last_peered":"2024-09-07T03:32:50.274315+0000","last_clean":"2024-09-07T03:32:50.274315+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:32:50.274315+0000","last_undegraded":"2024-09-07T03:32:50.274315+0000","last_fullsized":"2024-09-07T03:32:50.274315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.563922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.975371+0000","last_change":"2024-09-07T03:32:12.139855+0000","last_active":"2024-09-07T03:33:38.975371+0000","last_peered":"2024-09-07T03:33:38.975371+0000","last_clean":"2024-09-07T03:33:38.975371+0000","last_became_active":"2024-09-07T03:32:12.139224+0000","last_became_peered":"2024-09-07T03:32:12.139224+0000","last_unstale":"2024-09-07T03:33:38.975371+0000","last_undegraded":"2024-09-07T03:33:38.975371+0000","last_fullsized":"2024-09-07T03:33:38.975371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:34.147142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279225+0000","last_change":"2024-09-07T03:32:16.122151+0000","last_active":"2024-09-07T03:32:50.279225+0000","last_peered":"2024-09-07T03:32:50.279225+0000","last_clean":"2024-09-07T03:32:50.279225+0000","last_became_active":"2024-09-07T03:32:16.121817+0000","last_became_peered":"2024-09-07T03:32:16.121817+0000","last_unstale":"2024-09-07T03:32:50.279225+0000","last_undegraded":"2024-09-07T03:32:50.279225+0000","last_fullsized":"2024-09-07T03:32:50.279225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:15.023249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206736+0000","last_change":"2024-09-07T03:32:18.129607+0000","last_active":"2024-09-07T03:35:21.206736+0000","last_peered":"2024-09-07T03:35:21.206736+0000","last_clean":"2024-09-07T03:35:21.206736+0000","last_became_active":"2024-09-07T03:32:18.129264+0000","last_became_peered":"2024-09-07T03:32:18.129264+0000","last_unstale":"2024-09-07T03:35:21.206736+0000","last_undegraded":"2024-09-07T03:35:21.206736+0000","last_fullsized":"2024-09-07T03:35:21.206736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:52:54.317892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472271+0000","last_change":"2024-09-07T03:32:20.143074+0000","last_active":"2024-09-07T03:32:50.472271+0000","last_peered":"2024-09-07T03:32:50.472271+0000","last_clean":"2024-09-07T03:32:50.472271+0000","last_became_active":"2024-09-07T03:32:20.142764+0000","last_became_peered":"2024-09-07T03:32:20.142764+0000","last_unstale":"2024-09-07T03:32:50.472271+0000","last_undegraded":"2024-09-07T03:32:50.472271+0000","last_fullsized":"2024-09-07T03:32:50.472271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:36.484446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272193+0000","last_change":"2024-09-07T03:32:22.147788+0000","last_active":"2024-09-07T03:32:50.272193+0000","last_peered":"2024-09-07T03:32:50.272193+0000","last_clean":"2024-09-07T03:32:50.272193+0000","last_became_active":"2024-09-07T03:32:22.147510+0000","last_became_peered":"2024-09-07T03:32:22.147510+0000","last_unstale":"2024-09-07T03:32:50.272193+0000","last_undegraded":"2024-09-07T03:32:50.272193+0000","last_fullsized":"2024-09-07T03:32:50.272193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:37.758327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473250+0000","last_change":"2024-09-07T03:32:14.114315+0000","last_active":"2024-09-07T03:32:50.473250+0000","last_peered":"2024-09-07T03:32:50.473250+0000","last_clean":"2024-09-07T03:32:50.473250+0000","last_became_active":"2024-09-07T03:32:14.113700+0000","last_became_peered":"2024-09-07T03:32:14.113700+0000","last_unstale":"2024-09-07T03:32:50.473250+0000","last_undegraded":"2024-09-07T03:32:50.473250+0000","last_fullsized":"2024-09-07T03:32:50.473250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:56:02.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279568+0000","last_change":"2024-09-07T03:32:04.539644+0000","last_active":"2024-09-07T03:32:50.279568+0000","last_peered":"2024-09-07T03:32:50.279568+0000","last_clean":"2024-09-07T03:32:50.279568+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:32:50.279568+0000","last_undegraded":"2024-09-07T03:32:50.279568+0000","last_fullsized":"2024-09-07T03:32:50.279568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:43.880721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.720142+0000","last_change":"2024-09-07T03:32:12.125645+0000","last_active":"2024-09-07T03:35:23.720142+0000","last_peered":"2024-09-07T03:35:23.720142+0000","last_clean":"2024-09-07T03:35:23.720142+0000","last_became_active":"2024-09-07T03:32:12.124390+0000","last_became_peered":"2024-09-07T03:32:12.124390+0000","last_unstale":"2024-09-07T03:35:23.720142+0000","last_undegraded":"2024-09-07T03:35:23.720142+0000","last_fullsized":"2024-09-07T03:35:23.720142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:47:53.230073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472348+0000","last_change":"2024-09-07T03:32:16.122130+0000","last_active":"2024-09-07T03:32:50.472348+0000","last_peered":"2024-09-07T03:32:50.472348+0000","last_clean":"2024-09-07T03:32:50.472348+0000","last_became_active":"2024-09-07T03:32:16.120933+0000","last_became_peered":"2024-09-07T03:32:16.120933+0000","last_unstale":"2024-09-07T03:32:50.472348+0000","last_undegraded":"2024-09-07T03:32:50.472348+0000","last_fullsized":"2024-09-07T03:32:50.472348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:16.466896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.988572+0000","last_change":"2024-09-07T03:32:18.130861+0000","last_active":"2024-09-07T03:35:22.988572+0000","last_peered":"2024-09-07T03:35:22.988572+0000","last_clean":"2024-09-07T03:35:22.988572+0000","last_became_active":"2024-09-07T03:32:18.130557+0000","last_became_peered":"2024-09-07T03:32:18.130557+0000","last_unstale":"2024-09-07T03:35:22.988572+0000","last_undegraded":"2024-09-07T03:35:22.988572+0000","last_fullsized":"2024-09-07T03:35:22.988572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:23:58.249870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276706+0000","last_change":"2024-09-07T03:32:20.143006+0000","last_active":"2024-09-07T03:32:50.276706+0000","last_peered":"2024-09-07T03:32:50.276706+0000","last_clean":"2024-09-07T03:32:50.276706+0000","last_became_active":"2024-09-07T03:32:20.142650+0000","last_became_peered":"2024-09-07T03:32:20.142650+0000","last_unstale":"2024-09-07T03:32:50.276706+0000","last_undegraded":"2024-09-07T03:32:50.276706+0000","last_fullsized":"2024-09-07T03:32:50.276706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:47.155034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.532509+0000","last_change":"2024-09-07T03:32:22.151470+0000","last_active":"2024-09-07T03:34:22.532509+0000","last_peered":"2024-09-07T03:34:22.532509+0000","last_clean":"2024-09-07T03:34:22.532509+0000","last_became_active":"2024-09-07T03:32:22.150981+0000","last_became_peered":"2024-09-07T03:32:22.150981+0000","last_unstale":"2024-09-07T03:34:22.532509+0000","last_undegraded":"2024-09-07T03:34:22.532509+0000","last_fullsized":"2024-09-07T03:34:22.532509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:09.757277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731323+0000","last_change":"2024-09-07T03:32:50.282510+0000","last_active":"2024-09-07T03:35:23.731323+0000","last_peered":"2024-09-07T03:35:23.731323+0000","last_clean":"2024-09-07T03:35:23.731323+0000","last_became_active":"2024-09-07T03:32:50.282108+0000","last_became_peered":"2024-09-07T03:32:50.282108+0000","last_unstale":"2024-09-07T03:35:23.731323+0000","last_undegraded":"2024-09-07T03:35:23.731323+0000","last_fullsized":"2024-09-07T03:35:23.731323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:00:33.202265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.561631+0000","last_change":"2024-09-07T03:32:12.121500+0000","last_active":"2024-09-07T03:32:56.561631+0000","last_peered":"2024-09-07T03:32:56.561631+0000","last_clean":"2024-09-07T03:32:56.561631+0000","last_became_active":"2024-09-07T03:32:12.121179+0000","last_became_peered":"2024-09-07T03:32:12.121179+0000","last_unstale":"2024-09-07T03:32:56.561631+0000","last_undegraded":"2024-09-07T03:32:56.561631+0000","last_fullsized":"2024-09-07T03:32:56.561631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:27:51.832052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472095+0000","last_change":"2024-09-07T03:32:04.541917+0000","last_active":"2024-09-07T03:32:50.472095+0000","last_peered":"2024-09-07T03:32:50.472095+0000","last_clean":"2024-09-07T03:32:50.472095+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:32:50.472095+0000","last_undegraded":"2024-09-07T03:32:50.472095+0000","last_fullsized":"2024-09-07T03:32:50.472095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:39:36.959986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.113878+0000","last_change":"2024-09-07T03:32:16.126538+0000","last_active":"2024-09-07T03:35:24.113878+0000","last_peered":"2024-09-07T03:35:24.113878+0000","last_clean":"2024-09-07T03:35:24.113878+0000","last_became_active":"2024-09-07T03:32:16.126273+0000","last_became_peered":"2024-09-07T03:32:16.126273+0000","last_unstale":"2024-09-07T03:35:24.113878+0000","last_undegraded":"2024-09-07T03:35:24.113878+0000","last_fullsized":"2024-09-07T03:35:24.113878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:12:07.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'74","reported_seq":146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.207266+0000","last_change":"2024-09-07T03:32:18.132985+0000","last_active":"2024-09-07T03:34:21.207266+0000","last_peered":"2024-09-07T03:34:21.207266+0000","last_clean":"2024-09-07T03:34:21.207266+0000","last_became_active":"2024-09-07T03:32:18.132654+0000","last_became_peered":"2024-09-07T03:32:18.132654+0000","last_unstale":"2024-09-07T03:34:21.207266+0000","last_undegraded":"2024-09-07T03:34:21.207266+0000","last_fullsized":"2024-09-07T03:34:21.207266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:58.124761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278034+0000","last_change":"2024-09-07T03:32:20.140348+0000","last_active":"2024-09-07T03:32:50.278034+0000","last_peered":"2024-09-07T03:32:50.278034+0000","last_clean":"2024-09-07T03:32:50.278034+0000","last_became_active":"2024-09-07T03:32:20.140025+0000","last_became_peered":"2024-09-07T03:32:20.140025+0000","last_unstale":"2024-09-07T03:32:50.278034+0000","last_undegraded":"2024-09-07T03:32:50.278034+0000","last_fullsized":"2024-09-07T03:32:50.278034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:18:53.690582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'13","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.873538+0000","last_change":"2024-09-07T03:32:22.140343+0000","last_active":"2024-09-07T03:34:22.873538+0000","last_peered":"2024-09-07T03:34:22.873538+0000","last_clean":"2024-09-07T03:34:22.873538+0000","last_became_active":"2024-09-07T03:32:22.140043+0000","last_became_peered":"2024-09-07T03:32:22.140043+0000","last_unstale":"2024-09-07T03:34:22.873538+0000","last_undegraded":"2024-09-07T03:34:22.873538+0000","last_fullsized":"2024-09-07T03:34:22.873538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:55.502696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'12","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806308+0000","last_change":"2024-09-07T03:32:14.126934+0000","last_active":"2024-09-07T03:35:23.806308+0000","last_peered":"2024-09-07T03:35:23.806308+0000","last_clean":"2024-09-07T03:35:23.806308+0000","last_became_active":"2024-09-07T03:32:14.126663+0000","last_became_peered":"2024-09-07T03:32:14.126663+0000","last_unstale":"2024-09-07T03:35:23.806308+0000","last_undegraded":"2024-09-07T03:35:23.806308+0000","last_fullsized":"2024-09-07T03:35:23.806308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:58:27.663426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"36'1","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:18.228700+0000","last_change":"2024-09-07T03:32:12.134479+0000","last_active":"2024-09-07T03:34:18.228700+0000","last_peered":"2024-09-07T03:34:18.228700+0000","last_clean":"2024-09-07T03:34:18.228700+0000","last_became_active":"2024-09-07T03:32:12.133974+0000","last_became_peered":"2024-09-07T03:32:12.133974+0000","last_unstale":"2024-09-07T03:34:18.228700+0000","last_undegraded":"2024-09-07T03:34:18.228700+0000","last_fullsized":"2024-09-07T03:34:18.228700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:03:12.017360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281965+0000","last_change":"2024-09-07T03:32:04.539029+0000","last_active":"2024-09-07T03:32:50.281965+0000","last_peered":"2024-09-07T03:32:50.281965+0000","last_clean":"2024-09-07T03:32:50.281965+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:32:50.281965+0000","last_undegraded":"2024-09-07T03:32:50.281965+0000","last_fullsized":"2024-09-07T03:32:50.281965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:37:36.714209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278673+0000","last_change":"2024-09-07T03:32:16.122232+0000","last_active":"2024-09-07T03:32:50.278673+0000","last_peered":"2024-09-07T03:32:50.278673+0000","last_clean":"2024-09-07T03:32:50.278673+0000","last_became_active":"2024-09-07T03:32:16.121921+0000","last_became_peered":"2024-09-07T03:32:16.121921+0000","last_unstale":"2024-09-07T03:32:50.278673+0000","last_undegraded":"2024-09-07T03:32:50.278673+0000","last_fullsized":"2024-09-07T03:32:50.278673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:01:24.806960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469770+0000","last_change":"2024-09-07T03:32:18.134018+0000","last_active":"2024-09-07T03:32:50.469770+0000","last_peered":"2024-09-07T03:32:50.469770+0000","last_clean":"2024-09-07T03:32:50.469770+0000","last_became_active":"2024-09-07T03:32:18.133689+0000","last_became_peered":"2024-09-07T03:32:18.133689+0000","last_unstale":"2024-09-07T03:32:50.469770+0000","last_undegraded":"2024-09-07T03:32:50.469770+0000","last_fullsized":"2024-09-07T03:32:50.469770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:16.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":347,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206656+0000","last_change":"2024-09-07T03:32:20.143562+0000","last_active":"2024-09-07T03:35:21.206656+0000","last_peered":"2024-09-07T03:35:21.206656+0000","last_clean":"2024-09-07T03:35:21.206656+0000","last_became_active":"2024-09-07T03:32:20.143293+0000","last_became_peered":"2024-09-07T03:32:20.143293+0000","last_unstale":"2024-09-07T03:35:21.206656+0000","last_undegraded":"2024-09-07T03:35:21.206656+0000","last_fullsized":"2024-09-07T03:35:21.206656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:51.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273729+0000","last_change":"2024-09-07T03:32:22.147306+0000","last_active":"2024-09-07T03:32:50.273729+0000","last_peered":"2024-09-07T03:32:50.273729+0000","last_clean":"2024-09-07T03:32:50.273729+0000","last_became_active":"2024-09-07T03:32:22.147036+0000","last_became_peered":"2024-09-07T03:32:22.147036+0000","last_unstale":"2024-09-07T03:32:50.273729+0000","last_undegraded":"2024-09-07T03:32:50.273729+0000","last_fullsized":"2024-09-07T03:32:50.273729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:02.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.477342+0000","last_change":"2024-09-07T03:32:14.127131+0000","last_active":"2024-09-07T03:35:23.477342+0000","last_peered":"2024-09-07T03:35:23.477342+0000","last_clean":"2024-09-07T03:35:23.477342+0000","last_became_active":"2024-09-07T03:32:14.126350+0000","last_became_peered":"2024-09-07T03:32:14.126350+0000","last_unstale":"2024-09-07T03:35:23.477342+0000","last_undegraded":"2024-09-07T03:35:23.477342+0000","last_fullsized":"2024-09-07T03:35:23.477342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:48:39.075361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276350+0000","last_change":"2024-09-07T03:32:12.130912+0000","last_active":"2024-09-07T03:32:50.276350+0000","last_peered":"2024-09-07T03:32:50.276350+0000","last_clean":"2024-09-07T03:32:50.276350+0000","last_became_active":"2024-09-07T03:32:12.130058+0000","last_became_peered":"2024-09-07T03:32:12.130058+0000","last_unstale":"2024-09-07T03:32:50.276350+0000","last_undegraded":"2024-09-07T03:32:50.276350+0000","last_fullsized":"2024-09-07T03:32:50.276350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:39:14.276282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472091+0000","last_change":"2024-09-07T03:32:04.542033+0000","last_active":"2024-09-07T03:32:50.472091+0000","last_peered":"2024-09-07T03:32:50.472091+0000","last_clean":"2024-09-07T03:32:50.472091+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:32:50.472091+0000","last_undegraded":"2024-09-07T03:32:50.472091+0000","last_fullsized":"2024-09-07T03:32:50.472091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:18:29.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279335+0000","last_change":"2024-09-07T03:32:16.117328+0000","last_active":"2024-09-07T03:32:50.279335+0000","last_peered":"2024-09-07T03:32:50.279335+0000","last_clean":"2024-09-07T03:32:50.279335+0000","last_became_active":"2024-09-07T03:32:16.117025+0000","last_became_peered":"2024-09-07T03:32:16.117025+0000","last_unstale":"2024-09-07T03:32:50.279335+0000","last_undegraded":"2024-09-07T03:32:50.279335+0000","last_fullsized":"2024-09-07T03:32:50.279335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:43:01.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273099+0000","last_change":"2024-09-07T03:32:18.124974+0000","last_active":"2024-09-07T03:32:50.273099+0000","last_peered":"2024-09-07T03:32:50.273099+0000","last_clean":"2024-09-07T03:32:50.273099+0000","last_became_active":"2024-09-07T03:32:18.124641+0000","last_became_peered":"2024-09-07T03:32:18.124641+0000","last_unstale":"2024-09-07T03:32:50.273099+0000","last_undegraded":"2024-09-07T03:32:50.273099+0000","last_fullsized":"2024-09-07T03:32:50.273099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:36:49.839182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.544102+0000","last_change":"2024-09-07T03:32:20.149232+0000","last_active":"2024-09-07T03:35:30.544102+0000","last_peered":"2024-09-07T03:35:30.544102+0000","last_clean":"2024-09-07T03:35:30.544102+0000","last_became_active":"2024-09-07T03:32:20.148768+0000","last_became_peered":"2024-09-07T03:32:20.148768+0000","last_unstale":"2024-09-07T03:35:30.544102+0000","last_undegraded":"2024-09-07T03:35:30.544102+0000","last_fullsized":"2024-09-07T03:35:30.544102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:15:20.986169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470656+0000","last_change":"2024-09-07T03:32:22.148714+0000","last_active":"2024-09-07T03:32:50.470656+0000","last_peered":"2024-09-07T03:32:50.470656+0000","last_clean":"2024-09-07T03:32:50.470656+0000","last_became_active":"2024-09-07T03:32:22.148444+0000","last_became_peered":"2024-09-07T03:32:22.148444+0000","last_unstale":"2024-09-07T03:32:50.470656+0000","last_undegraded":"2024-09-07T03:32:50.470656+0000","last_fullsized":"2024-09-07T03:32:50.470656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:23.271638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.588175+0000","last_change":"2024-09-07T03:32:14.113991+0000","last_active":"2024-09-07T03:35:23.588175+0000","last_peered":"2024-09-07T03:35:23.588175+0000","last_clean":"2024-09-07T03:35:23.588175+0000","last_became_active":"2024-09-07T03:32:14.113077+0000","last_became_peered":"2024-09-07T03:32:14.113077+0000","last_unstale":"2024-09-07T03:35:23.588175+0000","last_undegraded":"2024-09-07T03:35:23.588175+0000","last_fullsized":"2024-09-07T03:35:23.588175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:14:51.585905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.717209+0000","last_change":"2024-09-07T03:32:12.124748+0000","last_active":"2024-09-07T03:35:23.717209+0000","last_peered":"2024-09-07T03:35:23.717209+0000","last_clean":"2024-09-07T03:35:23.717209+0000","last_became_active":"2024-09-07T03:32:12.124398+0000","last_became_peered":"2024-09-07T03:32:12.124398+0000","last_unstale":"2024-09-07T03:35:23.717209+0000","last_undegraded":"2024-09-07T03:35:23.717209+0000","last_fullsized":"2024-09-07T03:35:23.717209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:59:37.231002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282690+0000","last_change":"2024-09-07T03:32:04.539724+0000","last_active":"2024-09-07T03:32:50.282690+0000","last_peered":"2024-09-07T03:32:50.282690+0000","last_clean":"2024-09-07T03:32:50.282690+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:32:50.282690+0000","last_undegraded":"2024-09-07T03:32:50.282690+0000","last_fullsized":"2024-09-07T03:32:50.282690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:55:55.896127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273091+0000","last_change":"2024-09-07T03:32:16.130854+0000","last_active":"2024-09-07T03:32:50.273091+0000","last_peered":"2024-09-07T03:32:50.273091+0000","last_clean":"2024-09-07T03:32:50.273091+0000","last_became_active":"2024-09-07T03:32:16.130091+0000","last_became_peered":"2024-09-07T03:32:16.130091+0000","last_unstale":"2024-09-07T03:32:50.273091+0000","last_undegraded":"2024-09-07T03:32:50.273091+0000","last_fullsized":"2024-09-07T03:32:50.273091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:20.097492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.692496+0000","last_change":"2024-09-07T03:32:18.132376+0000","last_active":"2024-09-07T03:35:30.692496+0000","last_peered":"2024-09-07T03:35:30.692496+0000","last_clean":"2024-09-07T03:35:30.692496+0000","last_became_active":"2024-09-07T03:32:18.132111+0000","last_became_peered":"2024-09-07T03:32:18.132111+0000","last_unstale":"2024-09-07T03:35:30.692496+0000","last_undegraded":"2024-09-07T03:35:30.692496+0000","last_fullsized":"2024-09-07T03:35:30.692496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272816+0000","last_change":"2024-09-07T03:32:20.143405+0000","last_active":"2024-09-07T03:32:50.272816+0000","last_peered":"2024-09-07T03:32:50.272816+0000","last_clean":"2024-09-07T03:32:50.272816+0000","last_became_active":"2024-09-07T03:32:20.143072+0000","last_became_peered":"2024-09-07T03:32:20.143072+0000","last_unstale":"2024-09-07T03:32:50.272816+0000","last_undegraded":"2024-09-07T03:32:50.272816+0000","last_fullsized":"2024-09-07T03:32:50.272816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:35:06.275781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276617+0000","last_change":"2024-09-07T03:32:22.139462+0000","last_active":"2024-09-07T03:32:50.276617+0000","last_peered":"2024-09-07T03:32:50.276617+0000","last_clean":"2024-09-07T03:32:50.276617+0000","last_became_active":"2024-09-07T03:32:22.139150+0000","last_became_peered":"2024-09-07T03:32:22.139150+0000","last_unstale":"2024-09-07T03:32:50.276617+0000","last_undegraded":"2024-09-07T03:32:50.276617+0000","last_fullsized":"2024-09-07T03:32:50.276617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:16:29.302047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275974+0000","last_change":"2024-09-07T03:32:22.138596+0000","last_active":"2024-09-07T03:32:50.275974+0000","last_peered":"2024-09-07T03:32:50.275974+0000","last_clean":"2024-09-07T03:32:50.275974+0000","last_became_active":"2024-09-07T03:32:22.138315+0000","last_became_peered":"2024-09-07T03:32:22.138315+0000","last_unstale":"2024-09-07T03:32:50.275974+0000","last_undegraded":"2024-09-07T03:32:50.275974+0000","last_fullsized":"2024-09-07T03:32:50.275974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:54:59.992625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435487+0000","last_change":"2024-09-07T03:32:14.113374+0000","last_active":"2024-09-07T03:34:19.435487+0000","last_peered":"2024-09-07T03:34:19.435487+0000","last_clean":"2024-09-07T03:34:19.435487+0000","last_became_active":"2024-09-07T03:32:14.112744+0000","last_became_peered":"2024-09-07T03:32:14.112744+0000","last_unstale":"2024-09-07T03:34:19.435487+0000","last_undegraded":"2024-09-07T03:34:19.435487+0000","last_fullsized":"2024-09-07T03:34:19.435487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:58.377074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'5","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.790736+0000","last_change":"2024-09-07T03:32:12.133214+0000","last_active":"2024-09-07T03:33:38.790736+0000","last_peered":"2024-09-07T03:33:38.790736+0000","last_clean":"2024-09-07T03:33:38.790736+0000","last_became_active":"2024-09-07T03:32:12.132715+0000","last_became_peered":"2024-09-07T03:32:12.132715+0000","last_unstale":"2024-09-07T03:33:38.790736+0000","last_undegraded":"2024-09-07T03:33:38.790736+0000","last_fullsized":"2024-09-07T03:33:38.790736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:43.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470337+0000","last_change":"2024-09-07T03:32:16.125307+0000","last_active":"2024-09-07T03:32:50.470337+0000","last_peered":"2024-09-07T03:32:50.470337+0000","last_clean":"2024-09-07T03:32:50.470337+0000","last_became_active":"2024-09-07T03:32:16.124681+0000","last_became_peered":"2024-09-07T03:32:16.124681+0000","last_unstale":"2024-09-07T03:32:50.470337+0000","last_undegraded":"2024-09-07T03:32:50.470337+0000","last_fullsized":"2024-09-07T03:32:50.470337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:30.622001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.603642+0000","last_change":"2024-09-07T03:32:18.134183+0000","last_active":"2024-09-07T03:35:30.603642+0000","last_peered":"2024-09-07T03:35:30.603642+0000","last_clean":"2024-09-07T03:35:30.603642+0000","last_became_active":"2024-09-07T03:32:18.133844+0000","last_became_peered":"2024-09-07T03:32:18.133844+0000","last_unstale":"2024-09-07T03:35:30.603642+0000","last_undegraded":"2024-09-07T03:35:30.603642+0000","last_fullsized":"2024-09-07T03:35:30.603642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:10:39.060137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271616+0000","last_change":"2024-09-07T03:32:20.149175+0000","last_active":"2024-09-07T03:32:50.271616+0000","last_peered":"2024-09-07T03:32:50.271616+0000","last_clean":"2024-09-07T03:32:50.271616+0000","last_became_active":"2024-09-07T03:32:20.148900+0000","last_became_peered":"2024-09-07T03:32:20.148900+0000","last_unstale":"2024-09-07T03:32:50.271616+0000","last_undegraded":"2024-09-07T03:32:50.271616+0000","last_fullsized":"2024-09-07T03:32:50.271616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:25.130015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:20.895399+0000","last_change":"2024-09-07T03:32:22.150451+0000","last_active":"2024-09-07T03:34:20.895399+0000","last_peered":"2024-09-07T03:34:20.895399+0000","last_clean":"2024-09-07T03:34:20.895399+0000","last_became_active":"2024-09-07T03:32:22.150168+0000","last_became_peered":"2024-09-07T03:32:22.150168+0000","last_unstale":"2024-09-07T03:34:20.895399+0000","last_undegraded":"2024-09-07T03:34:20.895399+0000","last_fullsized":"2024-09-07T03:34:20.895399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:01:52.113292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985573+0000","last_change":"2024-09-07T03:32:14.111906+0000","last_active":"2024-09-07T03:33:38.985573+0000","last_peered":"2024-09-07T03:33:38.985573+0000","last_clean":"2024-09-07T03:33:38.985573+0000","last_became_active":"2024-09-07T03:32:14.111499+0000","last_became_peered":"2024-09-07T03:32:14.111499+0000","last_unstale":"2024-09-07T03:33:38.985573+0000","last_undegraded":"2024-09-07T03:33:38.985573+0000","last_fullsized":"2024-09-07T03:33:38.985573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:32.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276787+0000","last_change":"2024-09-07T03:32:12.129260+0000","last_active":"2024-09-07T03:32:50.276787+0000","last_peered":"2024-09-07T03:32:50.276787+0000","last_clean":"2024-09-07T03:32:50.276787+0000","last_became_active":"2024-09-07T03:32:12.128737+0000","last_became_peered":"2024-09-07T03:32:12.128737+0000","last_unstale":"2024-09-07T03:32:50.276787+0000","last_undegraded":"2024-09-07T03:32:50.276787+0000","last_fullsized":"2024-09-07T03:32:50.276787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:32.673872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272857+0000","last_change":"2024-09-07T03:32:16.125714+0000","last_active":"2024-09-07T03:32:50.272857+0000","last_peered":"2024-09-07T03:32:50.272857+0000","last_clean":"2024-09-07T03:32:50.272857+0000","last_became_active":"2024-09-07T03:32:16.125418+0000","last_became_peered":"2024-09-07T03:32:16.125418+0000","last_unstale":"2024-09-07T03:32:50.272857+0000","last_undegraded":"2024-09-07T03:32:50.272857+0000","last_fullsized":"2024-09-07T03:32:50.272857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:50:42.403817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.992476+0000","last_change":"2024-09-07T03:32:18.134208+0000","last_active":"2024-09-07T03:35:22.992476+0000","last_peered":"2024-09-07T03:35:22.992476+0000","last_clean":"2024-09-07T03:35:22.992476+0000","last_became_active":"2024-09-07T03:32:18.133770+0000","last_became_peered":"2024-09-07T03:32:18.133770+0000","last_unstale":"2024-09-07T03:35:22.992476+0000","last_undegraded":"2024-09-07T03:35:22.992476+0000","last_fullsized":"2024-09-07T03:35:22.992476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:01:16.182582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276619+0000","last_change":"2024-09-07T03:32:20.142736+0000","last_active":"2024-09-07T03:32:50.276619+0000","last_peered":"2024-09-07T03:32:50.276619+0000","last_clean":"2024-09-07T03:32:50.276619+0000","last_became_active":"2024-09-07T03:32:20.140729+0000","last_became_peered":"2024-09-07T03:32:20.140729+0000","last_unstale":"2024-09-07T03:32:50.276619+0000","last_undegraded":"2024-09-07T03:32:50.276619+0000","last_fullsized":"2024-09-07T03:32:50.276619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:48:10.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471241+0000","last_change":"2024-09-07T03:32:22.147660+0000","last_active":"2024-09-07T03:32:50.471241+0000","last_peered":"2024-09-07T03:32:50.471241+0000","last_clean":"2024-09-07T03:32:50.471241+0000","last_became_active":"2024-09-07T03:32:22.147374+0000","last_became_peered":"2024-09-07T03:32:22.147374+0000","last_unstale":"2024-09-07T03:32:50.471241+0000","last_undegraded":"2024-09-07T03:32:50.471241+0000","last_fullsized":"2024-09-07T03:32:50.471241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:06.728131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843420+0000","last_change":"2024-09-07T03:32:14.123487+0000","last_active":"2024-09-07T03:35:23.843420+0000","last_peered":"2024-09-07T03:35:23.843420+0000","last_clean":"2024-09-07T03:35:23.843420+0000","last_became_active":"2024-09-07T03:32:14.123172+0000","last_became_peered":"2024-09-07T03:32:14.123172+0000","last_unstale":"2024-09-07T03:35:23.843420+0000","last_undegraded":"2024-09-07T03:35:23.843420+0000","last_fullsized":"2024-09-07T03:35:23.843420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.426207+0000","last_change":"2024-09-07T03:32:12.125531+0000","last_active":"2024-09-07T03:34:19.426207+0000","last_peered":"2024-09-07T03:34:19.426207+0000","last_clean":"2024-09-07T03:34:19.426207+0000","last_became_active":"2024-09-07T03:32:12.124180+0000","last_became_peered":"2024-09-07T03:32:12.124180+0000","last_unstale":"2024-09-07T03:34:19.426207+0000","last_undegraded":"2024-09-07T03:34:19.426207+0000","last_fullsized":"2024-09-07T03:34:19.426207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:41.435390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277690+0000","last_change":"2024-09-07T03:32:16.124337+0000","last_active":"2024-09-07T03:32:50.277690+0000","last_peered":"2024-09-07T03:32:50.277690+0000","last_clean":"2024-09-07T03:32:50.277690+0000","last_became_active":"2024-09-07T03:32:16.123695+0000","last_became_peered":"2024-09-07T03:32:16.123695+0000","last_unstale":"2024-09-07T03:32:50.277690+0000","last_undegraded":"2024-09-07T03:32:50.277690+0000","last_fullsized":"2024-09-07T03:32:50.277690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:12:34.370044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'44","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.677944+0000","last_change":"2024-09-07T03:32:18.129794+0000","last_active":"2024-09-07T03:35:30.677944+0000","last_peered":"2024-09-07T03:35:30.677944+0000","last_clean":"2024-09-07T03:35:30.677944+0000","last_became_active":"2024-09-07T03:32:18.129502+0000","last_became_peered":"2024-09-07T03:32:18.129502+0000","last_unstale":"2024-09-07T03:35:30.677944+0000","last_undegraded":"2024-09-07T03:35:30.677944+0000","last_fullsized":"2024-09-07T03:35:30.677944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:35:55.771599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470189+0000","last_change":"2024-09-07T03:32:20.147965+0000","last_active":"2024-09-07T03:32:50.470189+0000","last_peered":"2024-09-07T03:32:50.470189+0000","last_clean":"2024-09-07T03:32:50.470189+0000","last_became_active":"2024-09-07T03:32:20.147588+0000","last_became_peered":"2024-09-07T03:32:20.147588+0000","last_unstale":"2024-09-07T03:32:50.470189+0000","last_undegraded":"2024-09-07T03:32:50.470189+0000","last_fullsized":"2024-09-07T03:32:50.470189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:33:20.522441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.433021+0000","last_change":"2024-09-07T03:32:22.146381+0000","last_active":"2024-09-07T03:34:19.433021+0000","last_peered":"2024-09-07T03:34:19.433021+0000","last_clean":"2024-09-07T03:34:19.433021+0000","last_became_active":"2024-09-07T03:32:22.146106+0000","last_became_peered":"2024-09-07T03:32:22.146106+0000","last_unstale":"2024-09-07T03:34:19.433021+0000","last_undegraded":"2024-09-07T03:34:19.433021+0000","last_fullsized":"2024-09-07T03:34:19.433021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:05:28.655126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.025001+0000","last_change":"2024-09-07T03:32:14.128094+0000","last_active":"2024-09-07T03:32:57.025001+0000","last_peered":"2024-09-07T03:32:57.025001+0000","last_clean":"2024-09-07T03:32:57.025001+0000","last_became_active":"2024-09-07T03:32:14.127334+0000","last_became_peered":"2024-09-07T03:32:14.127334+0000","last_unstale":"2024-09-07T03:32:57.025001+0000","last_undegraded":"2024-09-07T03:32:57.025001+0000","last_fullsized":"2024-09-07T03:32:57.025001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:23:03.931202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472920+0000","last_change":"2024-09-07T03:32:12.138270+0000","last_active":"2024-09-07T03:32:50.472920+0000","last_peered":"2024-09-07T03:32:50.472920+0000","last_clean":"2024-09-07T03:32:50.472920+0000","last_became_active":"2024-09-07T03:32:12.134823+0000","last_became_peered":"2024-09-07T03:32:12.134823+0000","last_unstale":"2024-09-07T03:32:50.472920+0000","last_undegraded":"2024-09-07T03:32:50.472920+0000","last_fullsized":"2024-09-07T03:32:50.472920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:01:11.999538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271764+0000","last_change":"2024-09-07T03:32:16.127981+0000","last_active":"2024-09-07T03:32:50.271764+0000","last_peered":"2024-09-07T03:32:50.271764+0000","last_clean":"2024-09-07T03:32:50.271764+0000","last_became_active":"2024-09-07T03:32:16.127615+0000","last_became_peered":"2024-09-07T03:32:16.127615+0000","last_unstale":"2024-09-07T03:32:50.271764+0000","last_undegraded":"2024-09-07T03:32:50.271764+0000","last_fullsized":"2024-09-07T03:32:50.271764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:04.434836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'35","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.669249+0000","last_change":"2024-09-07T03:32:18.130169+0000","last_active":"2024-09-07T03:35:30.669249+0000","last_peered":"2024-09-07T03:35:30.669249+0000","last_clean":"2024-09-07T03:35:30.669249+0000","last_became_active":"2024-09-07T03:32:18.129919+0000","last_became_peered":"2024-09-07T03:32:18.129919+0000","last_unstale":"2024-09-07T03:35:30.669249+0000","last_undegraded":"2024-09-07T03:35:30.669249+0000","last_fullsized":"2024-09-07T03:35:30.669249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:09.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275040+0000","last_change":"2024-09-07T03:32:20.145306+0000","last_active":"2024-09-07T03:32:50.275040+0000","last_peered":"2024-09-07T03:32:50.275040+0000","last_clean":"2024-09-07T03:32:50.275040+0000","last_became_active":"2024-09-07T03:32:20.143640+0000","last_became_peered":"2024-09-07T03:32:20.143640+0000","last_unstale":"2024-09-07T03:32:50.275040+0000","last_undegraded":"2024-09-07T03:32:50.275040+0000","last_fullsized":"2024-09-07T03:32:50.275040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:24:26.189411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282148+0000","last_change":"2024-09-07T03:32:14.123340+0000","last_active":"2024-09-07T03:32:50.282148+0000","last_peered":"2024-09-07T03:32:50.282148+0000","last_clean":"2024-09-07T03:32:50.282148+0000","last_became_active":"2024-09-07T03:32:14.123017+0000","last_became_peered":"2024-09-07T03:32:14.123017+0000","last_unstale":"2024-09-07T03:32:50.282148+0000","last_undegraded":"2024-09-07T03:32:50.282148+0000","last_fullsized":"2024-09-07T03:32:50.282148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:08.821201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271902+0000","last_change":"2024-09-07T03:32:12.144026+0000","last_active":"2024-09-07T03:32:50.271902+0000","last_peered":"2024-09-07T03:32:50.271902+0000","last_clean":"2024-09-07T03:32:50.271902+0000","last_became_active":"2024-09-07T03:32:12.143142+0000","last_became_peered":"2024-09-07T03:32:12.143142+0000","last_unstale":"2024-09-07T03:32:50.271902+0000","last_undegraded":"2024-09-07T03:32:50.271902+0000","last_fullsized":"2024-09-07T03:32:50.271902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:13:08.497889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471726+0000","last_change":"2024-09-07T03:32:16.124471+0000","last_active":"2024-09-07T03:32:50.471726+0000","last_peered":"2024-09-07T03:32:50.471726+0000","last_clean":"2024-09-07T03:32:50.471726+0000","last_became_active":"2024-09-07T03:32:16.124188+0000","last_became_peered":"2024-09-07T03:32:16.124188+0000","last_unstale":"2024-09-07T03:32:50.471726+0000","last_undegraded":"2024-09-07T03:32:50.471726+0000","last_fullsized":"2024-09-07T03:32:50.471726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:20.601144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'60","reported_seq":123,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.205167+0000","last_change":"2024-09-07T03:32:18.127241+0000","last_active":"2024-09-07T03:34:21.205167+0000","last_peered":"2024-09-07T03:34:21.205167+0000","last_clean":"2024-09-07T03:34:21.205167+0000","last_became_active":"2024-09-07T03:32:18.126946+0000","last_became_peered":"2024-09-07T03:32:18.126946+0000","last_unstale":"2024-09-07T03:34:21.205167+0000","last_undegraded":"2024-09-07T03:34:21.205167+0000","last_fullsized":"2024-09-07T03:34:21.205167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:12:23.096494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275569+0000","last_change":"2024-09-07T03:32:20.144697+0000","last_active":"2024-09-07T03:32:50.275569+0000","last_peered":"2024-09-07T03:32:50.275569+0000","last_clean":"2024-09-07T03:32:50.275569+0000","last_became_active":"2024-09-07T03:32:20.144417+0000","last_became_peered":"2024-09-07T03:32:20.144417+0000","last_unstale":"2024-09-07T03:32:50.275569+0000","last_undegraded":"2024-09-07T03:32:50.275569+0000","last_fullsized":"2024-09-07T03:32:50.275569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:37:54.709062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'16","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.592808+0000","last_change":"2024-09-07T03:32:22.149726+0000","last_active":"2024-09-07T03:35:23.592808+0000","last_peered":"2024-09-07T03:35:23.592808+0000","last_clean":"2024-09-07T03:35:23.592808+0000","last_became_active":"2024-09-07T03:32:22.149442+0000","last_became_peered":"2024-09-07T03:32:22.149442+0000","last_unstale":"2024-09-07T03:35:23.592808+0000","last_undegraded":"2024-09-07T03:35:23.592808+0000","last_fullsized":"2024-09-07T03:35:23.592808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:25.687323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'9","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.849698+0000","last_change":"2024-09-07T03:32:14.114246+0000","last_active":"2024-09-07T03:35:23.849698+0000","last_peered":"2024-09-07T03:35:23.849698+0000","last_clean":"2024-09-07T03:35:23.849698+0000","last_became_active":"2024-09-07T03:32:14.111795+0000","last_became_peered":"2024-09-07T03:32:14.111795+0000","last_unstale":"2024-09-07T03:35:23.849698+0000","last_undegraded":"2024-09-07T03:35:23.849698+0000","last_fullsized":"2024-09-07T03:35:23.849698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:41:31.009147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470018+0000","last_change":"2024-09-07T03:32:12.136641+0000","last_active":"2024-09-07T03:32:50.470018+0000","last_peered":"2024-09-07T03:32:50.470018+0000","last_clean":"2024-09-07T03:32:50.470018+0000","last_became_active":"2024-09-07T03:32:12.136258+0000","last_became_peered":"2024-09-07T03:32:12.136258+0000","last_unstale":"2024-09-07T03:32:50.470018+0000","last_undegraded":"2024-09-07T03:32:50.470018+0000","last_fullsized":"2024-09-07T03:32:50.470018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:19:06.594103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281863+0000","last_change":"2024-09-07T03:32:16.122569+0000","last_active":"2024-09-07T03:32:50.281863+0000","last_peered":"2024-09-07T03:32:50.281863+0000","last_clean":"2024-09-07T03:32:50.281863+0000","last_became_active":"2024-09-07T03:32:16.122316+0000","last_became_peered":"2024-09-07T03:32:16.122316+0000","last_unstale":"2024-09-07T03:32:50.281863+0000","last_undegraded":"2024-09-07T03:32:50.281863+0000","last_fullsized":"2024-09-07T03:32:50.281863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:09:15.334063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.672169+0000","last_change":"2024-09-07T03:32:18.132401+0000","last_active":"2024-09-07T03:35:30.672169+0000","last_peered":"2024-09-07T03:35:30.672169+0000","last_clean":"2024-09-07T03:35:30.672169+0000","last_became_active":"2024-09-07T03:32:18.132084+0000","last_became_peered":"2024-09-07T03:32:18.132084+0000","last_unstale":"2024-09-07T03:35:30.672169+0000","last_undegraded":"2024-09-07T03:35:30.672169+0000","last_fullsized":"2024-09-07T03:35:30.672169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:21:08.328913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471012+0000","last_change":"2024-09-07T03:32:20.143643+0000","last_active":"2024-09-07T03:32:50.471012+0000","last_peered":"2024-09-07T03:32:50.471012+0000","last_clean":"2024-09-07T03:32:50.471012+0000","last_became_active":"2024-09-07T03:32:20.143377+0000","last_became_peered":"2024-09-07T03:32:20.143377+0000","last_unstale":"2024-09-07T03:32:50.471012+0000","last_undegraded":"2024-09-07T03:32:50.471012+0000","last_fullsized":"2024-09-07T03:32:50.471012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:11.431453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278297+0000","last_change":"2024-09-07T03:32:22.146527+0000","last_active":"2024-09-07T03:32:50.278297+0000","last_peered":"2024-09-07T03:32:50.278297+0000","last_clean":"2024-09-07T03:32:50.278297+0000","last_became_active":"2024-09-07T03:32:22.146237+0000","last_became_peered":"2024-09-07T03:32:22.146237+0000","last_unstale":"2024-09-07T03:32:50.278297+0000","last_undegraded":"2024-09-07T03:32:50.278297+0000","last_fullsized":"2024-09-07T03:32:50.278297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:13:05.478773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570991+0000","last_change":"2024-09-07T03:32:14.126016+0000","last_active":"2024-09-07T03:32:56.570991+0000","last_peered":"2024-09-07T03:32:56.570991+0000","last_clean":"2024-09-07T03:32:56.570991+0000","last_became_active":"2024-09-07T03:32:14.125706+0000","last_became_peered":"2024-09-07T03:32:14.125706+0000","last_unstale":"2024-09-07T03:32:56.570991+0000","last_undegraded":"2024-09-07T03:32:56.570991+0000","last_fullsized":"2024-09-07T03:32:56.570991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.726613+0000","last_change":"2024-09-07T03:32:12.126028+0000","last_active":"2024-09-07T03:35:23.726613+0000","last_peered":"2024-09-07T03:35:23.726613+0000","last_clean":"2024-09-07T03:35:23.726613+0000","last_became_active":"2024-09-07T03:32:12.125261+0000","last_became_peered":"2024-09-07T03:32:12.125261+0000","last_unstale":"2024-09-07T03:35:23.726613+0000","last_undegraded":"2024-09-07T03:35:23.726613+0000","last_fullsized":"2024-09-07T03:35:23.726613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:30.313501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280234+0000","last_change":"2024-09-07T03:32:16.124615+0000","last_active":"2024-09-07T03:32:50.280234+0000","last_peered":"2024-09-07T03:32:50.280234+0000","last_clean":"2024-09-07T03:32:50.280234+0000","last_became_active":"2024-09-07T03:32:16.124314+0000","last_became_peered":"2024-09-07T03:32:16.124314+0000","last_unstale":"2024-09-07T03:32:50.280234+0000","last_undegraded":"2024-09-07T03:32:50.280234+0000","last_fullsized":"2024-09-07T03:32:50.280234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:44:43.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'41","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.616251+0000","last_change":"2024-09-07T03:32:18.129996+0000","last_active":"2024-09-07T03:35:30.616251+0000","last_peered":"2024-09-07T03:35:30.616251+0000","last_clean":"2024-09-07T03:35:30.616251+0000","last_became_active":"2024-09-07T03:32:18.129700+0000","last_became_peered":"2024-09-07T03:32:18.129700+0000","last_unstale":"2024-09-07T03:35:30.616251+0000","last_undegraded":"2024-09-07T03:35:30.616251+0000","last_fullsized":"2024-09-07T03:35:30.616251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:38:03.778044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471615+0000","last_change":"2024-09-07T03:32:20.142983+0000","last_active":"2024-09-07T03:32:50.471615+0000","last_peered":"2024-09-07T03:32:50.471615+0000","last_clean":"2024-09-07T03:32:50.471615+0000","last_became_active":"2024-09-07T03:32:20.142695+0000","last_became_peered":"2024-09-07T03:32:20.142695+0000","last_unstale":"2024-09-07T03:32:50.471615+0000","last_undegraded":"2024-09-07T03:32:50.471615+0000","last_fullsized":"2024-09-07T03:32:50.471615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:29.846270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.959036+0000","last_change":"2024-09-07T03:32:22.143270+0000","last_active":"2024-09-07T03:34:22.959036+0000","last_peered":"2024-09-07T03:34:22.959036+0000","last_clean":"2024-09-07T03:34:22.959036+0000","last_became_active":"2024-09-07T03:32:22.143053+0000","last_became_peered":"2024-09-07T03:32:22.143053+0000","last_unstale":"2024-09-07T03:34:22.959036+0000","last_undegraded":"2024-09-07T03:34:22.959036+0000","last_fullsized":"2024-09-07T03:34:22.959036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:05:14.463803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'12","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843581+0000","last_change":"2024-09-07T03:32:14.117890+0000","last_active":"2024-09-07T03:35:23.843581+0000","last_peered":"2024-09-07T03:35:23.843581+0000","last_clean":"2024-09-07T03:35:23.843581+0000","last_became_active":"2024-09-07T03:32:14.117608+0000","last_became_peered":"2024-09-07T03:32:14.117608+0000","last_unstale":"2024-09-07T03:35:23.843581+0000","last_undegraded":"2024-09-07T03:35:23.843581+0000","last_fullsized":"2024-09-07T03:35:23.843581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:50:58.423715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275329+0000","last_change":"2024-09-07T03:32:12.135875+0000","last_active":"2024-09-07T03:32:50.275329+0000","last_peered":"2024-09-07T03:32:50.275329+0000","last_clean":"2024-09-07T03:32:50.275329+0000","last_became_active":"2024-09-07T03:32:12.135523+0000","last_became_peered":"2024-09-07T03:32:12.135523+0000","last_unstale":"2024-09-07T03:32:50.275329+0000","last_undegraded":"2024-09-07T03:32:50.275329+0000","last_fullsized":"2024-09-07T03:32:50.275329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:35.883059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:51.215438+0000","last_change":"2024-09-07T03:32:50.279386+0000","last_active":"2024-09-07T03:32:51.215438+0000","last_peered":"2024-09-07T03:32:51.215438+0000","last_clean":"2024-09-07T03:32:51.215438+0000","last_became_active":"2024-09-07T03:32:50.279004+0000","last_became_peered":"2024-09-07T03:32:50.279004+0000","last_unstale":"2024-09-07T03:32:51.215438+0000","last_undegraded":"2024-09-07T03:32:51.215438+0000","last_fullsized":"2024-09-07T03:32:51.215438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:52.172562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"34'18","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273667+0000","last_change":"2024-09-07T03:32:18.127389+0000","last_active":"2024-09-07T03:32:50.273667+0000","last_peered":"2024-09-07T03:32:50.273667+0000","last_clean":"2024-09-07T03:32:50.273667+0000","last_became_active":"2024-09-07T03:32:18.127007+0000","last_became_peered":"2024-09-07T03:32:18.127007+0000","last_unstale":"2024-09-07T03:32:50.273667+0000","last_undegraded":"2024-09-07T03:32:50.273667+0000","last_fullsized":"2024-09-07T03:32:50.273667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:32:04.955651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":370,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.536750+0000","last_change":"2024-09-07T03:32:20.147075+0000","last_active":"2024-09-07T03:35:30.536750+0000","last_peered":"2024-09-07T03:35:30.536750+0000","last_clean":"2024-09-07T03:35:30.536750+0000","last_became_active":"2024-09-07T03:32:20.146738+0000","last_became_peered":"2024-09-07T03:32:20.146738+0000","last_unstale":"2024-09-07T03:35:30.536750+0000","last_undegraded":"2024-09-07T03:35:30.536750+0000","last_fullsized":"2024-09-07T03:35:30.536750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:39.886530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.568340+0000","last_change":"2024-09-07T03:32:22.151158+0000","last_active":"2024-09-07T03:32:56.568340+0000","last_peered":"2024-09-07T03:32:56.568340+0000","last_clean":"2024-09-07T03:32:56.568340+0000","last_became_active":"2024-09-07T03:32:22.150886+0000","last_became_peered":"2024-09-07T03:32:22.150886+0000","last_unstale":"2024-09-07T03:32:56.568340+0000","last_undegraded":"2024-09-07T03:32:56.568340+0000","last_fullsized":"2024-09-07T03:32:56.568340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:57:06.666886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'18","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843569+0000","last_change":"2024-09-07T03:32:14.127180+0000","last_active":"2024-09-07T03:35:23.843569+0000","last_peered":"2024-09-07T03:35:23.843569+0000","last_clean":"2024-09-07T03:35:23.843569+0000","last_became_active":"2024-09-07T03:32:14.126901+0000","last_became_peered":"2024-09-07T03:32:14.126901+0000","last_unstale":"2024-09-07T03:35:23.843569+0000","last_undegraded":"2024-09-07T03:35:23.843569+0000","last_fullsized":"2024-09-07T03:35:23.843569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:14.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473031+0000","last_change":"2024-09-07T03:32:12.134765+0000","last_active":"2024-09-07T03:32:50.473031+0000","last_peered":"2024-09-07T03:32:50.473031+0000","last_clean":"2024-09-07T03:32:50.473031+0000","last_became_active":"2024-09-07T03:32:12.133876+0000","last_became_peered":"2024-09-07T03:32:12.133876+0000","last_unstale":"2024-09-07T03:32:50.473031+0000","last_undegraded":"2024-09-07T03:32:50.473031+0000","last_fullsized":"2024-09-07T03:32:50.473031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:01.450719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'1","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.297081+0000","last_change":"2024-09-07T03:32:16.122534+0000","last_active":"2024-09-07T03:34:22.297081+0000","last_peered":"2024-09-07T03:34:22.297081+0000","last_clean":"2024-09-07T03:34:22.297081+0000","last_became_active":"2024-09-07T03:32:16.120952+0000","last_became_peered":"2024-09-07T03:32:16.120952+0000","last_unstale":"2024-09-07T03:34:22.297081+0000","last_undegraded":"2024-09-07T03:34:22.297081+0000","last_fullsized":"2024-09-07T03:34:22.297081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:35.686701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'66","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.635641+0000","last_change":"2024-09-07T03:32:18.133969+0000","last_active":"2024-09-07T03:35:30.635641+0000","last_peered":"2024-09-07T03:35:30.635641+0000","last_clean":"2024-09-07T03:35:30.635641+0000","last_became_active":"2024-09-07T03:32:18.133705+0000","last_became_peered":"2024-09-07T03:32:18.133705+0000","last_unstale":"2024-09-07T03:35:30.635641+0000","last_undegraded":"2024-09-07T03:35:30.635641+0000","last_fullsized":"2024-09-07T03:35:30.635641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:02.433602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271613+0000","last_change":"2024-09-07T03:32:20.137011+0000","last_active":"2024-09-07T03:32:50.271613+0000","last_peered":"2024-09-07T03:32:50.271613+0000","last_clean":"2024-09-07T03:32:50.271613+0000","last_became_active":"2024-09-07T03:32:20.135211+0000","last_became_peered":"2024-09-07T03:32:20.135211+0000","last_unstale":"2024-09-07T03:32:50.271613+0000","last_undegraded":"2024-09-07T03:32:50.271613+0000","last_fullsized":"2024-09-07T03:32:50.271613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:33.033993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.028862+0000","last_change":"2024-09-07T03:32:22.141840+0000","last_active":"2024-09-07T03:32:57.028862+0000","last_peered":"2024-09-07T03:32:57.028862+0000","last_clean":"2024-09-07T03:32:57.028862+0000","last_became_active":"2024-09-07T03:32:22.141533+0000","last_became_peered":"2024-09-07T03:32:22.141533+0000","last_unstale":"2024-09-07T03:32:57.028862+0000","last_undegraded":"2024-09-07T03:32:57.028862+0000","last_fullsized":"2024-09-07T03:32:57.028862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:32:37.743868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'20","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806061+0000","last_change":"2024-09-07T03:32:14.123194+0000","last_active":"2024-09-07T03:35:23.806061+0000","last_peered":"2024-09-07T03:35:23.806061+0000","last_clean":"2024-09-07T03:35:23.806061+0000","last_became_active":"2024-09-07T03:32:14.122929+0000","last_became_peered":"2024-09-07T03:32:14.122929+0000","last_unstale":"2024-09-07T03:35:23.806061+0000","last_undegraded":"2024-09-07T03:35:23.806061+0000","last_fullsized":"2024-09-07T03:35:23.806061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:27:08.474145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281523+0000","last_change":"2024-09-07T03:32:12.125302+0000","last_active":"2024-09-07T03:32:50.281523+0000","last_peered":"2024-09-07T03:32:50.281523+0000","last_clean":"2024-09-07T03:32:50.281523+0000","last_became_active":"2024-09-07T03:32:12.124610+0000","last_became_peered":"2024-09-07T03:32:12.124610+0000","last_unstale":"2024-09-07T03:32:50.281523+0000","last_undegraded":"2024-09-07T03:32:50.281523+0000","last_fullsized":"2024-09-07T03:32:50.281523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:41:42.237332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278654+0000","last_change":"2024-09-07T03:32:16.116613+0000","last_active":"2024-09-07T03:32:50.278654+0000","last_peered":"2024-09-07T03:32:50.278654+0000","last_clean":"2024-09-07T03:32:50.278654+0000","last_became_active":"2024-09-07T03:32:16.116296+0000","last_became_peered":"2024-09-07T03:32:16.116296+0000","last_unstale":"2024-09-07T03:32:50.278654+0000","last_undegraded":"2024-09-07T03:32:50.278654+0000","last_fullsized":"2024-09-07T03:32:50.278654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:40:46.166456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'40","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.638598+0000","last_change":"2024-09-07T03:32:18.134892+0000","last_active":"2024-09-07T03:35:30.638598+0000","last_peered":"2024-09-07T03:35:30.638598+0000","last_clean":"2024-09-07T03:35:30.638598+0000","last_became_active":"2024-09-07T03:32:18.134533+0000","last_became_peered":"2024-09-07T03:32:18.134533+0000","last_unstale":"2024-09-07T03:35:30.638598+0000","last_undegraded":"2024-09-07T03:35:30.638598+0000","last_fullsized":"2024-09-07T03:35:30.638598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:15:18.375395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278010+0000","last_change":"2024-09-07T03:32:20.146986+0000","last_active":"2024-09-07T03:32:50.278010+0000","last_peered":"2024-09-07T03:32:50.278010+0000","last_clean":"2024-09-07T03:32:50.278010+0000","last_became_active":"2024-09-07T03:32:20.146631+0000","last_became_peered":"2024-09-07T03:32:20.146631+0000","last_unstale":"2024-09-07T03:32:50.278010+0000","last_undegraded":"2024-09-07T03:32:50.278010+0000","last_fullsized":"2024-09-07T03:32:50.278010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:56.243102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275464+0000","last_change":"2024-09-07T03:32:22.152021+0000","last_active":"2024-09-07T03:32:50.275464+0000","last_peered":"2024-09-07T03:32:50.275464+0000","last_clean":"2024-09-07T03:32:50.275464+0000","last_became_active":"2024-09-07T03:32:22.151709+0000","last_became_peered":"2024-09-07T03:32:22.151709+0000","last_unstale":"2024-09-07T03:32:50.275464+0000","last_undegraded":"2024-09-07T03:32:50.275464+0000","last_fullsized":"2024-09-07T03:32:50.275464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:01.162547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963490+0000","last_change":"2024-09-07T03:32:14.127708+0000","last_active":"2024-09-07T03:34:22.963490+0000","last_peered":"2024-09-07T03:34:22.963490+0000","last_clean":"2024-09-07T03:34:22.963490+0000","last_became_active":"2024-09-07T03:32:14.127451+0000","last_became_peered":"2024-09-07T03:32:14.127451+0000","last_unstale":"2024-09-07T03:34:22.963490+0000","last_undegraded":"2024-09-07T03:34:22.963490+0000","last_fullsized":"2024-09-07T03:34:22.963490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:19.822962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273816+0000","last_change":"2024-09-07T03:32:12.125466+0000","last_active":"2024-09-07T03:32:50.273816+0000","last_peered":"2024-09-07T03:32:50.273816+0000","last_clean":"2024-09-07T03:32:50.273816+0000","last_became_active":"2024-09-07T03:32:12.124552+0000","last_became_peered":"2024-09-07T03:32:12.124552+0000","last_unstale":"2024-09-07T03:32:50.273816+0000","last_undegraded":"2024-09-07T03:32:50.273816+0000","last_fullsized":"2024-09-07T03:32:50.273816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:13:53.582954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469800+0000","last_change":"2024-09-07T03:32:16.125669+0000","last_active":"2024-09-07T03:32:50.469800+0000","last_peered":"2024-09-07T03:32:50.469800+0000","last_clean":"2024-09-07T03:32:50.469800+0000","last_became_active":"2024-09-07T03:32:16.123423+0000","last_became_peered":"2024-09-07T03:32:16.123423+0000","last_unstale":"2024-09-07T03:32:50.469800+0000","last_undegraded":"2024-09-07T03:32:50.469800+0000","last_fullsized":"2024-09-07T03:32:50.469800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:06:37.923895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'35","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.610398+0000","last_change":"2024-09-07T03:32:18.129106+0000","last_active":"2024-09-07T03:35:30.610398+0000","last_peered":"2024-09-07T03:35:30.610398+0000","last_clean":"2024-09-07T03:35:30.610398+0000","last_became_active":"2024-09-07T03:32:18.128812+0000","last_became_peered":"2024-09-07T03:32:18.128812+0000","last_unstale":"2024-09-07T03:35:30.610398+0000","last_undegraded":"2024-09-07T03:35:30.610398+0000","last_fullsized":"2024-09-07T03:35:30.610398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:51.897402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279344+0000","last_change":"2024-09-07T03:32:20.132779+0000","last_active":"2024-09-07T03:32:50.279344+0000","last_peered":"2024-09-07T03:32:50.279344+0000","last_clean":"2024-09-07T03:32:50.279344+0000","last_became_active":"2024-09-07T03:32:20.132396+0000","last_became_peered":"2024-09-07T03:32:20.132396+0000","last_unstale":"2024-09-07T03:32:50.279344+0000","last_undegraded":"2024-09-07T03:32:50.279344+0000","last_fullsized":"2024-09-07T03:32:50.279344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:29:30.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.210747+0000","last_change":"2024-09-07T03:32:22.152253+0000","last_active":"2024-09-07T03:34:21.210747+0000","last_peered":"2024-09-07T03:34:21.210747+0000","last_clean":"2024-09-07T03:34:21.210747+0000","last_became_active":"2024-09-07T03:32:22.151697+0000","last_became_peered":"2024-09-07T03:32:22.151697+0000","last_unstale":"2024-09-07T03:34:21.210747+0000","last_undegraded":"2024-09-07T03:34:21.210747+0000","last_fullsized":"2024-09-07T03:34:21.210747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:12:47.655977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806035+0000","last_change":"2024-09-07T03:32:14.113037+0000","last_active":"2024-09-07T03:35:23.806035+0000","last_peered":"2024-09-07T03:35:23.806035+0000","last_clean":"2024-09-07T03:35:23.806035+0000","last_became_active":"2024-09-07T03:32:14.112336+0000","last_became_peered":"2024-09-07T03:32:14.112336+0000","last_unstale":"2024-09-07T03:35:23.806035+0000","last_undegraded":"2024-09-07T03:35:23.806035+0000","last_fullsized":"2024-09-07T03:35:23.806035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.767629+0000","last_change":"2024-09-07T03:32:12.138565+0000","last_active":"2024-09-07T03:34:22.767629+0000","last_peered":"2024-09-07T03:34:22.767629+0000","last_clean":"2024-09-07T03:34:22.767629+0000","last_became_active":"2024-09-07T03:32:12.136020+0000","last_became_peered":"2024-09-07T03:32:12.136020+0000","last_unstale":"2024-09-07T03:34:22.767629+0000","last_undegraded":"2024-09-07T03:34:22.767629+0000","last_fullsized":"2024-09-07T03:34:22.767629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:57:08.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.817388+0000","last_change":"2024-09-07T03:32:16.129863+0000","last_active":"2024-09-07T03:34:19.817388+0000","last_peered":"2024-09-07T03:34:19.817388+0000","last_clean":"2024-09-07T03:34:19.817388+0000","last_became_active":"2024-09-07T03:32:16.129161+0000","last_became_peered":"2024-09-07T03:32:16.129161+0000","last_unstale":"2024-09-07T03:34:19.817388+0000","last_undegraded":"2024-09-07T03:34:19.817388+0000","last_fullsized":"2024-09-07T03:34:19.817388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:08:23.197757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'48","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.619879+0000","last_change":"2024-09-07T03:32:18.132380+0000","last_active":"2024-09-07T03:35:30.619879+0000","last_peered":"2024-09-07T03:35:30.619879+0000","last_clean":"2024-09-07T03:35:30.619879+0000","last_became_active":"2024-09-07T03:32:18.132072+0000","last_became_peered":"2024-09-07T03:32:18.132072+0000","last_unstale":"2024-09-07T03:35:30.619879+0000","last_undegraded":"2024-09-07T03:35:30.619879+0000","last_fullsized":"2024-09-07T03:35:30.619879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:37.568436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274904+0000","last_change":"2024-09-07T03:32:20.145649+0000","last_active":"2024-09-07T03:32:50.274904+0000","last_peered":"2024-09-07T03:32:50.274904+0000","last_clean":"2024-09-07T03:32:50.274904+0000","last_became_active":"2024-09-07T03:32:20.144977+0000","last_became_peered":"2024-09-07T03:32:20.144977+0000","last_unstale":"2024-09-07T03:32:50.274904+0000","last_undegraded":"2024-09-07T03:32:50.274904+0000","last_fullsized":"2024-09-07T03:32:50.274904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:56.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.213631+0000","last_change":"2024-09-07T03:32:22.141987+0000","last_active":"2024-09-07T03:34:21.213631+0000","last_peered":"2024-09-07T03:34:21.213631+0000","last_clean":"2024-09-07T03:34:21.213631+0000","last_became_active":"2024-09-07T03:32:22.141633+0000","last_became_peered":"2024-09-07T03:32:22.141633+0000","last_unstale":"2024-09-07T03:34:21.213631+0000","last_undegraded":"2024-09-07T03:34:21.213631+0000","last_fullsized":"2024-09-07T03:34:21.213631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:45.392294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.478248+0000","last_change":"2024-09-07T03:32:14.114021+0000","last_active":"2024-09-07T03:35:23.478248+0000","last_peered":"2024-09-07T03:35:23.478248+0000","last_clean":"2024-09-07T03:35:23.478248+0000","last_became_active":"2024-09-07T03:32:14.111950+0000","last_became_peered":"2024-09-07T03:32:14.111950+0000","last_unstale":"2024-09-07T03:35:23.478248+0000","last_undegraded":"2024-09-07T03:35:23.478248+0000","last_fullsized":"2024-09-07T03:35:23.478248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:42:20.068850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274043+0000","last_change":"2024-09-07T03:32:12.133214+0000","last_active":"2024-09-07T03:32:50.274043+0000","last_peered":"2024-09-07T03:32:50.274043+0000","last_clean":"2024-09-07T03:32:50.274043+0000","last_became_active":"2024-09-07T03:32:12.132814+0000","last_became_peered":"2024-09-07T03:32:12.132814+0000","last_unstale":"2024-09-07T03:32:50.274043+0000","last_undegraded":"2024-09-07T03:32:50.274043+0000","last_fullsized":"2024-09-07T03:32:50.274043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:53.987362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843863+0000","last_change":"2024-09-07T03:32:14.115342+0000","last_active":"2024-09-07T03:35:23.843863+0000","last_peered":"2024-09-07T03:35:23.843863+0000","last_clean":"2024-09-07T03:35:23.843863+0000","last_became_active":"2024-09-07T03:32:14.114966+0000","last_became_peered":"2024-09-07T03:32:14.114966+0000","last_unstale":"2024-09-07T03:35:23.843863+0000","last_undegraded":"2024-09-07T03:35:23.843863+0000","last_fullsized":"2024-09-07T03:35:23.843863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:07:27.478728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.346800+0000","last_change":"2024-09-07T03:32:12.134634+0000","last_active":"2024-09-07T03:35:23.346800+0000","last_peered":"2024-09-07T03:35:23.346800+0000","last_clean":"2024-09-07T03:35:23.346800+0000","last_became_active":"2024-09-07T03:32:12.132662+0000","last_became_peered":"2024-09-07T03:32:12.132662+0000","last_unstale":"2024-09-07T03:35:23.346800+0000","last_undegraded":"2024-09-07T03:35:23.346800+0000","last_fullsized":"2024-09-07T03:35:23.346800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:00:50.432167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.739589+0000","last_change":"2024-09-07T03:32:14.122593+0000","last_active":"2024-09-07T03:35:23.739589+0000","last_peered":"2024-09-07T03:35:23.739589+0000","last_clean":"2024-09-07T03:35:23.739589+0000","last_became_active":"2024-09-07T03:32:14.122301+0000","last_became_peered":"2024-09-07T03:32:14.122301+0000","last_unstale":"2024-09-07T03:35:23.739589+0000","last_undegraded":"2024-09-07T03:35:23.739589+0000","last_fullsized":"2024-09-07T03:35:23.739589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272108+0000","last_change":"2024-09-07T03:32:12.138037+0000","last_active":"2024-09-07T03:32:50.272108+0000","last_peered":"2024-09-07T03:32:50.272108+0000","last_clean":"2024-09-07T03:32:50.272108+0000","last_became_active":"2024-09-07T03:32:12.137561+0000","last_became_peered":"2024-09-07T03:32:12.137561+0000","last_unstale":"2024-09-07T03:32:50.272108+0000","last_undegraded":"2024-09-07T03:32:50.272108+0000","last_fullsized":"2024-09-07T03:32:50.272108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:59.055476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435902+0000","last_change":"2024-09-07T03:32:14.114337+0000","last_active":"2024-09-07T03:34:19.435902+0000","last_peered":"2024-09-07T03:34:19.435902+0000","last_clean":"2024-09-07T03:34:19.435902+0000","last_became_active":"2024-09-07T03:32:14.114055+0000","last_became_peered":"2024-09-07T03:32:14.114055+0000","last_unstale":"2024-09-07T03:34:19.435902+0000","last_undegraded":"2024-09-07T03:34:19.435902+0000","last_fullsized":"2024-09-07T03:34:19.435902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:55:05.807784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.728015+0000","last_change":"2024-09-07T03:32:12.132824+0000","last_active":"2024-09-07T03:34:22.728015+0000","last_peered":"2024-09-07T03:34:22.728015+0000","last_clean":"2024-09-07T03:34:22.728015+0000","last_became_active":"2024-09-07T03:32:12.132471+0000","last_became_peered":"2024-09-07T03:32:12.132471+0000","last_unstale":"2024-09-07T03:34:22.728015+0000","last_undegraded":"2024-09-07T03:34:22.728015+0000","last_fullsized":"2024-09-07T03:34:22.728015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:04:57.476630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803876+0000","last_change":"2024-09-07T03:32:50.285566+0000","last_active":"2024-09-07T03:35:23.803876+0000","last_peered":"2024-09-07T03:35:23.803876+0000","last_clean":"2024-09-07T03:35:23.803876+0000","last_became_active":"2024-09-07T03:32:50.280656+0000","last_became_peered":"2024-09-07T03:32:50.280656+0000","last_unstale":"2024-09-07T03:35:23.803876+0000","last_undegraded":"2024-09-07T03:35:23.803876+0000","last_fullsized":"2024-09-07T03:35:23.803876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:19:49.958031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.429207+0000","last_change":"2024-09-07T03:32:12.140756+0000","last_active":"2024-09-07T03:32:55.429207+0000","last_peered":"2024-09-07T03:32:55.429207+0000","last_clean":"2024-09-07T03:32:55.429207+0000","last_became_active":"2024-09-07T03:32:12.140393+0000","last_became_peered":"2024-09-07T03:32:12.140393+0000","last_unstale":"2024-09-07T03:32:55.429207+0000","last_undegraded":"2024-09-07T03:32:55.429207+0000","last_fullsized":"2024-09-07T03:32:55.429207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:23.691202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"36'10","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803631+0000","last_change":"2024-09-07T03:32:14.114468+0000","last_active":"2024-09-07T03:35:23.803631+0000","last_peered":"2024-09-07T03:35:23.803631+0000","last_clean":"2024-09-07T03:35:23.803631+0000","last_became_active":"2024-09-07T03:32:14.113830+0000","last_became_peered":"2024-09-07T03:32:14.113830+0000","last_unstale":"2024-09-07T03:35:23.803631+0000","last_undegraded":"2024-09-07T03:35:23.803631+0000","last_fullsized":"2024-09-07T03:35:23.803631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:00.736940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471745+0000","last_change":"2024-09-07T03:32:12.134769+0000","last_active":"2024-09-07T03:32:50.471745+0000","last_peered":"2024-09-07T03:32:50.471745+0000","last_clean":"2024-09-07T03:32:50.471745+0000","last_became_active":"2024-09-07T03:32:12.134287+0000","last_became_peered":"2024-09-07T03:32:12.134287+0000","last_unstale":"2024-09-07T03:32:50.471745+0000","last_undegraded":"2024-09-07T03:32:50.471745+0000","last_fullsized":"2024-09-07T03:32:50.471745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:29:37.829617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'17","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228255+0000","last_change":"2024-09-07T03:32:14.126278+0000","last_active":"2024-09-07T03:34:21.228255+0000","last_peered":"2024-09-07T03:34:21.228255+0000","last_clean":"2024-09-07T03:34:21.228255+0000","last_became_active":"2024-09-07T03:32:14.125990+0000","last_became_peered":"2024-09-07T03:32:14.125990+0000","last_unstale":"2024-09-07T03:34:21.228255+0000","last_undegraded":"2024-09-07T03:34:21.228255+0000","last_fullsized":"2024-09-07T03:34:21.228255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:31:20.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278552+0000","last_change":"2024-09-07T03:32:12.129933+0000","last_active":"2024-09-07T03:32:50.278552+0000","last_peered":"2024-09-07T03:32:50.278552+0000","last_clean":"2024-09-07T03:32:50.278552+0000","last_became_active":"2024-09-07T03:32:12.128807+0000","last_became_peered":"2024-09-07T03:32:12.128807+0000","last_unstale":"2024-09-07T03:32:50.278552+0000","last_undegraded":"2024-09-07T03:32:50.278552+0000","last_fullsized":"2024-09-07T03:32:50.278552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:14:03.821714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806043+0000","last_change":"2024-09-07T03:32:14.110088+0000","last_active":"2024-09-07T03:35:23.806043+0000","last_peered":"2024-09-07T03:35:23.806043+0000","last_clean":"2024-09-07T03:35:23.806043+0000","last_became_active":"2024-09-07T03:32:14.109799+0000","last_became_peered":"2024-09-07T03:32:14.109799+0000","last_unstale":"2024-09-07T03:35:23.806043+0000","last_undegraded":"2024-09-07T03:35:23.806043+0000","last_fullsized":"2024-09-07T03:35:23.806043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276544+0000","last_change":"2024-09-07T03:32:12.131240+0000","last_active":"2024-09-07T03:32:50.276544+0000","last_peered":"2024-09-07T03:32:50.276544+0000","last_clean":"2024-09-07T03:32:50.276544+0000","last_became_active":"2024-09-07T03:32:12.130563+0000","last_became_peered":"2024-09-07T03:32:12.130563+0000","last_unstale":"2024-09-07T03:32:50.276544+0000","last_undegraded":"2024-09-07T03:32:50.276544+0000","last_fullsized":"2024-09-07T03:32:50.276544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:35.973387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806088+0000","last_change":"2024-09-07T03:32:14.115326+0000","last_active":"2024-09-07T03:35:23.806088+0000","last_peered":"2024-09-07T03:35:23.806088+0000","last_clean":"2024-09-07T03:35:23.806088+0000","last_became_active":"2024-09-07T03:32:14.115000+0000","last_became_peered":"2024-09-07T03:32:14.115000+0000","last_unstale":"2024-09-07T03:35:23.806088+0000","last_undegraded":"2024-09-07T03:35:23.806088+0000","last_fullsized":"2024-09-07T03:35:23.806088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:20.852806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272042+0000","last_change":"2024-09-07T03:32:12.142672+0000","last_active":"2024-09-07T03:32:50.272042+0000","last_peered":"2024-09-07T03:32:50.272042+0000","last_clean":"2024-09-07T03:32:50.272042+0000","last_became_active":"2024-09-07T03:32:12.142315+0000","last_became_peered":"2024-09-07T03:32:12.142315+0000","last_unstale":"2024-09-07T03:32:50.272042+0000","last_undegraded":"2024-09-07T03:32:50.272042+0000","last_fullsized":"2024-09-07T03:32:50.272042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:04:31.049755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276218+0000","last_change":"2024-09-07T03:32:14.127846+0000","last_active":"2024-09-07T03:32:50.276218+0000","last_peered":"2024-09-07T03:32:50.276218+0000","last_clean":"2024-09-07T03:32:50.276218+0000","last_became_active":"2024-09-07T03:32:14.127560+0000","last_became_peered":"2024-09-07T03:32:14.127560+0000","last_unstale":"2024-09-07T03:32:50.276218+0000","last_undegraded":"2024-09-07T03:32:50.276218+0000","last_fullsized":"2024-09-07T03:32:50.276218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432265+0000","last_change":"2024-09-07T03:32:12.139702+0000","last_active":"2024-09-07T03:32:55.432265+0000","last_peered":"2024-09-07T03:32:55.432265+0000","last_clean":"2024-09-07T03:32:55.432265+0000","last_became_active":"2024-09-07T03:32:12.138745+0000","last_became_peered":"2024-09-07T03:32:12.138745+0000","last_unstale":"2024-09-07T03:32:55.432265+0000","last_undegraded":"2024-09-07T03:32:55.432265+0000","last_fullsized":"2024-09-07T03:32:55.432265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:58:53.427065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.805976+0000","last_change":"2024-09-07T03:32:14.123012+0000","last_active":"2024-09-07T03:35:23.805976+0000","last_peered":"2024-09-07T03:35:23.805976+0000","last_clean":"2024-09-07T03:35:23.805976+0000","last_became_active":"2024-09-07T03:32:14.122699+0000","last_became_peered":"2024-09-07T03:32:14.122699+0000","last_unstale":"2024-09-07T03:35:23.805976+0000","last_undegraded":"2024-09-07T03:35:23.805976+0000","last_fullsized":"2024-09-07T03:35:23.805976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:12.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280233+0000","last_change":"2024-09-07T03:32:12.133952+0000","last_active":"2024-09-07T03:32:50.280233+0000","last_peered":"2024-09-07T03:32:50.280233+0000","last_clean":"2024-09-07T03:32:50.280233+0000","last_became_active":"2024-09-07T03:32:12.133145+0000","last_became_peered":"2024-09-07T03:32:12.133145+0000","last_unstale":"2024-09-07T03:32:50.280233+0000","last_undegraded":"2024-09-07T03:32:50.280233+0000","last_fullsized":"2024-09-07T03:32:50.280233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:02.480411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"36'16","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587715+0000","last_change":"2024-09-07T03:32:14.112126+0000","last_active":"2024-09-07T03:35:23.587715+0000","last_peered":"2024-09-07T03:35:23.587715+0000","last_clean":"2024-09-07T03:35:23.587715+0000","last_became_active":"2024-09-07T03:32:14.111759+0000","last_became_peered":"2024-09-07T03:32:14.111759+0000","last_unstale":"2024-09-07T03:35:23.587715+0000","last_undegraded":"2024-09-07T03:35:23.587715+0000","last_fullsized":"2024-09-07T03:35:23.587715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:14.003758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":44,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'1","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230117+0000","last_change":"2024-09-07T03:32:12.134868+0000","last_active":"2024-09-07T03:34:28.230117+0000","last_peered":"2024-09-07T03:34:28.230117+0000","last_clean":"2024-09-07T03:34:28.230117+0000","last_became_active":"2024-09-07T03:32:12.134151+0000","last_became_peered":"2024-09-07T03:32:12.134151+0000","last_unstale":"2024-09-07T03:34:28.230117+0000","last_undegraded":"2024-09-07T03:34:28.230117+0000","last_fullsized":"2024-09-07T03:34:28.230117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:08:24.817906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'30","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731159+0000","last_change":"2024-09-07T03:32:14.124493+0000","last_active":"2024-09-07T03:35:23.731159+0000","last_peered":"2024-09-07T03:35:23.731159+0000","last_clean":"2024-09-07T03:35:23.731159+0000","last_became_active":"2024-09-07T03:32:14.124258+0000","last_became_peered":"2024-09-07T03:32:14.124258+0000","last_unstale":"2024-09-07T03:35:23.731159+0000","last_undegraded":"2024-09-07T03:35:23.731159+0000","last_fullsized":"2024-09-07T03:35:23.731159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":111,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273399+0000","last_change":"2024-09-07T03:32:12.140618+0000","last_active":"2024-09-07T03:32:50.273399+0000","last_peered":"2024-09-07T03:32:50.273399+0000","last_clean":"2024-09-07T03:32:50.273399+0000","last_became_active":"2024-09-07T03:32:12.140243+0000","last_became_peered":"2024-09-07T03:32:12.140243+0000","last_unstale":"2024-09-07T03:32:50.273399+0000","last_undegraded":"2024-09-07T03:32:50.273399+0000","last_fullsized":"2024-09-07T03:32:50.273399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:41.435390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570857+0000","last_change":"2024-09-07T03:32:14.113597+0000","last_active":"2024-09-07T03:32:56.570857+0000","last_peered":"2024-09-07T03:32:56.570857+0000","last_clean":"2024-09-07T03:32:56.570857+0000","last_became_active":"2024-09-07T03:32:14.113016+0000","last_became_peered":"2024-09-07T03:32:14.113016+0000","last_unstale":"2024-09-07T03:32:56.570857+0000","last_undegraded":"2024-09-07T03:32:56.570857+0000","last_fullsized":"2024-09-07T03:32:56.570857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:38:17.720862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272704+0000","last_change":"2024-09-07T03:32:12.136273+0000","last_active":"2024-09-07T03:32:50.272704+0000","last_peered":"2024-09-07T03:32:50.272704+0000","last_clean":"2024-09-07T03:32:50.272704+0000","last_became_active":"2024-09-07T03:32:12.135936+0000","last_became_peered":"2024-09-07T03:32:12.135936+0000","last_unstale":"2024-09-07T03:32:50.272704+0000","last_undegraded":"2024-09-07T03:32:50.272704+0000","last_fullsized":"2024-09-07T03:32:50.272704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:55.875414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731153+0000","last_change":"2024-09-07T03:32:14.128701+0000","last_active":"2024-09-07T03:35:23.731153+0000","last_peered":"2024-09-07T03:35:23.731153+0000","last_clean":"2024-09-07T03:35:23.731153+0000","last_became_active":"2024-09-07T03:32:14.127982+0000","last_became_peered":"2024-09-07T03:32:14.127982+0000","last_unstale":"2024-09-07T03:35:23.731153+0000","last_undegraded":"2024-09-07T03:35:23.731153+0000","last_fullsized":"2024-09-07T03:35:23.731153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278674+0000","last_change":"2024-09-07T03:32:12.134111+0000","last_active":"2024-09-07T03:32:50.278674+0000","last_peered":"2024-09-07T03:32:50.278674+0000","last_clean":"2024-09-07T03:32:50.278674+0000","last_became_active":"2024-09-07T03:32:12.133720+0000","last_became_peered":"2024-09-07T03:32:12.133720+0000","last_unstale":"2024-09-07T03:32:50.278674+0000","last_undegraded":"2024-09-07T03:32:50.278674+0000","last_fullsized":"2024-09-07T03:32:50.278674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:57:03.239693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843615+0000","last_change":"2024-09-07T03:32:14.124677+0000","last_active":"2024-09-07T03:35:23.843615+0000","last_peered":"2024-09-07T03:35:23.843615+0000","last_clean":"2024-09-07T03:35:23.843615+0000","last_became_active":"2024-09-07T03:32:14.124462+0000","last_became_peered":"2024-09-07T03:32:14.124462+0000","last_unstale":"2024-09-07T03:35:23.843615+0000","last_undegraded":"2024-09-07T03:35:23.843615+0000","last_fullsized":"2024-09-07T03:35:23.843615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.907020+0000","last_change":"2024-09-07T03:32:12.141303+0000","last_active":"2024-09-07T03:34:22.907020+0000","last_peered":"2024-09-07T03:34:22.907020+0000","last_clean":"2024-09-07T03:34:22.907020+0000","last_became_active":"2024-09-07T03:32:12.140957+0000","last_became_peered":"2024-09-07T03:32:12.140957+0000","last_unstale":"2024-09-07T03:34:22.907020+0000","last_undegraded":"2024-09-07T03:34:22.907020+0000","last_fullsized":"2024-09-07T03:34:22.907020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:19:10.920973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278119+0000","last_change":"2024-09-07T03:32:12.133925+0000","last_active":"2024-09-07T03:32:50.278119+0000","last_peered":"2024-09-07T03:32:50.278119+0000","last_clean":"2024-09-07T03:32:50.278119+0000","last_became_active":"2024-09-07T03:32:12.133460+0000","last_became_peered":"2024-09-07T03:32:12.133460+0000","last_unstale":"2024-09-07T03:32:50.278119+0000","last_undegraded":"2024-09-07T03:32:50.278119+0000","last_fullsized":"2024-09-07T03:32:50.278119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:50:56.419019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435937+0000","last_change":"2024-09-07T03:32:14.123815+0000","last_active":"2024-09-07T03:34:19.435937+0000","last_peered":"2024-09-07T03:34:19.435937+0000","last_clean":"2024-09-07T03:34:19.435937+0000","last_became_active":"2024-09-07T03:32:14.123554+0000","last_became_peered":"2024-09-07T03:32:14.123554+0000","last_unstale":"2024-09-07T03:34:19.435937+0000","last_undegraded":"2024-09-07T03:34:19.435937+0000","last_fullsized":"2024-09-07T03:34:19.435937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:12:13.928369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470165+0000","last_change":"2024-09-07T03:32:12.135828+0000","last_active":"2024-09-07T03:32:50.470165+0000","last_peered":"2024-09-07T03:32:50.470165+0000","last_clean":"2024-09-07T03:32:50.470165+0000","last_became_active":"2024-09-07T03:32:12.134650+0000","last_became_peered":"2024-09-07T03:32:12.134650+0000","last_unstale":"2024-09-07T03:32:50.470165+0000","last_undegraded":"2024-09-07T03:32:50.470165+0000","last_fullsized":"2024-09-07T03:32:50.470165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:30:53.762992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843565+0000","last_change":"2024-09-07T03:32:14.127747+0000","last_active":"2024-09-07T03:35:23.843565+0000","last_peered":"2024-09-07T03:35:23.843565+0000","last_clean":"2024-09-07T03:35:23.843565+0000","last_became_active":"2024-09-07T03:32:14.127493+0000","last_became_peered":"2024-09-07T03:32:14.127493+0000","last_unstale":"2024-09-07T03:35:23.843565+0000","last_undegraded":"2024-09-07T03:35:23.843565+0000","last_fullsized":"2024-09-07T03:35:23.843565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:45:11.748356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2277,"ondisk_log_size":2277,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1844,"num_read_kb":1609,"num_write":777,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1547,"ondisk_log_size":1547,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":969,"num_read_kb":969,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1666,"num_read_kb":1556,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":87,"num_write":314,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":450560,"data_stored":155820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640304,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1007616,"data_stored":744671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640304,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":507904,"data_stored":158016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48964,"kb_used_data":9460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322876,"statfs":{"total":96636764160,"available":96586625024,"internally_reserved":0,"allocated":9687040,"data_stored":9353945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:35:31.752 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-07T03:35:31.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.871+0000 7f8698ceb640 1 Processor -- start 2024-09-07T03:35:31.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.871+0000 7f8698ceb640 1 -- start start 2024-09-07T03:35:31.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.872+0000 7f8698ceb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8694130270 0x7f8694132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:31.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.872+0000 7f8698ceb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f869406dc00 con 0x7f8694129d80 2024-09-07T03:35:31.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.872+0000 7f8698ceb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f86941299c0 con 0x7f8694130270 2024-09-07T03:35:31.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.872+0000 7f8691d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8694130270 0x7f8694132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:31.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.872+0000 7f869259c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8694129d80 0x7f869412a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57226/0 (socket says 172.21.15.104:57226) 2024-09-07T03:35:31.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.872+0000 7f869259c640 1 -- 172.21.15.104:0/502287567 learned_addr learned my addr 172.21.15.104:0/502287567 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:31.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.872+0000 7f8691d9b640 1 -- 172.21.15.104:0/502287567 >> v1:172.21.15.104:6789/0 conn(0x7f8694129d80 legacy=0x7f869412a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.873+0000 7f8691d9b640 1 -- 172.21.15.104:0/502287567 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869412a870 con 0x7f8694130270 2024-09-07T03:35:31.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.872+0000 7f869159a640 1 -- 172.21.15.104:0/502287567 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709382899 0 0) 0x7f869406dc00 con 0x7f8694129d80 2024-09-07T03:35:31.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.873+0000 7f8691d9b640 1 --2- 172.21.15.104:0/502287567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694130270 0x7f8694132660 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f867c009720 tx=0x7f867c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ed950897f426d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:31.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.873+0000 7f869159a640 1 -- 172.21.15.104:0/502287567 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c037070 con 0x7f8694130270 2024-09-07T03:35:31.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.873+0000 7f869159a640 1 -- 172.21.15.104:0/502287567 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867c02ad90 con 0x7f8694130270 2024-09-07T03:35:31.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.873+0000 7f869159a640 1 -- 172.21.15.104:0/502287567 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c032590 con 0x7f8694130270 2024-09-07T03:35:31.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.874+0000 7f8698ceb640 1 -- 172.21.15.104:0/502287567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694130270 msgr2=0x7f8694132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:31.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.874+0000 7f8698ceb640 1 --2- 172.21.15.104:0/502287567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694130270 0x7f8694132660 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f867c009720 tx=0x7f867c02a110 comp rx=0 tx=0).stop 2024-09-07T03:35:31.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.874+0000 7f8698ceb640 1 -- 172.21.15.104:0/502287567 shutdown_connections 2024-09-07T03:35:31.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.874+0000 7f8698ceb640 1 --2- 172.21.15.104:0/502287567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694130270 0x7f8694132660 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:31.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.874+0000 7f8698ceb640 1 -- 172.21.15.104:0/502287567 >> 172.21.15.104:0/502287567 conn(0x7f8694070850 msgr2=0x7f8694072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:31.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.874+0000 7f8698ceb640 1 -- 172.21.15.104:0/502287567 shutdown_connections 2024-09-07T03:35:31.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.874+0000 7f8698ceb640 1 -- 172.21.15.104:0/502287567 wait complete. 2024-09-07T03:35:31.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.875+0000 7f8698ceb640 1 Processor -- start 2024-09-07T03:35:31.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.875+0000 7f8698ceb640 1 -- start start 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.875+0000 7f8698ceb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694129d80 0x7f8694115030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.875+0000 7f8698ceb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8694073a10 con 0x7f8694129d80 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.875+0000 7f869259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694129d80 0x7f8694115030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.875+0000 7f869259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694129d80 0x7f8694115030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50650/0 (socket says 172.21.15.104:50650) 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.875+0000 7f869259c640 1 -- 172.21.15.104:0/3850939986 learned_addr learned my addr 172.21.15.104:0/3850939986 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.876+0000 7f869259c640 1 -- 172.21.15.104:0/3850939986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8694117300 con 0x7f8694129d80 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.876+0000 7f869259c640 1 --2- 172.21.15.104:0/3850939986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694129d80 0x7f8694115030 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f868400c3d0 tx=0x7f868400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.876+0000 7f868affd640 1 -- 172.21.15.104:0/3850939986 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86840074d0 con 0x7f8694129d80 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.876+0000 7f868affd640 1 -- 172.21.15.104:0/3850939986 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86840047e0 con 0x7f8694129d80 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.876+0000 7f868affd640 1 -- 172.21.15.104:0/3850939986 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8684007670 con 0x7f8694129d80 2024-09-07T03:35:31.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.876+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8694116e00 con 0x7f8694129d80 2024-09-07T03:35:31.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.876+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8694126930 con 0x7f8694129d80 2024-09-07T03:35:31.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.877+0000 7f868affd640 1 -- 172.21.15.104:0/3850939986 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8684011070 con 0x7f8694129d80 2024-09-07T03:35:31.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.877+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f869412a160 con 0x7f8694129d80 2024-09-07T03:35:31.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.877+0000 7f868affd640 1 --2- 172.21.15.104:0/3850939986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f867403dec0 0x7f8674040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:31.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.877+0000 7f868affd640 1 -- 172.21.15.104:0/3850939986 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f86840528e0 con 0x7f8694129d80 2024-09-07T03:35:31.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.877+0000 7f8691d9b640 1 --2- 172.21.15.104:0/3850939986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f867403dec0 0x7f8674040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:31.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.878+0000 7f8691d9b640 1 --2- 172.21.15.104:0/3850939986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f867403dec0 0x7f8674040380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f867c034000 tx=0x7f867c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:31.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:31.881+0000 7f868affd640 1 -- 172.21.15.104:0/3850939986 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f8684012dd0 con 0x7f8694129d80 2024-09-07T03:35:32.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.055+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8694068da0 con 0x7f8694129d80 2024-09-07T03:35:32.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.056+0000 7f868affd640 1 -- 172.21.15.104:0/3850939986 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21206 (secure 0 0 0) 0x7f8684010d40 con 0x7f8694129d80 2024-09-07T03:35:32.058 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:35:32.058 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":36,"fsid":"ccd99612-983c-4850-93dd-2abdd870e9cd","created":"2024-09-07T03:31:45.098670+0000","modified":"2024-09-07T03:32:50.268584+0000","last_up_change":"2024-09-07T03:31:55.439585+0000","last_in_change":"2024-09-07T03:31:46.143995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-07T03:31:57.213085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-07T03:32:00.591976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-07T03:32:10.089859+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-07T03:32:12.418100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-07T03:32:14.383096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-07T03:32:16.192076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-07T03:32:18.133651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-07T03:32:20.224920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49009fa6-ab2b-4a54-839c-a8e81abf5b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6801","nonce":182397107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6803","nonce":182397107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6807","nonce":182397107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":182397107},{"type":"v1","addr":"172.21.15.104:6805","nonce":182397107}]},"public_addr":"172.21.15.104:6801/182397107","cluster_addr":"172.21.15.104:6803/182397107","heartbeat_back_addr":"172.21.15.104:6807/182397107","heartbeat_front_addr":"172.21.15.104:6805/182397107","state":["exists","up"]},{"osd":1,"uuid":"797a0187-6388-4317-a7ba-79a25f6c7f5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6810","nonce":3372043485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6814","nonce":3372043485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6822","nonce":3372043485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3372043485},{"type":"v1","addr":"172.21.15.120:6818","nonce":3372043485}]},"public_addr":"172.21.15.120:6810/3372043485","cluster_addr":"172.21.15.120:6814/3372043485","heartbeat_back_addr":"172.21.15.120:6822/3372043485","heartbeat_front_addr":"172.21.15.120:6818/3372043485","state":["exists","up"]},{"osd":2,"uuid":"df79cbe9-eaa6-45e9-ba4a-0e5f7f43d03e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6811","nonce":3781833098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6815","nonce":3781833098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6823","nonce":3781833098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":3781833098},{"type":"v1","addr":"172.21.15.120:6819","nonce":3781833098}]},"public_addr":"172.21.15.120:6811/3781833098","cluster_addr":"172.21.15.120:6815/3781833098","heartbeat_back_addr":"172.21.15.120:6823/3781833098","heartbeat_front_addr":"172.21.15.120:6819/3781833098","state":["exists","up"]},{"osd":3,"uuid":"582a1603-a3e0-4712-ab2e-e3233e9a1d60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6801","nonce":1193158925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6803","nonce":1193158925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6807","nonce":1193158925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1193158925},{"type":"v1","addr":"172.21.15.120:6805","nonce":1193158925}]},"public_addr":"172.21.15.120:6801/1193158925","cluster_addr":"172.21.15.120:6803/1193158925","heartbeat_back_addr":"172.21.15.120:6807/1193158925","heartbeat_front_addr":"172.21.15.120:6805/1193158925","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.299631+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.192229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.483211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-07T03:31:52.308063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":2}]},{"pgid":"5.1d","mappings":[{"from":1,"to":2}]},{"pgid":"6.c","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-07T03:35:32.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f867403dec0 msgr2=0x7f8674040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:32.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 --2- 172.21.15.104:0/3850939986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f867403dec0 0x7f8674040380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f867c034000 tx=0x7f867c02e000 comp rx=0 tx=0).stop 2024-09-07T03:35:32.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694129d80 msgr2=0x7f8694115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:32.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 --2- 172.21.15.104:0/3850939986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694129d80 0x7f8694115030 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f868400c3d0 tx=0x7f868400c890 comp rx=0 tx=0).stop 2024-09-07T03:35:32.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 shutdown_connections 2024-09-07T03:35:32.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 --2- 172.21.15.104:0/3850939986 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f867403dec0 0x7f8674040380 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:32.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 --2- 172.21.15.104:0/3850939986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8694129d80 0x7f8694115030 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:32.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 >> 172.21.15.104:0/3850939986 conn(0x7f8694070850 msgr2=0x7f86941b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:32.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 shutdown_connections 2024-09-07T03:35:32.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:32.059+0000 7f8698ceb640 1 -- 172.21.15.104:0/3850939986 wait complete. 2024-09-07T03:35:33.072 INFO:tasks.ceph:Scrubbing osd.0 2024-09-07T03:35:33.072 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-07T03:35:33.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.184+0000 7fbd9479b640 1 Processor -- start 2024-09-07T03:35:33.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.184+0000 7fbd9479b640 1 -- start start 2024-09-07T03:35:33.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.185+0000 7fbd9479b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd8c130290 0x7fbd8c132680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.185+0000 7fbd9479b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c0733d0 con 0x7fbd8c1235f0 2024-09-07T03:35:33.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.185+0000 7fbd9479b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8c114d60 con 0x7fbd8c130290 2024-09-07T03:35:33.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.185+0000 7fbd91d36640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd8c130290 0x7fbd8c132680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.185+0000 7fbd92537640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbd8c1235f0 0x7fbd8c1239d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57238/0 (socket says 172.21.15.104:57238) 2024-09-07T03:35:33.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.185+0000 7fbd92537640 1 -- 172.21.15.104:0/2605473811 learned_addr learned my addr 172.21.15.104:0/2605473811 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:33.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.185+0000 7fbd91d36640 1 -- 172.21.15.104:0/2605473811 >> v1:172.21.15.104:6789/0 conn(0x7fbd8c1235f0 legacy=0x7fbd8c1239d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.185+0000 7fbd91d36640 1 -- 172.21.15.104:0/2605473811 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c1240e0 con 0x7fbd8c130290 2024-09-07T03:35:33.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.185+0000 7fbd91535640 1 -- 172.21.15.104:0/2605473811 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141984543 0 0) 0x7fbd8c0733d0 con 0x7fbd8c1235f0 2024-09-07T03:35:33.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.186+0000 7fbd91d36640 1 --2- 172.21.15.104:0/2605473811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c130290 0x7fbd8c132680 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009720 tx=0x7fbd8002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea9a00ea9f15909 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.186+0000 7fbd91535640 1 -- 172.21.15.104:0/2605473811 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd80037070 con 0x7fbd8c130290 2024-09-07T03:35:33.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.186+0000 7fbd91535640 1 -- 172.21.15.104:0/2605473811 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8002ad90 con 0x7fbd8c130290 2024-09-07T03:35:33.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.186+0000 7fbd91535640 1 -- 172.21.15.104:0/2605473811 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd80032590 con 0x7fbd8c130290 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.186+0000 7fbd9479b640 1 -- 172.21.15.104:0/2605473811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c130290 msgr2=0x7fbd8c132680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.186+0000 7fbd9479b640 1 --2- 172.21.15.104:0/2605473811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c130290 0x7fbd8c132680 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009720 tx=0x7fbd8002a110 comp rx=0 tx=0).stop 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.187+0000 7fbd9479b640 1 -- 172.21.15.104:0/2605473811 shutdown_connections 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.187+0000 7fbd9479b640 1 --2- 172.21.15.104:0/2605473811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c130290 0x7fbd8c132680 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.187+0000 7fbd9479b640 1 -- 172.21.15.104:0/2605473811 >> 172.21.15.104:0/2605473811 conn(0x7fbd8c070210 msgr2=0x7fbd8c072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.187+0000 7fbd9479b640 1 -- 172.21.15.104:0/2605473811 shutdown_connections 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.187+0000 7fbd9479b640 1 -- 172.21.15.104:0/2605473811 wait complete. 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.187+0000 7fbd9479b640 1 Processor -- start 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.187+0000 7fbd9479b640 1 -- start start 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd9479b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c1235f0 0x7fbd8c125420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd9479b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c114380 con 0x7fbd8c1235f0 2024-09-07T03:35:33.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd92537640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c1235f0 0x7fbd8c125420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd92537640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c1235f0 0x7fbd8c125420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50664/0 (socket says 172.21.15.104:50664) 2024-09-07T03:35:33.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd92537640 1 -- 172.21.15.104:0/2404575164 learned_addr learned my addr 172.21.15.104:0/2404575164 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:33.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd92537640 1 -- 172.21.15.104:0/2404575164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c128c80 con 0x7fbd8c1235f0 2024-09-07T03:35:33.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd92537640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c1235f0 0x7fbd8c125420 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400c3d0 tx=0x7fbd8400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd8affd640 1 -- 172.21.15.104:0/2404575164 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd840074d0 con 0x7fbd8c1235f0 2024-09-07T03:35:33.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd8affd640 1 -- 172.21.15.104:0/2404575164 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd840047e0 con 0x7fbd8c1235f0 2024-09-07T03:35:33.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c1280d0 con 0x7fbd8c1235f0 2024-09-07T03:35:33.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd8affd640 1 -- 172.21.15.104:0/2404575164 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd84007670 con 0x7fbd8c1235f0 2024-09-07T03:35:33.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.188+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c125b40 con 0x7fbd8c1235f0 2024-09-07T03:35:33.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.189+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd8c127e20 con 0x7fbd8c1235f0 2024-09-07T03:35:33.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.189+0000 7fbd8affd640 1 -- 172.21.15.104:0/2404575164 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbd84011070 con 0x7fbd8c1235f0 2024-09-07T03:35:33.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.190+0000 7fbd8affd640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd7803de90 0x7fbd78040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.190+0000 7fbd8affd640 1 -- 172.21.15.104:0/2404575164 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fbd84052960 con 0x7fbd8c1235f0 2024-09-07T03:35:33.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.190+0000 7fbd8affd640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fbd7804a300 0x7fbd7804c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.190+0000 7fbd8affd640 1 -- 172.21.15.104:0/2404575164 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd84018e50 con 0x7fbd7804a300 2024-09-07T03:35:33.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.190+0000 7fbd8affd640 1 -- 172.21.15.104:0/2404575164 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbd840572a0 con 0x7fbd8c1235f0 2024-09-07T03:35:33.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.190+0000 7fbd91d36640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd7803de90 0x7fbd78040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.190+0000 7fbd92d38640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fbd7804a300 0x7fbd7804c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.190+0000 7fbd92d38640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fbd7804a300 0x7fbd7804c7a0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.190+0000 7fbd91d36640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd7803de90 0x7fbd78040350 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009720 tx=0x7fbd8002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.191+0000 7fbd8affd640 1 -- 172.21.15.104:0/2404575164 <== osd.0 v2:172.21.15.104:6800/182397107 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd84018e50 con 0x7fbd7804a300 2024-09-07T03:35:33.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.203+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 --> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbd8c126480 con 0x7fbd7804a300 2024-09-07T03:35:33.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd8affd640 1 -- 172.21.15.104:0/2404575164 <== osd.0 v2:172.21.15.104:6800/182397107 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbd7c00ad10 con 0x7fbd7804a300 2024-09-07T03:35:33.205 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-07T03:35:33.205 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-07T03:35:33.205 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-07T03:35:33.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fbd7804a300 msgr2=0x7fbd7804c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fbd7804a300 0x7fbd7804c7a0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd7803de90 msgr2=0x7fbd78040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd7803de90 0x7fbd78040350 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009720 tx=0x7fbd8002e000 comp rx=0 tx=0).stop 2024-09-07T03:35:33.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c1235f0 msgr2=0x7fbd8c125420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c1235f0 0x7fbd8c125420 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400c3d0 tx=0x7fbd8400c890 comp rx=0 tx=0).stop 2024-09-07T03:35:33.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 shutdown_connections 2024-09-07T03:35:33.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:6800/182397107,v1:172.21.15.104:6801/182397107] conn(0x7fbd7804a300 0x7fbd7804c7a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fbd7803de90 0x7fbd78040350 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 --2- 172.21.15.104:0/2404575164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd8c1235f0 0x7fbd8c125420 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 >> 172.21.15.104:0/2404575164 conn(0x7fbd8c070210 msgr2=0x7fbd8c121ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:33.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 shutdown_connections 2024-09-07T03:35:33.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.204+0000 7fbd9479b640 1 -- 172.21.15.104:0/2404575164 wait complete. 2024-09-07T03:35:33.215 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-07T03:35:33.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.312+0000 7fe9ea2d4640 1 Processor -- start 2024-09-07T03:35:33.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.312+0000 7fe9ea2d4640 1 -- start start 2024-09-07T03:35:33.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.312+0000 7fe9ea2d4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe9e409ecd0 0x7fe9e41314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.312+0000 7fe9ea2d4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e4073050 con 0x7fe9e4071d10 2024-09-07T03:35:33.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.312+0000 7fe9ea2d4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e4073600 con 0x7fe9e409ecd0 2024-09-07T03:35:33.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.312+0000 7fe9e37fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe9e409ecd0 0x7fe9e41314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.312+0000 7fe9e3fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe9e4071d10 0x7fe9e40720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57248/0 (socket says 172.21.15.104:57248) 2024-09-07T03:35:33.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.312+0000 7fe9e3fff640 1 -- 172.21.15.104:0/288756431 learned_addr learned my addr 172.21.15.104:0/288756431 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:33.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.313+0000 7fe9e37fe640 1 -- 172.21.15.104:0/288756431 >> v1:172.21.15.104:6789/0 conn(0x7fe9e4071d10 legacy=0x7fe9e40720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.313+0000 7fe9e37fe640 1 -- 172.21.15.104:0/288756431 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e40732f0 con 0x7fe9e409ecd0 2024-09-07T03:35:33.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.313+0000 7fe9e2ffd640 1 -- 172.21.15.104:0/288756431 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103021043 0 0) 0x7fe9d4001110 con 0x7fe9e4071d10 2024-09-07T03:35:33.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.313+0000 7fe9e37fe640 1 --2- 172.21.15.104:0/288756431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e409ecd0 0x7fe9e41314d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009720 tx=0x7fe9d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7085c22cf93a61e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.313+0000 7fe9e2ffd640 1 -- 172.21.15.104:0/288756431 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d8037070 con 0x7fe9e409ecd0 2024-09-07T03:35:33.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.314+0000 7fe9e2ffd640 1 -- 172.21.15.104:0/288756431 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d802ad90 con 0x7fe9e409ecd0 2024-09-07T03:35:33.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.314+0000 7fe9e2ffd640 1 -- 172.21.15.104:0/288756431 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d8032590 con 0x7fe9e409ecd0 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.314+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/288756431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e409ecd0 msgr2=0x7fe9e41314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.314+0000 7fe9ea2d4640 1 --2- 172.21.15.104:0/288756431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e409ecd0 0x7fe9e41314d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009720 tx=0x7fe9d802a110 comp rx=0 tx=0).stop 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.314+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/288756431 shutdown_connections 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.314+0000 7fe9ea2d4640 1 --2- 172.21.15.104:0/288756431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e409ecd0 0x7fe9e41314d0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.314+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/288756431 >> 172.21.15.104:0/288756431 conn(0x7fe9e409c640 msgr2=0x7fe9e406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.314+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/288756431 shutdown_connections 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.314+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/288756431 wait complete. 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.315+0000 7fe9ea2d4640 1 Processor -- start 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.315+0000 7fe9ea2d4640 1 -- start start 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.315+0000 7fe9ea2d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e4071d10 0x7fe9e41c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.315+0000 7fe9ea2d4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4072980 con 0x7fe9e4071d10 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e4071d10 0x7fe9e41c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e4071d10 0x7fe9e41c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50674/0 (socket says 172.21.15.104:50674) 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9e3fff640 1 -- 172.21.15.104:0/3324328206 learned_addr learned my addr 172.21.15.104:0/3324328206 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9e3fff640 1 -- 172.21.15.104:0/3324328206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e4126650 con 0x7fe9e4071d10 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9e3fff640 1 --2- 172.21.15.104:0/3324328206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e4071d10 0x7fe9e41c3d30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400c6b0 tx=0x7fe9d400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9e0ff9640 1 -- 172.21.15.104:0/3324328206 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d4018070 con 0x7fe9e4071d10 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9e0ff9640 1 -- 172.21.15.104:0/3324328206 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d4007e20 con 0x7fe9e4071d10 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e4070e70 con 0x7fe9e4071d10 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9e0ff9640 1 -- 172.21.15.104:0/3324328206 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d4007220 con 0x7fe9e4071d10 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.316+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e411bac0 con 0x7fe9e4071d10 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.317+0000 7fe9e0ff9640 1 -- 172.21.15.104:0/3324328206 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe9d401b070 con 0x7fe9e4071d10 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.317+0000 7fe9e0ff9640 1 --2- 172.21.15.104:0/3324328206 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe9d003de90 0x7fe9d0040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.317+0000 7fe9e0ff9640 1 -- 172.21.15.104:0/3324328206 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe9d4052090 con 0x7fe9e4071d10 2024-09-07T03:35:33.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.317+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e4116df0 con 0x7fe9e4071d10 2024-09-07T03:35:33.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.318+0000 7fe9e37fe640 1 --2- 172.21.15.104:0/3324328206 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe9d003de90 0x7fe9d0040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.318+0000 7fe9e37fe640 1 --2- 172.21.15.104:0/3324328206 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe9d003de90 0x7fe9d0040350 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8034000 tx=0x7fe9d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.322+0000 7fe9e0ff9640 1 -- 172.21.15.104:0/3324328206 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fe9e4073050 con 0x7fe9e4071d10 2024-09-07T03:35:33.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.495+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe9e4071510 con 0x7fe9d003de90 2024-09-07T03:35:33.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.497+0000 7fe9e0ff9640 1 -- 172.21.15.104:0/3324328206 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe9d80326f0 con 0x7fe9d003de90 2024-09-07T03:35:33.498 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 0 to deep-scrub 2024-09-07T03:35:33.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe9d003de90 msgr2=0x7fe9d0040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 --2- 172.21.15.104:0/3324328206 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe9d003de90 0x7fe9d0040350 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8034000 tx=0x7fe9d802e000 comp rx=0 tx=0).stop 2024-09-07T03:35:33.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e4071d10 msgr2=0x7fe9e41c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 --2- 172.21.15.104:0/3324328206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e4071d10 0x7fe9e41c3d30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400c6b0 tx=0x7fe9d400cb70 comp rx=0 tx=0).stop 2024-09-07T03:35:33.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 shutdown_connections 2024-09-07T03:35:33.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 --2- 172.21.15.104:0/3324328206 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe9d003de90 0x7fe9d0040350 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 --2- 172.21.15.104:0/3324328206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e4071d10 0x7fe9e41c3d30 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 >> 172.21.15.104:0/3324328206 conn(0x7fe9e409c640 msgr2=0x7fe9e4126980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:33.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 shutdown_connections 2024-09-07T03:35:33.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.499+0000 7fe9ea2d4640 1 -- 172.21.15.104:0/3324328206 wait complete. 2024-09-07T03:35:33.510 INFO:tasks.ceph:Scrubbing osd.1 2024-09-07T03:35:33.511 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-07T03:35:33.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.611+0000 7fdf86a18640 1 Processor -- start 2024-09-07T03:35:33.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.611+0000 7fdf86a18640 1 -- start start 2024-09-07T03:35:33.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.611+0000 7fdf86a18640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdf8012b670 0x7fdf8012ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.611+0000 7fdf86a18640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf80113000 con 0x7fdf8012bf90 2024-09-07T03:35:33.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.611+0000 7fdf86a18640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fdf80112820 con 0x7fdf8012b670 2024-09-07T03:35:33.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.611+0000 7fdf7ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdf8012b670 0x7fdf8012ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.611+0000 7fdf7f7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fdf8012bf90 0x7fdf801280f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44870/0 (socket says 172.21.15.104:44870) 2024-09-07T03:35:33.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.611+0000 7fdf7f7fe640 1 -- 172.21.15.104:0/2988280231 learned_addr learned my addr 172.21.15.104:0/2988280231 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:33.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.612+0000 7fdf7ffff640 1 -- 172.21.15.104:0/2988280231 >> v1:172.21.15.104:6789/0 conn(0x7fdf8012bf90 legacy=0x7fdf801280f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.612+0000 7fdf7ffff640 1 -- 172.21.15.104:0/2988280231 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8006dbb0 con 0x7fdf8012b670 2024-09-07T03:35:33.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.612+0000 7fdf7effd640 1 -- 172.21.15.104:0/2988280231 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683974799 0 0) 0x7fdf80113000 con 0x7fdf8012bf90 2024-09-07T03:35:33.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.612+0000 7fdf7ffff640 1 --2- 172.21.15.104:0/2988280231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 0x7fdf8012ba50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000b9c0 tx=0x7fdf7002c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1947e68f1a1a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.612+0000 7fdf7effd640 1 -- 172.21.15.104:0/2988280231 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf70031640 con 0x7fdf8012b670 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.612+0000 7fdf7effd640 1 -- 172.21.15.104:0/2988280231 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf700317e0 con 0x7fdf8012b670 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.612+0000 7fdf7effd640 1 -- 172.21.15.104:0/2988280231 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf70031ae0 con 0x7fdf8012b670 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.613+0000 7fdf86a18640 1 -- 172.21.15.104:0/2988280231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 msgr2=0x7fdf8012ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.613+0000 7fdf86a18640 1 --2- 172.21.15.104:0/2988280231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 0x7fdf8012ba50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000b9c0 tx=0x7fdf7002c7e0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.613+0000 7fdf86a18640 1 -- 172.21.15.104:0/2988280231 shutdown_connections 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.613+0000 7fdf86a18640 1 --2- 172.21.15.104:0/2988280231 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 0x7fdf8012ba50 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.613+0000 7fdf86a18640 1 -- 172.21.15.104:0/2988280231 >> 172.21.15.104:0/2988280231 conn(0x7fdf80070210 msgr2=0x7fdf80072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.613+0000 7fdf86a18640 1 -- 172.21.15.104:0/2988280231 shutdown_connections 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.613+0000 7fdf86a18640 1 -- 172.21.15.104:0/2988280231 wait complete. 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.614+0000 7fdf86a18640 1 Processor -- start 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.614+0000 7fdf86a18640 1 -- start start 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.614+0000 7fdf86a18640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 0x7fdf80117d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.614+0000 7fdf86a18640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdf800732e0 con 0x7fdf8012b670 2024-09-07T03:35:33.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.614+0000 7fdf7ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 0x7fdf80117d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.614+0000 7fdf7ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 0x7fdf80117d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55172/0 (socket says 172.21.15.104:55172) 2024-09-07T03:35:33.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.614+0000 7fdf7ffff640 1 -- 172.21.15.104:0/949498679 learned_addr learned my addr 172.21.15.104:0/949498679 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:33.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.615+0000 7fdf7ffff640 1 -- 172.21.15.104:0/949498679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8011b2b0 con 0x7fdf8012b670 2024-09-07T03:35:33.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.615+0000 7fdf7ffff640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 0x7fdf80117d70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fdf70000c00 tx=0x7fdf700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.615+0000 7fdf7cff9640 1 -- 172.21.15.104:0/949498679 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf70041020 con 0x7fdf8012b670 2024-09-07T03:35:33.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.615+0000 7fdf7cff9640 1 -- 172.21.15.104:0/949498679 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf70033c00 con 0x7fdf8012b670 2024-09-07T03:35:33.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.615+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf80119cb0 con 0x7fdf8012b670 2024-09-07T03:35:33.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.615+0000 7fdf7cff9640 1 -- 172.21.15.104:0/949498679 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf7003d440 con 0x7fdf8012b670 2024-09-07T03:35:33.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.615+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf80122200 con 0x7fdf8012b670 2024-09-07T03:35:33.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.616+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf8011b100 con 0x7fdf8012b670 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.616+0000 7fdf7cff9640 1 -- 172.21.15.104:0/949498679 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdf70044020 con 0x7fdf8012b670 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.616+0000 7fdf7cff9640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdf6c03de90 0x7fdf6c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.616+0000 7fdf7cff9640 1 -- 172.21.15.104:0/949498679 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fdf70073d40 con 0x7fdf8012b670 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.616+0000 7fdf7cff9640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7fdf6c04a360 0x7fdf6c04c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.616+0000 7fdf7cff9640 1 -- 172.21.15.104:0/949498679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf6c04ced0 con 0x7fdf6c04a360 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.616+0000 7fdf7cff9640 1 -- 172.21.15.104:0/949498679 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdf70077020 con 0x7fdf8012b670 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.617+0000 7fdf7f7fe640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdf6c03de90 0x7fdf6c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.617+0000 7fdf84fb5640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7fdf6c04a360 0x7fdf6c04c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.617+0000 7fdf7f7fe640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdf6c03de90 0x7fdf6c040350 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdf74000c00 tx=0x7fdf740078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.617+0000 7fdf84fb5640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7fdf6c04a360 0x7fdf6c04c800 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.618+0000 7fdf7cff9640 1 -- 172.21.15.104:0/949498679 <== osd.1 v2:172.21.15.120:6808/3372043485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf6c04ced0 con 0x7fdf6c04a360 2024-09-07T03:35:33.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.630+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 --> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdf80122490 con 0x7fdf6c04a360 2024-09-07T03:35:33.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf7cff9640 1 -- 172.21.15.104:0/949498679 <== osd.1 v2:172.21.15.120:6808/3372043485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdf80122490 con 0x7fdf6c04a360 2024-09-07T03:35:33.633 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-07T03:35:33.633 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-07T03:35:33.633 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7fdf6c04a360 msgr2=0x7fdf6c04c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7fdf6c04a360 0x7fdf6c04c800 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdf6c03de90 msgr2=0x7fdf6c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdf6c03de90 0x7fdf6c040350 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdf74000c00 tx=0x7fdf740078f0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 msgr2=0x7fdf80117d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 0x7fdf80117d70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fdf70000c00 tx=0x7fdf700046c0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 shutdown_connections 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6808/3372043485,v1:172.21.15.120:6810/3372043485] conn(0x7fdf6c04a360 0x7fdf6c04c800 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fdf6c03de90 0x7fdf6c040350 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 --2- 172.21.15.104:0/949498679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf8012b670 0x7fdf80117d70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 >> 172.21.15.104:0/949498679 conn(0x7fdf80070210 msgr2=0x7fdf80129450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:33.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 shutdown_connections 2024-09-07T03:35:33.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.631+0000 7fdf86a18640 1 -- 172.21.15.104:0/949498679 wait complete. 2024-09-07T03:35:33.642 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-07T03:35:33.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.739+0000 7fd193324640 1 Processor -- start 2024-09-07T03:35:33.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.739+0000 7fd193324640 1 -- start start 2024-09-07T03:35:33.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.739+0000 7fd193324640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd18c071d10 0x7fd18c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.739+0000 7fd193324640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd18c073050 con 0x7fd18c09ecd0 2024-09-07T03:35:33.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.739+0000 7fd193324640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fd18c073600 con 0x7fd18c071d10 2024-09-07T03:35:33.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.740+0000 7fd1910c0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd18c071d10 0x7fd18c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.740+0000 7fd1908bf640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd18c09ecd0 0x7fd18c125760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44884/0 (socket says 172.21.15.104:44884) 2024-09-07T03:35:33.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.740+0000 7fd1908bf640 1 -- 172.21.15.104:0/3582221468 learned_addr learned my addr 172.21.15.104:0/3582221468 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:33.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.740+0000 7fd1910c0640 1 -- 172.21.15.104:0/3582221468 >> v1:172.21.15.104:6789/0 conn(0x7fd18c09ecd0 legacy=0x7fd18c125760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.740+0000 7fd1910c0640 1 -- 172.21.15.104:0/3582221468 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c0732f0 con 0x7fd18c071d10 2024-09-07T03:35:33.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.740+0000 7fd183fff640 1 -- 172.21.15.104:0/3582221468 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624450132 0 0) 0x7fd188001110 con 0x7fd18c09ecd0 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd1910c0640 1 --2- 172.21.15.104:0/3582221468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 0x7fd18c0720f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00b9c0 tx=0x7fd17c02c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1042a26ecc62136b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd183fff640 1 -- 172.21.15.104:0/3582221468 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd17c031640 con 0x7fd18c071d10 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd183fff640 1 -- 172.21.15.104:0/3582221468 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17c0317e0 con 0x7fd18c071d10 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd183fff640 1 -- 172.21.15.104:0/3582221468 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd17c031ae0 con 0x7fd18c071d10 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd193324640 1 -- 172.21.15.104:0/3582221468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 msgr2=0x7fd18c0720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd193324640 1 --2- 172.21.15.104:0/3582221468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 0x7fd18c0720f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00b9c0 tx=0x7fd17c02c7e0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd193324640 1 -- 172.21.15.104:0/3582221468 shutdown_connections 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd193324640 1 --2- 172.21.15.104:0/3582221468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 0x7fd18c0720f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd193324640 1 -- 172.21.15.104:0/3582221468 >> 172.21.15.104:0/3582221468 conn(0x7fd18c09c640 msgr2=0x7fd18c06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd193324640 1 -- 172.21.15.104:0/3582221468 shutdown_connections 2024-09-07T03:35:33.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.741+0000 7fd193324640 1 -- 172.21.15.104:0/3582221468 wait complete. 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.742+0000 7fd193324640 1 Processor -- start 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.742+0000 7fd193324640 1 -- start start 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.742+0000 7fd193324640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 0x7fd18c11aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.742+0000 7fd193324640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c0727b0 con 0x7fd18c071d10 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd1910c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 0x7fd18c11aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd1910c0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 0x7fd18c11aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55190/0 (socket says 172.21.15.104:55190) 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd1910c0640 1 -- 172.21.15.104:0/981963390 learned_addr learned my addr 172.21.15.104:0/981963390 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd1910c0640 1 -- 172.21.15.104:0/981963390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c11cee0 con 0x7fd18c071d10 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd1910c0640 1 --2- 172.21.15.104:0/981963390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 0x7fd18c11aeb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000c00 tx=0x7fd17c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd181ffb640 1 -- 172.21.15.104:0/981963390 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd17c041020 con 0x7fd18c071d10 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd181ffb640 1 -- 172.21.15.104:0/981963390 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17c033c00 con 0x7fd18c071d10 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18c11d440 con 0x7fd18c071d10 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd181ffb640 1 -- 172.21.15.104:0/981963390 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd17c03d440 con 0x7fd18c071d10 2024-09-07T03:35:33.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.743+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18c11c790 con 0x7fd18c071d10 2024-09-07T03:35:33.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.744+0000 7fd181ffb640 1 -- 172.21.15.104:0/981963390 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd17c044020 con 0x7fd18c071d10 2024-09-07T03:35:33.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.744+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18c06ff30 con 0x7fd18c071d10 2024-09-07T03:35:33.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.744+0000 7fd181ffb640 1 --2- 172.21.15.104:0/981963390 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd17003de90 0x7fd170040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:33.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.744+0000 7fd181ffb640 1 -- 172.21.15.104:0/981963390 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd17c073d30 con 0x7fd18c071d10 2024-09-07T03:35:33.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.745+0000 7fd1908bf640 1 --2- 172.21.15.104:0/981963390 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd17003de90 0x7fd170040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:33.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.745+0000 7fd1908bf640 1 --2- 172.21.15.104:0/981963390 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd17003de90 0x7fd170040350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd188000c00 tx=0x7fd188001250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:33.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.749+0000 7fd181ffb640 1 -- 172.21.15.104:0/981963390 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fd18c06ff30 con 0x7fd18c071d10 2024-09-07T03:35:33.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.919+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd18c11d7e0 con 0x7fd17003de90 2024-09-07T03:35:33.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.920+0000 7fd181ffb640 1 -- 172.21.15.104:0/981963390 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd18c11d7e0 con 0x7fd17003de90 2024-09-07T03:35:33.922 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 1 to deep-scrub 2024-09-07T03:35:33.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.922+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd17003de90 msgr2=0x7fd170040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.922+0000 7fd193324640 1 --2- 172.21.15.104:0/981963390 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd17003de90 0x7fd170040350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd188000c00 tx=0x7fd188001250 comp rx=0 tx=0).stop 2024-09-07T03:35:33.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.922+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 msgr2=0x7fd18c11aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:33.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.922+0000 7fd193324640 1 --2- 172.21.15.104:0/981963390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 0x7fd18c11aeb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000c00 tx=0x7fd17c0046c0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.922+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 shutdown_connections 2024-09-07T03:35:33.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.922+0000 7fd193324640 1 --2- 172.21.15.104:0/981963390 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd17003de90 0x7fd170040350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.922+0000 7fd193324640 1 --2- 172.21.15.104:0/981963390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c071d10 0x7fd18c11aeb0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:33.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.922+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 >> 172.21.15.104:0/981963390 conn(0x7fd18c09c640 msgr2=0x7fd18c1279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:33.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.923+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 shutdown_connections 2024-09-07T03:35:33.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:33.923+0000 7fd193324640 1 -- 172.21.15.104:0/981963390 wait complete. 2024-09-07T03:35:33.934 INFO:tasks.ceph:Scrubbing osd.2 2024-09-07T03:35:33.934 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-07T03:35:34.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.033+0000 7f9ee7756640 1 Processor -- start 2024-09-07T03:35:34.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.033+0000 7f9ee7756640 1 -- start start 2024-09-07T03:35:34.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ee7756640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9ee01325e0 0x7f9ee01349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ee7756640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee0116d50 con 0x7f9ee012bed0 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ee7756640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee01170f0 con 0x7f9ee01325e0 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ee4cf1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9ee01325e0 0x7f9ee01349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ee4cf1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9ee01325e0 0x7f9ee01349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55204/0 (socket says 172.21.15.104:55204) 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ee4cf1640 1 -- 172.21.15.104:0/3155241191 learned_addr learned my addr 172.21.15.104:0/3155241191 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ee54f2640 1 --1- 172.21.15.104:0/3155241191 >> v1:172.21.15.104:6789/0 conn(0x7f9ee012bed0 0x7f9ee012c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44896/0 (socket says 172.21.15.104:44896) 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ee4cf1640 1 -- 172.21.15.104:0/3155241191 >> v1:172.21.15.104:6789/0 conn(0x7f9ee012bed0 legacy=0x7f9ee012c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ee4cf1640 1 -- 172.21.15.104:0/3155241191 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee0115df0 con 0x7f9ee01325e0 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.034+0000 7f9ed7fff640 1 -- 172.21.15.104:0/3155241191 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203996030 0 0) 0x7f9ee0116d50 con 0x7f9ee012bed0 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.035+0000 7f9ee4cf1640 1 --2- 172.21.15.104:0/3155241191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee01325e0 0x7f9ee01349d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00097f0 tx=0x7f9ed002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa4bad59139f662 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.035+0000 7f9ed7fff640 1 -- 172.21.15.104:0/3155241191 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed0037070 con 0x7f9ee01325e0 2024-09-07T03:35:34.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.035+0000 7f9ed7fff640 1 -- 172.21.15.104:0/3155241191 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed0032440 con 0x7f9ee01325e0 2024-09-07T03:35:34.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.035+0000 7f9ed7fff640 1 -- 172.21.15.104:0/3155241191 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed002ae60 con 0x7f9ee01325e0 2024-09-07T03:35:34.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.035+0000 7f9ee7756640 1 -- 172.21.15.104:0/3155241191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee01325e0 msgr2=0x7f9ee01349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.035+0000 7f9ee7756640 1 --2- 172.21.15.104:0/3155241191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee01325e0 0x7f9ee01349d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00097f0 tx=0x7f9ed002a1e0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.036+0000 7f9ee7756640 1 -- 172.21.15.104:0/3155241191 shutdown_connections 2024-09-07T03:35:34.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.036+0000 7f9ee7756640 1 --2- 172.21.15.104:0/3155241191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee01325e0 0x7f9ee01349d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.036+0000 7f9ee7756640 1 -- 172.21.15.104:0/3155241191 >> 172.21.15.104:0/3155241191 conn(0x7f9ee006fb60 msgr2=0x7f9ee0071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:34.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.036+0000 7f9ee7756640 1 -- 172.21.15.104:0/3155241191 shutdown_connections 2024-09-07T03:35:34.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.036+0000 7f9ee7756640 1 -- 172.21.15.104:0/3155241191 wait complete. 2024-09-07T03:35:34.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.036+0000 7f9ee7756640 1 Processor -- start 2024-09-07T03:35:34.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.036+0000 7f9ee7756640 1 -- start start 2024-09-07T03:35:34.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ee7756640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee012bed0 0x7f9ee01252b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ee7756640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee01166c0 con 0x7f9ee012bed0 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ee54f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee012bed0 0x7f9ee01252b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ee54f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee012bed0 0x7f9ee01252b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55214/0 (socket says 172.21.15.104:55214) 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ee54f2640 1 -- 172.21.15.104:0/3042848673 learned_addr learned my addr 172.21.15.104:0/3042848673 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ee54f2640 1 -- 172.21.15.104:0/3042848673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee0117b70 con 0x7f9ee012bed0 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ee54f2640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee012bed0 0x7f9ee01252b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c320 tx=0x7f9edc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ed5ffb640 1 -- 172.21.15.104:0/3042848673 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9edc007410 con 0x7f9ee012bed0 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ed5ffb640 1 -- 172.21.15.104:0/3042848673 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9edc0075d0 con 0x7f9ee012bed0 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee0117e00 con 0x7f9ee012bed0 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.037+0000 7f9ed5ffb640 1 -- 172.21.15.104:0/3042848673 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9edc004950 con 0x7f9ee012bed0 2024-09-07T03:35:34.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.038+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee01259d0 con 0x7f9ee012bed0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.038+0000 7f9ed5ffb640 1 -- 172.21.15.104:0/3042848673 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9edc011070 con 0x7f9ee012bed0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.038+0000 7f9ed5ffb640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9ec403de90 0x7f9ec4040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.038+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ee0117660 con 0x7f9ee012bed0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.038+0000 7f9ed5ffb640 1 -- 172.21.15.104:0/3042848673 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9edc0527f0 con 0x7f9ee012bed0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.039+0000 7f9ed5ffb640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9ec404a2e0 0x7f9ec404c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.039+0000 7f9ed5ffb640 1 -- 172.21.15.104:0/3042848673 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9edc00fe50 con 0x7f9ec404a2e0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.039+0000 7f9ed5ffb640 1 -- 172.21.15.104:0/3042848673 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9edc013c70 con 0x7f9ee012bed0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.039+0000 7f9ee4cf1640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9ec403de90 0x7f9ec4040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.039+0000 7f9ee5cf3640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9ec404a2e0 0x7f9ec404c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.039+0000 7f9ee4cf1640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9ec403de90 0x7f9ec4040350 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0034000 tx=0x7f9ed002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.039+0000 7f9ee5cf3640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9ec404a2e0 0x7f9ec404c780 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.040+0000 7f9ed5ffb640 1 -- 172.21.15.104:0/3042848673 <== osd.2 v2:172.21.15.120:6809/3781833098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9edc00fe50 con 0x7f9ec404a2e0 2024-09-07T03:35:34.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.052+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 --> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9ee012c2b0 con 0x7f9ec404a2e0 2024-09-07T03:35:34.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ed5ffb640 1 -- 172.21.15.104:0/3042848673 <== osd.2 v2:172.21.15.120:6809/3781833098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9ee012c2b0 con 0x7f9ec404a2e0 2024-09-07T03:35:34.054 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-07T03:35:34.054 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-07T03:35:34.054 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-07T03:35:34.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9ec404a2e0 msgr2=0x7f9ec404c780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9ec404a2e0 0x7f9ec404c780 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9ec403de90 msgr2=0x7f9ec4040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9ec403de90 0x7f9ec4040350 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0034000 tx=0x7f9ed002e000 comp rx=0 tx=0).stop 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee012bed0 msgr2=0x7f9ee01252b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee012bed0 0x7f9ee01252b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c320 tx=0x7f9edc00c7e0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 shutdown_connections 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6809/3781833098,v1:172.21.15.120:6811/3781833098] conn(0x7f9ec404a2e0 0x7f9ec404c780 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f9ec403de90 0x7f9ec4040350 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 --2- 172.21.15.104:0/3042848673 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ee012bed0 0x7f9ee01252b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 >> 172.21.15.104:0/3042848673 conn(0x7f9ee006fb60 msgr2=0x7f9ee0126630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:34.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 shutdown_connections 2024-09-07T03:35:34.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.053+0000 7f9ee7756640 1 -- 172.21.15.104:0/3042848673 wait complete. 2024-09-07T03:35:34.065 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-07T03:35:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.164+0000 7fc0dfbbb640 1 Processor -- start 2024-09-07T03:35:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.164+0000 7fc0dfbbb640 1 -- start start 2024-09-07T03:35:34.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.165+0000 7fc0dfbbb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc0d806fe70 0x7fc0d8070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.165+0000 7fc0dfbbb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d8071680 con 0x7fc0d8070790 2024-09-07T03:35:34.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.165+0000 7fc0dfbbb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d80a30e0 con 0x7fc0d806fe70 2024-09-07T03:35:34.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.165+0000 7fc0dd957640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc0d806fe70 0x7fc0d8070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.165+0000 7fc0dd156640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc0d8070790 0x7fc0d812ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44908/0 (socket says 172.21.15.104:44908) 2024-09-07T03:35:34.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.165+0000 7fc0dd957640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc0d806fe70 0x7fc0d8070250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55228/0 (socket says 172.21.15.104:55228) 2024-09-07T03:35:34.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.165+0000 7fc0dd156640 1 -- 172.21.15.104:0/2586512961 learned_addr learned my addr 172.21.15.104:0/2586512961 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:34.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.165+0000 7fc0dd957640 1 -- 172.21.15.104:0/2586512961 >> v1:172.21.15.104:6789/0 conn(0x7fc0d8070790 legacy=0x7fc0d812ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.165+0000 7fc0dd957640 1 -- 172.21.15.104:0/2586512961 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d8071dd0 con 0x7fc0d806fe70 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.166+0000 7fc0dd957640 1 --2- 172.21.15.104:0/2586512961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 0x7fc0d8070250 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009720 tx=0x7fc0d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f8d05ffa91ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.166+0000 7fc0dc955640 1 -- 172.21.15.104:0/2586512961 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d4037070 con 0x7fc0d806fe70 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.166+0000 7fc0dc955640 1 -- 172.21.15.104:0/2586512961 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d402ad90 con 0x7fc0d806fe70 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.166+0000 7fc0dc955640 1 -- 172.21.15.104:0/2586512961 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d4032590 con 0x7fc0d806fe70 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.166+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2586512961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 msgr2=0x7fc0d8070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.166+0000 7fc0dfbbb640 1 --2- 172.21.15.104:0/2586512961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 0x7fc0d8070250 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009720 tx=0x7fc0d402a110 comp rx=0 tx=0).stop 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.166+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2586512961 shutdown_connections 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.166+0000 7fc0dfbbb640 1 --2- 172.21.15.104:0/2586512961 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 0x7fc0d8070250 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.166+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2586512961 >> 172.21.15.104:0/2586512961 conn(0x7fc0d80a0a50 msgr2=0x7fc0d806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.167+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2586512961 shutdown_connections 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.167+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2586512961 wait complete. 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.167+0000 7fc0dfbbb640 1 Processor -- start 2024-09-07T03:35:34.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.167+0000 7fc0dfbbb640 1 -- start start 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0dfbbb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 0x7fc0d811f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0dfbbb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d8075cc0 con 0x7fc0d806fe70 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0dd957640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 0x7fc0d811f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0dd957640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 0x7fc0d811f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55244/0 (socket says 172.21.15.104:55244) 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0dd957640 1 -- 172.21.15.104:0/2032326702 learned_addr learned my addr 172.21.15.104:0/2032326702 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0dd957640 1 -- 172.21.15.104:0/2032326702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d8121300 con 0x7fc0d806fe70 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0dd957640 1 --2- 172.21.15.104:0/2032326702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 0x7fc0d811f210 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009840 tx=0x7fc0d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0ce7fc640 1 -- 172.21.15.104:0/2032326702 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d4041070 con 0x7fc0d806fe70 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0ce7fc640 1 -- 172.21.15.104:0/2032326702 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d403c460 con 0x7fc0d806fe70 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0ce7fc640 1 -- 172.21.15.104:0/2032326702 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d4037040 con 0x7fc0d806fe70 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d8122560 con 0x7fc0d806fe70 2024-09-07T03:35:34.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.168+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d8122890 con 0x7fc0d806fe70 2024-09-07T03:35:34.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.169+0000 7fc0ce7fc640 1 -- 172.21.15.104:0/2032326702 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc0d4044070 con 0x7fc0d806fe70 2024-09-07T03:35:34.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.169+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d8070250 con 0x7fc0d806fe70 2024-09-07T03:35:34.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.169+0000 7fc0ce7fc640 1 --2- 172.21.15.104:0/2032326702 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc0bc03dec0 0x7fc0bc040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.170+0000 7fc0ce7fc640 1 -- 172.21.15.104:0/2032326702 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc0d4073810 con 0x7fc0d806fe70 2024-09-07T03:35:34.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.170+0000 7fc0dd156640 1 --2- 172.21.15.104:0/2032326702 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc0bc03dec0 0x7fc0bc040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.170+0000 7fc0dd156640 1 --2- 172.21.15.104:0/2032326702 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc0bc03dec0 0x7fc0bc040380 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8007fd0 tx=0x7fc0c8007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.174+0000 7fc0ce7fc640 1 -- 172.21.15.104:0/2032326702 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fc0d404ed60 con 0x7fc0d806fe70 2024-09-07T03:35:34.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.347+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc0d8073970 con 0x7fc0bc03dec0 2024-09-07T03:35:34.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.348+0000 7fc0ce7fc640 1 -- 172.21.15.104:0/2032326702 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc0c80058b0 con 0x7fc0bc03dec0 2024-09-07T03:35:34.349 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 2 to deep-scrub 2024-09-07T03:35:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc0bc03dec0 msgr2=0x7fc0bc040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 --2- 172.21.15.104:0/2032326702 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc0bc03dec0 0x7fc0bc040380 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8007fd0 tx=0x7fc0c8007aa0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 msgr2=0x7fc0d811f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 --2- 172.21.15.104:0/2032326702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 0x7fc0d811f210 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009840 tx=0x7fc0d40046c0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 shutdown_connections 2024-09-07T03:35:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 --2- 172.21.15.104:0/2032326702 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fc0bc03dec0 0x7fc0bc040380 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 --2- 172.21.15.104:0/2032326702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d806fe70 0x7fc0d811f210 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 >> 172.21.15.104:0/2032326702 conn(0x7fc0d80a0a50 msgr2=0x7fc0d812c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 shutdown_connections 2024-09-07T03:35:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.350+0000 7fc0dfbbb640 1 -- 172.21.15.104:0/2032326702 wait complete. 2024-09-07T03:35:34.362 INFO:tasks.ceph:Scrubbing osd.3 2024-09-07T03:35:34.362 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-07T03:35:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.462+0000 7fd084b3a640 1 Processor -- start 2024-09-07T03:35:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.462+0000 7fd084b3a640 1 -- start start 2024-09-07T03:35:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.462+0000 7fd084b3a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd08012b670 0x7fd08012ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.462+0000 7fd084b3a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd080113000 con 0x7fd08012bf90 2024-09-07T03:35:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.462+0000 7fd084b3a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fd080112820 con 0x7fd08012b670 2024-09-07T03:35:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.462+0000 7fd07e59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd08012b670 0x7fd08012ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.462+0000 7fd07dd9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd08012bf90 0x7fd0801280f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44910/0 (socket says 172.21.15.104:44910) 2024-09-07T03:35:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.462+0000 7fd07e59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd08012b670 0x7fd08012ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55248/0 (socket says 172.21.15.104:55248) 2024-09-07T03:35:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.462+0000 7fd07dd9b640 1 -- 172.21.15.104:0/758721143 learned_addr learned my addr 172.21.15.104:0/758721143 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.463+0000 7fd07e59c640 1 -- 172.21.15.104:0/758721143 >> v1:172.21.15.104:6789/0 conn(0x7fd08012bf90 legacy=0x7fd0801280f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.463+0000 7fd07e59c640 1 -- 172.21.15.104:0/758721143 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08006dbb0 con 0x7fd08012b670 2024-09-07T03:35:34.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.463+0000 7fd07e59c640 1 --2- 172.21.15.104:0/758721143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 0x7fd08012ba50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd07802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161ec20822325f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.463+0000 7fd07d59a640 1 -- 172.21.15.104:0/758721143 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd078007670 con 0x7fd08012b670 2024-09-07T03:35:34.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.463+0000 7fd07d59a640 1 -- 172.21.15.104:0/758721143 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078007810 con 0x7fd08012b670 2024-09-07T03:35:34.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.463+0000 7fd07d59a640 1 -- 172.21.15.104:0/758721143 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd078007b10 con 0x7fd08012b670 2024-09-07T03:35:34.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.464+0000 7fd084b3a640 1 -- 172.21.15.104:0/758721143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 msgr2=0x7fd08012ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.464+0000 7fd084b3a640 1 --2- 172.21.15.104:0/758721143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 0x7fd08012ba50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd07802a660 comp rx=0 tx=0).stop 2024-09-07T03:35:34.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.464+0000 7fd084b3a640 1 -- 172.21.15.104:0/758721143 shutdown_connections 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.464+0000 7fd084b3a640 1 --2- 172.21.15.104:0/758721143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 0x7fd08012ba50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.464+0000 7fd084b3a640 1 -- 172.21.15.104:0/758721143 >> 172.21.15.104:0/758721143 conn(0x7fd080070210 msgr2=0x7fd080072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.464+0000 7fd084b3a640 1 -- 172.21.15.104:0/758721143 shutdown_connections 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.464+0000 7fd084b3a640 1 -- 172.21.15.104:0/758721143 wait complete. 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.465+0000 7fd084b3a640 1 Processor -- start 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.465+0000 7fd084b3a640 1 -- start start 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.465+0000 7fd084b3a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 0x7fd080122280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.465+0000 7fd084b3a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd0800732e0 con 0x7fd08012b670 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.465+0000 7fd07e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 0x7fd080122280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.465+0000 7fd07e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 0x7fd080122280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55254/0 (socket says 172.21.15.104:55254) 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.465+0000 7fd07e59c640 1 -- 172.21.15.104:0/3280084261 learned_addr learned my addr 172.21.15.104:0/3280084261 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.466+0000 7fd07e59c640 1 -- 172.21.15.104:0/3280084261 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd080132c80 con 0x7fd08012b670 2024-09-07T03:35:34.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.466+0000 7fd07e59c640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 0x7fd080122280 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd078004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.466+0000 7fd076ffd640 1 -- 172.21.15.104:0/3280084261 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd078040070 con 0x7fd08012b670 2024-09-07T03:35:34.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.466+0000 7fd076ffd640 1 -- 172.21.15.104:0/3280084261 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078031a90 con 0x7fd08012b670 2024-09-07T03:35:34.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.466+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd080125dc0 con 0x7fd08012b670 2024-09-07T03:35:34.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.466+0000 7fd076ffd640 1 -- 172.21.15.104:0/3280084261 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd078031d70 con 0x7fd08012b670 2024-09-07T03:35:34.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.466+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08012ea50 con 0x7fd08012b670 2024-09-07T03:35:34.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.467+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd080130550 con 0x7fd08012b670 2024-09-07T03:35:34.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.467+0000 7fd076ffd640 1 -- 172.21.15.104:0/3280084261 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd078039040 con 0x7fd08012b670 2024-09-07T03:35:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.467+0000 7fd076ffd640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd06003de90 0x7fd060040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.467+0000 7fd076ffd640 1 -- 172.21.15.104:0/3280084261 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd07802ae00 con 0x7fd08012b670 2024-09-07T03:35:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.467+0000 7fd076ffd640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7fd06004a360 0x7fd06004c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.467+0000 7fd076ffd640 1 -- 172.21.15.104:0/3280084261 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd078007810 con 0x7fd06004a360 2024-09-07T03:35:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.467+0000 7fd076ffd640 1 -- 172.21.15.104:0/3280084261 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd07807b050 con 0x7fd08012b670 2024-09-07T03:35:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.468+0000 7fd07dd9b640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd06003de90 0x7fd060040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.468+0000 7fd07ed9d640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7fd06004a360 0x7fd06004c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.468+0000 7fd07ed9d640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7fd06004a360 0x7fd06004c800 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.468+0000 7fd07dd9b640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd06003de90 0x7fd060040350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd068007fd0 tx=0x7fd068007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.469+0000 7fd076ffd640 1 -- 172.21.15.104:0/3280084261 <== osd.3 v2:172.21.15.120:6800/1193158925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd078007810 con 0x7fd06004a360 2024-09-07T03:35:34.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.481+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 --> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd08012ba50 con 0x7fd06004a360 2024-09-07T03:35:34.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd076ffd640 1 -- 172.21.15.104:0/3280084261 <== osd.3 v2:172.21.15.120:6800/1193158925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd08012ba50 con 0x7fd06004a360 2024-09-07T03:35:34.483 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-07T03:35:34.483 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-07T03:35:34.483 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-07T03:35:34.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7fd06004a360 msgr2=0x7fd06004c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7fd06004a360 0x7fd06004c800 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd06003de90 msgr2=0x7fd060040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd06003de90 0x7fd060040350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd068007fd0 tx=0x7fd068007aa0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 msgr2=0x7fd080122280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 0x7fd080122280 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd078004a40 comp rx=0 tx=0).stop 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 shutdown_connections 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6800/1193158925,v1:172.21.15.120:6801/1193158925] conn(0x7fd06004a360 0x7fd06004c800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fd06003de90 0x7fd060040350 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 --2- 172.21.15.104:0/3280084261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd08012b670 0x7fd080122280 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 >> 172.21.15.104:0/3280084261 conn(0x7fd080070210 msgr2=0x7fd0801295f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:34.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 shutdown_connections 2024-09-07T03:35:34.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.482+0000 7fd084b3a640 1 -- 172.21.15.104:0/3280084261 wait complete. 2024-09-07T03:35:34.493 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-07T03:35:34.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.589+0000 7f533efbb640 1 Processor -- start 2024-09-07T03:35:34.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.589+0000 7f533efbb640 1 -- start start 2024-09-07T03:35:34.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.590+0000 7f533efbb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5338070960 0x7f5338134780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.590+0000 7f533efbb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5338071680 con 0x7f533806fe70 2024-09-07T03:35:34.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.590+0000 7f533efbb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f53380a30e0 con 0x7f5338070960 2024-09-07T03:35:34.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.590+0000 7f5337fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5338070960 0x7f5338134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.590+0000 7f533cd57640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f533806fe70 0x7f5338070250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44922/0 (socket says 172.21.15.104:44922) 2024-09-07T03:35:34.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.590+0000 7f533cd57640 1 -- 172.21.15.104:0/4249618019 learned_addr learned my addr 172.21.15.104:0/4249618019 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:34.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.590+0000 7f5337fff640 1 -- 172.21.15.104:0/4249618019 >> v1:172.21.15.104:6789/0 conn(0x7f533806fe70 legacy=0x7f5338070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.590+0000 7f5337fff640 1 -- 172.21.15.104:0/4249618019 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5338071dd0 con 0x7f5338070960 2024-09-07T03:35:34.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.590+0000 7f53377fe640 1 -- 172.21.15.104:0/4249618019 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115202773 0 0) 0x7f5338071680 con 0x7f533806fe70 2024-09-07T03:35:34.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.591+0000 7f5337fff640 1 --2- 172.21.15.104:0/4249618019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5338070960 0x7f5338134780 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f532c009720 tx=0x7f532c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fc338d574b6433 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.591+0000 7f53377fe640 1 -- 172.21.15.104:0/4249618019 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c037070 con 0x7f5338070960 2024-09-07T03:35:34.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.591+0000 7f53377fe640 1 -- 172.21.15.104:0/4249618019 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c02ad90 con 0x7f5338070960 2024-09-07T03:35:34.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.591+0000 7f53377fe640 1 -- 172.21.15.104:0/4249618019 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c032590 con 0x7f5338070960 2024-09-07T03:35:34.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.592+0000 7f533efbb640 1 -- 172.21.15.104:0/4249618019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5338070960 msgr2=0x7f5338134780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.592+0000 7f533efbb640 1 --2- 172.21.15.104:0/4249618019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5338070960 0x7f5338134780 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f532c009720 tx=0x7f532c02a110 comp rx=0 tx=0).stop 2024-09-07T03:35:34.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.592+0000 7f533efbb640 1 -- 172.21.15.104:0/4249618019 shutdown_connections 2024-09-07T03:35:34.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.592+0000 7f533efbb640 1 --2- 172.21.15.104:0/4249618019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5338070960 0x7f5338134780 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.592+0000 7f533efbb640 1 -- 172.21.15.104:0/4249618019 >> 172.21.15.104:0/4249618019 conn(0x7f53380a0a50 msgr2=0x7f533806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:34.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.592+0000 7f533efbb640 1 -- 172.21.15.104:0/4249618019 shutdown_connections 2024-09-07T03:35:34.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.592+0000 7f533efbb640 1 -- 172.21.15.104:0/4249618019 wait complete. 2024-09-07T03:35:34.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.592+0000 7f533efbb640 1 Processor -- start 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.593+0000 7f533efbb640 1 -- start start 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.593+0000 7f533efbb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f533806fe70 0x7f533812b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.593+0000 7f533efbb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5338075cc0 con 0x7f533806fe70 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.593+0000 7f533cd57640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f533806fe70 0x7f533812b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.593+0000 7f533cd57640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f533806fe70 0x7f533812b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55276/0 (socket says 172.21.15.104:55276) 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.593+0000 7f533cd57640 1 -- 172.21.15.104:0/302054950 learned_addr learned my addr 172.21.15.104:0/302054950 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.593+0000 7f533cd57640 1 -- 172.21.15.104:0/302054950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533811dfc0 con 0x7f533806fe70 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.593+0000 7f533cd57640 1 --2- 172.21.15.104:0/302054950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f533806fe70 0x7f533812b7d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f532800c3d0 tx=0x7f532800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.594+0000 7f53357fa640 1 -- 172.21.15.104:0/302054950 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53280074d0 con 0x7f533806fe70 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.594+0000 7f53357fa640 1 -- 172.21.15.104:0/302054950 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53280047e0 con 0x7f533806fe70 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.594+0000 7f53357fa640 1 -- 172.21.15.104:0/302054950 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5328007670 con 0x7f533806fe70 2024-09-07T03:35:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.594+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533811e450 con 0x7f533806fe70 2024-09-07T03:35:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.594+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533812bef0 con 0x7f533806fe70 2024-09-07T03:35:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.595+0000 7f53357fa640 1 -- 172.21.15.104:0/302054950 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5328011070 con 0x7f533806fe70 2024-09-07T03:35:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.595+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5338070250 con 0x7f533806fe70 2024-09-07T03:35:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.595+0000 7f53357fa640 1 --2- 172.21.15.104:0/302054950 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f532403de90 0x7f5324040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.595+0000 7f53357fa640 1 -- 172.21.15.104:0/302054950 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f53280528e0 con 0x7f533806fe70 2024-09-07T03:35:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.595+0000 7f5337fff640 1 --2- 172.21.15.104:0/302054950 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f532403de90 0x7f5324040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.596+0000 7f5337fff640 1 --2- 172.21.15.104:0/302054950 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f532403de90 0x7f5324040350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f532c034000 tx=0x7f532c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.599+0000 7f53357fa640 1 -- 172.21.15.104:0/302054950 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f5328012dd0 con 0x7f533806fe70 2024-09-07T03:35:34.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.773+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5338073620 con 0x7f532403de90 2024-09-07T03:35:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.774+0000 7f53357fa640 1 -- 172.21.15.104:0/302054950 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5338073620 con 0x7f532403de90 2024-09-07T03:35:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 3 to deep-scrub 2024-09-07T03:35:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f532403de90 msgr2=0x7f5324040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 --2- 172.21.15.104:0/302054950 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f532403de90 0x7f5324040350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f532c034000 tx=0x7f532c02e000 comp rx=0 tx=0).stop 2024-09-07T03:35:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f533806fe70 msgr2=0x7f533812b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 --2- 172.21.15.104:0/302054950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f533806fe70 0x7f533812b7d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f532800c3d0 tx=0x7f532800c890 comp rx=0 tx=0).stop 2024-09-07T03:35:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 shutdown_connections 2024-09-07T03:35:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 --2- 172.21.15.104:0/302054950 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f532403de90 0x7f5324040350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 --2- 172.21.15.104:0/302054950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f533806fe70 0x7f533812b7d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 >> 172.21.15.104:0/302054950 conn(0x7f53380a0a50 msgr2=0x7f53380a1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 shutdown_connections 2024-09-07T03:35:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.776+0000 7f533efbb640 1 -- 172.21.15.104:0/302054950 wait complete. 2024-09-07T03:35:34.787 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:35:34.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.883+0000 7f3ce10db640 1 Processor -- start 2024-09-07T03:35:34.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.884+0000 7f3ce10db640 1 -- start start 2024-09-07T03:35:34.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.884+0000 7f3ce10db640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3cdc129d80 0x7f3cdc12a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.884+0000 7f3ce10db640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cdc06dc00 con 0x7f3cdc12a6a0 2024-09-07T03:35:34.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.884+0000 7f3ce10db640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f3cdc1299c0 con 0x7f3cdc129d80 2024-09-07T03:35:34.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.884+0000 7f3cdad9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3cdc129d80 0x7f3cdc12a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.884+0000 7f3cda59c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3cdc12a6a0 0x7f3cdc110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44928/0 (socket says 172.21.15.104:44928) 2024-09-07T03:35:34.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.884+0000 7f3cda59c640 1 -- 172.21.15.104:0/308797774 learned_addr learned my addr 172.21.15.104:0/308797774 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:34.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.884+0000 7f3cdad9d640 1 -- 172.21.15.104:0/308797774 >> v1:172.21.15.104:6789/0 conn(0x7f3cdc12a6a0 legacy=0x7f3cdc110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.884+0000 7f3cdad9d640 1 -- 172.21.15.104:0/308797774 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc114d20 con 0x7f3cdc129d80 2024-09-07T03:35:34.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.885+0000 7f3cdad9d640 1 --2- 172.21.15.104:0/308797774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 0x7f3cdc12a160 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009720 tx=0x7f3ccc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac98dc841d0a087 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.885+0000 7f3cd9d9b640 1 -- 172.21.15.104:0/308797774 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc037070 con 0x7f3cdc129d80 2024-09-07T03:35:34.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.885+0000 7f3cd9d9b640 1 -- 172.21.15.104:0/308797774 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc02ad90 con 0x7f3cdc129d80 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.885+0000 7f3cd9d9b640 1 -- 172.21.15.104:0/308797774 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc032590 con 0x7f3cdc129d80 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.886+0000 7f3ce10db640 1 -- 172.21.15.104:0/308797774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 msgr2=0x7f3cdc12a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.886+0000 7f3ce10db640 1 --2- 172.21.15.104:0/308797774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 0x7f3cdc12a160 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009720 tx=0x7f3ccc02a110 comp rx=0 tx=0).stop 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.886+0000 7f3ce10db640 1 -- 172.21.15.104:0/308797774 shutdown_connections 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.886+0000 7f3ce10db640 1 --2- 172.21.15.104:0/308797774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 0x7f3cdc12a160 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.886+0000 7f3ce10db640 1 -- 172.21.15.104:0/308797774 >> 172.21.15.104:0/308797774 conn(0x7f3cdc070850 msgr2=0x7f3cdc072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.886+0000 7f3ce10db640 1 -- 172.21.15.104:0/308797774 shutdown_connections 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.886+0000 7f3ce10db640 1 -- 172.21.15.104:0/308797774 wait complete. 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.887+0000 7f3ce10db640 1 Processor -- start 2024-09-07T03:35:34.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.887+0000 7f3ce10db640 1 -- start start 2024-09-07T03:35:34.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.887+0000 7f3ce10db640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 0x7f3cdc11b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.887+0000 7f3ce10db640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc114940 con 0x7f3cdc129d80 2024-09-07T03:35:34.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.887+0000 7f3cdad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 0x7f3cdc11b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.887+0000 7f3cdad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 0x7f3cdc11b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55288/0 (socket says 172.21.15.104:55288) 2024-09-07T03:35:34.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.887+0000 7f3cdad9d640 1 -- 172.21.15.104:0/241737434 learned_addr learned my addr 172.21.15.104:0/241737434 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:34.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.888+0000 7f3cdad9d640 1 -- 172.21.15.104:0/241737434 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc11c890 con 0x7f3cdc129d80 2024-09-07T03:35:34.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.888+0000 7f3cdad9d640 1 --2- 172.21.15.104:0/241737434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 0x7f3cdc11b070 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009840 tx=0x7f3ccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.888+0000 7f3cd37fe640 1 -- 172.21.15.104:0/241737434 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc041020 con 0x7f3cdc129d80 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.888+0000 7f3cd37fe640 1 -- 172.21.15.104:0/241737434 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc03d550 con 0x7f3cdc129d80 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.888+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc11dca0 con 0x7f3cdc129d80 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.888+0000 7f3cd37fe640 1 -- 172.21.15.104:0/241737434 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ccc037040 con 0x7f3cdc129d80 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.888+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc11b5b0 con 0x7f3cdc129d80 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.889+0000 7f3cd37fe640 1 -- 172.21.15.104:0/241737434 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3ccc044020 con 0x7f3cdc129d80 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.889+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cdc1119e0 con 0x7f3cdc129d80 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.889+0000 7f3cd37fe640 1 --2- 172.21.15.104:0/241737434 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3cbc03de40 0x7f3cbc040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.889+0000 7f3cd37fe640 1 -- 172.21.15.104:0/241737434 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3ccc073450 con 0x7f3cdc129d80 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.889+0000 7f3cda59c640 1 --2- 172.21.15.104:0/241737434 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3cbc03de40 0x7f3cbc040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:34.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.890+0000 7f3cda59c640 1 --2- 172.21.15.104:0/241737434 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3cbc03de40 0x7f3cbc040300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4007fd0 tx=0x7f3cc4007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:34.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:34.893+0000 7f3cd37fe640 1 -- 172.21.15.104:0/241737434 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f3ccc04b030 con 0x7f3cdc129d80 2024-09-07T03:35:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.063+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3cdc068da0 con 0x7f3cbc03de40 2024-09-07T03:35:35.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.073+0000 7f3cd37fe640 1 -- 172.21.15.104:0/241737434 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665943 (secure 0 0 0) 0x7f3cdc068da0 con 0x7f3cbc03de40 2024-09-07T03:35:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:35:35.088 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:35:35.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3cbc03de40 msgr2=0x7f3cbc040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:35.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 --2- 172.21.15.104:0/241737434 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3cbc03de40 0x7f3cbc040300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4007fd0 tx=0x7f3cc4007aa0 comp rx=0 tx=0).stop 2024-09-07T03:35:35.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 msgr2=0x7f3cdc11b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:35.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 --2- 172.21.15.104:0/241737434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 0x7f3cdc11b070 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009840 tx=0x7f3ccc0046c0 comp rx=0 tx=0).stop 2024-09-07T03:35:35.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 shutdown_connections 2024-09-07T03:35:35.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 --2- 172.21.15.104:0/241737434 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f3cbc03de40 0x7f3cbc040300 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:35.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 --2- 172.21.15.104:0/241737434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cdc129d80 0x7f3cdc11b070 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:35.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 >> 172.21.15.104:0/241737434 conn(0x7f3cdc070850 msgr2=0x7f3cdc126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:35.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 shutdown_connections 2024-09-07T03:35:35.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:35.078+0000 7f3ce10db640 1 -- 172.21.15.104:0/241737434 wait complete. 2024-09-07T03:35:35.091 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-07T03:35:33.263132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5430,"num_read_kb":4984,"num_write":2317,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4761,"ondisk_log_size":4761,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":161000,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326360,"statfs":{"total":386547056640,"available":386382192640,"internally_reserved":0,"allocated":3047424,"data_stored":1806756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":752,"num_read_kb":711,"num_write":461,"num_write_kb":29375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004159"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281796+0000","last_change":"2024-09-07T03:32:12.133842+0000","last_active":"2024-09-07T03:32:50.281796+0000","last_peered":"2024-09-07T03:32:50.281796+0000","last_clean":"2024-09-07T03:32:50.281796+0000","last_became_active":"2024-09-07T03:32:12.133110+0000","last_became_peered":"2024-09-07T03:32:12.133110+0000","last_unstale":"2024-09-07T03:32:50.281796+0000","last_undegraded":"2024-09-07T03:32:50.281796+0000","last_fullsized":"2024-09-07T03:32:50.281796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:21:24.282602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985450+0000","last_change":"2024-09-07T03:32:14.110006+0000","last_active":"2024-09-07T03:33:38.985450+0000","last_peered":"2024-09-07T03:33:38.985450+0000","last_clean":"2024-09-07T03:33:38.985450+0000","last_became_active":"2024-09-07T03:32:14.109379+0000","last_became_peered":"2024-09-07T03:32:14.109379+0000","last_unstale":"2024-09-07T03:33:38.985450+0000","last_undegraded":"2024-09-07T03:33:38.985450+0000","last_fullsized":"2024-09-07T03:33:38.985450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472145+0000","last_change":"2024-09-07T03:32:12.137021+0000","last_active":"2024-09-07T03:32:50.472145+0000","last_peered":"2024-09-07T03:32:50.472145+0000","last_clean":"2024-09-07T03:32:50.472145+0000","last_became_active":"2024-09-07T03:32:12.135945+0000","last_became_peered":"2024-09-07T03:32:12.135945+0000","last_unstale":"2024-09-07T03:32:50.472145+0000","last_undegraded":"2024-09-07T03:32:50.472145+0000","last_fullsized":"2024-09-07T03:32:50.472145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:24.882510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'18","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.476438+0000","last_change":"2024-09-07T03:32:50.283523+0000","last_active":"2024-09-07T03:35:23.476438+0000","last_peered":"2024-09-07T03:35:23.476438+0000","last_clean":"2024-09-07T03:35:23.476438+0000","last_became_active":"2024-09-07T03:32:50.279755+0000","last_became_peered":"2024-09-07T03:32:50.279755+0000","last_unstale":"2024-09-07T03:35:23.476438+0000","last_undegraded":"2024-09-07T03:35:23.476438+0000","last_fullsized":"2024-09-07T03:35:23.476438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:00:27.065883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.664376+0000","last_change":"2024-09-07T03:32:12.138579+0000","last_active":"2024-09-07T03:35:30.664376+0000","last_peered":"2024-09-07T03:35:30.664376+0000","last_clean":"2024-09-07T03:35:30.664376+0000","last_became_active":"2024-09-07T03:32:12.138176+0000","last_became_peered":"2024-09-07T03:32:12.138176+0000","last_unstale":"2024-09-07T03:35:30.664376+0000","last_undegraded":"2024-09-07T03:35:30.664376+0000","last_fullsized":"2024-09-07T03:35:30.664376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:43.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.299808+0000","last_change":"2024-09-07T03:32:50.282415+0000","last_active":"2024-09-07T03:32:56.299808+0000","last_peered":"2024-09-07T03:32:56.299808+0000","last_clean":"2024-09-07T03:32:56.299808+0000","last_became_active":"2024-09-07T03:32:50.282086+0000","last_became_peered":"2024-09-07T03:32:50.282086+0000","last_unstale":"2024-09-07T03:32:56.299808+0000","last_undegraded":"2024-09-07T03:32:56.299808+0000","last_fullsized":"2024-09-07T03:32:56.299808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:57:14.202152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275899+0000","last_change":"2024-09-07T03:32:12.129351+0000","last_active":"2024-09-07T03:32:50.275899+0000","last_peered":"2024-09-07T03:32:50.275899+0000","last_clean":"2024-09-07T03:32:50.275899+0000","last_became_active":"2024-09-07T03:32:12.128937+0000","last_became_peered":"2024-09-07T03:32:12.128937+0000","last_unstale":"2024-09-07T03:32:50.275899+0000","last_undegraded":"2024-09-07T03:32:50.275899+0000","last_fullsized":"2024-09-07T03:32:50.275899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:28:44.222642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963439+0000","last_change":"2024-09-07T03:32:14.123290+0000","last_active":"2024-09-07T03:34:22.963439+0000","last_peered":"2024-09-07T03:34:22.963439+0000","last_clean":"2024-09-07T03:34:22.963439+0000","last_became_active":"2024-09-07T03:32:14.122611+0000","last_became_peered":"2024-09-07T03:32:14.122611+0000","last_unstale":"2024-09-07T03:34:22.963439+0000","last_undegraded":"2024-09-07T03:34:22.963439+0000","last_fullsized":"2024-09-07T03:34:22.963439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279185+0000","last_change":"2024-09-07T03:32:12.124716+0000","last_active":"2024-09-07T03:32:50.279185+0000","last_peered":"2024-09-07T03:32:50.279185+0000","last_clean":"2024-09-07T03:32:50.279185+0000","last_became_active":"2024-09-07T03:32:12.123986+0000","last_became_peered":"2024-09-07T03:32:12.123986+0000","last_unstale":"2024-09-07T03:32:50.279185+0000","last_undegraded":"2024-09-07T03:32:50.279185+0000","last_fullsized":"2024-09-07T03:32:50.279185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:10.648401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.597575+0000","last_change":"2024-09-07T03:32:14.124801+0000","last_active":"2024-09-07T03:35:23.597575+0000","last_peered":"2024-09-07T03:35:23.597575+0000","last_clean":"2024-09-07T03:35:23.597575+0000","last_became_active":"2024-09-07T03:32:14.124523+0000","last_became_peered":"2024-09-07T03:32:14.124523+0000","last_unstale":"2024-09-07T03:35:23.597575+0000","last_undegraded":"2024-09-07T03:35:23.597575+0000","last_fullsized":"2024-09-07T03:35:23.597575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:39.133433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.558996+0000","last_change":"2024-09-07T03:32:12.133960+0000","last_active":"2024-09-07T03:32:56.558996+0000","last_peered":"2024-09-07T03:32:56.558996+0000","last_clean":"2024-09-07T03:32:56.558996+0000","last_became_active":"2024-09-07T03:32:12.133597+0000","last_became_peered":"2024-09-07T03:32:12.133597+0000","last_unstale":"2024-09-07T03:32:56.558996+0000","last_undegraded":"2024-09-07T03:32:56.558996+0000","last_fullsized":"2024-09-07T03:32:56.558996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:16:06.544105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.571091+0000","last_change":"2024-09-07T03:32:14.113584+0000","last_active":"2024-09-07T03:32:56.571091+0000","last_peered":"2024-09-07T03:32:56.571091+0000","last_clean":"2024-09-07T03:32:56.571091+0000","last_became_active":"2024-09-07T03:32:14.112622+0000","last_became_peered":"2024-09-07T03:32:14.112622+0000","last_unstale":"2024-09-07T03:32:56.571091+0000","last_undegraded":"2024-09-07T03:32:56.571091+0000","last_fullsized":"2024-09-07T03:32:56.571091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:52.320086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273279+0000","last_change":"2024-09-07T03:32:12.140541+0000","last_active":"2024-09-07T03:32:50.273279+0000","last_peered":"2024-09-07T03:32:50.273279+0000","last_clean":"2024-09-07T03:32:50.273279+0000","last_became_active":"2024-09-07T03:32:12.140221+0000","last_became_peered":"2024-09-07T03:32:12.140221+0000","last_unstale":"2024-09-07T03:32:50.273279+0000","last_undegraded":"2024-09-07T03:32:50.273279+0000","last_fullsized":"2024-09-07T03:32:50.273279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:56.248253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.300068+0000","last_change":"2024-09-07T03:32:14.114929+0000","last_active":"2024-09-07T03:32:56.300068+0000","last_peered":"2024-09-07T03:32:56.300068+0000","last_clean":"2024-09-07T03:32:56.300068+0000","last_became_active":"2024-09-07T03:32:14.114529+0000","last_became_peered":"2024-09-07T03:32:14.114529+0000","last_unstale":"2024-09-07T03:32:56.300068+0000","last_undegraded":"2024-09-07T03:32:56.300068+0000","last_fullsized":"2024-09-07T03:32:56.300068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.398335+0000","last_change":"2024-09-07T03:32:12.143568+0000","last_active":"2024-09-07T03:35:23.398335+0000","last_peered":"2024-09-07T03:35:23.398335+0000","last_clean":"2024-09-07T03:35:23.398335+0000","last_became_active":"2024-09-07T03:32:12.143209+0000","last_became_peered":"2024-09-07T03:32:12.143209+0000","last_unstale":"2024-09-07T03:35:23.398335+0000","last_undegraded":"2024-09-07T03:35:23.398335+0000","last_fullsized":"2024-09-07T03:35:23.398335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:31:58.691796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.944310+0000","last_change":"2024-09-07T03:32:14.124391+0000","last_active":"2024-09-07T03:35:23.944310+0000","last_peered":"2024-09-07T03:35:23.944310+0000","last_clean":"2024-09-07T03:35:23.944310+0000","last_became_active":"2024-09-07T03:32:14.124135+0000","last_became_peered":"2024-09-07T03:32:14.124135+0000","last_unstale":"2024-09-07T03:35:23.944310+0000","last_undegraded":"2024-09-07T03:35:23.944310+0000","last_fullsized":"2024-09-07T03:35:23.944310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:40.853544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'14","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806118+0000","last_change":"2024-09-07T03:32:14.109787+0000","last_active":"2024-09-07T03:35:23.806118+0000","last_peered":"2024-09-07T03:35:23.806118+0000","last_clean":"2024-09-07T03:35:23.806118+0000","last_became_active":"2024-09-07T03:32:14.109280+0000","last_became_peered":"2024-09-07T03:32:14.109280+0000","last_unstale":"2024-09-07T03:35:23.806118+0000","last_undegraded":"2024-09-07T03:35:23.806118+0000","last_fullsized":"2024-09-07T03:35:23.806118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473124+0000","last_change":"2024-09-07T03:32:12.136387+0000","last_active":"2024-09-07T03:32:50.473124+0000","last_peered":"2024-09-07T03:32:50.473124+0000","last_clean":"2024-09-07T03:32:50.473124+0000","last_became_active":"2024-09-07T03:32:12.134379+0000","last_became_peered":"2024-09-07T03:32:12.134379+0000","last_unstale":"2024-09-07T03:32:50.473124+0000","last_undegraded":"2024-09-07T03:32:50.473124+0000","last_fullsized":"2024-09-07T03:32:50.473124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:52:06.698087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843636+0000","last_change":"2024-09-07T03:32:14.112114+0000","last_active":"2024-09-07T03:35:23.843636+0000","last_peered":"2024-09-07T03:35:23.843636+0000","last_clean":"2024-09-07T03:35:23.843636+0000","last_became_active":"2024-09-07T03:32:14.111769+0000","last_became_peered":"2024-09-07T03:32:14.111769+0000","last_unstale":"2024-09-07T03:35:23.843636+0000","last_undegraded":"2024-09-07T03:35:23.843636+0000","last_fullsized":"2024-09-07T03:35:23.843636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.714226+0000","last_change":"2024-09-07T03:32:12.129681+0000","last_active":"2024-09-07T03:35:23.714226+0000","last_peered":"2024-09-07T03:35:23.714226+0000","last_clean":"2024-09-07T03:35:23.714226+0000","last_became_active":"2024-09-07T03:32:12.129310+0000","last_became_peered":"2024-09-07T03:32:12.129310+0000","last_unstale":"2024-09-07T03:35:23.714226+0000","last_undegraded":"2024-09-07T03:35:23.714226+0000","last_fullsized":"2024-09-07T03:35:23.714226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:31.913444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.590380+0000","last_change":"2024-09-07T03:32:14.109568+0000","last_active":"2024-09-07T03:35:23.590380+0000","last_peered":"2024-09-07T03:35:23.590380+0000","last_clean":"2024-09-07T03:35:23.590380+0000","last_became_active":"2024-09-07T03:32:14.109177+0000","last_became_peered":"2024-09-07T03:32:14.109177+0000","last_unstale":"2024-09-07T03:35:23.590380+0000","last_undegraded":"2024-09-07T03:35:23.590380+0000","last_fullsized":"2024-09-07T03:35:23.590380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:49:22.436331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281713+0000","last_change":"2024-09-07T03:32:12.121206+0000","last_active":"2024-09-07T03:32:50.281713+0000","last_peered":"2024-09-07T03:32:50.281713+0000","last_clean":"2024-09-07T03:32:50.281713+0000","last_became_active":"2024-09-07T03:32:12.120449+0000","last_became_peered":"2024-09-07T03:32:12.120449+0000","last_unstale":"2024-09-07T03:32:50.281713+0000","last_undegraded":"2024-09-07T03:32:50.281713+0000","last_fullsized":"2024-09-07T03:32:50.281713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:04:17.603683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731173+0000","last_change":"2024-09-07T03:32:14.125322+0000","last_active":"2024-09-07T03:35:23.731173+0000","last_peered":"2024-09-07T03:35:23.731173+0000","last_clean":"2024-09-07T03:35:23.731173+0000","last_became_active":"2024-09-07T03:32:14.125065+0000","last_became_peered":"2024-09-07T03:32:14.125065+0000","last_unstale":"2024-09-07T03:35:23.731173+0000","last_undegraded":"2024-09-07T03:35:23.731173+0000","last_fullsized":"2024-09-07T03:35:23.731173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.382792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279118+0000","last_change":"2024-09-07T03:32:12.125531+0000","last_active":"2024-09-07T03:32:50.279118+0000","last_peered":"2024-09-07T03:32:50.279118+0000","last_clean":"2024-09-07T03:32:50.279118+0000","last_became_active":"2024-09-07T03:32:12.124516+0000","last_became_peered":"2024-09-07T03:32:12.124516+0000","last_unstale":"2024-09-07T03:32:50.279118+0000","last_undegraded":"2024-09-07T03:32:50.279118+0000","last_fullsized":"2024-09-07T03:32:50.279118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:38.848848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:41.230770+0000","last_change":"2024-09-07T03:32:14.112755+0000","last_active":"2024-09-07T03:34:41.230770+0000","last_peered":"2024-09-07T03:34:41.230770+0000","last_clean":"2024-09-07T03:34:41.230770+0000","last_became_active":"2024-09-07T03:32:14.112477+0000","last_became_peered":"2024-09-07T03:32:14.112477+0000","last_unstale":"2024-09-07T03:34:41.230770+0000","last_undegraded":"2024-09-07T03:34:41.230770+0000","last_fullsized":"2024-09-07T03:34:41.230770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:41:15.350018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275444+0000","last_change":"2024-09-07T03:32:12.137178+0000","last_active":"2024-09-07T03:32:50.275444+0000","last_peered":"2024-09-07T03:32:50.275444+0000","last_clean":"2024-09-07T03:32:50.275444+0000","last_became_active":"2024-09-07T03:32:12.136801+0000","last_became_peered":"2024-09-07T03:32:12.136801+0000","last_unstale":"2024-09-07T03:32:50.275444+0000","last_undegraded":"2024-09-07T03:32:50.275444+0000","last_fullsized":"2024-09-07T03:32:50.275444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:14:59.894718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.850114+0000","last_change":"2024-09-07T03:32:14.109462+0000","last_active":"2024-09-07T03:35:23.850114+0000","last_peered":"2024-09-07T03:35:23.850114+0000","last_clean":"2024-09-07T03:35:23.850114+0000","last_became_active":"2024-09-07T03:32:14.109167+0000","last_became_peered":"2024-09-07T03:32:14.109167+0000","last_unstale":"2024-09-07T03:35:23.850114+0000","last_undegraded":"2024-09-07T03:35:23.850114+0000","last_fullsized":"2024-09-07T03:35:23.850114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:39.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272300+0000","last_change":"2024-09-07T03:32:12.138445+0000","last_active":"2024-09-07T03:32:50.272300+0000","last_peered":"2024-09-07T03:32:50.272300+0000","last_clean":"2024-09-07T03:32:50.272300+0000","last_became_active":"2024-09-07T03:32:12.138105+0000","last_became_peered":"2024-09-07T03:32:12.138105+0000","last_unstale":"2024-09-07T03:32:50.272300+0000","last_undegraded":"2024-09-07T03:32:50.272300+0000","last_fullsized":"2024-09-07T03:32:50.272300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.111018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.773106+0000","last_change":"2024-09-07T03:32:22.149626+0000","last_active":"2024-09-07T03:35:23.773106+0000","last_peered":"2024-09-07T03:35:23.773106+0000","last_clean":"2024-09-07T03:35:23.773106+0000","last_became_active":"2024-09-07T03:32:22.149337+0000","last_became_peered":"2024-09-07T03:32:22.149337+0000","last_unstale":"2024-09-07T03:35:23.773106+0000","last_undegraded":"2024-09-07T03:35:23.773106+0000","last_fullsized":"2024-09-07T03:35:23.773106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:00:45.310817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230587+0000","last_change":"2024-09-07T03:32:14.126524+0000","last_active":"2024-09-07T03:34:36.230587+0000","last_peered":"2024-09-07T03:34:36.230587+0000","last_clean":"2024-09-07T03:34:36.230587+0000","last_became_active":"2024-09-07T03:32:14.126222+0000","last_became_peered":"2024-09-07T03:32:14.126222+0000","last_unstale":"2024-09-07T03:34:36.230587+0000","last_undegraded":"2024-09-07T03:34:36.230587+0000","last_fullsized":"2024-09-07T03:34:36.230587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:51:09.670249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273573+0000","last_change":"2024-09-07T03:32:12.125232+0000","last_active":"2024-09-07T03:32:50.273573+0000","last_peered":"2024-09-07T03:32:50.273573+0000","last_clean":"2024-09-07T03:32:50.273573+0000","last_became_active":"2024-09-07T03:32:12.124815+0000","last_became_peered":"2024-09-07T03:32:12.124815+0000","last_unstale":"2024-09-07T03:32:50.273573+0000","last_undegraded":"2024-09-07T03:32:50.273573+0000","last_fullsized":"2024-09-07T03:32:50.273573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:23.041037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275282+0000","last_change":"2024-09-07T03:32:16.127792+0000","last_active":"2024-09-07T03:32:50.275282+0000","last_peered":"2024-09-07T03:32:50.275282+0000","last_clean":"2024-09-07T03:32:50.275282+0000","last_became_active":"2024-09-07T03:32:16.127430+0000","last_became_peered":"2024-09-07T03:32:16.127430+0000","last_unstale":"2024-09-07T03:32:50.275282+0000","last_undegraded":"2024-09-07T03:32:50.275282+0000","last_fullsized":"2024-09-07T03:32:50.275282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:46.752720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.588157+0000","last_change":"2024-09-07T03:32:18.130430+0000","last_active":"2024-09-07T03:35:30.588157+0000","last_peered":"2024-09-07T03:35:30.588157+0000","last_clean":"2024-09-07T03:35:30.588157+0000","last_became_active":"2024-09-07T03:32:18.130101+0000","last_became_peered":"2024-09-07T03:32:18.130101+0000","last_unstale":"2024-09-07T03:35:30.588157+0000","last_undegraded":"2024-09-07T03:35:30.588157+0000","last_fullsized":"2024-09-07T03:35:30.588157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:55.756545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280723+0000","last_change":"2024-09-07T03:32:20.147157+0000","last_active":"2024-09-07T03:32:50.280723+0000","last_peered":"2024-09-07T03:32:50.280723+0000","last_clean":"2024-09-07T03:32:50.280723+0000","last_became_active":"2024-09-07T03:32:20.146716+0000","last_became_peered":"2024-09-07T03:32:20.146716+0000","last_unstale":"2024-09-07T03:32:50.280723+0000","last_undegraded":"2024-09-07T03:32:50.280723+0000","last_fullsized":"2024-09-07T03:32:50.280723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:23.679745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"36'9","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.982420+0000","last_change":"2024-09-07T03:32:22.143355+0000","last_active":"2024-09-07T03:33:38.982420+0000","last_peered":"2024-09-07T03:33:38.982420+0000","last_clean":"2024-09-07T03:33:38.982420+0000","last_became_active":"2024-09-07T03:32:22.143092+0000","last_became_peered":"2024-09-07T03:32:22.143092+0000","last_unstale":"2024-09-07T03:33:38.982420+0000","last_undegraded":"2024-09-07T03:33:38.982420+0000","last_fullsized":"2024-09-07T03:33:38.982420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:30:18.450771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'8","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843638+0000","last_change":"2024-09-07T03:32:14.122327+0000","last_active":"2024-09-07T03:35:23.843638+0000","last_peered":"2024-09-07T03:35:23.843638+0000","last_clean":"2024-09-07T03:35:23.843638+0000","last_became_active":"2024-09-07T03:32:14.121998+0000","last_became_peered":"2024-09-07T03:32:14.121998+0000","last_unstale":"2024-09-07T03:35:23.843638+0000","last_undegraded":"2024-09-07T03:35:23.843638+0000","last_fullsized":"2024-09-07T03:35:23.843638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432032+0000","last_change":"2024-09-07T03:32:12.130331+0000","last_active":"2024-09-07T03:32:55.432032+0000","last_peered":"2024-09-07T03:32:55.432032+0000","last_clean":"2024-09-07T03:32:55.432032+0000","last_became_active":"2024-09-07T03:32:12.129979+0000","last_became_peered":"2024-09-07T03:32:12.129979+0000","last_unstale":"2024-09-07T03:32:55.432032+0000","last_undegraded":"2024-09-07T03:32:55.432032+0000","last_fullsized":"2024-09-07T03:32:55.432032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:15.786134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275223+0000","last_change":"2024-09-07T03:32:16.126421+0000","last_active":"2024-09-07T03:32:50.275223+0000","last_peered":"2024-09-07T03:32:50.275223+0000","last_clean":"2024-09-07T03:32:50.275223+0000","last_became_active":"2024-09-07T03:32:16.126116+0000","last_became_peered":"2024-09-07T03:32:16.126116+0000","last_unstale":"2024-09-07T03:32:50.275223+0000","last_undegraded":"2024-09-07T03:32:50.275223+0000","last_fullsized":"2024-09-07T03:32:50.275223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:07:32.152302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472267+0000","last_change":"2024-09-07T03:32:18.132461+0000","last_active":"2024-09-07T03:32:50.472267+0000","last_peered":"2024-09-07T03:32:50.472267+0000","last_clean":"2024-09-07T03:32:50.472267+0000","last_became_active":"2024-09-07T03:32:18.132152+0000","last_became_peered":"2024-09-07T03:32:18.132152+0000","last_unstale":"2024-09-07T03:32:50.472267+0000","last_undegraded":"2024-09-07T03:32:50.472267+0000","last_fullsized":"2024-09-07T03:32:50.472267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:45:42.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280341+0000","last_change":"2024-09-07T03:32:20.146991+0000","last_active":"2024-09-07T03:32:50.280341+0000","last_peered":"2024-09-07T03:32:50.280341+0000","last_clean":"2024-09-07T03:32:50.280341+0000","last_became_active":"2024-09-07T03:32:20.146457+0000","last_became_peered":"2024-09-07T03:32:20.146457+0000","last_unstale":"2024-09-07T03:32:50.280341+0000","last_undegraded":"2024-09-07T03:32:50.280341+0000","last_fullsized":"2024-09-07T03:32:50.280341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.222346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"36'10","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.807540+0000","last_change":"2024-09-07T03:32:22.144066+0000","last_active":"2024-09-07T03:35:23.807540+0000","last_peered":"2024-09-07T03:35:23.807540+0000","last_clean":"2024-09-07T03:35:23.807540+0000","last_became_active":"2024-09-07T03:32:22.143751+0000","last_became_peered":"2024-09-07T03:32:22.143751+0000","last_unstale":"2024-09-07T03:35:23.807540+0000","last_undegraded":"2024-09-07T03:35:23.807540+0000","last_fullsized":"2024-09-07T03:35:23.807540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:14.926443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"36'20","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731193+0000","last_change":"2024-09-07T03:32:14.130832+0000","last_active":"2024-09-07T03:35:23.731193+0000","last_peered":"2024-09-07T03:35:23.731193+0000","last_clean":"2024-09-07T03:35:23.731193+0000","last_became_active":"2024-09-07T03:32:14.130544+0000","last_became_peered":"2024-09-07T03:32:14.130544+0000","last_unstale":"2024-09-07T03:35:23.731193+0000","last_undegraded":"2024-09-07T03:35:23.731193+0000","last_fullsized":"2024-09-07T03:35:23.731193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278167+0000","last_change":"2024-09-07T03:32:12.125233+0000","last_active":"2024-09-07T03:32:50.278167+0000","last_peered":"2024-09-07T03:32:50.278167+0000","last_clean":"2024-09-07T03:32:50.278167+0000","last_became_active":"2024-09-07T03:32:12.124808+0000","last_became_peered":"2024-09-07T03:32:12.124808+0000","last_unstale":"2024-09-07T03:32:50.278167+0000","last_undegraded":"2024-09-07T03:32:50.278167+0000","last_fullsized":"2024-09-07T03:32:50.278167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:26.378096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276016+0000","last_change":"2024-09-07T03:32:16.126571+0000","last_active":"2024-09-07T03:32:50.276016+0000","last_peered":"2024-09-07T03:32:50.276016+0000","last_clean":"2024-09-07T03:32:50.276016+0000","last_became_active":"2024-09-07T03:32:16.126318+0000","last_became_peered":"2024-09-07T03:32:16.126318+0000","last_unstale":"2024-09-07T03:32:50.276016+0000","last_undegraded":"2024-09-07T03:32:50.276016+0000","last_fullsized":"2024-09-07T03:32:50.276016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:51.962540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275774+0000","last_change":"2024-09-07T03:32:18.128687+0000","last_active":"2024-09-07T03:32:50.275774+0000","last_peered":"2024-09-07T03:32:50.275774+0000","last_clean":"2024-09-07T03:32:50.275774+0000","last_became_active":"2024-09-07T03:32:18.128391+0000","last_became_peered":"2024-09-07T03:32:18.128391+0000","last_unstale":"2024-09-07T03:32:50.275774+0000","last_undegraded":"2024-09-07T03:32:50.275774+0000","last_fullsized":"2024-09-07T03:32:50.275774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:50:24.989266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.539513+0000","last_change":"2024-09-07T03:32:20.140796+0000","last_active":"2024-09-07T03:35:30.539513+0000","last_peered":"2024-09-07T03:35:30.539513+0000","last_clean":"2024-09-07T03:35:30.539513+0000","last_became_active":"2024-09-07T03:32:20.140249+0000","last_became_peered":"2024-09-07T03:32:20.140249+0000","last_unstale":"2024-09-07T03:35:30.539513+0000","last_undegraded":"2024-09-07T03:35:30.539513+0000","last_fullsized":"2024-09-07T03:35:30.539513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:12.918865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274799+0000","last_change":"2024-09-07T03:32:22.141118+0000","last_active":"2024-09-07T03:32:50.274799+0000","last_peered":"2024-09-07T03:32:50.274799+0000","last_clean":"2024-09-07T03:32:50.274799+0000","last_became_active":"2024-09-07T03:32:22.139829+0000","last_became_peered":"2024-09-07T03:32:22.139829+0000","last_unstale":"2024-09-07T03:32:50.274799+0000","last_undegraded":"2024-09-07T03:32:50.274799+0000","last_fullsized":"2024-09-07T03:32:50.274799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:55:30.425595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587735+0000","last_change":"2024-09-07T03:32:14.126517+0000","last_active":"2024-09-07T03:35:23.587735+0000","last_peered":"2024-09-07T03:35:23.587735+0000","last_clean":"2024-09-07T03:35:23.587735+0000","last_became_active":"2024-09-07T03:32:14.126140+0000","last_became_peered":"2024-09-07T03:32:14.126140+0000","last_unstale":"2024-09-07T03:35:23.587735+0000","last_undegraded":"2024-09-07T03:35:23.587735+0000","last_fullsized":"2024-09-07T03:35:23.587735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277837+0000","last_change":"2024-09-07T03:32:12.133946+0000","last_active":"2024-09-07T03:32:50.277837+0000","last_peered":"2024-09-07T03:32:50.277837+0000","last_clean":"2024-09-07T03:32:50.277837+0000","last_became_active":"2024-09-07T03:32:12.133270+0000","last_became_peered":"2024-09-07T03:32:12.133270+0000","last_unstale":"2024-09-07T03:32:50.277837+0000","last_undegraded":"2024-09-07T03:32:50.277837+0000","last_fullsized":"2024-09-07T03:32:50.277837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:56.372379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281906+0000","last_change":"2024-09-07T03:32:16.117091+0000","last_active":"2024-09-07T03:32:50.281906+0000","last_peered":"2024-09-07T03:32:50.281906+0000","last_clean":"2024-09-07T03:32:50.281906+0000","last_became_active":"2024-09-07T03:32:16.116761+0000","last_became_peered":"2024-09-07T03:32:16.116761+0000","last_unstale":"2024-09-07T03:32:50.281906+0000","last_undegraded":"2024-09-07T03:32:50.281906+0000","last_fullsized":"2024-09-07T03:32:50.281906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:07:07.674647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'41","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.680636+0000","last_change":"2024-09-07T03:32:18.129567+0000","last_active":"2024-09-07T03:35:30.680636+0000","last_peered":"2024-09-07T03:35:30.680636+0000","last_clean":"2024-09-07T03:35:30.680636+0000","last_became_active":"2024-09-07T03:32:18.128901+0000","last_became_peered":"2024-09-07T03:32:18.128901+0000","last_unstale":"2024-09-07T03:35:30.680636+0000","last_undegraded":"2024-09-07T03:35:30.680636+0000","last_fullsized":"2024-09-07T03:35:30.680636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:42:21.711836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.545527+0000","last_change":"2024-09-07T03:32:20.142693+0000","last_active":"2024-09-07T03:35:30.545527+0000","last_peered":"2024-09-07T03:35:30.545527+0000","last_clean":"2024-09-07T03:35:30.545527+0000","last_became_active":"2024-09-07T03:32:20.142390+0000","last_became_peered":"2024-09-07T03:32:20.142390+0000","last_unstale":"2024-09-07T03:35:30.545527+0000","last_undegraded":"2024-09-07T03:35:30.545527+0000","last_fullsized":"2024-09-07T03:35:30.545527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:51:20.882177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272814+0000","last_change":"2024-09-07T03:32:14.123300+0000","last_active":"2024-09-07T03:32:50.272814+0000","last_peered":"2024-09-07T03:32:50.272814+0000","last_clean":"2024-09-07T03:32:50.272814+0000","last_became_active":"2024-09-07T03:32:14.122806+0000","last_became_peered":"2024-09-07T03:32:14.122806+0000","last_unstale":"2024-09-07T03:32:50.272814+0000","last_undegraded":"2024-09-07T03:32:50.272814+0000","last_fullsized":"2024-09-07T03:32:50.272814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:12.527168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.458084+0000","last_change":"2024-09-07T03:32:12.125001+0000","last_active":"2024-09-07T03:35:23.458084+0000","last_peered":"2024-09-07T03:35:23.458084+0000","last_clean":"2024-09-07T03:35:23.458084+0000","last_became_active":"2024-09-07T03:32:12.124564+0000","last_became_peered":"2024-09-07T03:32:12.124564+0000","last_unstale":"2024-09-07T03:35:23.458084+0000","last_undegraded":"2024-09-07T03:35:23.458084+0000","last_fullsized":"2024-09-07T03:35:23.458084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:13:15.055699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470518+0000","last_change":"2024-09-07T03:32:16.128785+0000","last_active":"2024-09-07T03:32:50.470518+0000","last_peered":"2024-09-07T03:32:50.470518+0000","last_clean":"2024-09-07T03:32:50.470518+0000","last_became_active":"2024-09-07T03:32:16.128519+0000","last_became_peered":"2024-09-07T03:32:16.128519+0000","last_unstale":"2024-09-07T03:32:50.470518+0000","last_undegraded":"2024-09-07T03:32:50.470518+0000","last_fullsized":"2024-09-07T03:32:50.470518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:31.864367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'49","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.600626+0000","last_change":"2024-09-07T03:32:18.133115+0000","last_active":"2024-09-07T03:35:30.600626+0000","last_peered":"2024-09-07T03:35:30.600626+0000","last_clean":"2024-09-07T03:35:30.600626+0000","last_became_active":"2024-09-07T03:32:18.132867+0000","last_became_peered":"2024-09-07T03:32:18.132867+0000","last_unstale":"2024-09-07T03:35:30.600626+0000","last_undegraded":"2024-09-07T03:35:30.600626+0000","last_fullsized":"2024-09-07T03:35:30.600626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:21.167694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470403+0000","last_change":"2024-09-07T03:32:20.140261+0000","last_active":"2024-09-07T03:32:50.470403+0000","last_peered":"2024-09-07T03:32:50.470403+0000","last_clean":"2024-09-07T03:32:50.470403+0000","last_became_active":"2024-09-07T03:32:20.139806+0000","last_became_peered":"2024-09-07T03:32:20.139806+0000","last_unstale":"2024-09-07T03:32:50.470403+0000","last_undegraded":"2024-09-07T03:32:50.470403+0000","last_fullsized":"2024-09-07T03:32:50.470403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:38:36.923114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.784797+0000","last_change":"2024-09-07T03:32:22.148464+0000","last_active":"2024-09-07T03:35:23.784797+0000","last_peered":"2024-09-07T03:35:23.784797+0000","last_clean":"2024-09-07T03:35:23.784797+0000","last_became_active":"2024-09-07T03:32:22.148149+0000","last_became_peered":"2024-09-07T03:32:22.148149+0000","last_unstale":"2024-09-07T03:35:23.784797+0000","last_undegraded":"2024-09-07T03:35:23.784797+0000","last_fullsized":"2024-09-07T03:35:23.784797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:22.630172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806003+0000","last_change":"2024-09-07T03:32:50.281567+0000","last_active":"2024-09-07T03:35:23.806003+0000","last_peered":"2024-09-07T03:35:23.806003+0000","last_clean":"2024-09-07T03:35:23.806003+0000","last_became_active":"2024-09-07T03:32:50.279097+0000","last_became_peered":"2024-09-07T03:32:50.279097+0000","last_unstale":"2024-09-07T03:35:23.806003+0000","last_undegraded":"2024-09-07T03:35:23.806003+0000","last_fullsized":"2024-09-07T03:35:23.806003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:31:29.966121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.432175+0000","last_change":"2024-09-07T03:32:12.124416+0000","last_active":"2024-09-07T03:35:23.432175+0000","last_peered":"2024-09-07T03:35:23.432175+0000","last_clean":"2024-09-07T03:35:23.432175+0000","last_became_active":"2024-09-07T03:32:12.123895+0000","last_became_peered":"2024-09-07T03:32:12.123895+0000","last_unstale":"2024-09-07T03:35:23.432175+0000","last_undegraded":"2024-09-07T03:35:23.432175+0000","last_fullsized":"2024-09-07T03:35:23.432175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:03.158393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274777+0000","last_change":"2024-09-07T03:32:16.129022+0000","last_active":"2024-09-07T03:32:50.274777+0000","last_peered":"2024-09-07T03:32:50.274777+0000","last_clean":"2024-09-07T03:32:50.274777+0000","last_became_active":"2024-09-07T03:32:16.128471+0000","last_became_peered":"2024-09-07T03:32:16.128471+0000","last_unstale":"2024-09-07T03:32:50.274777+0000","last_undegraded":"2024-09-07T03:32:50.274777+0000","last_fullsized":"2024-09-07T03:32:50.274777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:29.378625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'39","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.641623+0000","last_change":"2024-09-07T03:32:18.127995+0000","last_active":"2024-09-07T03:35:30.641623+0000","last_peered":"2024-09-07T03:35:30.641623+0000","last_clean":"2024-09-07T03:35:30.641623+0000","last_became_active":"2024-09-07T03:32:18.127674+0000","last_became_peered":"2024-09-07T03:32:18.127674+0000","last_unstale":"2024-09-07T03:35:30.641623+0000","last_undegraded":"2024-09-07T03:35:30.641623+0000","last_fullsized":"2024-09-07T03:35:30.641623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:39:30.847124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272008+0000","last_change":"2024-09-07T03:32:20.142615+0000","last_active":"2024-09-07T03:32:50.272008+0000","last_peered":"2024-09-07T03:32:50.272008+0000","last_clean":"2024-09-07T03:32:50.272008+0000","last_became_active":"2024-09-07T03:32:20.142322+0000","last_became_peered":"2024-09-07T03:32:20.142322+0000","last_unstale":"2024-09-07T03:32:50.272008+0000","last_undegraded":"2024-09-07T03:32:50.272008+0000","last_fullsized":"2024-09-07T03:32:50.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:20:24.113543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:33.274480+0000","last_change":"2024-09-07T03:32:22.140060+0000","last_active":"2024-09-07T03:33:33.274480+0000","last_peered":"2024-09-07T03:33:33.274480+0000","last_clean":"2024-09-07T03:33:33.274480+0000","last_became_active":"2024-09-07T03:32:22.139771+0000","last_became_peered":"2024-09-07T03:32:22.139771+0000","last_unstale":"2024-09-07T03:33:33.274480+0000","last_undegraded":"2024-09-07T03:33:33.274480+0000","last_fullsized":"2024-09-07T03:33:33.274480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:32:56.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963274+0000","last_change":"2024-09-07T03:32:14.122499+0000","last_active":"2024-09-07T03:34:22.963274+0000","last_peered":"2024-09-07T03:34:22.963274+0000","last_clean":"2024-09-07T03:34:22.963274+0000","last_became_active":"2024-09-07T03:32:14.122182+0000","last_became_peered":"2024-09-07T03:32:14.122182+0000","last_unstale":"2024-09-07T03:34:22.963274+0000","last_undegraded":"2024-09-07T03:34:22.963274+0000","last_fullsized":"2024-09-07T03:34:22.963274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.940422+0000","last_change":"2024-09-07T03:32:12.120934+0000","last_active":"2024-09-07T03:34:22.940422+0000","last_peered":"2024-09-07T03:34:22.940422+0000","last_clean":"2024-09-07T03:34:22.940422+0000","last_became_active":"2024-09-07T03:32:12.120464+0000","last_became_peered":"2024-09-07T03:32:12.120464+0000","last_unstale":"2024-09-07T03:34:22.940422+0000","last_undegraded":"2024-09-07T03:34:22.940422+0000","last_fullsized":"2024-09-07T03:34:22.940422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:35:47.814978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275521+0000","last_change":"2024-09-07T03:32:16.124913+0000","last_active":"2024-09-07T03:32:50.275521+0000","last_peered":"2024-09-07T03:32:50.275521+0000","last_clean":"2024-09-07T03:32:50.275521+0000","last_became_active":"2024-09-07T03:32:16.124297+0000","last_became_peered":"2024-09-07T03:32:16.124297+0000","last_unstale":"2024-09-07T03:32:50.275521+0000","last_undegraded":"2024-09-07T03:32:50.275521+0000","last_fullsized":"2024-09-07T03:32:50.275521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:34.327180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'52","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.607217+0000","last_change":"2024-09-07T03:32:18.130149+0000","last_active":"2024-09-07T03:35:30.607217+0000","last_peered":"2024-09-07T03:35:30.607217+0000","last_clean":"2024-09-07T03:35:30.607217+0000","last_became_active":"2024-09-07T03:32:18.129944+0000","last_became_peered":"2024-09-07T03:32:18.129944+0000","last_unstale":"2024-09-07T03:35:30.607217+0000","last_undegraded":"2024-09-07T03:35:30.607217+0000","last_fullsized":"2024-09-07T03:35:30.607217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:27:30.361760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":352,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.546808+0000","last_change":"2024-09-07T03:32:20.144523+0000","last_active":"2024-09-07T03:35:30.546808+0000","last_peered":"2024-09-07T03:35:30.546808+0000","last_clean":"2024-09-07T03:35:30.546808+0000","last_became_active":"2024-09-07T03:32:20.144077+0000","last_became_peered":"2024-09-07T03:32:20.144077+0000","last_unstale":"2024-09-07T03:35:30.546808+0000","last_undegraded":"2024-09-07T03:35:30.546808+0000","last_fullsized":"2024-09-07T03:35:30.546808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:25.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471098+0000","last_change":"2024-09-07T03:32:22.146228+0000","last_active":"2024-09-07T03:32:50.471098+0000","last_peered":"2024-09-07T03:32:50.471098+0000","last_clean":"2024-09-07T03:32:50.471098+0000","last_became_active":"2024-09-07T03:32:22.145690+0000","last_became_peered":"2024-09-07T03:32:22.145690+0000","last_unstale":"2024-09-07T03:32:50.471098+0000","last_undegraded":"2024-09-07T03:32:50.471098+0000","last_fullsized":"2024-09-07T03:32:50.471098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:59:34.851122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'7","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.483958+0000","last_change":"2024-09-07T03:32:14.113637+0000","last_active":"2024-09-07T03:35:23.483958+0000","last_peered":"2024-09-07T03:35:23.483958+0000","last_clean":"2024-09-07T03:35:23.483958+0000","last_became_active":"2024-09-07T03:32:14.113104+0000","last_became_peered":"2024-09-07T03:32:14.113104+0000","last_unstale":"2024-09-07T03:35:23.483958+0000","last_undegraded":"2024-09-07T03:35:23.483958+0000","last_fullsized":"2024-09-07T03:35:23.483958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:46:15.552973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278855+0000","last_change":"2024-09-07T03:32:12.125878+0000","last_active":"2024-09-07T03:32:50.278855+0000","last_peered":"2024-09-07T03:32:50.278855+0000","last_clean":"2024-09-07T03:32:50.278855+0000","last_became_active":"2024-09-07T03:32:12.125172+0000","last_became_peered":"2024-09-07T03:32:12.125172+0000","last_unstale":"2024-09-07T03:32:50.278855+0000","last_undegraded":"2024-09-07T03:32:50.278855+0000","last_fullsized":"2024-09-07T03:32:50.278855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:36:10.691266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278236+0000","last_change":"2024-09-07T03:32:16.125904+0000","last_active":"2024-09-07T03:32:50.278236+0000","last_peered":"2024-09-07T03:32:50.278236+0000","last_clean":"2024-09-07T03:32:50.278236+0000","last_became_active":"2024-09-07T03:32:16.125618+0000","last_became_peered":"2024-09-07T03:32:16.125618+0000","last_unstale":"2024-09-07T03:32:50.278236+0000","last_undegraded":"2024-09-07T03:32:50.278236+0000","last_fullsized":"2024-09-07T03:32:50.278236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:06.494089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'72","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.650570+0000","last_change":"2024-09-07T03:32:18.134274+0000","last_active":"2024-09-07T03:35:30.650570+0000","last_peered":"2024-09-07T03:35:30.650570+0000","last_clean":"2024-09-07T03:35:30.650570+0000","last_became_active":"2024-09-07T03:32:18.134005+0000","last_became_peered":"2024-09-07T03:32:18.134005+0000","last_unstale":"2024-09-07T03:35:30.650570+0000","last_undegraded":"2024-09-07T03:35:30.650570+0000","last_fullsized":"2024-09-07T03:35:30.650570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:07.792695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274382+0000","last_change":"2024-09-07T03:32:20.145524+0000","last_active":"2024-09-07T03:32:50.274382+0000","last_peered":"2024-09-07T03:32:50.274382+0000","last_clean":"2024-09-07T03:32:50.274382+0000","last_became_active":"2024-09-07T03:32:20.145119+0000","last_became_peered":"2024-09-07T03:32:20.145119+0000","last_unstale":"2024-09-07T03:32:50.274382+0000","last_undegraded":"2024-09-07T03:32:50.274382+0000","last_fullsized":"2024-09-07T03:32:50.274382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:21.410162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.058175+0000","last_change":"2024-09-07T03:32:22.149484+0000","last_active":"2024-09-07T03:35:24.058175+0000","last_peered":"2024-09-07T03:35:24.058175+0000","last_clean":"2024-09-07T03:35:24.058175+0000","last_became_active":"2024-09-07T03:32:22.149203+0000","last_became_peered":"2024-09-07T03:32:22.149203+0000","last_unstale":"2024-09-07T03:35:24.058175+0000","last_undegraded":"2024-09-07T03:35:24.058175+0000","last_fullsized":"2024-09-07T03:35:24.058175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:33.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230163+0000","last_change":"2024-09-07T03:32:14.124704+0000","last_active":"2024-09-07T03:34:28.230163+0000","last_peered":"2024-09-07T03:34:28.230163+0000","last_clean":"2024-09-07T03:34:28.230163+0000","last_became_active":"2024-09-07T03:32:14.124120+0000","last_became_peered":"2024-09-07T03:32:14.124120+0000","last_unstale":"2024-09-07T03:34:28.230163+0000","last_undegraded":"2024-09-07T03:34:28.230163+0000","last_fullsized":"2024-09-07T03:34:28.230163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:15:18.554790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273263+0000","last_change":"2024-09-07T03:32:12.133844+0000","last_active":"2024-09-07T03:32:50.273263+0000","last_peered":"2024-09-07T03:32:50.273263+0000","last_clean":"2024-09-07T03:32:50.273263+0000","last_became_active":"2024-09-07T03:32:12.133434+0000","last_became_peered":"2024-09-07T03:32:12.133434+0000","last_unstale":"2024-09-07T03:32:50.273263+0000","last_undegraded":"2024-09-07T03:32:50.273263+0000","last_fullsized":"2024-09-07T03:32:50.273263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:56:28.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277527+0000","last_change":"2024-09-07T03:32:16.121534+0000","last_active":"2024-09-07T03:32:50.277527+0000","last_peered":"2024-09-07T03:32:50.277527+0000","last_clean":"2024-09-07T03:32:50.277527+0000","last_became_active":"2024-09-07T03:32:16.121256+0000","last_became_peered":"2024-09-07T03:32:16.121256+0000","last_unstale":"2024-09-07T03:32:50.277527+0000","last_undegraded":"2024-09-07T03:32:50.277527+0000","last_fullsized":"2024-09-07T03:32:50.277527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:19.973036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.654116+0000","last_change":"2024-09-07T03:32:18.128938+0000","last_active":"2024-09-07T03:35:30.654116+0000","last_peered":"2024-09-07T03:35:30.654116+0000","last_clean":"2024-09-07T03:35:30.654116+0000","last_became_active":"2024-09-07T03:32:18.128470+0000","last_became_peered":"2024-09-07T03:32:18.128470+0000","last_unstale":"2024-09-07T03:35:30.654116+0000","last_undegraded":"2024-09-07T03:35:30.654116+0000","last_fullsized":"2024-09-07T03:35:30.654116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:15:06.767791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276446+0000","last_change":"2024-09-07T03:32:20.136526+0000","last_active":"2024-09-07T03:32:50.276446+0000","last_peered":"2024-09-07T03:32:50.276446+0000","last_clean":"2024-09-07T03:32:50.276446+0000","last_became_active":"2024-09-07T03:32:20.134892+0000","last_became_peered":"2024-09-07T03:32:20.134892+0000","last_unstale":"2024-09-07T03:32:50.276446+0000","last_undegraded":"2024-09-07T03:32:50.276446+0000","last_fullsized":"2024-09-07T03:32:50.276446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:28.142767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228166+0000","last_change":"2024-09-07T03:32:22.153373+0000","last_active":"2024-09-07T03:34:21.228166+0000","last_peered":"2024-09-07T03:34:21.228166+0000","last_clean":"2024-09-07T03:34:21.228166+0000","last_became_active":"2024-09-07T03:32:22.153134+0000","last_became_peered":"2024-09-07T03:32:22.153134+0000","last_unstale":"2024-09-07T03:34:21.228166+0000","last_undegraded":"2024-09-07T03:34:21.228166+0000","last_fullsized":"2024-09-07T03:34:21.228166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:54.932378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435691+0000","last_change":"2024-09-07T03:32:14.113575+0000","last_active":"2024-09-07T03:34:19.435691+0000","last_peered":"2024-09-07T03:34:19.435691+0000","last_clean":"2024-09-07T03:34:19.435691+0000","last_became_active":"2024-09-07T03:32:14.113243+0000","last_became_peered":"2024-09-07T03:32:14.113243+0000","last_unstale":"2024-09-07T03:34:19.435691+0000","last_undegraded":"2024-09-07T03:34:19.435691+0000","last_fullsized":"2024-09-07T03:34:19.435691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:14.596869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.723676+0000","last_change":"2024-09-07T03:32:12.120954+0000","last_active":"2024-09-07T03:35:23.723676+0000","last_peered":"2024-09-07T03:35:23.723676+0000","last_clean":"2024-09-07T03:35:23.723676+0000","last_became_active":"2024-09-07T03:32:12.120531+0000","last_became_peered":"2024-09-07T03:32:12.120531+0000","last_unstale":"2024-09-07T03:35:23.723676+0000","last_undegraded":"2024-09-07T03:35:23.723676+0000","last_fullsized":"2024-09-07T03:35:23.723676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:11.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470958+0000","last_change":"2024-09-07T03:32:16.124431+0000","last_active":"2024-09-07T03:32:50.470958+0000","last_peered":"2024-09-07T03:32:50.470958+0000","last_clean":"2024-09-07T03:32:50.470958+0000","last_became_active":"2024-09-07T03:32:16.124100+0000","last_became_peered":"2024-09-07T03:32:16.124100+0000","last_unstale":"2024-09-07T03:32:50.470958+0000","last_undegraded":"2024-09-07T03:32:50.470958+0000","last_fullsized":"2024-09-07T03:32:50.470958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:20:34.634089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.632033+0000","last_change":"2024-09-07T03:32:18.130376+0000","last_active":"2024-09-07T03:35:30.632033+0000","last_peered":"2024-09-07T03:35:30.632033+0000","last_clean":"2024-09-07T03:35:30.632033+0000","last_became_active":"2024-09-07T03:32:18.130120+0000","last_became_peered":"2024-09-07T03:32:18.130120+0000","last_unstale":"2024-09-07T03:35:30.632033+0000","last_undegraded":"2024-09-07T03:35:30.632033+0000","last_fullsized":"2024-09-07T03:35:30.632033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:03.978153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.540272+0000","last_change":"2024-09-07T03:32:20.146795+0000","last_active":"2024-09-07T03:35:30.540272+0000","last_peered":"2024-09-07T03:35:30.540272+0000","last_clean":"2024-09-07T03:35:30.540272+0000","last_became_active":"2024-09-07T03:32:20.146408+0000","last_became_peered":"2024-09-07T03:32:20.146408+0000","last_unstale":"2024-09-07T03:35:30.540272+0000","last_undegraded":"2024-09-07T03:35:30.540272+0000","last_fullsized":"2024-09-07T03:35:30.540272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:41.611972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'14","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230053+0000","last_change":"2024-09-07T03:32:22.147032+0000","last_active":"2024-09-07T03:34:28.230053+0000","last_peered":"2024-09-07T03:34:28.230053+0000","last_clean":"2024-09-07T03:34:28.230053+0000","last_became_active":"2024-09-07T03:32:22.145911+0000","last_became_peered":"2024-09-07T03:32:22.145911+0000","last_unstale":"2024-09-07T03:34:28.230053+0000","last_undegraded":"2024-09-07T03:34:28.230053+0000","last_fullsized":"2024-09-07T03:34:28.230053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:59:11.588353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278589+0000","last_change":"2024-09-07T03:32:14.112827+0000","last_active":"2024-09-07T03:32:50.278589+0000","last_peered":"2024-09-07T03:32:50.278589+0000","last_clean":"2024-09-07T03:32:50.278589+0000","last_became_active":"2024-09-07T03:32:14.112499+0000","last_became_peered":"2024-09-07T03:32:14.112499+0000","last_unstale":"2024-09-07T03:32:50.278589+0000","last_undegraded":"2024-09-07T03:32:50.278589+0000","last_fullsized":"2024-09-07T03:32:50.278589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:47:55.234769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432136+0000","last_change":"2024-09-07T03:32:12.132816+0000","last_active":"2024-09-07T03:32:55.432136+0000","last_peered":"2024-09-07T03:32:55.432136+0000","last_clean":"2024-09-07T03:32:55.432136+0000","last_became_active":"2024-09-07T03:32:12.132462+0000","last_became_peered":"2024-09-07T03:32:12.132462+0000","last_unstale":"2024-09-07T03:32:55.432136+0000","last_undegraded":"2024-09-07T03:32:55.432136+0000","last_fullsized":"2024-09-07T03:32:55.432136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:53:07.085389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":617,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.522508+0000","last_change":"2024-09-07T03:32:16.124805+0000","last_active":"2024-09-07T03:35:30.522508+0000","last_peered":"2024-09-07T03:35:30.522508+0000","last_clean":"2024-09-07T03:35:30.522508+0000","last_became_active":"2024-09-07T03:32:16.124500+0000","last_became_peered":"2024-09-07T03:32:16.124500+0000","last_unstale":"2024-09-07T03:35:30.522508+0000","last_undegraded":"2024-09-07T03:35:30.522508+0000","last_fullsized":"2024-09-07T03:35:30.522508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:21:20.333446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'11","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230563+0000","last_change":"2024-09-07T03:32:50.286792+0000","last_active":"2024-09-07T03:34:36.230563+0000","last_peered":"2024-09-07T03:34:36.230563+0000","last_clean":"2024-09-07T03:34:36.230563+0000","last_became_active":"2024-09-07T03:32:50.278739+0000","last_became_peered":"2024-09-07T03:32:50.278739+0000","last_unstale":"2024-09-07T03:34:36.230563+0000","last_undegraded":"2024-09-07T03:34:36.230563+0000","last_fullsized":"2024-09-07T03:34:36.230563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:41.377209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.541844+0000","last_change":"2024-09-07T03:32:20.140656+0000","last_active":"2024-09-07T03:35:30.541844+0000","last_peered":"2024-09-07T03:35:30.541844+0000","last_clean":"2024-09-07T03:35:30.541844+0000","last_became_active":"2024-09-07T03:32:20.140148+0000","last_became_peered":"2024-09-07T03:32:20.140148+0000","last_unstale":"2024-09-07T03:35:30.541844+0000","last_undegraded":"2024-09-07T03:35:30.541844+0000","last_fullsized":"2024-09-07T03:35:30.541844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:10.352295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.602934+0000","last_change":"2024-09-07T03:32:22.147355+0000","last_active":"2024-09-07T03:34:22.602934+0000","last_peered":"2024-09-07T03:34:22.602934+0000","last_clean":"2024-09-07T03:34:22.602934+0000","last_became_active":"2024-09-07T03:32:22.147049+0000","last_became_peered":"2024-09-07T03:32:22.147049+0000","last_unstale":"2024-09-07T03:34:22.602934+0000","last_undegraded":"2024-09-07T03:34:22.602934+0000","last_fullsized":"2024-09-07T03:34:22.602934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:16.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'5","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230226+0000","last_change":"2024-09-07T03:32:14.124366+0000","last_active":"2024-09-07T03:34:28.230226+0000","last_peered":"2024-09-07T03:34:28.230226+0000","last_clean":"2024-09-07T03:34:28.230226+0000","last_became_active":"2024-09-07T03:32:14.124083+0000","last_became_peered":"2024-09-07T03:32:14.124083+0000","last_unstale":"2024-09-07T03:34:28.230226+0000","last_undegraded":"2024-09-07T03:34:28.230226+0000","last_fullsized":"2024-09-07T03:34:28.230226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.448249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.384212+0000","last_change":"2024-09-07T03:32:12.141656+0000","last_active":"2024-09-07T03:35:23.384212+0000","last_peered":"2024-09-07T03:35:23.384212+0000","last_clean":"2024-09-07T03:35:23.384212+0000","last_became_active":"2024-09-07T03:32:12.141314+0000","last_became_peered":"2024-09-07T03:32:12.141314+0000","last_unstale":"2024-09-07T03:35:23.384212+0000","last_undegraded":"2024-09-07T03:35:23.384212+0000","last_fullsized":"2024-09-07T03:35:23.384212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:48:41.251471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276435+0000","last_change":"2024-09-07T03:32:16.128496+0000","last_active":"2024-09-07T03:32:50.276435+0000","last_peered":"2024-09-07T03:32:50.276435+0000","last_clean":"2024-09-07T03:32:50.276435+0000","last_became_active":"2024-09-07T03:32:16.128099+0000","last_became_peered":"2024-09-07T03:32:16.128099+0000","last_unstale":"2024-09-07T03:32:50.276435+0000","last_undegraded":"2024-09-07T03:32:50.276435+0000","last_fullsized":"2024-09-07T03:32:50.276435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:54:04.786020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'41","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.591142+0000","last_change":"2024-09-07T03:32:18.129264+0000","last_active":"2024-09-07T03:35:30.591142+0000","last_peered":"2024-09-07T03:35:30.591142+0000","last_clean":"2024-09-07T03:35:30.591142+0000","last_became_active":"2024-09-07T03:32:18.128679+0000","last_became_peered":"2024-09-07T03:32:18.128679+0000","last_unstale":"2024-09-07T03:35:30.591142+0000","last_undegraded":"2024-09-07T03:35:30.591142+0000","last_fullsized":"2024-09-07T03:35:30.591142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:04.595879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280409+0000","last_change":"2024-09-07T03:32:20.132823+0000","last_active":"2024-09-07T03:32:50.280409+0000","last_peered":"2024-09-07T03:32:50.280409+0000","last_clean":"2024-09-07T03:32:50.280409+0000","last_became_active":"2024-09-07T03:32:20.132479+0000","last_became_peered":"2024-09-07T03:32:20.132479+0000","last_unstale":"2024-09-07T03:32:50.280409+0000","last_undegraded":"2024-09-07T03:32:50.280409+0000","last_fullsized":"2024-09-07T03:32:50.280409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:52.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.060147+0000","last_change":"2024-09-07T03:32:22.140676+0000","last_active":"2024-09-07T03:35:24.060147+0000","last_peered":"2024-09-07T03:35:24.060147+0000","last_clean":"2024-09-07T03:35:24.060147+0000","last_became_active":"2024-09-07T03:32:22.140389+0000","last_became_peered":"2024-09-07T03:32:22.140389+0000","last_unstale":"2024-09-07T03:35:24.060147+0000","last_undegraded":"2024-09-07T03:35:24.060147+0000","last_fullsized":"2024-09-07T03:35:24.060147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:12:54.218779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.024887+0000","last_change":"2024-09-07T03:32:14.113244+0000","last_active":"2024-09-07T03:32:57.024887+0000","last_peered":"2024-09-07T03:32:57.024887+0000","last_clean":"2024-09-07T03:32:57.024887+0000","last_became_active":"2024-09-07T03:32:14.112612+0000","last_became_peered":"2024-09-07T03:32:14.112612+0000","last_unstale":"2024-09-07T03:32:57.024887+0000","last_undegraded":"2024-09-07T03:32:57.024887+0000","last_fullsized":"2024-09-07T03:32:57.024887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:24.044336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469899+0000","last_change":"2024-09-07T03:31:58.568783+0000","last_active":"2024-09-07T03:32:50.469899+0000","last_peered":"2024-09-07T03:32:50.469899+0000","last_clean":"2024-09-07T03:32:50.469899+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:32:50.469899+0000","last_undegraded":"2024-09-07T03:32:50.469899+0000","last_fullsized":"2024-09-07T03:32:50.469899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:31:57.501815+0000","last_clean_scrub_stamp":"2024-09-07T03:31:57.501815+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:54.736044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278835+0000","last_change":"2024-09-07T03:32:04.539297+0000","last_active":"2024-09-07T03:32:50.278835+0000","last_peered":"2024-09-07T03:32:50.278835+0000","last_clean":"2024-09-07T03:32:50.278835+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:32:50.278835+0000","last_undegraded":"2024-09-07T03:32:50.278835+0000","last_fullsized":"2024-09-07T03:32:50.278835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:59:06.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.838441+0000","last_change":"2024-09-07T03:32:12.130687+0000","last_active":"2024-09-07T03:35:23.838441+0000","last_peered":"2024-09-07T03:35:23.838441+0000","last_clean":"2024-09-07T03:35:23.838441+0000","last_became_active":"2024-09-07T03:32:12.130323+0000","last_became_peered":"2024-09-07T03:32:12.130323+0000","last_unstale":"2024-09-07T03:35:23.838441+0000","last_undegraded":"2024-09-07T03:35:23.838441+0000","last_fullsized":"2024-09-07T03:35:23.838441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:45.892639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471096+0000","last_change":"2024-09-07T03:32:16.127232+0000","last_active":"2024-09-07T03:32:50.471096+0000","last_peered":"2024-09-07T03:32:50.471096+0000","last_clean":"2024-09-07T03:32:50.471096+0000","last_became_active":"2024-09-07T03:32:16.126915+0000","last_became_peered":"2024-09-07T03:32:16.126915+0000","last_unstale":"2024-09-07T03:32:50.471096+0000","last_undegraded":"2024-09-07T03:32:50.471096+0000","last_fullsized":"2024-09-07T03:32:50.471096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:52:36.603646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'93","reported_seq":181,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.689595+0000","last_change":"2024-09-07T03:32:18.129530+0000","last_active":"2024-09-07T03:35:30.689595+0000","last_peered":"2024-09-07T03:35:30.689595+0000","last_clean":"2024-09-07T03:35:30.689595+0000","last_became_active":"2024-09-07T03:32:18.129224+0000","last_became_peered":"2024-09-07T03:32:18.129224+0000","last_unstale":"2024-09-07T03:35:30.689595+0000","last_undegraded":"2024-09-07T03:35:30.689595+0000","last_fullsized":"2024-09-07T03:35:30.689595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:25:57.912545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275577+0000","last_change":"2024-09-07T03:32:20.135113+0000","last_active":"2024-09-07T03:32:50.275577+0000","last_peered":"2024-09-07T03:32:50.275577+0000","last_clean":"2024-09-07T03:32:50.275577+0000","last_became_active":"2024-09-07T03:32:20.134819+0000","last_became_peered":"2024-09-07T03:32:20.134819+0000","last_unstale":"2024-09-07T03:32:50.275577+0000","last_undegraded":"2024-09-07T03:32:50.275577+0000","last_fullsized":"2024-09-07T03:32:50.275577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:30.829289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'84","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.852849+0000","last_change":"2024-09-07T03:32:22.152124+0000","last_active":"2024-09-07T03:35:23.852849+0000","last_peered":"2024-09-07T03:35:23.852849+0000","last_clean":"2024-09-07T03:35:23.852849+0000","last_became_active":"2024-09-07T03:32:22.151817+0000","last_became_peered":"2024-09-07T03:32:22.151817+0000","last_unstale":"2024-09-07T03:35:23.852849+0000","last_undegraded":"2024-09-07T03:35:23.852849+0000","last_fullsized":"2024-09-07T03:35:23.852849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:00.353389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'16","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843497+0000","last_change":"2024-09-07T03:32:14.130827+0000","last_active":"2024-09-07T03:35:23.843497+0000","last_peered":"2024-09-07T03:35:23.843497+0000","last_clean":"2024-09-07T03:35:23.843497+0000","last_became_active":"2024-09-07T03:32:14.130484+0000","last_became_peered":"2024-09-07T03:32:14.130484+0000","last_unstale":"2024-09-07T03:35:23.843497+0000","last_undegraded":"2024-09-07T03:35:23.843497+0000","last_fullsized":"2024-09-07T03:35:23.843497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279322+0000","last_change":"2024-09-07T03:32:04.539038+0000","last_active":"2024-09-07T03:32:50.279322+0000","last_peered":"2024-09-07T03:32:50.279322+0000","last_clean":"2024-09-07T03:32:50.279322+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:32:50.279322+0000","last_undegraded":"2024-09-07T03:32:50.279322+0000","last_fullsized":"2024-09-07T03:32:50.279322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:11.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470907+0000","last_change":"2024-09-07T03:32:12.124849+0000","last_active":"2024-09-07T03:32:50.470907+0000","last_peered":"2024-09-07T03:32:50.470907+0000","last_clean":"2024-09-07T03:32:50.470907+0000","last_became_active":"2024-09-07T03:32:12.124522+0000","last_became_peered":"2024-09-07T03:32:12.124522+0000","last_unstale":"2024-09-07T03:32:50.470907+0000","last_undegraded":"2024-09-07T03:32:50.470907+0000","last_fullsized":"2024-09-07T03:32:50.470907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:46:14.653854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282885+0000","last_change":"2024-09-07T03:32:16.124594+0000","last_active":"2024-09-07T03:32:50.282885+0000","last_peered":"2024-09-07T03:32:50.282885+0000","last_clean":"2024-09-07T03:32:50.282885+0000","last_became_active":"2024-09-07T03:32:16.124243+0000","last_became_peered":"2024-09-07T03:32:16.124243+0000","last_unstale":"2024-09-07T03:32:50.282885+0000","last_undegraded":"2024-09-07T03:32:50.282885+0000","last_fullsized":"2024-09-07T03:32:50.282885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:00:23.883657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":513,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.687382+0000","last_change":"2024-09-07T03:32:18.132880+0000","last_active":"2024-09-07T03:35:30.687382+0000","last_peered":"2024-09-07T03:35:30.687382+0000","last_clean":"2024-09-07T03:35:30.687382+0000","last_became_active":"2024-09-07T03:32:18.132579+0000","last_became_peered":"2024-09-07T03:32:18.132579+0000","last_unstale":"2024-09-07T03:35:30.687382+0000","last_undegraded":"2024-09-07T03:35:30.687382+0000","last_fullsized":"2024-09-07T03:35:30.687382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:11:51.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272567+0000","last_change":"2024-09-07T03:32:20.141318+0000","last_active":"2024-09-07T03:32:50.272567+0000","last_peered":"2024-09-07T03:32:50.272567+0000","last_clean":"2024-09-07T03:32:50.272567+0000","last_became_active":"2024-09-07T03:32:20.141044+0000","last_became_peered":"2024-09-07T03:32:20.141044+0000","last_unstale":"2024-09-07T03:32:50.272567+0000","last_undegraded":"2024-09-07T03:32:50.272567+0000","last_fullsized":"2024-09-07T03:32:50.272567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:09:44.169617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.806191+0000","last_change":"2024-09-07T03:32:22.143631+0000","last_active":"2024-09-07T03:33:38.806191+0000","last_peered":"2024-09-07T03:33:38.806191+0000","last_clean":"2024-09-07T03:33:38.806191+0000","last_became_active":"2024-09-07T03:32:22.143337+0000","last_became_peered":"2024-09-07T03:32:22.143337+0000","last_unstale":"2024-09-07T03:33:38.806191+0000","last_undegraded":"2024-09-07T03:33:38.806191+0000","last_fullsized":"2024-09-07T03:33:38.806191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:30.421368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":64,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570852+0000","last_change":"2024-09-07T03:32:14.128064+0000","last_active":"2024-09-07T03:32:56.570852+0000","last_peered":"2024-09-07T03:32:56.570852+0000","last_clean":"2024-09-07T03:32:56.570852+0000","last_became_active":"2024-09-07T03:32:14.127288+0000","last_became_peered":"2024-09-07T03:32:14.127288+0000","last_unstale":"2024-09-07T03:32:56.570852+0000","last_undegraded":"2024-09-07T03:32:56.570852+0000","last_fullsized":"2024-09-07T03:32:56.570852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:43.810866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274315+0000","last_change":"2024-09-07T03:32:04.537641+0000","last_active":"2024-09-07T03:32:50.274315+0000","last_peered":"2024-09-07T03:32:50.274315+0000","last_clean":"2024-09-07T03:32:50.274315+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:32:50.274315+0000","last_undegraded":"2024-09-07T03:32:50.274315+0000","last_fullsized":"2024-09-07T03:32:50.274315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.563922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.975371+0000","last_change":"2024-09-07T03:32:12.139855+0000","last_active":"2024-09-07T03:33:38.975371+0000","last_peered":"2024-09-07T03:33:38.975371+0000","last_clean":"2024-09-07T03:33:38.975371+0000","last_became_active":"2024-09-07T03:32:12.139224+0000","last_became_peered":"2024-09-07T03:32:12.139224+0000","last_unstale":"2024-09-07T03:33:38.975371+0000","last_undegraded":"2024-09-07T03:33:38.975371+0000","last_fullsized":"2024-09-07T03:33:38.975371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:34.147142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279225+0000","last_change":"2024-09-07T03:32:16.122151+0000","last_active":"2024-09-07T03:32:50.279225+0000","last_peered":"2024-09-07T03:32:50.279225+0000","last_clean":"2024-09-07T03:32:50.279225+0000","last_became_active":"2024-09-07T03:32:16.121817+0000","last_became_peered":"2024-09-07T03:32:16.121817+0000","last_unstale":"2024-09-07T03:32:50.279225+0000","last_undegraded":"2024-09-07T03:32:50.279225+0000","last_fullsized":"2024-09-07T03:32:50.279225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:15.023249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206736+0000","last_change":"2024-09-07T03:32:18.129607+0000","last_active":"2024-09-07T03:35:21.206736+0000","last_peered":"2024-09-07T03:35:21.206736+0000","last_clean":"2024-09-07T03:35:21.206736+0000","last_became_active":"2024-09-07T03:32:18.129264+0000","last_became_peered":"2024-09-07T03:32:18.129264+0000","last_unstale":"2024-09-07T03:35:21.206736+0000","last_undegraded":"2024-09-07T03:35:21.206736+0000","last_fullsized":"2024-09-07T03:35:21.206736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:52:54.317892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472271+0000","last_change":"2024-09-07T03:32:20.143074+0000","last_active":"2024-09-07T03:32:50.472271+0000","last_peered":"2024-09-07T03:32:50.472271+0000","last_clean":"2024-09-07T03:32:50.472271+0000","last_became_active":"2024-09-07T03:32:20.142764+0000","last_became_peered":"2024-09-07T03:32:20.142764+0000","last_unstale":"2024-09-07T03:32:50.472271+0000","last_undegraded":"2024-09-07T03:32:50.472271+0000","last_fullsized":"2024-09-07T03:32:50.472271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:36.484446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272193+0000","last_change":"2024-09-07T03:32:22.147788+0000","last_active":"2024-09-07T03:32:50.272193+0000","last_peered":"2024-09-07T03:32:50.272193+0000","last_clean":"2024-09-07T03:32:50.272193+0000","last_became_active":"2024-09-07T03:32:22.147510+0000","last_became_peered":"2024-09-07T03:32:22.147510+0000","last_unstale":"2024-09-07T03:32:50.272193+0000","last_undegraded":"2024-09-07T03:32:50.272193+0000","last_fullsized":"2024-09-07T03:32:50.272193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:37.758327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473250+0000","last_change":"2024-09-07T03:32:14.114315+0000","last_active":"2024-09-07T03:32:50.473250+0000","last_peered":"2024-09-07T03:32:50.473250+0000","last_clean":"2024-09-07T03:32:50.473250+0000","last_became_active":"2024-09-07T03:32:14.113700+0000","last_became_peered":"2024-09-07T03:32:14.113700+0000","last_unstale":"2024-09-07T03:32:50.473250+0000","last_undegraded":"2024-09-07T03:32:50.473250+0000","last_fullsized":"2024-09-07T03:32:50.473250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:56:02.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279568+0000","last_change":"2024-09-07T03:32:04.539644+0000","last_active":"2024-09-07T03:32:50.279568+0000","last_peered":"2024-09-07T03:32:50.279568+0000","last_clean":"2024-09-07T03:32:50.279568+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:32:50.279568+0000","last_undegraded":"2024-09-07T03:32:50.279568+0000","last_fullsized":"2024-09-07T03:32:50.279568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:43.880721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.720142+0000","last_change":"2024-09-07T03:32:12.125645+0000","last_active":"2024-09-07T03:35:23.720142+0000","last_peered":"2024-09-07T03:35:23.720142+0000","last_clean":"2024-09-07T03:35:23.720142+0000","last_became_active":"2024-09-07T03:32:12.124390+0000","last_became_peered":"2024-09-07T03:32:12.124390+0000","last_unstale":"2024-09-07T03:35:23.720142+0000","last_undegraded":"2024-09-07T03:35:23.720142+0000","last_fullsized":"2024-09-07T03:35:23.720142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:47:53.230073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472348+0000","last_change":"2024-09-07T03:32:16.122130+0000","last_active":"2024-09-07T03:32:50.472348+0000","last_peered":"2024-09-07T03:32:50.472348+0000","last_clean":"2024-09-07T03:32:50.472348+0000","last_became_active":"2024-09-07T03:32:16.120933+0000","last_became_peered":"2024-09-07T03:32:16.120933+0000","last_unstale":"2024-09-07T03:32:50.472348+0000","last_undegraded":"2024-09-07T03:32:50.472348+0000","last_fullsized":"2024-09-07T03:32:50.472348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:16.466896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.988572+0000","last_change":"2024-09-07T03:32:18.130861+0000","last_active":"2024-09-07T03:35:22.988572+0000","last_peered":"2024-09-07T03:35:22.988572+0000","last_clean":"2024-09-07T03:35:22.988572+0000","last_became_active":"2024-09-07T03:32:18.130557+0000","last_became_peered":"2024-09-07T03:32:18.130557+0000","last_unstale":"2024-09-07T03:35:22.988572+0000","last_undegraded":"2024-09-07T03:35:22.988572+0000","last_fullsized":"2024-09-07T03:35:22.988572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:23:58.249870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276706+0000","last_change":"2024-09-07T03:32:20.143006+0000","last_active":"2024-09-07T03:32:50.276706+0000","last_peered":"2024-09-07T03:32:50.276706+0000","last_clean":"2024-09-07T03:32:50.276706+0000","last_became_active":"2024-09-07T03:32:20.142650+0000","last_became_peered":"2024-09-07T03:32:20.142650+0000","last_unstale":"2024-09-07T03:32:50.276706+0000","last_undegraded":"2024-09-07T03:32:50.276706+0000","last_fullsized":"2024-09-07T03:32:50.276706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:47.155034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.532509+0000","last_change":"2024-09-07T03:32:22.151470+0000","last_active":"2024-09-07T03:34:22.532509+0000","last_peered":"2024-09-07T03:34:22.532509+0000","last_clean":"2024-09-07T03:34:22.532509+0000","last_became_active":"2024-09-07T03:32:22.150981+0000","last_became_peered":"2024-09-07T03:32:22.150981+0000","last_unstale":"2024-09-07T03:34:22.532509+0000","last_undegraded":"2024-09-07T03:34:22.532509+0000","last_fullsized":"2024-09-07T03:34:22.532509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:09.757277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731323+0000","last_change":"2024-09-07T03:32:50.282510+0000","last_active":"2024-09-07T03:35:23.731323+0000","last_peered":"2024-09-07T03:35:23.731323+0000","last_clean":"2024-09-07T03:35:23.731323+0000","last_became_active":"2024-09-07T03:32:50.282108+0000","last_became_peered":"2024-09-07T03:32:50.282108+0000","last_unstale":"2024-09-07T03:35:23.731323+0000","last_undegraded":"2024-09-07T03:35:23.731323+0000","last_fullsized":"2024-09-07T03:35:23.731323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:00:33.202265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.561631+0000","last_change":"2024-09-07T03:32:12.121500+0000","last_active":"2024-09-07T03:32:56.561631+0000","last_peered":"2024-09-07T03:32:56.561631+0000","last_clean":"2024-09-07T03:32:56.561631+0000","last_became_active":"2024-09-07T03:32:12.121179+0000","last_became_peered":"2024-09-07T03:32:12.121179+0000","last_unstale":"2024-09-07T03:32:56.561631+0000","last_undegraded":"2024-09-07T03:32:56.561631+0000","last_fullsized":"2024-09-07T03:32:56.561631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:27:51.832052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472095+0000","last_change":"2024-09-07T03:32:04.541917+0000","last_active":"2024-09-07T03:32:50.472095+0000","last_peered":"2024-09-07T03:32:50.472095+0000","last_clean":"2024-09-07T03:32:50.472095+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:32:50.472095+0000","last_undegraded":"2024-09-07T03:32:50.472095+0000","last_fullsized":"2024-09-07T03:32:50.472095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:39:36.959986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.113878+0000","last_change":"2024-09-07T03:32:16.126538+0000","last_active":"2024-09-07T03:35:24.113878+0000","last_peered":"2024-09-07T03:35:24.113878+0000","last_clean":"2024-09-07T03:35:24.113878+0000","last_became_active":"2024-09-07T03:32:16.126273+0000","last_became_peered":"2024-09-07T03:32:16.126273+0000","last_unstale":"2024-09-07T03:35:24.113878+0000","last_undegraded":"2024-09-07T03:35:24.113878+0000","last_fullsized":"2024-09-07T03:35:24.113878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:12:07.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'80","reported_seq":160,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.683357+0000","last_change":"2024-09-07T03:32:18.132985+0000","last_active":"2024-09-07T03:35:30.683357+0000","last_peered":"2024-09-07T03:35:30.683357+0000","last_clean":"2024-09-07T03:35:30.683357+0000","last_became_active":"2024-09-07T03:32:18.132654+0000","last_became_peered":"2024-09-07T03:32:18.132654+0000","last_unstale":"2024-09-07T03:35:30.683357+0000","last_undegraded":"2024-09-07T03:35:30.683357+0000","last_fullsized":"2024-09-07T03:35:30.683357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:58.124761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278034+0000","last_change":"2024-09-07T03:32:20.140348+0000","last_active":"2024-09-07T03:32:50.278034+0000","last_peered":"2024-09-07T03:32:50.278034+0000","last_clean":"2024-09-07T03:32:50.278034+0000","last_became_active":"2024-09-07T03:32:20.140025+0000","last_became_peered":"2024-09-07T03:32:20.140025+0000","last_unstale":"2024-09-07T03:32:50.278034+0000","last_undegraded":"2024-09-07T03:32:50.278034+0000","last_fullsized":"2024-09-07T03:32:50.278034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:18:53.690582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'13","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.873538+0000","last_change":"2024-09-07T03:32:22.140343+0000","last_active":"2024-09-07T03:34:22.873538+0000","last_peered":"2024-09-07T03:34:22.873538+0000","last_clean":"2024-09-07T03:34:22.873538+0000","last_became_active":"2024-09-07T03:32:22.140043+0000","last_became_peered":"2024-09-07T03:32:22.140043+0000","last_unstale":"2024-09-07T03:34:22.873538+0000","last_undegraded":"2024-09-07T03:34:22.873538+0000","last_fullsized":"2024-09-07T03:34:22.873538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:55.502696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'12","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806308+0000","last_change":"2024-09-07T03:32:14.126934+0000","last_active":"2024-09-07T03:35:23.806308+0000","last_peered":"2024-09-07T03:35:23.806308+0000","last_clean":"2024-09-07T03:35:23.806308+0000","last_became_active":"2024-09-07T03:32:14.126663+0000","last_became_peered":"2024-09-07T03:32:14.126663+0000","last_unstale":"2024-09-07T03:35:23.806308+0000","last_undegraded":"2024-09-07T03:35:23.806308+0000","last_fullsized":"2024-09-07T03:35:23.806308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:58:27.663426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.406414+0000","last_change":"2024-09-07T03:32:12.134479+0000","last_active":"2024-09-07T03:35:23.406414+0000","last_peered":"2024-09-07T03:35:23.406414+0000","last_clean":"2024-09-07T03:35:23.406414+0000","last_became_active":"2024-09-07T03:32:12.133974+0000","last_became_peered":"2024-09-07T03:32:12.133974+0000","last_unstale":"2024-09-07T03:35:23.406414+0000","last_undegraded":"2024-09-07T03:35:23.406414+0000","last_fullsized":"2024-09-07T03:35:23.406414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:03:12.017360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281965+0000","last_change":"2024-09-07T03:32:04.539029+0000","last_active":"2024-09-07T03:32:50.281965+0000","last_peered":"2024-09-07T03:32:50.281965+0000","last_clean":"2024-09-07T03:32:50.281965+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:32:50.281965+0000","last_undegraded":"2024-09-07T03:32:50.281965+0000","last_fullsized":"2024-09-07T03:32:50.281965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:37:36.714209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278673+0000","last_change":"2024-09-07T03:32:16.122232+0000","last_active":"2024-09-07T03:32:50.278673+0000","last_peered":"2024-09-07T03:32:50.278673+0000","last_clean":"2024-09-07T03:32:50.278673+0000","last_became_active":"2024-09-07T03:32:16.121921+0000","last_became_peered":"2024-09-07T03:32:16.121921+0000","last_unstale":"2024-09-07T03:32:50.278673+0000","last_undegraded":"2024-09-07T03:32:50.278673+0000","last_fullsized":"2024-09-07T03:32:50.278673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:01:24.806960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469770+0000","last_change":"2024-09-07T03:32:18.134018+0000","last_active":"2024-09-07T03:32:50.469770+0000","last_peered":"2024-09-07T03:32:50.469770+0000","last_clean":"2024-09-07T03:32:50.469770+0000","last_became_active":"2024-09-07T03:32:18.133689+0000","last_became_peered":"2024-09-07T03:32:18.133689+0000","last_unstale":"2024-09-07T03:32:50.469770+0000","last_undegraded":"2024-09-07T03:32:50.469770+0000","last_fullsized":"2024-09-07T03:32:50.469770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:16.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":350,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.537865+0000","last_change":"2024-09-07T03:32:20.143562+0000","last_active":"2024-09-07T03:35:30.537865+0000","last_peered":"2024-09-07T03:35:30.537865+0000","last_clean":"2024-09-07T03:35:30.537865+0000","last_became_active":"2024-09-07T03:32:20.143293+0000","last_became_peered":"2024-09-07T03:32:20.143293+0000","last_unstale":"2024-09-07T03:35:30.537865+0000","last_undegraded":"2024-09-07T03:35:30.537865+0000","last_fullsized":"2024-09-07T03:35:30.537865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:51.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273729+0000","last_change":"2024-09-07T03:32:22.147306+0000","last_active":"2024-09-07T03:32:50.273729+0000","last_peered":"2024-09-07T03:32:50.273729+0000","last_clean":"2024-09-07T03:32:50.273729+0000","last_became_active":"2024-09-07T03:32:22.147036+0000","last_became_peered":"2024-09-07T03:32:22.147036+0000","last_unstale":"2024-09-07T03:32:50.273729+0000","last_undegraded":"2024-09-07T03:32:50.273729+0000","last_fullsized":"2024-09-07T03:32:50.273729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:02.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.477342+0000","last_change":"2024-09-07T03:32:14.127131+0000","last_active":"2024-09-07T03:35:23.477342+0000","last_peered":"2024-09-07T03:35:23.477342+0000","last_clean":"2024-09-07T03:35:23.477342+0000","last_became_active":"2024-09-07T03:32:14.126350+0000","last_became_peered":"2024-09-07T03:32:14.126350+0000","last_unstale":"2024-09-07T03:35:23.477342+0000","last_undegraded":"2024-09-07T03:35:23.477342+0000","last_fullsized":"2024-09-07T03:35:23.477342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:48:39.075361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276350+0000","last_change":"2024-09-07T03:32:12.130912+0000","last_active":"2024-09-07T03:32:50.276350+0000","last_peered":"2024-09-07T03:32:50.276350+0000","last_clean":"2024-09-07T03:32:50.276350+0000","last_became_active":"2024-09-07T03:32:12.130058+0000","last_became_peered":"2024-09-07T03:32:12.130058+0000","last_unstale":"2024-09-07T03:32:50.276350+0000","last_undegraded":"2024-09-07T03:32:50.276350+0000","last_fullsized":"2024-09-07T03:32:50.276350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:39:14.276282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472091+0000","last_change":"2024-09-07T03:32:04.542033+0000","last_active":"2024-09-07T03:32:50.472091+0000","last_peered":"2024-09-07T03:32:50.472091+0000","last_clean":"2024-09-07T03:32:50.472091+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:32:50.472091+0000","last_undegraded":"2024-09-07T03:32:50.472091+0000","last_fullsized":"2024-09-07T03:32:50.472091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:18:29.084858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279335+0000","last_change":"2024-09-07T03:32:16.117328+0000","last_active":"2024-09-07T03:32:50.279335+0000","last_peered":"2024-09-07T03:32:50.279335+0000","last_clean":"2024-09-07T03:32:50.279335+0000","last_became_active":"2024-09-07T03:32:16.117025+0000","last_became_peered":"2024-09-07T03:32:16.117025+0000","last_unstale":"2024-09-07T03:32:50.279335+0000","last_undegraded":"2024-09-07T03:32:50.279335+0000","last_fullsized":"2024-09-07T03:32:50.279335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:43:01.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273099+0000","last_change":"2024-09-07T03:32:18.124974+0000","last_active":"2024-09-07T03:32:50.273099+0000","last_peered":"2024-09-07T03:32:50.273099+0000","last_clean":"2024-09-07T03:32:50.273099+0000","last_became_active":"2024-09-07T03:32:18.124641+0000","last_became_peered":"2024-09-07T03:32:18.124641+0000","last_unstale":"2024-09-07T03:32:50.273099+0000","last_undegraded":"2024-09-07T03:32:50.273099+0000","last_fullsized":"2024-09-07T03:32:50.273099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:36:49.839182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.544102+0000","last_change":"2024-09-07T03:32:20.149232+0000","last_active":"2024-09-07T03:35:30.544102+0000","last_peered":"2024-09-07T03:35:30.544102+0000","last_clean":"2024-09-07T03:35:30.544102+0000","last_became_active":"2024-09-07T03:32:20.148768+0000","last_became_peered":"2024-09-07T03:32:20.148768+0000","last_unstale":"2024-09-07T03:35:30.544102+0000","last_undegraded":"2024-09-07T03:35:30.544102+0000","last_fullsized":"2024-09-07T03:35:30.544102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:15:20.986169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470656+0000","last_change":"2024-09-07T03:32:22.148714+0000","last_active":"2024-09-07T03:32:50.470656+0000","last_peered":"2024-09-07T03:32:50.470656+0000","last_clean":"2024-09-07T03:32:50.470656+0000","last_became_active":"2024-09-07T03:32:22.148444+0000","last_became_peered":"2024-09-07T03:32:22.148444+0000","last_unstale":"2024-09-07T03:32:50.470656+0000","last_undegraded":"2024-09-07T03:32:50.470656+0000","last_fullsized":"2024-09-07T03:32:50.470656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:23.271638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.588175+0000","last_change":"2024-09-07T03:32:14.113991+0000","last_active":"2024-09-07T03:35:23.588175+0000","last_peered":"2024-09-07T03:35:23.588175+0000","last_clean":"2024-09-07T03:35:23.588175+0000","last_became_active":"2024-09-07T03:32:14.113077+0000","last_became_peered":"2024-09-07T03:32:14.113077+0000","last_unstale":"2024-09-07T03:35:23.588175+0000","last_undegraded":"2024-09-07T03:35:23.588175+0000","last_fullsized":"2024-09-07T03:35:23.588175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:14:51.585905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.717209+0000","last_change":"2024-09-07T03:32:12.124748+0000","last_active":"2024-09-07T03:35:23.717209+0000","last_peered":"2024-09-07T03:35:23.717209+0000","last_clean":"2024-09-07T03:35:23.717209+0000","last_became_active":"2024-09-07T03:32:12.124398+0000","last_became_peered":"2024-09-07T03:32:12.124398+0000","last_unstale":"2024-09-07T03:35:23.717209+0000","last_undegraded":"2024-09-07T03:35:23.717209+0000","last_fullsized":"2024-09-07T03:35:23.717209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:59:37.231002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282690+0000","last_change":"2024-09-07T03:32:04.539724+0000","last_active":"2024-09-07T03:32:50.282690+0000","last_peered":"2024-09-07T03:32:50.282690+0000","last_clean":"2024-09-07T03:32:50.282690+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:32:50.282690+0000","last_undegraded":"2024-09-07T03:32:50.282690+0000","last_fullsized":"2024-09-07T03:32:50.282690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:01.524558+0000","last_clean_scrub_stamp":"2024-09-07T03:32:01.524558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:55:55.896127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273091+0000","last_change":"2024-09-07T03:32:16.130854+0000","last_active":"2024-09-07T03:32:50.273091+0000","last_peered":"2024-09-07T03:32:50.273091+0000","last_clean":"2024-09-07T03:32:50.273091+0000","last_became_active":"2024-09-07T03:32:16.130091+0000","last_became_peered":"2024-09-07T03:32:16.130091+0000","last_unstale":"2024-09-07T03:32:50.273091+0000","last_undegraded":"2024-09-07T03:32:50.273091+0000","last_fullsized":"2024-09-07T03:32:50.273091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:20.097492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.692496+0000","last_change":"2024-09-07T03:32:18.132376+0000","last_active":"2024-09-07T03:35:30.692496+0000","last_peered":"2024-09-07T03:35:30.692496+0000","last_clean":"2024-09-07T03:35:30.692496+0000","last_became_active":"2024-09-07T03:32:18.132111+0000","last_became_peered":"2024-09-07T03:32:18.132111+0000","last_unstale":"2024-09-07T03:35:30.692496+0000","last_undegraded":"2024-09-07T03:35:30.692496+0000","last_fullsized":"2024-09-07T03:35:30.692496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272816+0000","last_change":"2024-09-07T03:32:20.143405+0000","last_active":"2024-09-07T03:32:50.272816+0000","last_peered":"2024-09-07T03:32:50.272816+0000","last_clean":"2024-09-07T03:32:50.272816+0000","last_became_active":"2024-09-07T03:32:20.143072+0000","last_became_peered":"2024-09-07T03:32:20.143072+0000","last_unstale":"2024-09-07T03:32:50.272816+0000","last_undegraded":"2024-09-07T03:32:50.272816+0000","last_fullsized":"2024-09-07T03:32:50.272816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:35:06.275781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276617+0000","last_change":"2024-09-07T03:32:22.139462+0000","last_active":"2024-09-07T03:32:50.276617+0000","last_peered":"2024-09-07T03:32:50.276617+0000","last_clean":"2024-09-07T03:32:50.276617+0000","last_became_active":"2024-09-07T03:32:22.139150+0000","last_became_peered":"2024-09-07T03:32:22.139150+0000","last_unstale":"2024-09-07T03:32:50.276617+0000","last_undegraded":"2024-09-07T03:32:50.276617+0000","last_fullsized":"2024-09-07T03:32:50.276617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:16:29.302047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275974+0000","last_change":"2024-09-07T03:32:22.138596+0000","last_active":"2024-09-07T03:32:50.275974+0000","last_peered":"2024-09-07T03:32:50.275974+0000","last_clean":"2024-09-07T03:32:50.275974+0000","last_became_active":"2024-09-07T03:32:22.138315+0000","last_became_peered":"2024-09-07T03:32:22.138315+0000","last_unstale":"2024-09-07T03:32:50.275974+0000","last_undegraded":"2024-09-07T03:32:50.275974+0000","last_fullsized":"2024-09-07T03:32:50.275974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:54:59.992625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435487+0000","last_change":"2024-09-07T03:32:14.113374+0000","last_active":"2024-09-07T03:34:19.435487+0000","last_peered":"2024-09-07T03:34:19.435487+0000","last_clean":"2024-09-07T03:34:19.435487+0000","last_became_active":"2024-09-07T03:32:14.112744+0000","last_became_peered":"2024-09-07T03:32:14.112744+0000","last_unstale":"2024-09-07T03:34:19.435487+0000","last_undegraded":"2024-09-07T03:34:19.435487+0000","last_fullsized":"2024-09-07T03:34:19.435487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:58.377074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'5","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.790736+0000","last_change":"2024-09-07T03:32:12.133214+0000","last_active":"2024-09-07T03:33:38.790736+0000","last_peered":"2024-09-07T03:33:38.790736+0000","last_clean":"2024-09-07T03:33:38.790736+0000","last_became_active":"2024-09-07T03:32:12.132715+0000","last_became_peered":"2024-09-07T03:32:12.132715+0000","last_unstale":"2024-09-07T03:33:38.790736+0000","last_undegraded":"2024-09-07T03:33:38.790736+0000","last_fullsized":"2024-09-07T03:33:38.790736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:43.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470337+0000","last_change":"2024-09-07T03:32:16.125307+0000","last_active":"2024-09-07T03:32:50.470337+0000","last_peered":"2024-09-07T03:32:50.470337+0000","last_clean":"2024-09-07T03:32:50.470337+0000","last_became_active":"2024-09-07T03:32:16.124681+0000","last_became_peered":"2024-09-07T03:32:16.124681+0000","last_unstale":"2024-09-07T03:32:50.470337+0000","last_undegraded":"2024-09-07T03:32:50.470337+0000","last_fullsized":"2024-09-07T03:32:50.470337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:30.622001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.603642+0000","last_change":"2024-09-07T03:32:18.134183+0000","last_active":"2024-09-07T03:35:30.603642+0000","last_peered":"2024-09-07T03:35:30.603642+0000","last_clean":"2024-09-07T03:35:30.603642+0000","last_became_active":"2024-09-07T03:32:18.133844+0000","last_became_peered":"2024-09-07T03:32:18.133844+0000","last_unstale":"2024-09-07T03:35:30.603642+0000","last_undegraded":"2024-09-07T03:35:30.603642+0000","last_fullsized":"2024-09-07T03:35:30.603642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:10:39.060137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271616+0000","last_change":"2024-09-07T03:32:20.149175+0000","last_active":"2024-09-07T03:32:50.271616+0000","last_peered":"2024-09-07T03:32:50.271616+0000","last_clean":"2024-09-07T03:32:50.271616+0000","last_became_active":"2024-09-07T03:32:20.148900+0000","last_became_peered":"2024-09-07T03:32:20.148900+0000","last_unstale":"2024-09-07T03:32:50.271616+0000","last_undegraded":"2024-09-07T03:32:50.271616+0000","last_fullsized":"2024-09-07T03:32:50.271616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:25.130015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:20.895399+0000","last_change":"2024-09-07T03:32:22.150451+0000","last_active":"2024-09-07T03:34:20.895399+0000","last_peered":"2024-09-07T03:34:20.895399+0000","last_clean":"2024-09-07T03:34:20.895399+0000","last_became_active":"2024-09-07T03:32:22.150168+0000","last_became_peered":"2024-09-07T03:32:22.150168+0000","last_unstale":"2024-09-07T03:34:20.895399+0000","last_undegraded":"2024-09-07T03:34:20.895399+0000","last_fullsized":"2024-09-07T03:34:20.895399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:01:52.113292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985573+0000","last_change":"2024-09-07T03:32:14.111906+0000","last_active":"2024-09-07T03:33:38.985573+0000","last_peered":"2024-09-07T03:33:38.985573+0000","last_clean":"2024-09-07T03:33:38.985573+0000","last_became_active":"2024-09-07T03:32:14.111499+0000","last_became_peered":"2024-09-07T03:32:14.111499+0000","last_unstale":"2024-09-07T03:33:38.985573+0000","last_undegraded":"2024-09-07T03:33:38.985573+0000","last_fullsized":"2024-09-07T03:33:38.985573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:32.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276787+0000","last_change":"2024-09-07T03:32:12.129260+0000","last_active":"2024-09-07T03:32:50.276787+0000","last_peered":"2024-09-07T03:32:50.276787+0000","last_clean":"2024-09-07T03:32:50.276787+0000","last_became_active":"2024-09-07T03:32:12.128737+0000","last_became_peered":"2024-09-07T03:32:12.128737+0000","last_unstale":"2024-09-07T03:32:50.276787+0000","last_undegraded":"2024-09-07T03:32:50.276787+0000","last_fullsized":"2024-09-07T03:32:50.276787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:32.673872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272857+0000","last_change":"2024-09-07T03:32:16.125714+0000","last_active":"2024-09-07T03:32:50.272857+0000","last_peered":"2024-09-07T03:32:50.272857+0000","last_clean":"2024-09-07T03:32:50.272857+0000","last_became_active":"2024-09-07T03:32:16.125418+0000","last_became_peered":"2024-09-07T03:32:16.125418+0000","last_unstale":"2024-09-07T03:32:50.272857+0000","last_undegraded":"2024-09-07T03:32:50.272857+0000","last_fullsized":"2024-09-07T03:32:50.272857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:50:42.403817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.992476+0000","last_change":"2024-09-07T03:32:18.134208+0000","last_active":"2024-09-07T03:35:22.992476+0000","last_peered":"2024-09-07T03:35:22.992476+0000","last_clean":"2024-09-07T03:35:22.992476+0000","last_became_active":"2024-09-07T03:32:18.133770+0000","last_became_peered":"2024-09-07T03:32:18.133770+0000","last_unstale":"2024-09-07T03:35:22.992476+0000","last_undegraded":"2024-09-07T03:35:22.992476+0000","last_fullsized":"2024-09-07T03:35:22.992476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:01:16.182582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276619+0000","last_change":"2024-09-07T03:32:20.142736+0000","last_active":"2024-09-07T03:32:50.276619+0000","last_peered":"2024-09-07T03:32:50.276619+0000","last_clean":"2024-09-07T03:32:50.276619+0000","last_became_active":"2024-09-07T03:32:20.140729+0000","last_became_peered":"2024-09-07T03:32:20.140729+0000","last_unstale":"2024-09-07T03:32:50.276619+0000","last_undegraded":"2024-09-07T03:32:50.276619+0000","last_fullsized":"2024-09-07T03:32:50.276619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:48:10.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471241+0000","last_change":"2024-09-07T03:32:22.147660+0000","last_active":"2024-09-07T03:32:50.471241+0000","last_peered":"2024-09-07T03:32:50.471241+0000","last_clean":"2024-09-07T03:32:50.471241+0000","last_became_active":"2024-09-07T03:32:22.147374+0000","last_became_peered":"2024-09-07T03:32:22.147374+0000","last_unstale":"2024-09-07T03:32:50.471241+0000","last_undegraded":"2024-09-07T03:32:50.471241+0000","last_fullsized":"2024-09-07T03:32:50.471241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:06.728131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843420+0000","last_change":"2024-09-07T03:32:14.123487+0000","last_active":"2024-09-07T03:35:23.843420+0000","last_peered":"2024-09-07T03:35:23.843420+0000","last_clean":"2024-09-07T03:35:23.843420+0000","last_became_active":"2024-09-07T03:32:14.123172+0000","last_became_peered":"2024-09-07T03:32:14.123172+0000","last_unstale":"2024-09-07T03:35:23.843420+0000","last_undegraded":"2024-09-07T03:35:23.843420+0000","last_fullsized":"2024-09-07T03:35:23.843420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.426207+0000","last_change":"2024-09-07T03:32:12.125531+0000","last_active":"2024-09-07T03:34:19.426207+0000","last_peered":"2024-09-07T03:34:19.426207+0000","last_clean":"2024-09-07T03:34:19.426207+0000","last_became_active":"2024-09-07T03:32:12.124180+0000","last_became_peered":"2024-09-07T03:32:12.124180+0000","last_unstale":"2024-09-07T03:34:19.426207+0000","last_undegraded":"2024-09-07T03:34:19.426207+0000","last_fullsized":"2024-09-07T03:34:19.426207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:41.435390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277690+0000","last_change":"2024-09-07T03:32:16.124337+0000","last_active":"2024-09-07T03:32:50.277690+0000","last_peered":"2024-09-07T03:32:50.277690+0000","last_clean":"2024-09-07T03:32:50.277690+0000","last_became_active":"2024-09-07T03:32:16.123695+0000","last_became_peered":"2024-09-07T03:32:16.123695+0000","last_unstale":"2024-09-07T03:32:50.277690+0000","last_undegraded":"2024-09-07T03:32:50.277690+0000","last_fullsized":"2024-09-07T03:32:50.277690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:12:34.370044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'44","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.677944+0000","last_change":"2024-09-07T03:32:18.129794+0000","last_active":"2024-09-07T03:35:30.677944+0000","last_peered":"2024-09-07T03:35:30.677944+0000","last_clean":"2024-09-07T03:35:30.677944+0000","last_became_active":"2024-09-07T03:32:18.129502+0000","last_became_peered":"2024-09-07T03:32:18.129502+0000","last_unstale":"2024-09-07T03:35:30.677944+0000","last_undegraded":"2024-09-07T03:35:30.677944+0000","last_fullsized":"2024-09-07T03:35:30.677944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:35:55.771599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470189+0000","last_change":"2024-09-07T03:32:20.147965+0000","last_active":"2024-09-07T03:32:50.470189+0000","last_peered":"2024-09-07T03:32:50.470189+0000","last_clean":"2024-09-07T03:32:50.470189+0000","last_became_active":"2024-09-07T03:32:20.147588+0000","last_became_peered":"2024-09-07T03:32:20.147588+0000","last_unstale":"2024-09-07T03:32:50.470189+0000","last_undegraded":"2024-09-07T03:32:50.470189+0000","last_fullsized":"2024-09-07T03:32:50.470189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:33:20.522441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.433021+0000","last_change":"2024-09-07T03:32:22.146381+0000","last_active":"2024-09-07T03:34:19.433021+0000","last_peered":"2024-09-07T03:34:19.433021+0000","last_clean":"2024-09-07T03:34:19.433021+0000","last_became_active":"2024-09-07T03:32:22.146106+0000","last_became_peered":"2024-09-07T03:32:22.146106+0000","last_unstale":"2024-09-07T03:34:19.433021+0000","last_undegraded":"2024-09-07T03:34:19.433021+0000","last_fullsized":"2024-09-07T03:34:19.433021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:05:28.655126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.025001+0000","last_change":"2024-09-07T03:32:14.128094+0000","last_active":"2024-09-07T03:32:57.025001+0000","last_peered":"2024-09-07T03:32:57.025001+0000","last_clean":"2024-09-07T03:32:57.025001+0000","last_became_active":"2024-09-07T03:32:14.127334+0000","last_became_peered":"2024-09-07T03:32:14.127334+0000","last_unstale":"2024-09-07T03:32:57.025001+0000","last_undegraded":"2024-09-07T03:32:57.025001+0000","last_fullsized":"2024-09-07T03:32:57.025001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:23:03.931202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472920+0000","last_change":"2024-09-07T03:32:12.138270+0000","last_active":"2024-09-07T03:32:50.472920+0000","last_peered":"2024-09-07T03:32:50.472920+0000","last_clean":"2024-09-07T03:32:50.472920+0000","last_became_active":"2024-09-07T03:32:12.134823+0000","last_became_peered":"2024-09-07T03:32:12.134823+0000","last_unstale":"2024-09-07T03:32:50.472920+0000","last_undegraded":"2024-09-07T03:32:50.472920+0000","last_fullsized":"2024-09-07T03:32:50.472920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:01:11.999538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271764+0000","last_change":"2024-09-07T03:32:16.127981+0000","last_active":"2024-09-07T03:32:50.271764+0000","last_peered":"2024-09-07T03:32:50.271764+0000","last_clean":"2024-09-07T03:32:50.271764+0000","last_became_active":"2024-09-07T03:32:16.127615+0000","last_became_peered":"2024-09-07T03:32:16.127615+0000","last_unstale":"2024-09-07T03:32:50.271764+0000","last_undegraded":"2024-09-07T03:32:50.271764+0000","last_fullsized":"2024-09-07T03:32:50.271764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:04.434836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'35","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.669249+0000","last_change":"2024-09-07T03:32:18.130169+0000","last_active":"2024-09-07T03:35:30.669249+0000","last_peered":"2024-09-07T03:35:30.669249+0000","last_clean":"2024-09-07T03:35:30.669249+0000","last_became_active":"2024-09-07T03:32:18.129919+0000","last_became_peered":"2024-09-07T03:32:18.129919+0000","last_unstale":"2024-09-07T03:35:30.669249+0000","last_undegraded":"2024-09-07T03:35:30.669249+0000","last_fullsized":"2024-09-07T03:35:30.669249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:09.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275040+0000","last_change":"2024-09-07T03:32:20.145306+0000","last_active":"2024-09-07T03:32:50.275040+0000","last_peered":"2024-09-07T03:32:50.275040+0000","last_clean":"2024-09-07T03:32:50.275040+0000","last_became_active":"2024-09-07T03:32:20.143640+0000","last_became_peered":"2024-09-07T03:32:20.143640+0000","last_unstale":"2024-09-07T03:32:50.275040+0000","last_undegraded":"2024-09-07T03:32:50.275040+0000","last_fullsized":"2024-09-07T03:32:50.275040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:24:26.189411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282148+0000","last_change":"2024-09-07T03:32:14.123340+0000","last_active":"2024-09-07T03:32:50.282148+0000","last_peered":"2024-09-07T03:32:50.282148+0000","last_clean":"2024-09-07T03:32:50.282148+0000","last_became_active":"2024-09-07T03:32:14.123017+0000","last_became_peered":"2024-09-07T03:32:14.123017+0000","last_unstale":"2024-09-07T03:32:50.282148+0000","last_undegraded":"2024-09-07T03:32:50.282148+0000","last_fullsized":"2024-09-07T03:32:50.282148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:08.821201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271902+0000","last_change":"2024-09-07T03:32:12.144026+0000","last_active":"2024-09-07T03:32:50.271902+0000","last_peered":"2024-09-07T03:32:50.271902+0000","last_clean":"2024-09-07T03:32:50.271902+0000","last_became_active":"2024-09-07T03:32:12.143142+0000","last_became_peered":"2024-09-07T03:32:12.143142+0000","last_unstale":"2024-09-07T03:32:50.271902+0000","last_undegraded":"2024-09-07T03:32:50.271902+0000","last_fullsized":"2024-09-07T03:32:50.271902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:13:08.497889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471726+0000","last_change":"2024-09-07T03:32:16.124471+0000","last_active":"2024-09-07T03:32:50.471726+0000","last_peered":"2024-09-07T03:32:50.471726+0000","last_clean":"2024-09-07T03:32:50.471726+0000","last_became_active":"2024-09-07T03:32:16.124188+0000","last_became_peered":"2024-09-07T03:32:16.124188+0000","last_unstale":"2024-09-07T03:32:50.471726+0000","last_undegraded":"2024-09-07T03:32:50.471726+0000","last_fullsized":"2024-09-07T03:32:50.471726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:20.601144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'66","reported_seq":137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.657676+0000","last_change":"2024-09-07T03:32:18.127241+0000","last_active":"2024-09-07T03:35:30.657676+0000","last_peered":"2024-09-07T03:35:30.657676+0000","last_clean":"2024-09-07T03:35:30.657676+0000","last_became_active":"2024-09-07T03:32:18.126946+0000","last_became_peered":"2024-09-07T03:32:18.126946+0000","last_unstale":"2024-09-07T03:35:30.657676+0000","last_undegraded":"2024-09-07T03:35:30.657676+0000","last_fullsized":"2024-09-07T03:35:30.657676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:12:23.096494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275569+0000","last_change":"2024-09-07T03:32:20.144697+0000","last_active":"2024-09-07T03:32:50.275569+0000","last_peered":"2024-09-07T03:32:50.275569+0000","last_clean":"2024-09-07T03:32:50.275569+0000","last_became_active":"2024-09-07T03:32:20.144417+0000","last_became_peered":"2024-09-07T03:32:20.144417+0000","last_unstale":"2024-09-07T03:32:50.275569+0000","last_undegraded":"2024-09-07T03:32:50.275569+0000","last_fullsized":"2024-09-07T03:32:50.275569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:37:54.709062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'16","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.592808+0000","last_change":"2024-09-07T03:32:22.149726+0000","last_active":"2024-09-07T03:35:23.592808+0000","last_peered":"2024-09-07T03:35:23.592808+0000","last_clean":"2024-09-07T03:35:23.592808+0000","last_became_active":"2024-09-07T03:32:22.149442+0000","last_became_peered":"2024-09-07T03:32:22.149442+0000","last_unstale":"2024-09-07T03:35:23.592808+0000","last_undegraded":"2024-09-07T03:35:23.592808+0000","last_fullsized":"2024-09-07T03:35:23.592808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:25.687323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'9","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.849698+0000","last_change":"2024-09-07T03:32:14.114246+0000","last_active":"2024-09-07T03:35:23.849698+0000","last_peered":"2024-09-07T03:35:23.849698+0000","last_clean":"2024-09-07T03:35:23.849698+0000","last_became_active":"2024-09-07T03:32:14.111795+0000","last_became_peered":"2024-09-07T03:32:14.111795+0000","last_unstale":"2024-09-07T03:35:23.849698+0000","last_undegraded":"2024-09-07T03:35:23.849698+0000","last_fullsized":"2024-09-07T03:35:23.849698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:41:31.009147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470018+0000","last_change":"2024-09-07T03:32:12.136641+0000","last_active":"2024-09-07T03:32:50.470018+0000","last_peered":"2024-09-07T03:32:50.470018+0000","last_clean":"2024-09-07T03:32:50.470018+0000","last_became_active":"2024-09-07T03:32:12.136258+0000","last_became_peered":"2024-09-07T03:32:12.136258+0000","last_unstale":"2024-09-07T03:32:50.470018+0000","last_undegraded":"2024-09-07T03:32:50.470018+0000","last_fullsized":"2024-09-07T03:32:50.470018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:19:06.594103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281863+0000","last_change":"2024-09-07T03:32:16.122569+0000","last_active":"2024-09-07T03:32:50.281863+0000","last_peered":"2024-09-07T03:32:50.281863+0000","last_clean":"2024-09-07T03:32:50.281863+0000","last_became_active":"2024-09-07T03:32:16.122316+0000","last_became_peered":"2024-09-07T03:32:16.122316+0000","last_unstale":"2024-09-07T03:32:50.281863+0000","last_undegraded":"2024-09-07T03:32:50.281863+0000","last_fullsized":"2024-09-07T03:32:50.281863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:09:15.334063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.672169+0000","last_change":"2024-09-07T03:32:18.132401+0000","last_active":"2024-09-07T03:35:30.672169+0000","last_peered":"2024-09-07T03:35:30.672169+0000","last_clean":"2024-09-07T03:35:30.672169+0000","last_became_active":"2024-09-07T03:32:18.132084+0000","last_became_peered":"2024-09-07T03:32:18.132084+0000","last_unstale":"2024-09-07T03:35:30.672169+0000","last_undegraded":"2024-09-07T03:35:30.672169+0000","last_fullsized":"2024-09-07T03:35:30.672169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:21:08.328913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471012+0000","last_change":"2024-09-07T03:32:20.143643+0000","last_active":"2024-09-07T03:32:50.471012+0000","last_peered":"2024-09-07T03:32:50.471012+0000","last_clean":"2024-09-07T03:32:50.471012+0000","last_became_active":"2024-09-07T03:32:20.143377+0000","last_became_peered":"2024-09-07T03:32:20.143377+0000","last_unstale":"2024-09-07T03:32:50.471012+0000","last_undegraded":"2024-09-07T03:32:50.471012+0000","last_fullsized":"2024-09-07T03:32:50.471012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:11.431453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278297+0000","last_change":"2024-09-07T03:32:22.146527+0000","last_active":"2024-09-07T03:32:50.278297+0000","last_peered":"2024-09-07T03:32:50.278297+0000","last_clean":"2024-09-07T03:32:50.278297+0000","last_became_active":"2024-09-07T03:32:22.146237+0000","last_became_peered":"2024-09-07T03:32:22.146237+0000","last_unstale":"2024-09-07T03:32:50.278297+0000","last_undegraded":"2024-09-07T03:32:50.278297+0000","last_fullsized":"2024-09-07T03:32:50.278297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:13:05.478773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570991+0000","last_change":"2024-09-07T03:32:14.126016+0000","last_active":"2024-09-07T03:32:56.570991+0000","last_peered":"2024-09-07T03:32:56.570991+0000","last_clean":"2024-09-07T03:32:56.570991+0000","last_became_active":"2024-09-07T03:32:14.125706+0000","last_became_peered":"2024-09-07T03:32:14.125706+0000","last_unstale":"2024-09-07T03:32:56.570991+0000","last_undegraded":"2024-09-07T03:32:56.570991+0000","last_fullsized":"2024-09-07T03:32:56.570991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.726613+0000","last_change":"2024-09-07T03:32:12.126028+0000","last_active":"2024-09-07T03:35:23.726613+0000","last_peered":"2024-09-07T03:35:23.726613+0000","last_clean":"2024-09-07T03:35:23.726613+0000","last_became_active":"2024-09-07T03:32:12.125261+0000","last_became_peered":"2024-09-07T03:32:12.125261+0000","last_unstale":"2024-09-07T03:35:23.726613+0000","last_undegraded":"2024-09-07T03:35:23.726613+0000","last_fullsized":"2024-09-07T03:35:23.726613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:30.313501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280234+0000","last_change":"2024-09-07T03:32:16.124615+0000","last_active":"2024-09-07T03:32:50.280234+0000","last_peered":"2024-09-07T03:32:50.280234+0000","last_clean":"2024-09-07T03:32:50.280234+0000","last_became_active":"2024-09-07T03:32:16.124314+0000","last_became_peered":"2024-09-07T03:32:16.124314+0000","last_unstale":"2024-09-07T03:32:50.280234+0000","last_undegraded":"2024-09-07T03:32:50.280234+0000","last_fullsized":"2024-09-07T03:32:50.280234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:44:43.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'41","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.616251+0000","last_change":"2024-09-07T03:32:18.129996+0000","last_active":"2024-09-07T03:35:30.616251+0000","last_peered":"2024-09-07T03:35:30.616251+0000","last_clean":"2024-09-07T03:35:30.616251+0000","last_became_active":"2024-09-07T03:32:18.129700+0000","last_became_peered":"2024-09-07T03:32:18.129700+0000","last_unstale":"2024-09-07T03:35:30.616251+0000","last_undegraded":"2024-09-07T03:35:30.616251+0000","last_fullsized":"2024-09-07T03:35:30.616251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:38:03.778044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471615+0000","last_change":"2024-09-07T03:32:20.142983+0000","last_active":"2024-09-07T03:32:50.471615+0000","last_peered":"2024-09-07T03:32:50.471615+0000","last_clean":"2024-09-07T03:32:50.471615+0000","last_became_active":"2024-09-07T03:32:20.142695+0000","last_became_peered":"2024-09-07T03:32:20.142695+0000","last_unstale":"2024-09-07T03:32:50.471615+0000","last_undegraded":"2024-09-07T03:32:50.471615+0000","last_fullsized":"2024-09-07T03:32:50.471615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:29.846270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.959036+0000","last_change":"2024-09-07T03:32:22.143270+0000","last_active":"2024-09-07T03:34:22.959036+0000","last_peered":"2024-09-07T03:34:22.959036+0000","last_clean":"2024-09-07T03:34:22.959036+0000","last_became_active":"2024-09-07T03:32:22.143053+0000","last_became_peered":"2024-09-07T03:32:22.143053+0000","last_unstale":"2024-09-07T03:34:22.959036+0000","last_undegraded":"2024-09-07T03:34:22.959036+0000","last_fullsized":"2024-09-07T03:34:22.959036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:05:14.463803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'12","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843581+0000","last_change":"2024-09-07T03:32:14.117890+0000","last_active":"2024-09-07T03:35:23.843581+0000","last_peered":"2024-09-07T03:35:23.843581+0000","last_clean":"2024-09-07T03:35:23.843581+0000","last_became_active":"2024-09-07T03:32:14.117608+0000","last_became_peered":"2024-09-07T03:32:14.117608+0000","last_unstale":"2024-09-07T03:35:23.843581+0000","last_undegraded":"2024-09-07T03:35:23.843581+0000","last_fullsized":"2024-09-07T03:35:23.843581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:50:58.423715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275329+0000","last_change":"2024-09-07T03:32:12.135875+0000","last_active":"2024-09-07T03:32:50.275329+0000","last_peered":"2024-09-07T03:32:50.275329+0000","last_clean":"2024-09-07T03:32:50.275329+0000","last_became_active":"2024-09-07T03:32:12.135523+0000","last_became_peered":"2024-09-07T03:32:12.135523+0000","last_unstale":"2024-09-07T03:32:50.275329+0000","last_undegraded":"2024-09-07T03:32:50.275329+0000","last_fullsized":"2024-09-07T03:32:50.275329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:35.883059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:51.215438+0000","last_change":"2024-09-07T03:32:50.279386+0000","last_active":"2024-09-07T03:32:51.215438+0000","last_peered":"2024-09-07T03:32:51.215438+0000","last_clean":"2024-09-07T03:32:51.215438+0000","last_became_active":"2024-09-07T03:32:50.279004+0000","last_became_peered":"2024-09-07T03:32:50.279004+0000","last_unstale":"2024-09-07T03:32:51.215438+0000","last_undegraded":"2024-09-07T03:32:51.215438+0000","last_fullsized":"2024-09-07T03:32:51.215438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:52.172562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"34'18","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273667+0000","last_change":"2024-09-07T03:32:18.127389+0000","last_active":"2024-09-07T03:32:50.273667+0000","last_peered":"2024-09-07T03:32:50.273667+0000","last_clean":"2024-09-07T03:32:50.273667+0000","last_became_active":"2024-09-07T03:32:18.127007+0000","last_became_peered":"2024-09-07T03:32:18.127007+0000","last_unstale":"2024-09-07T03:32:50.273667+0000","last_undegraded":"2024-09-07T03:32:50.273667+0000","last_fullsized":"2024-09-07T03:32:50.273667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:32:04.955651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":370,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.536750+0000","last_change":"2024-09-07T03:32:20.147075+0000","last_active":"2024-09-07T03:35:30.536750+0000","last_peered":"2024-09-07T03:35:30.536750+0000","last_clean":"2024-09-07T03:35:30.536750+0000","last_became_active":"2024-09-07T03:32:20.146738+0000","last_became_peered":"2024-09-07T03:32:20.146738+0000","last_unstale":"2024-09-07T03:35:30.536750+0000","last_undegraded":"2024-09-07T03:35:30.536750+0000","last_fullsized":"2024-09-07T03:35:30.536750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:39.886530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.568340+0000","last_change":"2024-09-07T03:32:22.151158+0000","last_active":"2024-09-07T03:32:56.568340+0000","last_peered":"2024-09-07T03:32:56.568340+0000","last_clean":"2024-09-07T03:32:56.568340+0000","last_became_active":"2024-09-07T03:32:22.150886+0000","last_became_peered":"2024-09-07T03:32:22.150886+0000","last_unstale":"2024-09-07T03:32:56.568340+0000","last_undegraded":"2024-09-07T03:32:56.568340+0000","last_fullsized":"2024-09-07T03:32:56.568340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:57:06.666886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'18","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843569+0000","last_change":"2024-09-07T03:32:14.127180+0000","last_active":"2024-09-07T03:35:23.843569+0000","last_peered":"2024-09-07T03:35:23.843569+0000","last_clean":"2024-09-07T03:35:23.843569+0000","last_became_active":"2024-09-07T03:32:14.126901+0000","last_became_peered":"2024-09-07T03:32:14.126901+0000","last_unstale":"2024-09-07T03:35:23.843569+0000","last_undegraded":"2024-09-07T03:35:23.843569+0000","last_fullsized":"2024-09-07T03:35:23.843569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:14.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.473031+0000","last_change":"2024-09-07T03:32:12.134765+0000","last_active":"2024-09-07T03:32:50.473031+0000","last_peered":"2024-09-07T03:32:50.473031+0000","last_clean":"2024-09-07T03:32:50.473031+0000","last_became_active":"2024-09-07T03:32:12.133876+0000","last_became_peered":"2024-09-07T03:32:12.133876+0000","last_unstale":"2024-09-07T03:32:50.473031+0000","last_undegraded":"2024-09-07T03:32:50.473031+0000","last_fullsized":"2024-09-07T03:32:50.473031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:01.450719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'1","reported_seq":221,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.512095+0000","last_change":"2024-09-07T03:32:16.122534+0000","last_active":"2024-09-07T03:35:30.512095+0000","last_peered":"2024-09-07T03:35:30.512095+0000","last_clean":"2024-09-07T03:35:30.512095+0000","last_became_active":"2024-09-07T03:32:16.120952+0000","last_became_peered":"2024-09-07T03:32:16.120952+0000","last_unstale":"2024-09-07T03:35:30.512095+0000","last_undegraded":"2024-09-07T03:35:30.512095+0000","last_fullsized":"2024-09-07T03:35:30.512095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:35.686701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'66","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.635641+0000","last_change":"2024-09-07T03:32:18.133969+0000","last_active":"2024-09-07T03:35:30.635641+0000","last_peered":"2024-09-07T03:35:30.635641+0000","last_clean":"2024-09-07T03:35:30.635641+0000","last_became_active":"2024-09-07T03:32:18.133705+0000","last_became_peered":"2024-09-07T03:32:18.133705+0000","last_unstale":"2024-09-07T03:35:30.635641+0000","last_undegraded":"2024-09-07T03:35:30.635641+0000","last_fullsized":"2024-09-07T03:35:30.635641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:02.433602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271613+0000","last_change":"2024-09-07T03:32:20.137011+0000","last_active":"2024-09-07T03:32:50.271613+0000","last_peered":"2024-09-07T03:32:50.271613+0000","last_clean":"2024-09-07T03:32:50.271613+0000","last_became_active":"2024-09-07T03:32:20.135211+0000","last_became_peered":"2024-09-07T03:32:20.135211+0000","last_unstale":"2024-09-07T03:32:50.271613+0000","last_undegraded":"2024-09-07T03:32:50.271613+0000","last_fullsized":"2024-09-07T03:32:50.271613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:33.033993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.028862+0000","last_change":"2024-09-07T03:32:22.141840+0000","last_active":"2024-09-07T03:32:57.028862+0000","last_peered":"2024-09-07T03:32:57.028862+0000","last_clean":"2024-09-07T03:32:57.028862+0000","last_became_active":"2024-09-07T03:32:22.141533+0000","last_became_peered":"2024-09-07T03:32:22.141533+0000","last_unstale":"2024-09-07T03:32:57.028862+0000","last_undegraded":"2024-09-07T03:32:57.028862+0000","last_fullsized":"2024-09-07T03:32:57.028862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:32:37.743868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'20","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806061+0000","last_change":"2024-09-07T03:32:14.123194+0000","last_active":"2024-09-07T03:35:23.806061+0000","last_peered":"2024-09-07T03:35:23.806061+0000","last_clean":"2024-09-07T03:35:23.806061+0000","last_became_active":"2024-09-07T03:32:14.122929+0000","last_became_peered":"2024-09-07T03:32:14.122929+0000","last_unstale":"2024-09-07T03:35:23.806061+0000","last_undegraded":"2024-09-07T03:35:23.806061+0000","last_fullsized":"2024-09-07T03:35:23.806061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:27:08.474145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281523+0000","last_change":"2024-09-07T03:32:12.125302+0000","last_active":"2024-09-07T03:32:50.281523+0000","last_peered":"2024-09-07T03:32:50.281523+0000","last_clean":"2024-09-07T03:32:50.281523+0000","last_became_active":"2024-09-07T03:32:12.124610+0000","last_became_peered":"2024-09-07T03:32:12.124610+0000","last_unstale":"2024-09-07T03:32:50.281523+0000","last_undegraded":"2024-09-07T03:32:50.281523+0000","last_fullsized":"2024-09-07T03:32:50.281523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:41:42.237332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278654+0000","last_change":"2024-09-07T03:32:16.116613+0000","last_active":"2024-09-07T03:32:50.278654+0000","last_peered":"2024-09-07T03:32:50.278654+0000","last_clean":"2024-09-07T03:32:50.278654+0000","last_became_active":"2024-09-07T03:32:16.116296+0000","last_became_peered":"2024-09-07T03:32:16.116296+0000","last_unstale":"2024-09-07T03:32:50.278654+0000","last_undegraded":"2024-09-07T03:32:50.278654+0000","last_fullsized":"2024-09-07T03:32:50.278654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:40:46.166456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'40","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.638598+0000","last_change":"2024-09-07T03:32:18.134892+0000","last_active":"2024-09-07T03:35:30.638598+0000","last_peered":"2024-09-07T03:35:30.638598+0000","last_clean":"2024-09-07T03:35:30.638598+0000","last_became_active":"2024-09-07T03:32:18.134533+0000","last_became_peered":"2024-09-07T03:32:18.134533+0000","last_unstale":"2024-09-07T03:35:30.638598+0000","last_undegraded":"2024-09-07T03:35:30.638598+0000","last_fullsized":"2024-09-07T03:35:30.638598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:15:18.375395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278010+0000","last_change":"2024-09-07T03:32:20.146986+0000","last_active":"2024-09-07T03:32:50.278010+0000","last_peered":"2024-09-07T03:32:50.278010+0000","last_clean":"2024-09-07T03:32:50.278010+0000","last_became_active":"2024-09-07T03:32:20.146631+0000","last_became_peered":"2024-09-07T03:32:20.146631+0000","last_unstale":"2024-09-07T03:32:50.278010+0000","last_undegraded":"2024-09-07T03:32:50.278010+0000","last_fullsized":"2024-09-07T03:32:50.278010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:56.243102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275464+0000","last_change":"2024-09-07T03:32:22.152021+0000","last_active":"2024-09-07T03:32:50.275464+0000","last_peered":"2024-09-07T03:32:50.275464+0000","last_clean":"2024-09-07T03:32:50.275464+0000","last_became_active":"2024-09-07T03:32:22.151709+0000","last_became_peered":"2024-09-07T03:32:22.151709+0000","last_unstale":"2024-09-07T03:32:50.275464+0000","last_undegraded":"2024-09-07T03:32:50.275464+0000","last_fullsized":"2024-09-07T03:32:50.275464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:01.162547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963490+0000","last_change":"2024-09-07T03:32:14.127708+0000","last_active":"2024-09-07T03:34:22.963490+0000","last_peered":"2024-09-07T03:34:22.963490+0000","last_clean":"2024-09-07T03:34:22.963490+0000","last_became_active":"2024-09-07T03:32:14.127451+0000","last_became_peered":"2024-09-07T03:32:14.127451+0000","last_unstale":"2024-09-07T03:34:22.963490+0000","last_undegraded":"2024-09-07T03:34:22.963490+0000","last_fullsized":"2024-09-07T03:34:22.963490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:19.822962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273816+0000","last_change":"2024-09-07T03:32:12.125466+0000","last_active":"2024-09-07T03:32:50.273816+0000","last_peered":"2024-09-07T03:32:50.273816+0000","last_clean":"2024-09-07T03:32:50.273816+0000","last_became_active":"2024-09-07T03:32:12.124552+0000","last_became_peered":"2024-09-07T03:32:12.124552+0000","last_unstale":"2024-09-07T03:32:50.273816+0000","last_undegraded":"2024-09-07T03:32:50.273816+0000","last_fullsized":"2024-09-07T03:32:50.273816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:13:53.582954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469800+0000","last_change":"2024-09-07T03:32:16.125669+0000","last_active":"2024-09-07T03:32:50.469800+0000","last_peered":"2024-09-07T03:32:50.469800+0000","last_clean":"2024-09-07T03:32:50.469800+0000","last_became_active":"2024-09-07T03:32:16.123423+0000","last_became_peered":"2024-09-07T03:32:16.123423+0000","last_unstale":"2024-09-07T03:32:50.469800+0000","last_undegraded":"2024-09-07T03:32:50.469800+0000","last_fullsized":"2024-09-07T03:32:50.469800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:06:37.923895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'35","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.610398+0000","last_change":"2024-09-07T03:32:18.129106+0000","last_active":"2024-09-07T03:35:30.610398+0000","last_peered":"2024-09-07T03:35:30.610398+0000","last_clean":"2024-09-07T03:35:30.610398+0000","last_became_active":"2024-09-07T03:32:18.128812+0000","last_became_peered":"2024-09-07T03:32:18.128812+0000","last_unstale":"2024-09-07T03:35:30.610398+0000","last_undegraded":"2024-09-07T03:35:30.610398+0000","last_fullsized":"2024-09-07T03:35:30.610398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:51.897402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279344+0000","last_change":"2024-09-07T03:32:20.132779+0000","last_active":"2024-09-07T03:32:50.279344+0000","last_peered":"2024-09-07T03:32:50.279344+0000","last_clean":"2024-09-07T03:32:50.279344+0000","last_became_active":"2024-09-07T03:32:20.132396+0000","last_became_peered":"2024-09-07T03:32:20.132396+0000","last_unstale":"2024-09-07T03:32:50.279344+0000","last_undegraded":"2024-09-07T03:32:50.279344+0000","last_fullsized":"2024-09-07T03:32:50.279344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:29:30.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.210747+0000","last_change":"2024-09-07T03:32:22.152253+0000","last_active":"2024-09-07T03:34:21.210747+0000","last_peered":"2024-09-07T03:34:21.210747+0000","last_clean":"2024-09-07T03:34:21.210747+0000","last_became_active":"2024-09-07T03:32:22.151697+0000","last_became_peered":"2024-09-07T03:32:22.151697+0000","last_unstale":"2024-09-07T03:34:21.210747+0000","last_undegraded":"2024-09-07T03:34:21.210747+0000","last_fullsized":"2024-09-07T03:34:21.210747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:12:47.655977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806035+0000","last_change":"2024-09-07T03:32:14.113037+0000","last_active":"2024-09-07T03:35:23.806035+0000","last_peered":"2024-09-07T03:35:23.806035+0000","last_clean":"2024-09-07T03:35:23.806035+0000","last_became_active":"2024-09-07T03:32:14.112336+0000","last_became_peered":"2024-09-07T03:32:14.112336+0000","last_unstale":"2024-09-07T03:35:23.806035+0000","last_undegraded":"2024-09-07T03:35:23.806035+0000","last_fullsized":"2024-09-07T03:35:23.806035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.767629+0000","last_change":"2024-09-07T03:32:12.138565+0000","last_active":"2024-09-07T03:34:22.767629+0000","last_peered":"2024-09-07T03:34:22.767629+0000","last_clean":"2024-09-07T03:34:22.767629+0000","last_became_active":"2024-09-07T03:32:12.136020+0000","last_became_peered":"2024-09-07T03:32:12.136020+0000","last_unstale":"2024-09-07T03:34:22.767629+0000","last_undegraded":"2024-09-07T03:34:22.767629+0000","last_fullsized":"2024-09-07T03:34:22.767629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:57:08.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.817388+0000","last_change":"2024-09-07T03:32:16.129863+0000","last_active":"2024-09-07T03:34:19.817388+0000","last_peered":"2024-09-07T03:34:19.817388+0000","last_clean":"2024-09-07T03:34:19.817388+0000","last_became_active":"2024-09-07T03:32:16.129161+0000","last_became_peered":"2024-09-07T03:32:16.129161+0000","last_unstale":"2024-09-07T03:34:19.817388+0000","last_undegraded":"2024-09-07T03:34:19.817388+0000","last_fullsized":"2024-09-07T03:34:19.817388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:08:23.197757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'48","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.619879+0000","last_change":"2024-09-07T03:32:18.132380+0000","last_active":"2024-09-07T03:35:30.619879+0000","last_peered":"2024-09-07T03:35:30.619879+0000","last_clean":"2024-09-07T03:35:30.619879+0000","last_became_active":"2024-09-07T03:32:18.132072+0000","last_became_peered":"2024-09-07T03:32:18.132072+0000","last_unstale":"2024-09-07T03:35:30.619879+0000","last_undegraded":"2024-09-07T03:35:30.619879+0000","last_fullsized":"2024-09-07T03:35:30.619879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:37.568436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274904+0000","last_change":"2024-09-07T03:32:20.145649+0000","last_active":"2024-09-07T03:32:50.274904+0000","last_peered":"2024-09-07T03:32:50.274904+0000","last_clean":"2024-09-07T03:32:50.274904+0000","last_became_active":"2024-09-07T03:32:20.144977+0000","last_became_peered":"2024-09-07T03:32:20.144977+0000","last_unstale":"2024-09-07T03:32:50.274904+0000","last_undegraded":"2024-09-07T03:32:50.274904+0000","last_fullsized":"2024-09-07T03:32:50.274904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:56.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.213631+0000","last_change":"2024-09-07T03:32:22.141987+0000","last_active":"2024-09-07T03:34:21.213631+0000","last_peered":"2024-09-07T03:34:21.213631+0000","last_clean":"2024-09-07T03:34:21.213631+0000","last_became_active":"2024-09-07T03:32:22.141633+0000","last_became_peered":"2024-09-07T03:32:22.141633+0000","last_unstale":"2024-09-07T03:34:21.213631+0000","last_undegraded":"2024-09-07T03:34:21.213631+0000","last_fullsized":"2024-09-07T03:34:21.213631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:45.392294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.478248+0000","last_change":"2024-09-07T03:32:14.114021+0000","last_active":"2024-09-07T03:35:23.478248+0000","last_peered":"2024-09-07T03:35:23.478248+0000","last_clean":"2024-09-07T03:35:23.478248+0000","last_became_active":"2024-09-07T03:32:14.111950+0000","last_became_peered":"2024-09-07T03:32:14.111950+0000","last_unstale":"2024-09-07T03:35:23.478248+0000","last_undegraded":"2024-09-07T03:35:23.478248+0000","last_fullsized":"2024-09-07T03:35:23.478248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:42:20.068850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274043+0000","last_change":"2024-09-07T03:32:12.133214+0000","last_active":"2024-09-07T03:32:50.274043+0000","last_peered":"2024-09-07T03:32:50.274043+0000","last_clean":"2024-09-07T03:32:50.274043+0000","last_became_active":"2024-09-07T03:32:12.132814+0000","last_became_peered":"2024-09-07T03:32:12.132814+0000","last_unstale":"2024-09-07T03:32:50.274043+0000","last_undegraded":"2024-09-07T03:32:50.274043+0000","last_fullsized":"2024-09-07T03:32:50.274043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:53.987362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843863+0000","last_change":"2024-09-07T03:32:14.115342+0000","last_active":"2024-09-07T03:35:23.843863+0000","last_peered":"2024-09-07T03:35:23.843863+0000","last_clean":"2024-09-07T03:35:23.843863+0000","last_became_active":"2024-09-07T03:32:14.114966+0000","last_became_peered":"2024-09-07T03:32:14.114966+0000","last_unstale":"2024-09-07T03:35:23.843863+0000","last_undegraded":"2024-09-07T03:35:23.843863+0000","last_fullsized":"2024-09-07T03:35:23.843863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:07:27.478728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.346800+0000","last_change":"2024-09-07T03:32:12.134634+0000","last_active":"2024-09-07T03:35:23.346800+0000","last_peered":"2024-09-07T03:35:23.346800+0000","last_clean":"2024-09-07T03:35:23.346800+0000","last_became_active":"2024-09-07T03:32:12.132662+0000","last_became_peered":"2024-09-07T03:32:12.132662+0000","last_unstale":"2024-09-07T03:35:23.346800+0000","last_undegraded":"2024-09-07T03:35:23.346800+0000","last_fullsized":"2024-09-07T03:35:23.346800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:00:50.432167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.739589+0000","last_change":"2024-09-07T03:32:14.122593+0000","last_active":"2024-09-07T03:35:23.739589+0000","last_peered":"2024-09-07T03:35:23.739589+0000","last_clean":"2024-09-07T03:35:23.739589+0000","last_became_active":"2024-09-07T03:32:14.122301+0000","last_became_peered":"2024-09-07T03:32:14.122301+0000","last_unstale":"2024-09-07T03:35:23.739589+0000","last_undegraded":"2024-09-07T03:35:23.739589+0000","last_fullsized":"2024-09-07T03:35:23.739589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272108+0000","last_change":"2024-09-07T03:32:12.138037+0000","last_active":"2024-09-07T03:32:50.272108+0000","last_peered":"2024-09-07T03:32:50.272108+0000","last_clean":"2024-09-07T03:32:50.272108+0000","last_became_active":"2024-09-07T03:32:12.137561+0000","last_became_peered":"2024-09-07T03:32:12.137561+0000","last_unstale":"2024-09-07T03:32:50.272108+0000","last_undegraded":"2024-09-07T03:32:50.272108+0000","last_fullsized":"2024-09-07T03:32:50.272108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:59.055476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435902+0000","last_change":"2024-09-07T03:32:14.114337+0000","last_active":"2024-09-07T03:34:19.435902+0000","last_peered":"2024-09-07T03:34:19.435902+0000","last_clean":"2024-09-07T03:34:19.435902+0000","last_became_active":"2024-09-07T03:32:14.114055+0000","last_became_peered":"2024-09-07T03:32:14.114055+0000","last_unstale":"2024-09-07T03:34:19.435902+0000","last_undegraded":"2024-09-07T03:34:19.435902+0000","last_fullsized":"2024-09-07T03:34:19.435902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:55:05.807784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.728015+0000","last_change":"2024-09-07T03:32:12.132824+0000","last_active":"2024-09-07T03:34:22.728015+0000","last_peered":"2024-09-07T03:34:22.728015+0000","last_clean":"2024-09-07T03:34:22.728015+0000","last_became_active":"2024-09-07T03:32:12.132471+0000","last_became_peered":"2024-09-07T03:32:12.132471+0000","last_unstale":"2024-09-07T03:34:22.728015+0000","last_undegraded":"2024-09-07T03:34:22.728015+0000","last_fullsized":"2024-09-07T03:34:22.728015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:04:57.476630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803876+0000","last_change":"2024-09-07T03:32:50.285566+0000","last_active":"2024-09-07T03:35:23.803876+0000","last_peered":"2024-09-07T03:35:23.803876+0000","last_clean":"2024-09-07T03:35:23.803876+0000","last_became_active":"2024-09-07T03:32:50.280656+0000","last_became_peered":"2024-09-07T03:32:50.280656+0000","last_unstale":"2024-09-07T03:35:23.803876+0000","last_undegraded":"2024-09-07T03:35:23.803876+0000","last_fullsized":"2024-09-07T03:35:23.803876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:19:49.958031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.429207+0000","last_change":"2024-09-07T03:32:12.140756+0000","last_active":"2024-09-07T03:32:55.429207+0000","last_peered":"2024-09-07T03:32:55.429207+0000","last_clean":"2024-09-07T03:32:55.429207+0000","last_became_active":"2024-09-07T03:32:12.140393+0000","last_became_peered":"2024-09-07T03:32:12.140393+0000","last_unstale":"2024-09-07T03:32:55.429207+0000","last_undegraded":"2024-09-07T03:32:55.429207+0000","last_fullsized":"2024-09-07T03:32:55.429207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:23.691202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"36'10","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803631+0000","last_change":"2024-09-07T03:32:14.114468+0000","last_active":"2024-09-07T03:35:23.803631+0000","last_peered":"2024-09-07T03:35:23.803631+0000","last_clean":"2024-09-07T03:35:23.803631+0000","last_became_active":"2024-09-07T03:32:14.113830+0000","last_became_peered":"2024-09-07T03:32:14.113830+0000","last_unstale":"2024-09-07T03:35:23.803631+0000","last_undegraded":"2024-09-07T03:35:23.803631+0000","last_fullsized":"2024-09-07T03:35:23.803631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:00.736940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471745+0000","last_change":"2024-09-07T03:32:12.134769+0000","last_active":"2024-09-07T03:32:50.471745+0000","last_peered":"2024-09-07T03:32:50.471745+0000","last_clean":"2024-09-07T03:32:50.471745+0000","last_became_active":"2024-09-07T03:32:12.134287+0000","last_became_peered":"2024-09-07T03:32:12.134287+0000","last_unstale":"2024-09-07T03:32:50.471745+0000","last_undegraded":"2024-09-07T03:32:50.471745+0000","last_fullsized":"2024-09-07T03:32:50.471745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:29:37.829617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'17","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228255+0000","last_change":"2024-09-07T03:32:14.126278+0000","last_active":"2024-09-07T03:34:21.228255+0000","last_peered":"2024-09-07T03:34:21.228255+0000","last_clean":"2024-09-07T03:34:21.228255+0000","last_became_active":"2024-09-07T03:32:14.125990+0000","last_became_peered":"2024-09-07T03:32:14.125990+0000","last_unstale":"2024-09-07T03:34:21.228255+0000","last_undegraded":"2024-09-07T03:34:21.228255+0000","last_fullsized":"2024-09-07T03:34:21.228255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:31:20.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278552+0000","last_change":"2024-09-07T03:32:12.129933+0000","last_active":"2024-09-07T03:32:50.278552+0000","last_peered":"2024-09-07T03:32:50.278552+0000","last_clean":"2024-09-07T03:32:50.278552+0000","last_became_active":"2024-09-07T03:32:12.128807+0000","last_became_peered":"2024-09-07T03:32:12.128807+0000","last_unstale":"2024-09-07T03:32:50.278552+0000","last_undegraded":"2024-09-07T03:32:50.278552+0000","last_fullsized":"2024-09-07T03:32:50.278552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:14:03.821714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806043+0000","last_change":"2024-09-07T03:32:14.110088+0000","last_active":"2024-09-07T03:35:23.806043+0000","last_peered":"2024-09-07T03:35:23.806043+0000","last_clean":"2024-09-07T03:35:23.806043+0000","last_became_active":"2024-09-07T03:32:14.109799+0000","last_became_peered":"2024-09-07T03:32:14.109799+0000","last_unstale":"2024-09-07T03:35:23.806043+0000","last_undegraded":"2024-09-07T03:35:23.806043+0000","last_fullsized":"2024-09-07T03:35:23.806043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276544+0000","last_change":"2024-09-07T03:32:12.131240+0000","last_active":"2024-09-07T03:32:50.276544+0000","last_peered":"2024-09-07T03:32:50.276544+0000","last_clean":"2024-09-07T03:32:50.276544+0000","last_became_active":"2024-09-07T03:32:12.130563+0000","last_became_peered":"2024-09-07T03:32:12.130563+0000","last_unstale":"2024-09-07T03:32:50.276544+0000","last_undegraded":"2024-09-07T03:32:50.276544+0000","last_fullsized":"2024-09-07T03:32:50.276544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:35.973387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806088+0000","last_change":"2024-09-07T03:32:14.115326+0000","last_active":"2024-09-07T03:35:23.806088+0000","last_peered":"2024-09-07T03:35:23.806088+0000","last_clean":"2024-09-07T03:35:23.806088+0000","last_became_active":"2024-09-07T03:32:14.115000+0000","last_became_peered":"2024-09-07T03:32:14.115000+0000","last_unstale":"2024-09-07T03:35:23.806088+0000","last_undegraded":"2024-09-07T03:35:23.806088+0000","last_fullsized":"2024-09-07T03:35:23.806088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:20.852806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272042+0000","last_change":"2024-09-07T03:32:12.142672+0000","last_active":"2024-09-07T03:32:50.272042+0000","last_peered":"2024-09-07T03:32:50.272042+0000","last_clean":"2024-09-07T03:32:50.272042+0000","last_became_active":"2024-09-07T03:32:12.142315+0000","last_became_peered":"2024-09-07T03:32:12.142315+0000","last_unstale":"2024-09-07T03:32:50.272042+0000","last_undegraded":"2024-09-07T03:32:50.272042+0000","last_fullsized":"2024-09-07T03:32:50.272042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:04:31.049755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276218+0000","last_change":"2024-09-07T03:32:14.127846+0000","last_active":"2024-09-07T03:32:50.276218+0000","last_peered":"2024-09-07T03:32:50.276218+0000","last_clean":"2024-09-07T03:32:50.276218+0000","last_became_active":"2024-09-07T03:32:14.127560+0000","last_became_peered":"2024-09-07T03:32:14.127560+0000","last_unstale":"2024-09-07T03:32:50.276218+0000","last_undegraded":"2024-09-07T03:32:50.276218+0000","last_fullsized":"2024-09-07T03:32:50.276218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:55.432265+0000","last_change":"2024-09-07T03:32:12.139702+0000","last_active":"2024-09-07T03:32:55.432265+0000","last_peered":"2024-09-07T03:32:55.432265+0000","last_clean":"2024-09-07T03:32:55.432265+0000","last_became_active":"2024-09-07T03:32:12.138745+0000","last_became_peered":"2024-09-07T03:32:12.138745+0000","last_unstale":"2024-09-07T03:32:55.432265+0000","last_undegraded":"2024-09-07T03:32:55.432265+0000","last_fullsized":"2024-09-07T03:32:55.432265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:58:53.427065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.805976+0000","last_change":"2024-09-07T03:32:14.123012+0000","last_active":"2024-09-07T03:35:23.805976+0000","last_peered":"2024-09-07T03:35:23.805976+0000","last_clean":"2024-09-07T03:35:23.805976+0000","last_became_active":"2024-09-07T03:32:14.122699+0000","last_became_peered":"2024-09-07T03:32:14.122699+0000","last_unstale":"2024-09-07T03:35:23.805976+0000","last_undegraded":"2024-09-07T03:35:23.805976+0000","last_fullsized":"2024-09-07T03:35:23.805976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:12.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280233+0000","last_change":"2024-09-07T03:32:12.133952+0000","last_active":"2024-09-07T03:32:50.280233+0000","last_peered":"2024-09-07T03:32:50.280233+0000","last_clean":"2024-09-07T03:32:50.280233+0000","last_became_active":"2024-09-07T03:32:12.133145+0000","last_became_peered":"2024-09-07T03:32:12.133145+0000","last_unstale":"2024-09-07T03:32:50.280233+0000","last_undegraded":"2024-09-07T03:32:50.280233+0000","last_fullsized":"2024-09-07T03:32:50.280233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:02.480411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"36'16","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587715+0000","last_change":"2024-09-07T03:32:14.112126+0000","last_active":"2024-09-07T03:35:23.587715+0000","last_peered":"2024-09-07T03:35:23.587715+0000","last_clean":"2024-09-07T03:35:23.587715+0000","last_became_active":"2024-09-07T03:32:14.111759+0000","last_became_peered":"2024-09-07T03:32:14.111759+0000","last_unstale":"2024-09-07T03:35:23.587715+0000","last_undegraded":"2024-09-07T03:35:23.587715+0000","last_fullsized":"2024-09-07T03:35:23.587715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:14.003758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":44,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.360209+0000","last_change":"2024-09-07T03:32:12.134868+0000","last_active":"2024-09-07T03:35:23.360209+0000","last_peered":"2024-09-07T03:35:23.360209+0000","last_clean":"2024-09-07T03:35:23.360209+0000","last_became_active":"2024-09-07T03:32:12.134151+0000","last_became_peered":"2024-09-07T03:32:12.134151+0000","last_unstale":"2024-09-07T03:35:23.360209+0000","last_undegraded":"2024-09-07T03:35:23.360209+0000","last_fullsized":"2024-09-07T03:35:23.360209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:08:24.817906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'30","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731159+0000","last_change":"2024-09-07T03:32:14.124493+0000","last_active":"2024-09-07T03:35:23.731159+0000","last_peered":"2024-09-07T03:35:23.731159+0000","last_clean":"2024-09-07T03:35:23.731159+0000","last_became_active":"2024-09-07T03:32:14.124258+0000","last_became_peered":"2024-09-07T03:32:14.124258+0000","last_unstale":"2024-09-07T03:35:23.731159+0000","last_undegraded":"2024-09-07T03:35:23.731159+0000","last_fullsized":"2024-09-07T03:35:23.731159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":111,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273399+0000","last_change":"2024-09-07T03:32:12.140618+0000","last_active":"2024-09-07T03:32:50.273399+0000","last_peered":"2024-09-07T03:32:50.273399+0000","last_clean":"2024-09-07T03:32:50.273399+0000","last_became_active":"2024-09-07T03:32:12.140243+0000","last_became_peered":"2024-09-07T03:32:12.140243+0000","last_unstale":"2024-09-07T03:32:50.273399+0000","last_undegraded":"2024-09-07T03:32:50.273399+0000","last_fullsized":"2024-09-07T03:32:50.273399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:41.435390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570857+0000","last_change":"2024-09-07T03:32:14.113597+0000","last_active":"2024-09-07T03:32:56.570857+0000","last_peered":"2024-09-07T03:32:56.570857+0000","last_clean":"2024-09-07T03:32:56.570857+0000","last_became_active":"2024-09-07T03:32:14.113016+0000","last_became_peered":"2024-09-07T03:32:14.113016+0000","last_unstale":"2024-09-07T03:32:56.570857+0000","last_undegraded":"2024-09-07T03:32:56.570857+0000","last_fullsized":"2024-09-07T03:32:56.570857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:38:17.720862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272704+0000","last_change":"2024-09-07T03:32:12.136273+0000","last_active":"2024-09-07T03:32:50.272704+0000","last_peered":"2024-09-07T03:32:50.272704+0000","last_clean":"2024-09-07T03:32:50.272704+0000","last_became_active":"2024-09-07T03:32:12.135936+0000","last_became_peered":"2024-09-07T03:32:12.135936+0000","last_unstale":"2024-09-07T03:32:50.272704+0000","last_undegraded":"2024-09-07T03:32:50.272704+0000","last_fullsized":"2024-09-07T03:32:50.272704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:55.875414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731153+0000","last_change":"2024-09-07T03:32:14.128701+0000","last_active":"2024-09-07T03:35:23.731153+0000","last_peered":"2024-09-07T03:35:23.731153+0000","last_clean":"2024-09-07T03:35:23.731153+0000","last_became_active":"2024-09-07T03:32:14.127982+0000","last_became_peered":"2024-09-07T03:32:14.127982+0000","last_unstale":"2024-09-07T03:35:23.731153+0000","last_undegraded":"2024-09-07T03:35:23.731153+0000","last_fullsized":"2024-09-07T03:35:23.731153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278674+0000","last_change":"2024-09-07T03:32:12.134111+0000","last_active":"2024-09-07T03:32:50.278674+0000","last_peered":"2024-09-07T03:32:50.278674+0000","last_clean":"2024-09-07T03:32:50.278674+0000","last_became_active":"2024-09-07T03:32:12.133720+0000","last_became_peered":"2024-09-07T03:32:12.133720+0000","last_unstale":"2024-09-07T03:32:50.278674+0000","last_undegraded":"2024-09-07T03:32:50.278674+0000","last_fullsized":"2024-09-07T03:32:50.278674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:57:03.239693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843615+0000","last_change":"2024-09-07T03:32:14.124677+0000","last_active":"2024-09-07T03:35:23.843615+0000","last_peered":"2024-09-07T03:35:23.843615+0000","last_clean":"2024-09-07T03:35:23.843615+0000","last_became_active":"2024-09-07T03:32:14.124462+0000","last_became_peered":"2024-09-07T03:32:14.124462+0000","last_unstale":"2024-09-07T03:35:23.843615+0000","last_undegraded":"2024-09-07T03:35:23.843615+0000","last_fullsized":"2024-09-07T03:35:23.843615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.907020+0000","last_change":"2024-09-07T03:32:12.141303+0000","last_active":"2024-09-07T03:34:22.907020+0000","last_peered":"2024-09-07T03:34:22.907020+0000","last_clean":"2024-09-07T03:34:22.907020+0000","last_became_active":"2024-09-07T03:32:12.140957+0000","last_became_peered":"2024-09-07T03:32:12.140957+0000","last_unstale":"2024-09-07T03:34:22.907020+0000","last_undegraded":"2024-09-07T03:34:22.907020+0000","last_fullsized":"2024-09-07T03:34:22.907020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:19:10.920973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278119+0000","last_change":"2024-09-07T03:32:12.133925+0000","last_active":"2024-09-07T03:32:50.278119+0000","last_peered":"2024-09-07T03:32:50.278119+0000","last_clean":"2024-09-07T03:32:50.278119+0000","last_became_active":"2024-09-07T03:32:12.133460+0000","last_became_peered":"2024-09-07T03:32:12.133460+0000","last_unstale":"2024-09-07T03:32:50.278119+0000","last_undegraded":"2024-09-07T03:32:50.278119+0000","last_fullsized":"2024-09-07T03:32:50.278119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:50:56.419019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435937+0000","last_change":"2024-09-07T03:32:14.123815+0000","last_active":"2024-09-07T03:34:19.435937+0000","last_peered":"2024-09-07T03:34:19.435937+0000","last_clean":"2024-09-07T03:34:19.435937+0000","last_became_active":"2024-09-07T03:32:14.123554+0000","last_became_peered":"2024-09-07T03:32:14.123554+0000","last_unstale":"2024-09-07T03:34:19.435937+0000","last_undegraded":"2024-09-07T03:34:19.435937+0000","last_fullsized":"2024-09-07T03:34:19.435937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:12:13.928369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470165+0000","last_change":"2024-09-07T03:32:12.135828+0000","last_active":"2024-09-07T03:32:50.470165+0000","last_peered":"2024-09-07T03:32:50.470165+0000","last_clean":"2024-09-07T03:32:50.470165+0000","last_became_active":"2024-09-07T03:32:12.134650+0000","last_became_peered":"2024-09-07T03:32:12.134650+0000","last_unstale":"2024-09-07T03:32:50.470165+0000","last_undegraded":"2024-09-07T03:32:50.470165+0000","last_fullsized":"2024-09-07T03:32:50.470165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:30:53.762992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843565+0000","last_change":"2024-09-07T03:32:14.127747+0000","last_active":"2024-09-07T03:35:23.843565+0000","last_peered":"2024-09-07T03:35:23.843565+0000","last_clean":"2024-09-07T03:35:23.843565+0000","last_became_active":"2024-09-07T03:32:14.127493+0000","last_became_peered":"2024-09-07T03:32:14.127493+0000","last_unstale":"2024-09-07T03:35:23.843565+0000","last_undegraded":"2024-09-07T03:35:23.843565+0000","last_fullsized":"2024-09-07T03:35:23.843565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:45:11.748356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1570,"ondisk_log_size":1570,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1666,"num_read_kb":1556,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":450560,"data_stored":155820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640304,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1007616,"data_stored":744671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640304,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":507904,"data_stored":158016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705711,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40560,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331280,"statfs":{"total":96636764160,"available":96595230720,"internally_reserved":0,"allocated":1081344,"data_stored":748249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:35:35.191 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.191 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.191 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.191 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.191 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.192 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.192 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.192 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.192 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.192 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.192 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.192 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.192 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.193 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.194 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.194 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.194 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.194 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.194 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.194 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.194 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.194 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.194 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.195 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.195 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.195 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.195 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.195 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.195 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.195 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.195 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.195 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.196 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.196 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.196 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.196 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.196 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.196 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.196 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.196 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.196 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.197 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.197 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.197 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.197 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.197 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.197 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.197 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.197 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.197 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.198 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.199 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.199 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.199 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.199 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.199 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.199 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.199 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.199 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.200 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.200 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.201 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.201 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.201 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.201 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.201 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.201 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.201 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.202 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.202 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.202 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.202 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.202 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.202 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.202 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.203 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.203 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.203 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.203 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.203 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.203 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.204 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.204 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.204 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-07T03:31:57.501815+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=31, tm_sec=57, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.204 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-07T03:32:01.524558+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=1, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.204 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.204 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.204 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.204 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.204 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.205 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.205 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-07T03:32:01.524558+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=1, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.205 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.205 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.205 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.206 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.206 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.206 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.206 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-07T03:32:01.524558+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=1, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.206 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.206 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.207 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.207 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.207 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.208 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.208 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-07T03:32:01.524558+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=1, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.208 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.208 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.208 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.208 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.209 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.209 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.209 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.209 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-07T03:32:01.524558+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=1, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.210 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.210 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.210 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.210 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.210 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.210 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.210 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-07T03:32:01.524558+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=1, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.211 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.211 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.211 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.211 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.211 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.211 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.211 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-07T03:32:01.524558+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=1, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.211 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.212 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.212 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.212 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.212 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.212 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.212 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-07T03:32:01.524558+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=1, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.213 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.213 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.213 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.213 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.213 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.213 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.214 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.214 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.214 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.214 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.214 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.214 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.215 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.215 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.215 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.215 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.215 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.215 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.215 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.215 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.216 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.216 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.216 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.216 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.216 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.216 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.216 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.216 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.216 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.217 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.217 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.217 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.217 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.217 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.217 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.217 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.217 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.217 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.218 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.218 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.218 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.218 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.218 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.218 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.218 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.218 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.219 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.219 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.219 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.219 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.219 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.219 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.219 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.219 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.219 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.220 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.220 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.220 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.220 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.220 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.220 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.220 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.220 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.221 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.221 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.221 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.221 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.221 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.221 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.221 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.221 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.221 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.222 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.222 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.222 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.222 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.222 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.222 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.222 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.222 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.222 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.223 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.223 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.223 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.223 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.223 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.223 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.223 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.223 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.223 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.224 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.224 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.224 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.224 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.224 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.224 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.224 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.224 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.224 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.225 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.225 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.225 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.225 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.225 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.225 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.225 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.225 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.226 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.226 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.226 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.226 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.226 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:35.226 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-07T03:35:55.227 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:35:55.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.336+0000 7f3847473640 1 Processor -- start 2024-09-07T03:35:55.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.336+0000 7f3847473640 1 -- start start 2024-09-07T03:35:55.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f3847473640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3840129d80 0x7f384012a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:55.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f3847473640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f384006dc00 con 0x7f384012a6a0 2024-09-07T03:35:55.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f3847473640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f38401299c0 con 0x7f3840129d80 2024-09-07T03:35:55.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f384520f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3840129d80 0x7f384012a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:55.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f3844a0e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f384012a6a0 0x7f3840110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:35470/0 (socket says 172.21.15.104:35470) 2024-09-07T03:35:55.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f384520f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3840129d80 0x7f384012a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51422/0 (socket says 172.21.15.104:51422) 2024-09-07T03:35:55.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f3844a0e640 1 -- 172.21.15.104:0/335263077 learned_addr learned my addr 172.21.15.104:0/335263077 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:35:55.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f384520f640 1 -- 172.21.15.104:0/335263077 >> v1:172.21.15.104:6789/0 conn(0x7f384012a6a0 legacy=0x7f3840110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:55.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f3837fff640 1 -- 172.21.15.104:0/335263077 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567587689 0 0) 0x7f384006dc00 con 0x7f384012a6a0 2024-09-07T03:35:55.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.337+0000 7f384520f640 1 -- 172.21.15.104:0/335263077 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3840114d20 con 0x7f3840129d80 2024-09-07T03:35:55.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.338+0000 7f384520f640 1 --2- 172.21.15.104:0/335263077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 0x7f384012a160 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f383c009720 tx=0x7f383c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef5fd1813a183a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:55.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.338+0000 7f3837fff640 1 -- 172.21.15.104:0/335263077 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c037070 con 0x7f3840129d80 2024-09-07T03:35:55.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.338+0000 7f3837fff640 1 -- 172.21.15.104:0/335263077 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383c02ad90 con 0x7f3840129d80 2024-09-07T03:35:55.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.338+0000 7f3837fff640 1 -- 172.21.15.104:0/335263077 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c032590 con 0x7f3840129d80 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.339+0000 7f3847473640 1 -- 172.21.15.104:0/335263077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 msgr2=0x7f384012a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.339+0000 7f3847473640 1 --2- 172.21.15.104:0/335263077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 0x7f384012a160 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f383c009720 tx=0x7f383c02a110 comp rx=0 tx=0).stop 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.339+0000 7f3847473640 1 -- 172.21.15.104:0/335263077 shutdown_connections 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.339+0000 7f3847473640 1 --2- 172.21.15.104:0/335263077 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 0x7f384012a160 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.339+0000 7f3847473640 1 -- 172.21.15.104:0/335263077 >> 172.21.15.104:0/335263077 conn(0x7f3840070850 msgr2=0x7f3840072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.339+0000 7f3847473640 1 -- 172.21.15.104:0/335263077 shutdown_connections 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.339+0000 7f3847473640 1 -- 172.21.15.104:0/335263077 wait complete. 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.340+0000 7f3847473640 1 Processor -- start 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.340+0000 7f3847473640 1 -- start start 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.340+0000 7f3847473640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 0x7f384011b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.340+0000 7f3847473640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3840114940 con 0x7f3840129d80 2024-09-07T03:35:55.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.340+0000 7f384520f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 0x7f384011b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:55.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.340+0000 7f384520f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 0x7f384011b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51428/0 (socket says 172.21.15.104:51428) 2024-09-07T03:35:55.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.340+0000 7f384520f640 1 -- 172.21.15.104:0/3780924162 learned_addr learned my addr 172.21.15.104:0/3780924162 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:35:55.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.340+0000 7f384520f640 1 -- 172.21.15.104:0/3780924162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384011ca80 con 0x7f3840129d80 2024-09-07T03:35:55.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.341+0000 7f384520f640 1 --2- 172.21.15.104:0/3780924162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 0x7f384011b390 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f383c009720 tx=0x7f383c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:55.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.341+0000 7f3835ffb640 1 -- 172.21.15.104:0/3780924162 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c041070 con 0x7f3840129d80 2024-09-07T03:35:55.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.341+0000 7f3835ffb640 1 -- 172.21.15.104:0/3780924162 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383c03c460 con 0x7f3840129d80 2024-09-07T03:35:55.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.341+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384011d730 con 0x7f3840129d80 2024-09-07T03:35:55.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.341+0000 7f3835ffb640 1 -- 172.21.15.104:0/3780924162 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c037040 con 0x7f3840129d80 2024-09-07T03:35:55.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.341+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f384011dd60 con 0x7f3840129d80 2024-09-07T03:35:55.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.342+0000 7f3835ffb640 1 -- 172.21.15.104:0/3780924162 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f383c044070 con 0x7f3840129d80 2024-09-07T03:35:55.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.342+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384011c4f0 con 0x7f3840129d80 2024-09-07T03:35:55.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.342+0000 7f3835ffb640 1 --2- 172.21.15.104:0/3780924162 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382403de90 0x7f3824040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:35:55.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.342+0000 7f3835ffb640 1 -- 172.21.15.104:0/3780924162 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f383c073610 con 0x7f3840129d80 2024-09-07T03:35:55.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.343+0000 7f3844a0e640 1 --2- 172.21.15.104:0/3780924162 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382403de90 0x7f3824040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:35:55.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.343+0000 7f3844a0e640 1 --2- 172.21.15.104:0/3780924162 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382403de90 0x7f3824040350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3830000c00 tx=0x7f38300078d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:35:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.347+0000 7f3835ffb640 1 -- 172.21.15.104:0/3780924162 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f383c075cf0 con 0x7f3840129d80 2024-09-07T03:35:55.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.518+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3840071150 con 0x7f382403de90 2024-09-07T03:35:55.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.529+0000 7f3835ffb640 1 -- 172.21.15.104:0/3780924162 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666020 (secure 0 0 0) 0x7f3840071150 con 0x7f382403de90 2024-09-07T03:35:55.538 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:35:55.543 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:35:55.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382403de90 msgr2=0x7f3824040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:55.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 --2- 172.21.15.104:0/3780924162 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382403de90 0x7f3824040350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3830000c00 tx=0x7f38300078d0 comp rx=0 tx=0).stop 2024-09-07T03:35:55.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 msgr2=0x7f384011b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:35:55.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 --2- 172.21.15.104:0/3780924162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 0x7f384011b390 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f383c009720 tx=0x7f383c0046c0 comp rx=0 tx=0).stop 2024-09-07T03:35:55.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 shutdown_connections 2024-09-07T03:35:55.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 --2- 172.21.15.104:0/3780924162 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f382403de90 0x7f3824040350 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:55.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 --2- 172.21.15.104:0/3780924162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3840129d80 0x7f384011b390 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:35:55.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 >> 172.21.15.104:0/3780924162 conn(0x7f3840070850 msgr2=0x7f3840126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:35:55.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 shutdown_connections 2024-09-07T03:35:55.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:35:55.534+0000 7f3847473640 1 -- 172.21.15.104:0/3780924162 wait complete. 2024-09-07T03:35:55.547 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-07T03:35:55.270517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5430,"num_read_kb":4984,"num_write":2317,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4765,"ondisk_log_size":4765,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160992,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326368,"statfs":{"total":386547056640,"available":386382200832,"internally_reserved":0,"allocated":3047424,"data_stored":1806756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004001"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281796+0000","last_change":"2024-09-07T03:32:12.133842+0000","last_active":"2024-09-07T03:32:50.281796+0000","last_peered":"2024-09-07T03:32:50.281796+0000","last_clean":"2024-09-07T03:32:50.281796+0000","last_became_active":"2024-09-07T03:32:12.133110+0000","last_became_peered":"2024-09-07T03:32:12.133110+0000","last_unstale":"2024-09-07T03:32:50.281796+0000","last_undegraded":"2024-09-07T03:32:50.281796+0000","last_fullsized":"2024-09-07T03:32:50.281796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:21:24.282602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985450+0000","last_change":"2024-09-07T03:32:14.110006+0000","last_active":"2024-09-07T03:33:38.985450+0000","last_peered":"2024-09-07T03:33:38.985450+0000","last_clean":"2024-09-07T03:33:38.985450+0000","last_became_active":"2024-09-07T03:32:14.109379+0000","last_became_peered":"2024-09-07T03:32:14.109379+0000","last_unstale":"2024-09-07T03:33:38.985450+0000","last_undegraded":"2024-09-07T03:33:38.985450+0000","last_fullsized":"2024-09-07T03:33:38.985450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.129075+0000","last_change":"2024-09-07T03:35:46.129075+0000","last_active":"2024-09-07T03:35:46.129075+0000","last_peered":"2024-09-07T03:35:46.129075+0000","last_clean":"2024-09-07T03:35:46.129075+0000","last_became_active":"2024-09-07T03:32:12.135945+0000","last_became_peered":"2024-09-07T03:32:12.135945+0000","last_unstale":"2024-09-07T03:35:46.129075+0000","last_undegraded":"2024-09-07T03:35:46.129075+0000","last_fullsized":"2024-09-07T03:35:46.129075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.128991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.128991+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.128991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:16:00.699297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'18","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.476438+0000","last_change":"2024-09-07T03:32:50.283523+0000","last_active":"2024-09-07T03:35:23.476438+0000","last_peered":"2024-09-07T03:35:23.476438+0000","last_clean":"2024-09-07T03:35:23.476438+0000","last_became_active":"2024-09-07T03:32:50.279755+0000","last_became_peered":"2024-09-07T03:32:50.279755+0000","last_unstale":"2024-09-07T03:35:23.476438+0000","last_undegraded":"2024-09-07T03:35:23.476438+0000","last_fullsized":"2024-09-07T03:35:23.476438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:00:27.065883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.664376+0000","last_change":"2024-09-07T03:32:12.138579+0000","last_active":"2024-09-07T03:35:30.664376+0000","last_peered":"2024-09-07T03:35:30.664376+0000","last_clean":"2024-09-07T03:35:30.664376+0000","last_became_active":"2024-09-07T03:32:12.138176+0000","last_became_peered":"2024-09-07T03:32:12.138176+0000","last_unstale":"2024-09-07T03:35:30.664376+0000","last_undegraded":"2024-09-07T03:35:30.664376+0000","last_fullsized":"2024-09-07T03:35:30.664376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:43.715317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.299808+0000","last_change":"2024-09-07T03:32:50.282415+0000","last_active":"2024-09-07T03:32:56.299808+0000","last_peered":"2024-09-07T03:32:56.299808+0000","last_clean":"2024-09-07T03:32:56.299808+0000","last_became_active":"2024-09-07T03:32:50.282086+0000","last_became_peered":"2024-09-07T03:32:50.282086+0000","last_unstale":"2024-09-07T03:32:56.299808+0000","last_undegraded":"2024-09-07T03:32:56.299808+0000","last_fullsized":"2024-09-07T03:32:56.299808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:57:14.202152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.102738+0000","last_change":"2024-09-07T03:35:41.102738+0000","last_active":"2024-09-07T03:35:41.102738+0000","last_peered":"2024-09-07T03:35:41.102738+0000","last_clean":"2024-09-07T03:35:41.102738+0000","last_became_active":"2024-09-07T03:32:12.128937+0000","last_became_peered":"2024-09-07T03:32:12.128937+0000","last_unstale":"2024-09-07T03:35:41.102738+0000","last_undegraded":"2024-09-07T03:35:41.102738+0000","last_fullsized":"2024-09-07T03:35:41.102738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.102653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.102653+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.102653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:22:21.638223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963439+0000","last_change":"2024-09-07T03:32:14.123290+0000","last_active":"2024-09-07T03:34:22.963439+0000","last_peered":"2024-09-07T03:34:22.963439+0000","last_clean":"2024-09-07T03:34:22.963439+0000","last_became_active":"2024-09-07T03:32:14.122611+0000","last_became_peered":"2024-09-07T03:32:14.122611+0000","last_unstale":"2024-09-07T03:34:22.963439+0000","last_undegraded":"2024-09-07T03:34:22.963439+0000","last_fullsized":"2024-09-07T03:34:22.963439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279185+0000","last_change":"2024-09-07T03:32:12.124716+0000","last_active":"2024-09-07T03:32:50.279185+0000","last_peered":"2024-09-07T03:32:50.279185+0000","last_clean":"2024-09-07T03:32:50.279185+0000","last_became_active":"2024-09-07T03:32:12.123986+0000","last_became_peered":"2024-09-07T03:32:12.123986+0000","last_unstale":"2024-09-07T03:32:50.279185+0000","last_undegraded":"2024-09-07T03:32:50.279185+0000","last_fullsized":"2024-09-07T03:32:50.279185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:10.648401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.597575+0000","last_change":"2024-09-07T03:32:14.124801+0000","last_active":"2024-09-07T03:35:23.597575+0000","last_peered":"2024-09-07T03:35:23.597575+0000","last_clean":"2024-09-07T03:35:23.597575+0000","last_became_active":"2024-09-07T03:32:14.124523+0000","last_became_peered":"2024-09-07T03:32:14.124523+0000","last_unstale":"2024-09-07T03:35:23.597575+0000","last_undegraded":"2024-09-07T03:35:23.597575+0000","last_fullsized":"2024-09-07T03:35:23.597575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:39.133433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.558996+0000","last_change":"2024-09-07T03:32:12.133960+0000","last_active":"2024-09-07T03:32:56.558996+0000","last_peered":"2024-09-07T03:32:56.558996+0000","last_clean":"2024-09-07T03:32:56.558996+0000","last_became_active":"2024-09-07T03:32:12.133597+0000","last_became_peered":"2024-09-07T03:32:12.133597+0000","last_unstale":"2024-09-07T03:32:56.558996+0000","last_undegraded":"2024-09-07T03:32:56.558996+0000","last_fullsized":"2024-09-07T03:32:56.558996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:16:06.544105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.571091+0000","last_change":"2024-09-07T03:32:14.113584+0000","last_active":"2024-09-07T03:32:56.571091+0000","last_peered":"2024-09-07T03:32:56.571091+0000","last_clean":"2024-09-07T03:32:56.571091+0000","last_became_active":"2024-09-07T03:32:14.112622+0000","last_became_peered":"2024-09-07T03:32:14.112622+0000","last_unstale":"2024-09-07T03:32:56.571091+0000","last_undegraded":"2024-09-07T03:32:56.571091+0000","last_fullsized":"2024-09-07T03:32:56.571091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:52.320086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273279+0000","last_change":"2024-09-07T03:32:12.140541+0000","last_active":"2024-09-07T03:32:50.273279+0000","last_peered":"2024-09-07T03:32:50.273279+0000","last_clean":"2024-09-07T03:32:50.273279+0000","last_became_active":"2024-09-07T03:32:12.140221+0000","last_became_peered":"2024-09-07T03:32:12.140221+0000","last_unstale":"2024-09-07T03:32:50.273279+0000","last_undegraded":"2024-09-07T03:32:50.273279+0000","last_fullsized":"2024-09-07T03:32:50.273279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:56.248253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.300068+0000","last_change":"2024-09-07T03:32:14.114929+0000","last_active":"2024-09-07T03:32:56.300068+0000","last_peered":"2024-09-07T03:32:56.300068+0000","last_clean":"2024-09-07T03:32:56.300068+0000","last_became_active":"2024-09-07T03:32:14.114529+0000","last_became_peered":"2024-09-07T03:32:14.114529+0000","last_unstale":"2024-09-07T03:32:56.300068+0000","last_undegraded":"2024-09-07T03:32:56.300068+0000","last_fullsized":"2024-09-07T03:32:56.300068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.909080+0000","last_change":"2024-09-07T03:35:49.909080+0000","last_active":"2024-09-07T03:35:49.909080+0000","last_peered":"2024-09-07T03:35:49.909080+0000","last_clean":"2024-09-07T03:35:49.909080+0000","last_became_active":"2024-09-07T03:32:12.143209+0000","last_became_peered":"2024-09-07T03:32:12.143209+0000","last_unstale":"2024-09-07T03:35:49.909080+0000","last_undegraded":"2024-09-07T03:35:49.909080+0000","last_fullsized":"2024-09-07T03:35:49.909080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:49.908949+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:49.908949+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.908949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:33:51.713150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.944310+0000","last_change":"2024-09-07T03:32:14.124391+0000","last_active":"2024-09-07T03:35:23.944310+0000","last_peered":"2024-09-07T03:35:23.944310+0000","last_clean":"2024-09-07T03:35:23.944310+0000","last_became_active":"2024-09-07T03:32:14.124135+0000","last_became_peered":"2024-09-07T03:32:14.124135+0000","last_unstale":"2024-09-07T03:35:23.944310+0000","last_undegraded":"2024-09-07T03:35:23.944310+0000","last_fullsized":"2024-09-07T03:35:23.944310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:40.853544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'14","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806118+0000","last_change":"2024-09-07T03:32:14.109787+0000","last_active":"2024-09-07T03:35:23.806118+0000","last_peered":"2024-09-07T03:35:23.806118+0000","last_clean":"2024-09-07T03:35:23.806118+0000","last_became_active":"2024-09-07T03:32:14.109280+0000","last_became_peered":"2024-09-07T03:32:14.109280+0000","last_unstale":"2024-09-07T03:35:23.806118+0000","last_undegraded":"2024-09-07T03:35:23.806118+0000","last_fullsized":"2024-09-07T03:35:23.806118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.074893+0000","last_change":"2024-09-07T03:35:49.074893+0000","last_active":"2024-09-07T03:35:49.074893+0000","last_peered":"2024-09-07T03:35:49.074893+0000","last_clean":"2024-09-07T03:35:49.074893+0000","last_became_active":"2024-09-07T03:32:12.134379+0000","last_became_peered":"2024-09-07T03:32:12.134379+0000","last_unstale":"2024-09-07T03:35:49.074893+0000","last_undegraded":"2024-09-07T03:35:49.074893+0000","last_fullsized":"2024-09-07T03:35:49.074893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:49.074793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:49.074793+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.074793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:58:33.349796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843636+0000","last_change":"2024-09-07T03:32:14.112114+0000","last_active":"2024-09-07T03:35:23.843636+0000","last_peered":"2024-09-07T03:35:23.843636+0000","last_clean":"2024-09-07T03:35:23.843636+0000","last_became_active":"2024-09-07T03:32:14.111769+0000","last_became_peered":"2024-09-07T03:32:14.111769+0000","last_unstale":"2024-09-07T03:35:23.843636+0000","last_undegraded":"2024-09-07T03:35:23.843636+0000","last_fullsized":"2024-09-07T03:35:23.843636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.132801+0000","last_change":"2024-09-07T03:35:47.132801+0000","last_active":"2024-09-07T03:35:47.132801+0000","last_peered":"2024-09-07T03:35:47.132801+0000","last_clean":"2024-09-07T03:35:47.132801+0000","last_became_active":"2024-09-07T03:32:12.129310+0000","last_became_peered":"2024-09-07T03:32:12.129310+0000","last_unstale":"2024-09-07T03:35:47.132801+0000","last_undegraded":"2024-09-07T03:35:47.132801+0000","last_fullsized":"2024-09-07T03:35:47.132801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:47.132683+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:47.132683+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.132683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:14:40.445362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.590380+0000","last_change":"2024-09-07T03:32:14.109568+0000","last_active":"2024-09-07T03:35:23.590380+0000","last_peered":"2024-09-07T03:35:23.590380+0000","last_clean":"2024-09-07T03:35:23.590380+0000","last_became_active":"2024-09-07T03:32:14.109177+0000","last_became_peered":"2024-09-07T03:32:14.109177+0000","last_unstale":"2024-09-07T03:35:23.590380+0000","last_undegraded":"2024-09-07T03:35:23.590380+0000","last_fullsized":"2024-09-07T03:35:23.590380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:49:22.436331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281713+0000","last_change":"2024-09-07T03:32:12.121206+0000","last_active":"2024-09-07T03:32:50.281713+0000","last_peered":"2024-09-07T03:32:50.281713+0000","last_clean":"2024-09-07T03:32:50.281713+0000","last_became_active":"2024-09-07T03:32:12.120449+0000","last_became_peered":"2024-09-07T03:32:12.120449+0000","last_unstale":"2024-09-07T03:32:50.281713+0000","last_undegraded":"2024-09-07T03:32:50.281713+0000","last_fullsized":"2024-09-07T03:32:50.281713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:04:17.603683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731173+0000","last_change":"2024-09-07T03:32:14.125322+0000","last_active":"2024-09-07T03:35:23.731173+0000","last_peered":"2024-09-07T03:35:23.731173+0000","last_clean":"2024-09-07T03:35:23.731173+0000","last_became_active":"2024-09-07T03:32:14.125065+0000","last_became_peered":"2024-09-07T03:32:14.125065+0000","last_unstale":"2024-09-07T03:35:23.731173+0000","last_undegraded":"2024-09-07T03:35:23.731173+0000","last_fullsized":"2024-09-07T03:35:23.731173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.382792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279118+0000","last_change":"2024-09-07T03:32:12.125531+0000","last_active":"2024-09-07T03:32:50.279118+0000","last_peered":"2024-09-07T03:32:50.279118+0000","last_clean":"2024-09-07T03:32:50.279118+0000","last_became_active":"2024-09-07T03:32:12.124516+0000","last_became_peered":"2024-09-07T03:32:12.124516+0000","last_unstale":"2024-09-07T03:32:50.279118+0000","last_undegraded":"2024-09-07T03:32:50.279118+0000","last_fullsized":"2024-09-07T03:32:50.279118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:28:38.848848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:41.230770+0000","last_change":"2024-09-07T03:32:14.112755+0000","last_active":"2024-09-07T03:34:41.230770+0000","last_peered":"2024-09-07T03:34:41.230770+0000","last_clean":"2024-09-07T03:34:41.230770+0000","last_became_active":"2024-09-07T03:32:14.112477+0000","last_became_peered":"2024-09-07T03:32:14.112477+0000","last_unstale":"2024-09-07T03:34:41.230770+0000","last_undegraded":"2024-09-07T03:34:41.230770+0000","last_fullsized":"2024-09-07T03:34:41.230770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:41:15.350018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275444+0000","last_change":"2024-09-07T03:32:12.137178+0000","last_active":"2024-09-07T03:32:50.275444+0000","last_peered":"2024-09-07T03:32:50.275444+0000","last_clean":"2024-09-07T03:32:50.275444+0000","last_became_active":"2024-09-07T03:32:12.136801+0000","last_became_peered":"2024-09-07T03:32:12.136801+0000","last_unstale":"2024-09-07T03:32:50.275444+0000","last_undegraded":"2024-09-07T03:32:50.275444+0000","last_fullsized":"2024-09-07T03:32:50.275444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:14:59.894718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.850114+0000","last_change":"2024-09-07T03:32:14.109462+0000","last_active":"2024-09-07T03:35:23.850114+0000","last_peered":"2024-09-07T03:35:23.850114+0000","last_clean":"2024-09-07T03:35:23.850114+0000","last_became_active":"2024-09-07T03:32:14.109167+0000","last_became_peered":"2024-09-07T03:32:14.109167+0000","last_unstale":"2024-09-07T03:35:23.850114+0000","last_undegraded":"2024-09-07T03:35:23.850114+0000","last_fullsized":"2024-09-07T03:35:23.850114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:39.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272300+0000","last_change":"2024-09-07T03:32:12.138445+0000","last_active":"2024-09-07T03:32:50.272300+0000","last_peered":"2024-09-07T03:32:50.272300+0000","last_clean":"2024-09-07T03:32:50.272300+0000","last_became_active":"2024-09-07T03:32:12.138105+0000","last_became_peered":"2024-09-07T03:32:12.138105+0000","last_unstale":"2024-09-07T03:32:50.272300+0000","last_undegraded":"2024-09-07T03:32:50.272300+0000","last_fullsized":"2024-09-07T03:32:50.272300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:36:28.111018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.773106+0000","last_change":"2024-09-07T03:32:22.149626+0000","last_active":"2024-09-07T03:35:23.773106+0000","last_peered":"2024-09-07T03:35:23.773106+0000","last_clean":"2024-09-07T03:35:23.773106+0000","last_became_active":"2024-09-07T03:32:22.149337+0000","last_became_peered":"2024-09-07T03:32:22.149337+0000","last_unstale":"2024-09-07T03:35:23.773106+0000","last_undegraded":"2024-09-07T03:35:23.773106+0000","last_fullsized":"2024-09-07T03:35:23.773106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:00:45.310817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230587+0000","last_change":"2024-09-07T03:32:14.126524+0000","last_active":"2024-09-07T03:34:36.230587+0000","last_peered":"2024-09-07T03:34:36.230587+0000","last_clean":"2024-09-07T03:34:36.230587+0000","last_became_active":"2024-09-07T03:32:14.126222+0000","last_became_peered":"2024-09-07T03:32:14.126222+0000","last_unstale":"2024-09-07T03:34:36.230587+0000","last_undegraded":"2024-09-07T03:34:36.230587+0000","last_fullsized":"2024-09-07T03:34:36.230587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:51:09.670249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.063889+0000","last_change":"2024-09-07T03:35:40.063889+0000","last_active":"2024-09-07T03:35:40.063889+0000","last_peered":"2024-09-07T03:35:40.063889+0000","last_clean":"2024-09-07T03:35:40.063889+0000","last_became_active":"2024-09-07T03:32:12.124815+0000","last_became_peered":"2024-09-07T03:32:12.124815+0000","last_unstale":"2024-09-07T03:35:40.063889+0000","last_undegraded":"2024-09-07T03:35:40.063889+0000","last_fullsized":"2024-09-07T03:35:40.063889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:40.063781+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.063781+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.063781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:11.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275282+0000","last_change":"2024-09-07T03:32:16.127792+0000","last_active":"2024-09-07T03:32:50.275282+0000","last_peered":"2024-09-07T03:32:50.275282+0000","last_clean":"2024-09-07T03:32:50.275282+0000","last_became_active":"2024-09-07T03:32:16.127430+0000","last_became_peered":"2024-09-07T03:32:16.127430+0000","last_unstale":"2024-09-07T03:32:50.275282+0000","last_undegraded":"2024-09-07T03:32:50.275282+0000","last_fullsized":"2024-09-07T03:32:50.275282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:46.752720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.588157+0000","last_change":"2024-09-07T03:32:18.130430+0000","last_active":"2024-09-07T03:35:30.588157+0000","last_peered":"2024-09-07T03:35:30.588157+0000","last_clean":"2024-09-07T03:35:30.588157+0000","last_became_active":"2024-09-07T03:32:18.130101+0000","last_became_peered":"2024-09-07T03:32:18.130101+0000","last_unstale":"2024-09-07T03:35:30.588157+0000","last_undegraded":"2024-09-07T03:35:30.588157+0000","last_fullsized":"2024-09-07T03:35:30.588157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:55.756545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280723+0000","last_change":"2024-09-07T03:32:20.147157+0000","last_active":"2024-09-07T03:32:50.280723+0000","last_peered":"2024-09-07T03:32:50.280723+0000","last_clean":"2024-09-07T03:32:50.280723+0000","last_became_active":"2024-09-07T03:32:20.146716+0000","last_became_peered":"2024-09-07T03:32:20.146716+0000","last_unstale":"2024-09-07T03:32:50.280723+0000","last_undegraded":"2024-09-07T03:32:50.280723+0000","last_fullsized":"2024-09-07T03:32:50.280723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:23.679745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"36'9","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.982420+0000","last_change":"2024-09-07T03:32:22.143355+0000","last_active":"2024-09-07T03:33:38.982420+0000","last_peered":"2024-09-07T03:33:38.982420+0000","last_clean":"2024-09-07T03:33:38.982420+0000","last_became_active":"2024-09-07T03:32:22.143092+0000","last_became_peered":"2024-09-07T03:32:22.143092+0000","last_unstale":"2024-09-07T03:33:38.982420+0000","last_undegraded":"2024-09-07T03:33:38.982420+0000","last_fullsized":"2024-09-07T03:33:38.982420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:30:18.450771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'8","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843638+0000","last_change":"2024-09-07T03:32:14.122327+0000","last_active":"2024-09-07T03:35:23.843638+0000","last_peered":"2024-09-07T03:35:23.843638+0000","last_clean":"2024-09-07T03:35:23.843638+0000","last_became_active":"2024-09-07T03:32:14.121998+0000","last_became_peered":"2024-09-07T03:32:14.121998+0000","last_unstale":"2024-09-07T03:35:23.843638+0000","last_undegraded":"2024-09-07T03:35:23.843638+0000","last_fullsized":"2024-09-07T03:35:23.843638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.036982+0000","last_change":"2024-09-07T03:35:35.036982+0000","last_active":"2024-09-07T03:35:35.036982+0000","last_peered":"2024-09-07T03:35:35.036982+0000","last_clean":"2024-09-07T03:35:35.036982+0000","last_became_active":"2024-09-07T03:32:12.129979+0000","last_became_peered":"2024-09-07T03:32:12.129979+0000","last_unstale":"2024-09-07T03:35:35.036982+0000","last_undegraded":"2024-09-07T03:35:35.036982+0000","last_fullsized":"2024-09-07T03:35:35.036982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:35.036881+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:35.036881+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.036881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:32:01.763051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275223+0000","last_change":"2024-09-07T03:32:16.126421+0000","last_active":"2024-09-07T03:32:50.275223+0000","last_peered":"2024-09-07T03:32:50.275223+0000","last_clean":"2024-09-07T03:32:50.275223+0000","last_became_active":"2024-09-07T03:32:16.126116+0000","last_became_peered":"2024-09-07T03:32:16.126116+0000","last_unstale":"2024-09-07T03:32:50.275223+0000","last_undegraded":"2024-09-07T03:32:50.275223+0000","last_fullsized":"2024-09-07T03:32:50.275223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:07:32.152302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472267+0000","last_change":"2024-09-07T03:32:18.132461+0000","last_active":"2024-09-07T03:32:50.472267+0000","last_peered":"2024-09-07T03:32:50.472267+0000","last_clean":"2024-09-07T03:32:50.472267+0000","last_became_active":"2024-09-07T03:32:18.132152+0000","last_became_peered":"2024-09-07T03:32:18.132152+0000","last_unstale":"2024-09-07T03:32:50.472267+0000","last_undegraded":"2024-09-07T03:32:50.472267+0000","last_fullsized":"2024-09-07T03:32:50.472267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:45:42.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280341+0000","last_change":"2024-09-07T03:32:20.146991+0000","last_active":"2024-09-07T03:32:50.280341+0000","last_peered":"2024-09-07T03:32:50.280341+0000","last_clean":"2024-09-07T03:32:50.280341+0000","last_became_active":"2024-09-07T03:32:20.146457+0000","last_became_peered":"2024-09-07T03:32:20.146457+0000","last_unstale":"2024-09-07T03:32:50.280341+0000","last_undegraded":"2024-09-07T03:32:50.280341+0000","last_fullsized":"2024-09-07T03:32:50.280341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.222346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"36'10","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.807540+0000","last_change":"2024-09-07T03:32:22.144066+0000","last_active":"2024-09-07T03:35:23.807540+0000","last_peered":"2024-09-07T03:35:23.807540+0000","last_clean":"2024-09-07T03:35:23.807540+0000","last_became_active":"2024-09-07T03:32:22.143751+0000","last_became_peered":"2024-09-07T03:32:22.143751+0000","last_unstale":"2024-09-07T03:35:23.807540+0000","last_undegraded":"2024-09-07T03:35:23.807540+0000","last_fullsized":"2024-09-07T03:35:23.807540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:14.926443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"36'20","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731193+0000","last_change":"2024-09-07T03:32:14.130832+0000","last_active":"2024-09-07T03:35:23.731193+0000","last_peered":"2024-09-07T03:35:23.731193+0000","last_clean":"2024-09-07T03:35:23.731193+0000","last_became_active":"2024-09-07T03:32:14.130544+0000","last_became_peered":"2024-09-07T03:32:14.130544+0000","last_unstale":"2024-09-07T03:35:23.731193+0000","last_undegraded":"2024-09-07T03:35:23.731193+0000","last_fullsized":"2024-09-07T03:35:23.731193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.060884+0000","last_change":"2024-09-07T03:35:47.060884+0000","last_active":"2024-09-07T03:35:47.060884+0000","last_peered":"2024-09-07T03:35:47.060884+0000","last_clean":"2024-09-07T03:35:47.060884+0000","last_became_active":"2024-09-07T03:32:12.124808+0000","last_became_peered":"2024-09-07T03:32:12.124808+0000","last_unstale":"2024-09-07T03:35:47.060884+0000","last_undegraded":"2024-09-07T03:35:47.060884+0000","last_fullsized":"2024-09-07T03:35:47.060884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:47.060791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:47.060791+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.060791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:54.421614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276016+0000","last_change":"2024-09-07T03:32:16.126571+0000","last_active":"2024-09-07T03:32:50.276016+0000","last_peered":"2024-09-07T03:32:50.276016+0000","last_clean":"2024-09-07T03:32:50.276016+0000","last_became_active":"2024-09-07T03:32:16.126318+0000","last_became_peered":"2024-09-07T03:32:16.126318+0000","last_unstale":"2024-09-07T03:32:50.276016+0000","last_undegraded":"2024-09-07T03:32:50.276016+0000","last_fullsized":"2024-09-07T03:32:50.276016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:51.962540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275774+0000","last_change":"2024-09-07T03:32:18.128687+0000","last_active":"2024-09-07T03:32:50.275774+0000","last_peered":"2024-09-07T03:32:50.275774+0000","last_clean":"2024-09-07T03:32:50.275774+0000","last_became_active":"2024-09-07T03:32:18.128391+0000","last_became_peered":"2024-09-07T03:32:18.128391+0000","last_unstale":"2024-09-07T03:32:50.275774+0000","last_undegraded":"2024-09-07T03:32:50.275774+0000","last_fullsized":"2024-09-07T03:32:50.275774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:50:24.989266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.539513+0000","last_change":"2024-09-07T03:32:20.140796+0000","last_active":"2024-09-07T03:35:30.539513+0000","last_peered":"2024-09-07T03:35:30.539513+0000","last_clean":"2024-09-07T03:35:30.539513+0000","last_became_active":"2024-09-07T03:32:20.140249+0000","last_became_peered":"2024-09-07T03:32:20.140249+0000","last_unstale":"2024-09-07T03:35:30.539513+0000","last_undegraded":"2024-09-07T03:35:30.539513+0000","last_fullsized":"2024-09-07T03:35:30.539513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:12.918865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274799+0000","last_change":"2024-09-07T03:32:22.141118+0000","last_active":"2024-09-07T03:32:50.274799+0000","last_peered":"2024-09-07T03:32:50.274799+0000","last_clean":"2024-09-07T03:32:50.274799+0000","last_became_active":"2024-09-07T03:32:22.139829+0000","last_became_peered":"2024-09-07T03:32:22.139829+0000","last_unstale":"2024-09-07T03:32:50.274799+0000","last_undegraded":"2024-09-07T03:32:50.274799+0000","last_fullsized":"2024-09-07T03:32:50.274799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:55:30.425595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587735+0000","last_change":"2024-09-07T03:32:14.126517+0000","last_active":"2024-09-07T03:35:23.587735+0000","last_peered":"2024-09-07T03:35:23.587735+0000","last_clean":"2024-09-07T03:35:23.587735+0000","last_became_active":"2024-09-07T03:32:14.126140+0000","last_became_peered":"2024-09-07T03:32:14.126140+0000","last_unstale":"2024-09-07T03:35:23.587735+0000","last_undegraded":"2024-09-07T03:35:23.587735+0000","last_fullsized":"2024-09-07T03:35:23.587735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.015724+0000","last_change":"2024-09-07T03:35:46.015724+0000","last_active":"2024-09-07T03:35:46.015724+0000","last_peered":"2024-09-07T03:35:46.015724+0000","last_clean":"2024-09-07T03:35:46.015724+0000","last_became_active":"2024-09-07T03:32:12.133270+0000","last_became_peered":"2024-09-07T03:32:12.133270+0000","last_unstale":"2024-09-07T03:35:46.015724+0000","last_undegraded":"2024-09-07T03:35:46.015724+0000","last_fullsized":"2024-09-07T03:35:46.015724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.015616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.015616+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.015616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:06:46.915585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281906+0000","last_change":"2024-09-07T03:32:16.117091+0000","last_active":"2024-09-07T03:32:50.281906+0000","last_peered":"2024-09-07T03:32:50.281906+0000","last_clean":"2024-09-07T03:32:50.281906+0000","last_became_active":"2024-09-07T03:32:16.116761+0000","last_became_peered":"2024-09-07T03:32:16.116761+0000","last_unstale":"2024-09-07T03:32:50.281906+0000","last_undegraded":"2024-09-07T03:32:50.281906+0000","last_fullsized":"2024-09-07T03:32:50.281906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:07:07.674647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'41","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.680636+0000","last_change":"2024-09-07T03:32:18.129567+0000","last_active":"2024-09-07T03:35:30.680636+0000","last_peered":"2024-09-07T03:35:30.680636+0000","last_clean":"2024-09-07T03:35:30.680636+0000","last_became_active":"2024-09-07T03:32:18.128901+0000","last_became_peered":"2024-09-07T03:32:18.128901+0000","last_unstale":"2024-09-07T03:35:30.680636+0000","last_undegraded":"2024-09-07T03:35:30.680636+0000","last_fullsized":"2024-09-07T03:35:30.680636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:42:21.711836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.545527+0000","last_change":"2024-09-07T03:32:20.142693+0000","last_active":"2024-09-07T03:35:30.545527+0000","last_peered":"2024-09-07T03:35:30.545527+0000","last_clean":"2024-09-07T03:35:30.545527+0000","last_became_active":"2024-09-07T03:32:20.142390+0000","last_became_peered":"2024-09-07T03:32:20.142390+0000","last_unstale":"2024-09-07T03:35:30.545527+0000","last_undegraded":"2024-09-07T03:35:30.545527+0000","last_fullsized":"2024-09-07T03:35:30.545527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:51:20.882177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272814+0000","last_change":"2024-09-07T03:32:14.123300+0000","last_active":"2024-09-07T03:32:50.272814+0000","last_peered":"2024-09-07T03:32:50.272814+0000","last_clean":"2024-09-07T03:32:50.272814+0000","last_became_active":"2024-09-07T03:32:14.122806+0000","last_became_peered":"2024-09-07T03:32:14.122806+0000","last_unstale":"2024-09-07T03:32:50.272814+0000","last_undegraded":"2024-09-07T03:32:50.272814+0000","last_fullsized":"2024-09-07T03:32:50.272814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:12.527168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.958364+0000","last_change":"2024-09-07T03:35:43.958364+0000","last_active":"2024-09-07T03:35:43.958364+0000","last_peered":"2024-09-07T03:35:43.958364+0000","last_clean":"2024-09-07T03:35:43.958364+0000","last_became_active":"2024-09-07T03:32:12.124564+0000","last_became_peered":"2024-09-07T03:32:12.124564+0000","last_unstale":"2024-09-07T03:35:43.958364+0000","last_undegraded":"2024-09-07T03:35:43.958364+0000","last_fullsized":"2024-09-07T03:35:43.958364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.958249+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.958249+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.958249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:56:10.343804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470518+0000","last_change":"2024-09-07T03:32:16.128785+0000","last_active":"2024-09-07T03:32:50.470518+0000","last_peered":"2024-09-07T03:32:50.470518+0000","last_clean":"2024-09-07T03:32:50.470518+0000","last_became_active":"2024-09-07T03:32:16.128519+0000","last_became_peered":"2024-09-07T03:32:16.128519+0000","last_unstale":"2024-09-07T03:32:50.470518+0000","last_undegraded":"2024-09-07T03:32:50.470518+0000","last_fullsized":"2024-09-07T03:32:50.470518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:31.864367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'49","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.600626+0000","last_change":"2024-09-07T03:32:18.133115+0000","last_active":"2024-09-07T03:35:30.600626+0000","last_peered":"2024-09-07T03:35:30.600626+0000","last_clean":"2024-09-07T03:35:30.600626+0000","last_became_active":"2024-09-07T03:32:18.132867+0000","last_became_peered":"2024-09-07T03:32:18.132867+0000","last_unstale":"2024-09-07T03:35:30.600626+0000","last_undegraded":"2024-09-07T03:35:30.600626+0000","last_fullsized":"2024-09-07T03:35:30.600626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:21.167694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470403+0000","last_change":"2024-09-07T03:32:20.140261+0000","last_active":"2024-09-07T03:32:50.470403+0000","last_peered":"2024-09-07T03:32:50.470403+0000","last_clean":"2024-09-07T03:32:50.470403+0000","last_became_active":"2024-09-07T03:32:20.139806+0000","last_became_peered":"2024-09-07T03:32:20.139806+0000","last_unstale":"2024-09-07T03:32:50.470403+0000","last_undegraded":"2024-09-07T03:32:50.470403+0000","last_fullsized":"2024-09-07T03:32:50.470403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:38:36.923114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.784797+0000","last_change":"2024-09-07T03:32:22.148464+0000","last_active":"2024-09-07T03:35:23.784797+0000","last_peered":"2024-09-07T03:35:23.784797+0000","last_clean":"2024-09-07T03:35:23.784797+0000","last_became_active":"2024-09-07T03:32:22.148149+0000","last_became_peered":"2024-09-07T03:32:22.148149+0000","last_unstale":"2024-09-07T03:35:23.784797+0000","last_undegraded":"2024-09-07T03:35:23.784797+0000","last_fullsized":"2024-09-07T03:35:23.784797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:22.630172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.127054+0000","last_change":"2024-09-07T03:35:45.127054+0000","last_active":"2024-09-07T03:35:45.127054+0000","last_peered":"2024-09-07T03:35:45.127054+0000","last_clean":"2024-09-07T03:35:45.127054+0000","last_became_active":"2024-09-07T03:32:50.279097+0000","last_became_peered":"2024-09-07T03:32:50.279097+0000","last_unstale":"2024-09-07T03:35:45.127054+0000","last_undegraded":"2024-09-07T03:35:45.127054+0000","last_fullsized":"2024-09-07T03:35:45.127054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:45.126957+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:45.126957+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.126957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:52:31.656890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.977163+0000","last_change":"2024-09-07T03:35:44.977163+0000","last_active":"2024-09-07T03:35:44.977163+0000","last_peered":"2024-09-07T03:35:44.977163+0000","last_clean":"2024-09-07T03:35:44.977163+0000","last_became_active":"2024-09-07T03:32:12.123895+0000","last_became_peered":"2024-09-07T03:32:12.123895+0000","last_unstale":"2024-09-07T03:35:44.977163+0000","last_undegraded":"2024-09-07T03:35:44.977163+0000","last_fullsized":"2024-09-07T03:35:44.977163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:44.977080+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:44.977080+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.977080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:31:52.221278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274777+0000","last_change":"2024-09-07T03:32:16.129022+0000","last_active":"2024-09-07T03:32:50.274777+0000","last_peered":"2024-09-07T03:32:50.274777+0000","last_clean":"2024-09-07T03:32:50.274777+0000","last_became_active":"2024-09-07T03:32:16.128471+0000","last_became_peered":"2024-09-07T03:32:16.128471+0000","last_unstale":"2024-09-07T03:32:50.274777+0000","last_undegraded":"2024-09-07T03:32:50.274777+0000","last_fullsized":"2024-09-07T03:32:50.274777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:29.378625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'39","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.641623+0000","last_change":"2024-09-07T03:32:18.127995+0000","last_active":"2024-09-07T03:35:30.641623+0000","last_peered":"2024-09-07T03:35:30.641623+0000","last_clean":"2024-09-07T03:35:30.641623+0000","last_became_active":"2024-09-07T03:32:18.127674+0000","last_became_peered":"2024-09-07T03:32:18.127674+0000","last_unstale":"2024-09-07T03:35:30.641623+0000","last_undegraded":"2024-09-07T03:35:30.641623+0000","last_fullsized":"2024-09-07T03:35:30.641623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:39:30.847124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272008+0000","last_change":"2024-09-07T03:32:20.142615+0000","last_active":"2024-09-07T03:32:50.272008+0000","last_peered":"2024-09-07T03:32:50.272008+0000","last_clean":"2024-09-07T03:32:50.272008+0000","last_became_active":"2024-09-07T03:32:20.142322+0000","last_became_peered":"2024-09-07T03:32:20.142322+0000","last_unstale":"2024-09-07T03:32:50.272008+0000","last_undegraded":"2024-09-07T03:32:50.272008+0000","last_fullsized":"2024-09-07T03:32:50.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:20:24.113543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:33.274480+0000","last_change":"2024-09-07T03:32:22.140060+0000","last_active":"2024-09-07T03:33:33.274480+0000","last_peered":"2024-09-07T03:33:33.274480+0000","last_clean":"2024-09-07T03:33:33.274480+0000","last_became_active":"2024-09-07T03:32:22.139771+0000","last_became_peered":"2024-09-07T03:32:22.139771+0000","last_unstale":"2024-09-07T03:33:33.274480+0000","last_undegraded":"2024-09-07T03:33:33.274480+0000","last_fullsized":"2024-09-07T03:33:33.274480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:32:56.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963274+0000","last_change":"2024-09-07T03:32:14.122499+0000","last_active":"2024-09-07T03:34:22.963274+0000","last_peered":"2024-09-07T03:34:22.963274+0000","last_clean":"2024-09-07T03:34:22.963274+0000","last_became_active":"2024-09-07T03:32:14.122182+0000","last_became_peered":"2024-09-07T03:32:14.122182+0000","last_unstale":"2024-09-07T03:34:22.963274+0000","last_undegraded":"2024-09-07T03:34:22.963274+0000","last_fullsized":"2024-09-07T03:34:22.963274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.971146+0000","last_change":"2024-09-07T03:35:42.971146+0000","last_active":"2024-09-07T03:35:42.971146+0000","last_peered":"2024-09-07T03:35:42.971146+0000","last_clean":"2024-09-07T03:35:42.971146+0000","last_became_active":"2024-09-07T03:32:12.120464+0000","last_became_peered":"2024-09-07T03:32:12.120464+0000","last_unstale":"2024-09-07T03:35:42.971146+0000","last_undegraded":"2024-09-07T03:35:42.971146+0000","last_fullsized":"2024-09-07T03:35:42.971146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:42.971064+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:42.971064+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.971064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:22:31.004500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275521+0000","last_change":"2024-09-07T03:32:16.124913+0000","last_active":"2024-09-07T03:32:50.275521+0000","last_peered":"2024-09-07T03:32:50.275521+0000","last_clean":"2024-09-07T03:32:50.275521+0000","last_became_active":"2024-09-07T03:32:16.124297+0000","last_became_peered":"2024-09-07T03:32:16.124297+0000","last_unstale":"2024-09-07T03:32:50.275521+0000","last_undegraded":"2024-09-07T03:32:50.275521+0000","last_fullsized":"2024-09-07T03:32:50.275521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:17:34.327180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'52","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.607217+0000","last_change":"2024-09-07T03:32:18.130149+0000","last_active":"2024-09-07T03:35:30.607217+0000","last_peered":"2024-09-07T03:35:30.607217+0000","last_clean":"2024-09-07T03:35:30.607217+0000","last_became_active":"2024-09-07T03:32:18.129944+0000","last_became_peered":"2024-09-07T03:32:18.129944+0000","last_unstale":"2024-09-07T03:35:30.607217+0000","last_undegraded":"2024-09-07T03:35:30.607217+0000","last_fullsized":"2024-09-07T03:35:30.607217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:27:30.361760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":352,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.546808+0000","last_change":"2024-09-07T03:32:20.144523+0000","last_active":"2024-09-07T03:35:30.546808+0000","last_peered":"2024-09-07T03:35:30.546808+0000","last_clean":"2024-09-07T03:35:30.546808+0000","last_became_active":"2024-09-07T03:32:20.144077+0000","last_became_peered":"2024-09-07T03:32:20.144077+0000","last_unstale":"2024-09-07T03:35:30.546808+0000","last_undegraded":"2024-09-07T03:35:30.546808+0000","last_fullsized":"2024-09-07T03:35:30.546808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:25.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471098+0000","last_change":"2024-09-07T03:32:22.146228+0000","last_active":"2024-09-07T03:32:50.471098+0000","last_peered":"2024-09-07T03:32:50.471098+0000","last_clean":"2024-09-07T03:32:50.471098+0000","last_became_active":"2024-09-07T03:32:22.145690+0000","last_became_peered":"2024-09-07T03:32:22.145690+0000","last_unstale":"2024-09-07T03:32:50.471098+0000","last_undegraded":"2024-09-07T03:32:50.471098+0000","last_fullsized":"2024-09-07T03:32:50.471098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:59:34.851122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'7","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.092414+0000","last_change":"2024-09-07T03:35:50.092414+0000","last_active":"2024-09-07T03:35:50.092414+0000","last_peered":"2024-09-07T03:35:50.092414+0000","last_clean":"2024-09-07T03:35:50.092414+0000","last_became_active":"2024-09-07T03:32:14.113104+0000","last_became_peered":"2024-09-07T03:32:14.113104+0000","last_unstale":"2024-09-07T03:35:50.092414+0000","last_undegraded":"2024-09-07T03:35:50.092414+0000","last_fullsized":"2024-09-07T03:35:50.092414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-07T03:35:50.092309+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-07T03:35:50.092309+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.092309+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:22:24.668039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.984704+0000","last_change":"2024-09-07T03:35:41.984704+0000","last_active":"2024-09-07T03:35:41.984704+0000","last_peered":"2024-09-07T03:35:41.984704+0000","last_clean":"2024-09-07T03:35:41.984704+0000","last_became_active":"2024-09-07T03:32:12.125172+0000","last_became_peered":"2024-09-07T03:32:12.125172+0000","last_unstale":"2024-09-07T03:35:41.984704+0000","last_undegraded":"2024-09-07T03:35:41.984704+0000","last_fullsized":"2024-09-07T03:35:41.984704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.984625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.984625+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.984625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:03:57.662456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278236+0000","last_change":"2024-09-07T03:32:16.125904+0000","last_active":"2024-09-07T03:32:50.278236+0000","last_peered":"2024-09-07T03:32:50.278236+0000","last_clean":"2024-09-07T03:32:50.278236+0000","last_became_active":"2024-09-07T03:32:16.125618+0000","last_became_peered":"2024-09-07T03:32:16.125618+0000","last_unstale":"2024-09-07T03:32:50.278236+0000","last_undegraded":"2024-09-07T03:32:50.278236+0000","last_fullsized":"2024-09-07T03:32:50.278236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:06.494089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'72","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.650570+0000","last_change":"2024-09-07T03:32:18.134274+0000","last_active":"2024-09-07T03:35:30.650570+0000","last_peered":"2024-09-07T03:35:30.650570+0000","last_clean":"2024-09-07T03:35:30.650570+0000","last_became_active":"2024-09-07T03:32:18.134005+0000","last_became_peered":"2024-09-07T03:32:18.134005+0000","last_unstale":"2024-09-07T03:35:30.650570+0000","last_undegraded":"2024-09-07T03:35:30.650570+0000","last_fullsized":"2024-09-07T03:35:30.650570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:07.792695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274382+0000","last_change":"2024-09-07T03:32:20.145524+0000","last_active":"2024-09-07T03:32:50.274382+0000","last_peered":"2024-09-07T03:32:50.274382+0000","last_clean":"2024-09-07T03:32:50.274382+0000","last_became_active":"2024-09-07T03:32:20.145119+0000","last_became_peered":"2024-09-07T03:32:20.145119+0000","last_unstale":"2024-09-07T03:32:50.274382+0000","last_undegraded":"2024-09-07T03:32:50.274382+0000","last_fullsized":"2024-09-07T03:32:50.274382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:21.410162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.058175+0000","last_change":"2024-09-07T03:32:22.149484+0000","last_active":"2024-09-07T03:35:24.058175+0000","last_peered":"2024-09-07T03:35:24.058175+0000","last_clean":"2024-09-07T03:35:24.058175+0000","last_became_active":"2024-09-07T03:32:22.149203+0000","last_became_peered":"2024-09-07T03:32:22.149203+0000","last_unstale":"2024-09-07T03:35:24.058175+0000","last_undegraded":"2024-09-07T03:35:24.058175+0000","last_fullsized":"2024-09-07T03:35:24.058175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:33.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.151181+0000","last_change":"2024-09-07T03:35:53.151181+0000","last_active":"2024-09-07T03:35:53.151181+0000","last_peered":"2024-09-07T03:35:53.151181+0000","last_clean":"2024-09-07T03:35:53.151181+0000","last_became_active":"2024-09-07T03:32:14.124120+0000","last_became_peered":"2024-09-07T03:32:14.124120+0000","last_unstale":"2024-09-07T03:35:53.151181+0000","last_undegraded":"2024-09-07T03:35:53.151181+0000","last_fullsized":"2024-09-07T03:35:53.151181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:35:53.151087+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:35:53.151087+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.151087+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:29:35.373709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.127043+0000","last_change":"2024-09-07T03:35:38.127043+0000","last_active":"2024-09-07T03:35:38.127043+0000","last_peered":"2024-09-07T03:35:38.127043+0000","last_clean":"2024-09-07T03:35:38.127043+0000","last_became_active":"2024-09-07T03:32:12.133434+0000","last_became_peered":"2024-09-07T03:32:12.133434+0000","last_unstale":"2024-09-07T03:35:38.127043+0000","last_undegraded":"2024-09-07T03:35:38.127043+0000","last_fullsized":"2024-09-07T03:35:38.127043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.126948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.126948+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.126948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:20:49.410859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277527+0000","last_change":"2024-09-07T03:32:16.121534+0000","last_active":"2024-09-07T03:32:50.277527+0000","last_peered":"2024-09-07T03:32:50.277527+0000","last_clean":"2024-09-07T03:32:50.277527+0000","last_became_active":"2024-09-07T03:32:16.121256+0000","last_became_peered":"2024-09-07T03:32:16.121256+0000","last_unstale":"2024-09-07T03:32:50.277527+0000","last_undegraded":"2024-09-07T03:32:50.277527+0000","last_fullsized":"2024-09-07T03:32:50.277527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:19.973036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.654116+0000","last_change":"2024-09-07T03:32:18.128938+0000","last_active":"2024-09-07T03:35:30.654116+0000","last_peered":"2024-09-07T03:35:30.654116+0000","last_clean":"2024-09-07T03:35:30.654116+0000","last_became_active":"2024-09-07T03:32:18.128470+0000","last_became_peered":"2024-09-07T03:32:18.128470+0000","last_unstale":"2024-09-07T03:35:30.654116+0000","last_undegraded":"2024-09-07T03:35:30.654116+0000","last_fullsized":"2024-09-07T03:35:30.654116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:15:06.767791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276446+0000","last_change":"2024-09-07T03:32:20.136526+0000","last_active":"2024-09-07T03:32:50.276446+0000","last_peered":"2024-09-07T03:32:50.276446+0000","last_clean":"2024-09-07T03:32:50.276446+0000","last_became_active":"2024-09-07T03:32:20.134892+0000","last_became_peered":"2024-09-07T03:32:20.134892+0000","last_unstale":"2024-09-07T03:32:50.276446+0000","last_undegraded":"2024-09-07T03:32:50.276446+0000","last_fullsized":"2024-09-07T03:32:50.276446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:28.142767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228166+0000","last_change":"2024-09-07T03:32:22.153373+0000","last_active":"2024-09-07T03:34:21.228166+0000","last_peered":"2024-09-07T03:34:21.228166+0000","last_clean":"2024-09-07T03:34:21.228166+0000","last_became_active":"2024-09-07T03:32:22.153134+0000","last_became_peered":"2024-09-07T03:32:22.153134+0000","last_unstale":"2024-09-07T03:34:21.228166+0000","last_undegraded":"2024-09-07T03:34:21.228166+0000","last_fullsized":"2024-09-07T03:34:21.228166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:54.932378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435691+0000","last_change":"2024-09-07T03:32:14.113575+0000","last_active":"2024-09-07T03:34:19.435691+0000","last_peered":"2024-09-07T03:34:19.435691+0000","last_clean":"2024-09-07T03:34:19.435691+0000","last_became_active":"2024-09-07T03:32:14.113243+0000","last_became_peered":"2024-09-07T03:32:14.113243+0000","last_unstale":"2024-09-07T03:34:19.435691+0000","last_undegraded":"2024-09-07T03:34:19.435691+0000","last_fullsized":"2024-09-07T03:34:19.435691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:14.596869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.990026+0000","last_change":"2024-09-07T03:35:40.990026+0000","last_active":"2024-09-07T03:35:40.990026+0000","last_peered":"2024-09-07T03:35:40.990026+0000","last_clean":"2024-09-07T03:35:40.990026+0000","last_became_active":"2024-09-07T03:32:12.120531+0000","last_became_peered":"2024-09-07T03:32:12.120531+0000","last_unstale":"2024-09-07T03:35:40.990026+0000","last_undegraded":"2024-09-07T03:35:40.990026+0000","last_fullsized":"2024-09-07T03:35:40.990026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.989938+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.989938+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.989938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:58:08.481418+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470958+0000","last_change":"2024-09-07T03:32:16.124431+0000","last_active":"2024-09-07T03:32:50.470958+0000","last_peered":"2024-09-07T03:32:50.470958+0000","last_clean":"2024-09-07T03:32:50.470958+0000","last_became_active":"2024-09-07T03:32:16.124100+0000","last_became_peered":"2024-09-07T03:32:16.124100+0000","last_unstale":"2024-09-07T03:32:50.470958+0000","last_undegraded":"2024-09-07T03:32:50.470958+0000","last_fullsized":"2024-09-07T03:32:50.470958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:20:34.634089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.632033+0000","last_change":"2024-09-07T03:32:18.130376+0000","last_active":"2024-09-07T03:35:30.632033+0000","last_peered":"2024-09-07T03:35:30.632033+0000","last_clean":"2024-09-07T03:35:30.632033+0000","last_became_active":"2024-09-07T03:32:18.130120+0000","last_became_peered":"2024-09-07T03:32:18.130120+0000","last_unstale":"2024-09-07T03:35:30.632033+0000","last_undegraded":"2024-09-07T03:35:30.632033+0000","last_fullsized":"2024-09-07T03:35:30.632033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:03.978153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.540272+0000","last_change":"2024-09-07T03:32:20.146795+0000","last_active":"2024-09-07T03:35:30.540272+0000","last_peered":"2024-09-07T03:35:30.540272+0000","last_clean":"2024-09-07T03:35:30.540272+0000","last_became_active":"2024-09-07T03:32:20.146408+0000","last_became_peered":"2024-09-07T03:32:20.146408+0000","last_unstale":"2024-09-07T03:35:30.540272+0000","last_undegraded":"2024-09-07T03:35:30.540272+0000","last_fullsized":"2024-09-07T03:35:30.540272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:41.611972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'14","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230053+0000","last_change":"2024-09-07T03:32:22.147032+0000","last_active":"2024-09-07T03:34:28.230053+0000","last_peered":"2024-09-07T03:34:28.230053+0000","last_clean":"2024-09-07T03:34:28.230053+0000","last_became_active":"2024-09-07T03:32:22.145911+0000","last_became_peered":"2024-09-07T03:32:22.145911+0000","last_unstale":"2024-09-07T03:34:28.230053+0000","last_undegraded":"2024-09-07T03:34:28.230053+0000","last_fullsized":"2024-09-07T03:34:28.230053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:59:11.588353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.101986+0000","last_change":"2024-09-07T03:35:48.101986+0000","last_active":"2024-09-07T03:35:48.101986+0000","last_peered":"2024-09-07T03:35:48.101986+0000","last_clean":"2024-09-07T03:35:48.101986+0000","last_became_active":"2024-09-07T03:32:14.112499+0000","last_became_peered":"2024-09-07T03:32:14.112499+0000","last_unstale":"2024-09-07T03:35:48.101986+0000","last_undegraded":"2024-09-07T03:35:48.101986+0000","last_fullsized":"2024-09-07T03:35:48.101986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:48.101897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:48.101897+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.101897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:11:08.140746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.054642+0000","last_change":"2024-09-07T03:35:36.054642+0000","last_active":"2024-09-07T03:35:36.054642+0000","last_peered":"2024-09-07T03:35:36.054642+0000","last_clean":"2024-09-07T03:35:36.054642+0000","last_became_active":"2024-09-07T03:32:12.132462+0000","last_became_peered":"2024-09-07T03:32:12.132462+0000","last_unstale":"2024-09-07T03:35:36.054642+0000","last_undegraded":"2024-09-07T03:35:36.054642+0000","last_fullsized":"2024-09-07T03:35:36.054642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:36.054527+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:36.054527+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.054527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:13:11.473174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":617,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.522508+0000","last_change":"2024-09-07T03:32:16.124805+0000","last_active":"2024-09-07T03:35:30.522508+0000","last_peered":"2024-09-07T03:35:30.522508+0000","last_clean":"2024-09-07T03:35:30.522508+0000","last_became_active":"2024-09-07T03:32:16.124500+0000","last_became_peered":"2024-09-07T03:32:16.124500+0000","last_unstale":"2024-09-07T03:35:30.522508+0000","last_undegraded":"2024-09-07T03:35:30.522508+0000","last_fullsized":"2024-09-07T03:35:30.522508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:21:20.333446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'11","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230563+0000","last_change":"2024-09-07T03:32:50.286792+0000","last_active":"2024-09-07T03:34:36.230563+0000","last_peered":"2024-09-07T03:34:36.230563+0000","last_clean":"2024-09-07T03:34:36.230563+0000","last_became_active":"2024-09-07T03:32:50.278739+0000","last_became_peered":"2024-09-07T03:32:50.278739+0000","last_unstale":"2024-09-07T03:34:36.230563+0000","last_undegraded":"2024-09-07T03:34:36.230563+0000","last_fullsized":"2024-09-07T03:34:36.230563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:41.377209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.541844+0000","last_change":"2024-09-07T03:32:20.140656+0000","last_active":"2024-09-07T03:35:30.541844+0000","last_peered":"2024-09-07T03:35:30.541844+0000","last_clean":"2024-09-07T03:35:30.541844+0000","last_became_active":"2024-09-07T03:32:20.140148+0000","last_became_peered":"2024-09-07T03:32:20.140148+0000","last_unstale":"2024-09-07T03:35:30.541844+0000","last_undegraded":"2024-09-07T03:35:30.541844+0000","last_fullsized":"2024-09-07T03:35:30.541844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:10.352295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.602934+0000","last_change":"2024-09-07T03:32:22.147355+0000","last_active":"2024-09-07T03:34:22.602934+0000","last_peered":"2024-09-07T03:34:22.602934+0000","last_clean":"2024-09-07T03:34:22.602934+0000","last_became_active":"2024-09-07T03:32:22.147049+0000","last_became_peered":"2024-09-07T03:32:22.147049+0000","last_unstale":"2024-09-07T03:34:22.602934+0000","last_undegraded":"2024-09-07T03:34:22.602934+0000","last_fullsized":"2024-09-07T03:34:22.602934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:16.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'5","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230226+0000","last_change":"2024-09-07T03:32:14.124366+0000","last_active":"2024-09-07T03:34:28.230226+0000","last_peered":"2024-09-07T03:34:28.230226+0000","last_clean":"2024-09-07T03:34:28.230226+0000","last_became_active":"2024-09-07T03:32:14.124083+0000","last_became_peered":"2024-09-07T03:32:14.124083+0000","last_unstale":"2024-09-07T03:34:28.230226+0000","last_undegraded":"2024-09-07T03:34:28.230226+0000","last_fullsized":"2024-09-07T03:34:28.230226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:15:46.448249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.109873+0000","last_change":"2024-09-07T03:35:39.109873+0000","last_active":"2024-09-07T03:35:39.109873+0000","last_peered":"2024-09-07T03:35:39.109873+0000","last_clean":"2024-09-07T03:35:39.109873+0000","last_became_active":"2024-09-07T03:32:12.141314+0000","last_became_peered":"2024-09-07T03:32:12.141314+0000","last_unstale":"2024-09-07T03:35:39.109873+0000","last_undegraded":"2024-09-07T03:35:39.109873+0000","last_fullsized":"2024-09-07T03:35:39.109873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:39.109787+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:39.109787+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.109787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:13:50.111247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276435+0000","last_change":"2024-09-07T03:32:16.128496+0000","last_active":"2024-09-07T03:32:50.276435+0000","last_peered":"2024-09-07T03:32:50.276435+0000","last_clean":"2024-09-07T03:32:50.276435+0000","last_became_active":"2024-09-07T03:32:16.128099+0000","last_became_peered":"2024-09-07T03:32:16.128099+0000","last_unstale":"2024-09-07T03:32:50.276435+0000","last_undegraded":"2024-09-07T03:32:50.276435+0000","last_fullsized":"2024-09-07T03:32:50.276435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:54:04.786020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'41","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.591142+0000","last_change":"2024-09-07T03:32:18.129264+0000","last_active":"2024-09-07T03:35:30.591142+0000","last_peered":"2024-09-07T03:35:30.591142+0000","last_clean":"2024-09-07T03:35:30.591142+0000","last_became_active":"2024-09-07T03:32:18.128679+0000","last_became_peered":"2024-09-07T03:32:18.128679+0000","last_unstale":"2024-09-07T03:35:30.591142+0000","last_undegraded":"2024-09-07T03:35:30.591142+0000","last_fullsized":"2024-09-07T03:35:30.591142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:04.595879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280409+0000","last_change":"2024-09-07T03:32:20.132823+0000","last_active":"2024-09-07T03:32:50.280409+0000","last_peered":"2024-09-07T03:32:50.280409+0000","last_clean":"2024-09-07T03:32:50.280409+0000","last_became_active":"2024-09-07T03:32:20.132479+0000","last_became_peered":"2024-09-07T03:32:20.132479+0000","last_unstale":"2024-09-07T03:32:50.280409+0000","last_undegraded":"2024-09-07T03:32:50.280409+0000","last_fullsized":"2024-09-07T03:32:50.280409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:52.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.060147+0000","last_change":"2024-09-07T03:32:22.140676+0000","last_active":"2024-09-07T03:35:24.060147+0000","last_peered":"2024-09-07T03:35:24.060147+0000","last_clean":"2024-09-07T03:35:24.060147+0000","last_became_active":"2024-09-07T03:32:22.140389+0000","last_became_peered":"2024-09-07T03:32:22.140389+0000","last_unstale":"2024-09-07T03:35:24.060147+0000","last_undegraded":"2024-09-07T03:35:24.060147+0000","last_fullsized":"2024-09-07T03:35:24.060147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:12:54.218779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.024887+0000","last_change":"2024-09-07T03:32:14.113244+0000","last_active":"2024-09-07T03:32:57.024887+0000","last_peered":"2024-09-07T03:32:57.024887+0000","last_clean":"2024-09-07T03:32:57.024887+0000","last_became_active":"2024-09-07T03:32:14.112612+0000","last_became_peered":"2024-09-07T03:32:14.112612+0000","last_unstale":"2024-09-07T03:32:57.024887+0000","last_undegraded":"2024-09-07T03:32:57.024887+0000","last_fullsized":"2024-09-07T03:32:57.024887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:24.044336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"36'74","reported_seq":154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:34.263470+0000","last_change":"2024-09-07T03:35:34.263470+0000","last_active":"2024-09-07T03:35:34.263470+0000","last_peered":"2024-09-07T03:35:34.263470+0000","last_clean":"2024-09-07T03:35:34.263470+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:35:34.263470+0000","last_undegraded":"2024-09-07T03:35:34.263470+0000","last_fullsized":"2024-09-07T03:35:34.263470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-09-07T03:35:34.263378+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-09-07T03:35:34.263378+0000","last_clean_scrub_stamp":"2024-09-07T03:35:34.263378+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:30:23.857990+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.054987+0000","last_change":"2024-09-07T03:35:36.054987+0000","last_active":"2024-09-07T03:35:36.054987+0000","last_peered":"2024-09-07T03:35:36.054987+0000","last_clean":"2024-09-07T03:35:36.054987+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:35:36.054987+0000","last_undegraded":"2024-09-07T03:35:36.054987+0000","last_fullsized":"2024-09-07T03:35:36.054987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:36.054875+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:36.054875+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.054875+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:03.880806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.060262+0000","last_change":"2024-09-07T03:35:35.060262+0000","last_active":"2024-09-07T03:35:35.060262+0000","last_peered":"2024-09-07T03:35:35.060262+0000","last_clean":"2024-09-07T03:35:35.060262+0000","last_became_active":"2024-09-07T03:32:12.130323+0000","last_became_peered":"2024-09-07T03:32:12.130323+0000","last_unstale":"2024-09-07T03:35:35.060262+0000","last_undegraded":"2024-09-07T03:35:35.060262+0000","last_fullsized":"2024-09-07T03:35:35.060262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:35.060153+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:35.060153+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.060153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:51.353906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471096+0000","last_change":"2024-09-07T03:32:16.127232+0000","last_active":"2024-09-07T03:32:50.471096+0000","last_peered":"2024-09-07T03:32:50.471096+0000","last_clean":"2024-09-07T03:32:50.471096+0000","last_became_active":"2024-09-07T03:32:16.126915+0000","last_became_peered":"2024-09-07T03:32:16.126915+0000","last_unstale":"2024-09-07T03:32:50.471096+0000","last_undegraded":"2024-09-07T03:32:50.471096+0000","last_fullsized":"2024-09-07T03:32:50.471096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:52:36.603646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'93","reported_seq":181,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.689595+0000","last_change":"2024-09-07T03:32:18.129530+0000","last_active":"2024-09-07T03:35:30.689595+0000","last_peered":"2024-09-07T03:35:30.689595+0000","last_clean":"2024-09-07T03:35:30.689595+0000","last_became_active":"2024-09-07T03:32:18.129224+0000","last_became_peered":"2024-09-07T03:32:18.129224+0000","last_unstale":"2024-09-07T03:35:30.689595+0000","last_undegraded":"2024-09-07T03:35:30.689595+0000","last_fullsized":"2024-09-07T03:35:30.689595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:25:57.912545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275577+0000","last_change":"2024-09-07T03:32:20.135113+0000","last_active":"2024-09-07T03:32:50.275577+0000","last_peered":"2024-09-07T03:32:50.275577+0000","last_clean":"2024-09-07T03:32:50.275577+0000","last_became_active":"2024-09-07T03:32:20.134819+0000","last_became_peered":"2024-09-07T03:32:20.134819+0000","last_unstale":"2024-09-07T03:32:50.275577+0000","last_undegraded":"2024-09-07T03:32:50.275577+0000","last_fullsized":"2024-09-07T03:32:50.275577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:30.829289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'84","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.852849+0000","last_change":"2024-09-07T03:32:22.152124+0000","last_active":"2024-09-07T03:35:23.852849+0000","last_peered":"2024-09-07T03:35:23.852849+0000","last_clean":"2024-09-07T03:35:23.852849+0000","last_became_active":"2024-09-07T03:32:22.151817+0000","last_became_peered":"2024-09-07T03:32:22.151817+0000","last_unstale":"2024-09-07T03:35:23.852849+0000","last_undegraded":"2024-09-07T03:35:23.852849+0000","last_fullsized":"2024-09-07T03:35:23.852849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:00.353389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'16","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843497+0000","last_change":"2024-09-07T03:32:14.130827+0000","last_active":"2024-09-07T03:35:23.843497+0000","last_peered":"2024-09-07T03:35:23.843497+0000","last_clean":"2024-09-07T03:35:23.843497+0000","last_became_active":"2024-09-07T03:32:14.130484+0000","last_became_peered":"2024-09-07T03:32:14.130484+0000","last_unstale":"2024-09-07T03:35:23.843497+0000","last_undegraded":"2024-09-07T03:35:23.843497+0000","last_fullsized":"2024-09-07T03:35:23.843497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:18:58.528009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:34.143292+0000","last_change":"2024-09-07T03:35:34.143292+0000","last_active":"2024-09-07T03:35:34.143292+0000","last_peered":"2024-09-07T03:35:34.143292+0000","last_clean":"2024-09-07T03:35:34.143292+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:35:34.143292+0000","last_undegraded":"2024-09-07T03:35:34.143292+0000","last_fullsized":"2024-09-07T03:35:34.143292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:34.143191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:34.143191+0000","last_clean_scrub_stamp":"2024-09-07T03:35:34.143191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:36:29.075222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.174918+0000","last_change":"2024-09-07T03:35:37.174918+0000","last_active":"2024-09-07T03:35:37.174918+0000","last_peered":"2024-09-07T03:35:37.174918+0000","last_clean":"2024-09-07T03:35:37.174918+0000","last_became_active":"2024-09-07T03:32:12.124522+0000","last_became_peered":"2024-09-07T03:32:12.124522+0000","last_unstale":"2024-09-07T03:35:37.174918+0000","last_undegraded":"2024-09-07T03:35:37.174918+0000","last_fullsized":"2024-09-07T03:35:37.174918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.174806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.174806+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.174806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:06:10.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282885+0000","last_change":"2024-09-07T03:32:16.124594+0000","last_active":"2024-09-07T03:32:50.282885+0000","last_peered":"2024-09-07T03:32:50.282885+0000","last_clean":"2024-09-07T03:32:50.282885+0000","last_became_active":"2024-09-07T03:32:16.124243+0000","last_became_peered":"2024-09-07T03:32:16.124243+0000","last_unstale":"2024-09-07T03:32:50.282885+0000","last_undegraded":"2024-09-07T03:32:50.282885+0000","last_fullsized":"2024-09-07T03:32:50.282885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:00:23.883657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":513,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.687382+0000","last_change":"2024-09-07T03:32:18.132880+0000","last_active":"2024-09-07T03:35:30.687382+0000","last_peered":"2024-09-07T03:35:30.687382+0000","last_clean":"2024-09-07T03:35:30.687382+0000","last_became_active":"2024-09-07T03:32:18.132579+0000","last_became_peered":"2024-09-07T03:32:18.132579+0000","last_unstale":"2024-09-07T03:35:30.687382+0000","last_undegraded":"2024-09-07T03:35:30.687382+0000","last_fullsized":"2024-09-07T03:35:30.687382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:11:51.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272567+0000","last_change":"2024-09-07T03:32:20.141318+0000","last_active":"2024-09-07T03:32:50.272567+0000","last_peered":"2024-09-07T03:32:50.272567+0000","last_clean":"2024-09-07T03:32:50.272567+0000","last_became_active":"2024-09-07T03:32:20.141044+0000","last_became_peered":"2024-09-07T03:32:20.141044+0000","last_unstale":"2024-09-07T03:32:50.272567+0000","last_undegraded":"2024-09-07T03:32:50.272567+0000","last_fullsized":"2024-09-07T03:32:50.272567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:09:44.169617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.806191+0000","last_change":"2024-09-07T03:32:22.143631+0000","last_active":"2024-09-07T03:33:38.806191+0000","last_peered":"2024-09-07T03:33:38.806191+0000","last_clean":"2024-09-07T03:33:38.806191+0000","last_became_active":"2024-09-07T03:32:22.143337+0000","last_became_peered":"2024-09-07T03:32:22.143337+0000","last_unstale":"2024-09-07T03:33:38.806191+0000","last_undegraded":"2024-09-07T03:33:38.806191+0000","last_fullsized":"2024-09-07T03:33:38.806191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:30.421368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":64,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.151332+0000","last_change":"2024-09-07T03:35:52.151332+0000","last_active":"2024-09-07T03:35:52.151332+0000","last_peered":"2024-09-07T03:35:52.151332+0000","last_clean":"2024-09-07T03:35:52.151332+0000","last_became_active":"2024-09-07T03:32:14.127288+0000","last_became_peered":"2024-09-07T03:32:14.127288+0000","last_unstale":"2024-09-07T03:35:52.151332+0000","last_undegraded":"2024-09-07T03:35:52.151332+0000","last_fullsized":"2024-09-07T03:35:52.151332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:52.151246+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:52.151246+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.151246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:14:33.440532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.067219+0000","last_change":"2024-09-07T03:35:36.067219+0000","last_active":"2024-09-07T03:35:36.067219+0000","last_peered":"2024-09-07T03:35:36.067219+0000","last_clean":"2024-09-07T03:35:36.067219+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:35:36.067219+0000","last_undegraded":"2024-09-07T03:35:36.067219+0000","last_fullsized":"2024-09-07T03:35:36.067219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:36.067138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:36.067138+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.067138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:05.511968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.155583+0000","last_change":"2024-09-07T03:35:39.155583+0000","last_active":"2024-09-07T03:35:39.155583+0000","last_peered":"2024-09-07T03:35:39.155583+0000","last_clean":"2024-09-07T03:35:39.155583+0000","last_became_active":"2024-09-07T03:32:12.139224+0000","last_became_peered":"2024-09-07T03:32:12.139224+0000","last_unstale":"2024-09-07T03:35:39.155583+0000","last_undegraded":"2024-09-07T03:35:39.155583+0000","last_fullsized":"2024-09-07T03:35:39.155583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:39.155484+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:39.155484+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.155484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:35:35.465606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279225+0000","last_change":"2024-09-07T03:32:16.122151+0000","last_active":"2024-09-07T03:32:50.279225+0000","last_peered":"2024-09-07T03:32:50.279225+0000","last_clean":"2024-09-07T03:32:50.279225+0000","last_became_active":"2024-09-07T03:32:16.121817+0000","last_became_peered":"2024-09-07T03:32:16.121817+0000","last_unstale":"2024-09-07T03:32:50.279225+0000","last_undegraded":"2024-09-07T03:32:50.279225+0000","last_fullsized":"2024-09-07T03:32:50.279225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:15.023249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206736+0000","last_change":"2024-09-07T03:32:18.129607+0000","last_active":"2024-09-07T03:35:21.206736+0000","last_peered":"2024-09-07T03:35:21.206736+0000","last_clean":"2024-09-07T03:35:21.206736+0000","last_became_active":"2024-09-07T03:32:18.129264+0000","last_became_peered":"2024-09-07T03:32:18.129264+0000","last_unstale":"2024-09-07T03:35:21.206736+0000","last_undegraded":"2024-09-07T03:35:21.206736+0000","last_fullsized":"2024-09-07T03:35:21.206736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:52:54.317892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472271+0000","last_change":"2024-09-07T03:32:20.143074+0000","last_active":"2024-09-07T03:32:50.472271+0000","last_peered":"2024-09-07T03:32:50.472271+0000","last_clean":"2024-09-07T03:32:50.472271+0000","last_became_active":"2024-09-07T03:32:20.142764+0000","last_became_peered":"2024-09-07T03:32:20.142764+0000","last_unstale":"2024-09-07T03:32:50.472271+0000","last_undegraded":"2024-09-07T03:32:50.472271+0000","last_fullsized":"2024-09-07T03:32:50.472271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:36.484446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272193+0000","last_change":"2024-09-07T03:32:22.147788+0000","last_active":"2024-09-07T03:32:50.272193+0000","last_peered":"2024-09-07T03:32:50.272193+0000","last_clean":"2024-09-07T03:32:50.272193+0000","last_became_active":"2024-09-07T03:32:22.147510+0000","last_became_peered":"2024-09-07T03:32:22.147510+0000","last_unstale":"2024-09-07T03:32:50.272193+0000","last_undegraded":"2024-09-07T03:32:50.272193+0000","last_fullsized":"2024-09-07T03:32:50.272193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:37.758327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.126506+0000","last_change":"2024-09-07T03:35:51.126506+0000","last_active":"2024-09-07T03:35:51.126506+0000","last_peered":"2024-09-07T03:35:51.126506+0000","last_clean":"2024-09-07T03:35:51.126506+0000","last_became_active":"2024-09-07T03:32:14.113700+0000","last_became_peered":"2024-09-07T03:32:14.113700+0000","last_unstale":"2024-09-07T03:35:51.126506+0000","last_undegraded":"2024-09-07T03:35:51.126506+0000","last_fullsized":"2024-09-07T03:35:51.126506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:51.126405+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:51.126405+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.126405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:05:32.898918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.101343+0000","last_change":"2024-09-07T03:35:35.101343+0000","last_active":"2024-09-07T03:35:35.101343+0000","last_peered":"2024-09-07T03:35:35.101343+0000","last_clean":"2024-09-07T03:35:35.101343+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:35:35.101343+0000","last_undegraded":"2024-09-07T03:35:35.101343+0000","last_fullsized":"2024-09-07T03:35:35.101343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:35:35.101255+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:35:35.101255+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.101255+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:45:10.988630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.967838+0000","last_change":"2024-09-07T03:35:38.967838+0000","last_active":"2024-09-07T03:35:38.967838+0000","last_peered":"2024-09-07T03:35:38.967838+0000","last_clean":"2024-09-07T03:35:38.967838+0000","last_became_active":"2024-09-07T03:32:12.124390+0000","last_became_peered":"2024-09-07T03:32:12.124390+0000","last_unstale":"2024-09-07T03:35:38.967838+0000","last_undegraded":"2024-09-07T03:35:38.967838+0000","last_fullsized":"2024-09-07T03:35:38.967838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:38.967736+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:38.967736+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.967736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:06:28.145953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472348+0000","last_change":"2024-09-07T03:32:16.122130+0000","last_active":"2024-09-07T03:32:50.472348+0000","last_peered":"2024-09-07T03:32:50.472348+0000","last_clean":"2024-09-07T03:32:50.472348+0000","last_became_active":"2024-09-07T03:32:16.120933+0000","last_became_peered":"2024-09-07T03:32:16.120933+0000","last_unstale":"2024-09-07T03:32:50.472348+0000","last_undegraded":"2024-09-07T03:32:50.472348+0000","last_fullsized":"2024-09-07T03:32:50.472348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:16.466896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.988572+0000","last_change":"2024-09-07T03:32:18.130861+0000","last_active":"2024-09-07T03:35:22.988572+0000","last_peered":"2024-09-07T03:35:22.988572+0000","last_clean":"2024-09-07T03:35:22.988572+0000","last_became_active":"2024-09-07T03:32:18.130557+0000","last_became_peered":"2024-09-07T03:32:18.130557+0000","last_unstale":"2024-09-07T03:35:22.988572+0000","last_undegraded":"2024-09-07T03:35:22.988572+0000","last_fullsized":"2024-09-07T03:35:22.988572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:23:58.249870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276706+0000","last_change":"2024-09-07T03:32:20.143006+0000","last_active":"2024-09-07T03:32:50.276706+0000","last_peered":"2024-09-07T03:32:50.276706+0000","last_clean":"2024-09-07T03:32:50.276706+0000","last_became_active":"2024-09-07T03:32:20.142650+0000","last_became_peered":"2024-09-07T03:32:20.142650+0000","last_unstale":"2024-09-07T03:32:50.276706+0000","last_undegraded":"2024-09-07T03:32:50.276706+0000","last_fullsized":"2024-09-07T03:32:50.276706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:47.155034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.532509+0000","last_change":"2024-09-07T03:32:22.151470+0000","last_active":"2024-09-07T03:34:22.532509+0000","last_peered":"2024-09-07T03:34:22.532509+0000","last_clean":"2024-09-07T03:34:22.532509+0000","last_became_active":"2024-09-07T03:32:22.150981+0000","last_became_peered":"2024-09-07T03:32:22.150981+0000","last_unstale":"2024-09-07T03:34:22.532509+0000","last_undegraded":"2024-09-07T03:34:22.532509+0000","last_fullsized":"2024-09-07T03:34:22.532509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:09.757277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.141859+0000","last_change":"2024-09-07T03:35:46.141859+0000","last_active":"2024-09-07T03:35:46.141859+0000","last_peered":"2024-09-07T03:35:46.141859+0000","last_clean":"2024-09-07T03:35:46.141859+0000","last_became_active":"2024-09-07T03:32:50.282108+0000","last_became_peered":"2024-09-07T03:32:50.282108+0000","last_unstale":"2024-09-07T03:35:46.141859+0000","last_undegraded":"2024-09-07T03:35:46.141859+0000","last_fullsized":"2024-09-07T03:35:46.141859+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:46.141737+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:46.141737+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.141737+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:06.335628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.985231+0000","last_change":"2024-09-07T03:35:39.985231+0000","last_active":"2024-09-07T03:35:39.985231+0000","last_peered":"2024-09-07T03:35:39.985231+0000","last_clean":"2024-09-07T03:35:39.985231+0000","last_became_active":"2024-09-07T03:32:12.121179+0000","last_became_peered":"2024-09-07T03:32:12.121179+0000","last_unstale":"2024-09-07T03:35:39.985231+0000","last_undegraded":"2024-09-07T03:35:39.985231+0000","last_fullsized":"2024-09-07T03:35:39.985231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:39.985147+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:39.985147+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.985147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:39:22.800295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.220654+0000","last_change":"2024-09-07T03:35:36.220654+0000","last_active":"2024-09-07T03:35:36.220654+0000","last_peered":"2024-09-07T03:35:36.220654+0000","last_clean":"2024-09-07T03:35:36.220654+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:35:36.220654+0000","last_undegraded":"2024-09-07T03:35:36.220654+0000","last_fullsized":"2024-09-07T03:35:36.220654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:36.220564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:36.220564+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.220564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:55:02.916343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.113878+0000","last_change":"2024-09-07T03:32:16.126538+0000","last_active":"2024-09-07T03:35:24.113878+0000","last_peered":"2024-09-07T03:35:24.113878+0000","last_clean":"2024-09-07T03:35:24.113878+0000","last_became_active":"2024-09-07T03:32:16.126273+0000","last_became_peered":"2024-09-07T03:32:16.126273+0000","last_unstale":"2024-09-07T03:35:24.113878+0000","last_undegraded":"2024-09-07T03:35:24.113878+0000","last_fullsized":"2024-09-07T03:35:24.113878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:12:07.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'80","reported_seq":160,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.683357+0000","last_change":"2024-09-07T03:32:18.132985+0000","last_active":"2024-09-07T03:35:30.683357+0000","last_peered":"2024-09-07T03:35:30.683357+0000","last_clean":"2024-09-07T03:35:30.683357+0000","last_became_active":"2024-09-07T03:32:18.132654+0000","last_became_peered":"2024-09-07T03:32:18.132654+0000","last_unstale":"2024-09-07T03:35:30.683357+0000","last_undegraded":"2024-09-07T03:35:30.683357+0000","last_fullsized":"2024-09-07T03:35:30.683357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:58.124761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278034+0000","last_change":"2024-09-07T03:32:20.140348+0000","last_active":"2024-09-07T03:32:50.278034+0000","last_peered":"2024-09-07T03:32:50.278034+0000","last_clean":"2024-09-07T03:32:50.278034+0000","last_became_active":"2024-09-07T03:32:20.140025+0000","last_became_peered":"2024-09-07T03:32:20.140025+0000","last_unstale":"2024-09-07T03:32:50.278034+0000","last_undegraded":"2024-09-07T03:32:50.278034+0000","last_fullsized":"2024-09-07T03:32:50.278034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:18:53.690582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'13","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.873538+0000","last_change":"2024-09-07T03:32:22.140343+0000","last_active":"2024-09-07T03:34:22.873538+0000","last_peered":"2024-09-07T03:34:22.873538+0000","last_clean":"2024-09-07T03:34:22.873538+0000","last_became_active":"2024-09-07T03:32:22.140043+0000","last_became_peered":"2024-09-07T03:32:22.140043+0000","last_unstale":"2024-09-07T03:34:22.873538+0000","last_undegraded":"2024-09-07T03:34:22.873538+0000","last_fullsized":"2024-09-07T03:34:22.873538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:55.502696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'12","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.099558+0000","last_change":"2024-09-07T03:35:50.099558+0000","last_active":"2024-09-07T03:35:50.099558+0000","last_peered":"2024-09-07T03:35:50.099558+0000","last_clean":"2024-09-07T03:35:50.099558+0000","last_became_active":"2024-09-07T03:32:14.126663+0000","last_became_peered":"2024-09-07T03:32:14.126663+0000","last_unstale":"2024-09-07T03:35:50.099558+0000","last_undegraded":"2024-09-07T03:35:50.099558+0000","last_fullsized":"2024-09-07T03:35:50.099558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:50.099477+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:50.099477+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.099477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:27:04.417756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.116801+0000","last_change":"2024-09-07T03:35:40.116801+0000","last_active":"2024-09-07T03:35:40.116801+0000","last_peered":"2024-09-07T03:35:40.116801+0000","last_clean":"2024-09-07T03:35:40.116801+0000","last_became_active":"2024-09-07T03:32:12.133974+0000","last_became_peered":"2024-09-07T03:32:12.133974+0000","last_unstale":"2024-09-07T03:35:40.116801+0000","last_undegraded":"2024-09-07T03:35:40.116801+0000","last_fullsized":"2024-09-07T03:35:40.116801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.116697+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.116697+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.116697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:35.362673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.014367+0000","last_change":"2024-09-07T03:35:37.014367+0000","last_active":"2024-09-07T03:35:37.014367+0000","last_peered":"2024-09-07T03:35:37.014367+0000","last_clean":"2024-09-07T03:35:37.014367+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:35:37.014367+0000","last_undegraded":"2024-09-07T03:35:37.014367+0000","last_fullsized":"2024-09-07T03:35:37.014367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.014282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.014282+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.014282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:46:10.364315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278673+0000","last_change":"2024-09-07T03:32:16.122232+0000","last_active":"2024-09-07T03:32:50.278673+0000","last_peered":"2024-09-07T03:32:50.278673+0000","last_clean":"2024-09-07T03:32:50.278673+0000","last_became_active":"2024-09-07T03:32:16.121921+0000","last_became_peered":"2024-09-07T03:32:16.121921+0000","last_unstale":"2024-09-07T03:32:50.278673+0000","last_undegraded":"2024-09-07T03:32:50.278673+0000","last_fullsized":"2024-09-07T03:32:50.278673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:01:24.806960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469770+0000","last_change":"2024-09-07T03:32:18.134018+0000","last_active":"2024-09-07T03:32:50.469770+0000","last_peered":"2024-09-07T03:32:50.469770+0000","last_clean":"2024-09-07T03:32:50.469770+0000","last_became_active":"2024-09-07T03:32:18.133689+0000","last_became_peered":"2024-09-07T03:32:18.133689+0000","last_unstale":"2024-09-07T03:32:50.469770+0000","last_undegraded":"2024-09-07T03:32:50.469770+0000","last_fullsized":"2024-09-07T03:32:50.469770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:16.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":350,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.537865+0000","last_change":"2024-09-07T03:32:20.143562+0000","last_active":"2024-09-07T03:35:30.537865+0000","last_peered":"2024-09-07T03:35:30.537865+0000","last_clean":"2024-09-07T03:35:30.537865+0000","last_became_active":"2024-09-07T03:32:20.143293+0000","last_became_peered":"2024-09-07T03:32:20.143293+0000","last_unstale":"2024-09-07T03:35:30.537865+0000","last_undegraded":"2024-09-07T03:35:30.537865+0000","last_fullsized":"2024-09-07T03:35:30.537865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:51.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273729+0000","last_change":"2024-09-07T03:32:22.147306+0000","last_active":"2024-09-07T03:32:50.273729+0000","last_peered":"2024-09-07T03:32:50.273729+0000","last_clean":"2024-09-07T03:32:50.273729+0000","last_became_active":"2024-09-07T03:32:22.147036+0000","last_became_peered":"2024-09-07T03:32:22.147036+0000","last_unstale":"2024-09-07T03:32:50.273729+0000","last_undegraded":"2024-09-07T03:32:50.273729+0000","last_fullsized":"2024-09-07T03:32:50.273729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:02.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.477342+0000","last_change":"2024-09-07T03:32:14.127131+0000","last_active":"2024-09-07T03:35:23.477342+0000","last_peered":"2024-09-07T03:35:23.477342+0000","last_clean":"2024-09-07T03:35:23.477342+0000","last_became_active":"2024-09-07T03:32:14.126350+0000","last_became_peered":"2024-09-07T03:32:14.126350+0000","last_unstale":"2024-09-07T03:35:23.477342+0000","last_undegraded":"2024-09-07T03:35:23.477342+0000","last_fullsized":"2024-09-07T03:35:23.477342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:48:39.075361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.090380+0000","last_change":"2024-09-07T03:35:37.090380+0000","last_active":"2024-09-07T03:35:37.090380+0000","last_peered":"2024-09-07T03:35:37.090380+0000","last_clean":"2024-09-07T03:35:37.090380+0000","last_became_active":"2024-09-07T03:32:12.130058+0000","last_became_peered":"2024-09-07T03:32:12.130058+0000","last_unstale":"2024-09-07T03:35:37.090380+0000","last_undegraded":"2024-09-07T03:35:37.090380+0000","last_fullsized":"2024-09-07T03:35:37.090380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.090296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.090296+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.090296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:10:30.746067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.254145+0000","last_change":"2024-09-07T03:35:35.254145+0000","last_active":"2024-09-07T03:35:35.254145+0000","last_peered":"2024-09-07T03:35:35.254145+0000","last_clean":"2024-09-07T03:35:35.254145+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:35:35.254145+0000","last_undegraded":"2024-09-07T03:35:35.254145+0000","last_fullsized":"2024-09-07T03:35:35.254145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:35.254064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:35.254064+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.254064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:11:50.660290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279335+0000","last_change":"2024-09-07T03:32:16.117328+0000","last_active":"2024-09-07T03:32:50.279335+0000","last_peered":"2024-09-07T03:32:50.279335+0000","last_clean":"2024-09-07T03:32:50.279335+0000","last_became_active":"2024-09-07T03:32:16.117025+0000","last_became_peered":"2024-09-07T03:32:16.117025+0000","last_unstale":"2024-09-07T03:32:50.279335+0000","last_undegraded":"2024-09-07T03:32:50.279335+0000","last_fullsized":"2024-09-07T03:32:50.279335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:43:01.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273099+0000","last_change":"2024-09-07T03:32:18.124974+0000","last_active":"2024-09-07T03:32:50.273099+0000","last_peered":"2024-09-07T03:32:50.273099+0000","last_clean":"2024-09-07T03:32:50.273099+0000","last_became_active":"2024-09-07T03:32:18.124641+0000","last_became_peered":"2024-09-07T03:32:18.124641+0000","last_unstale":"2024-09-07T03:32:50.273099+0000","last_undegraded":"2024-09-07T03:32:50.273099+0000","last_fullsized":"2024-09-07T03:32:50.273099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:36:49.839182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.544102+0000","last_change":"2024-09-07T03:32:20.149232+0000","last_active":"2024-09-07T03:35:30.544102+0000","last_peered":"2024-09-07T03:35:30.544102+0000","last_clean":"2024-09-07T03:35:30.544102+0000","last_became_active":"2024-09-07T03:32:20.148768+0000","last_became_peered":"2024-09-07T03:32:20.148768+0000","last_unstale":"2024-09-07T03:35:30.544102+0000","last_undegraded":"2024-09-07T03:35:30.544102+0000","last_fullsized":"2024-09-07T03:35:30.544102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:15:20.986169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470656+0000","last_change":"2024-09-07T03:32:22.148714+0000","last_active":"2024-09-07T03:32:50.470656+0000","last_peered":"2024-09-07T03:32:50.470656+0000","last_clean":"2024-09-07T03:32:50.470656+0000","last_became_active":"2024-09-07T03:32:22.148444+0000","last_became_peered":"2024-09-07T03:32:22.148444+0000","last_unstale":"2024-09-07T03:32:50.470656+0000","last_undegraded":"2024-09-07T03:32:50.470656+0000","last_fullsized":"2024-09-07T03:32:50.470656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:23.271638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'10","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.115335+0000","last_change":"2024-09-07T03:35:43.115335+0000","last_active":"2024-09-07T03:35:43.115335+0000","last_peered":"2024-09-07T03:35:43.115335+0000","last_clean":"2024-09-07T03:35:43.115335+0000","last_became_active":"2024-09-07T03:32:14.113077+0000","last_became_peered":"2024-09-07T03:32:14.113077+0000","last_unstale":"2024-09-07T03:35:43.115335+0000","last_undegraded":"2024-09-07T03:35:43.115335+0000","last_fullsized":"2024-09-07T03:35:43.115335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:43.115240+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:43.115240+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.115240+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:13:08.170005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.154058+0000","last_change":"2024-09-07T03:35:38.154058+0000","last_active":"2024-09-07T03:35:38.154058+0000","last_peered":"2024-09-07T03:35:38.154058+0000","last_clean":"2024-09-07T03:35:38.154058+0000","last_became_active":"2024-09-07T03:32:12.124398+0000","last_became_peered":"2024-09-07T03:32:12.124398+0000","last_unstale":"2024-09-07T03:35:38.154058+0000","last_undegraded":"2024-09-07T03:35:38.154058+0000","last_fullsized":"2024-09-07T03:35:38.154058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:38.153969+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:38.153969+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.153969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:07:56.086318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.014826+0000","last_change":"2024-09-07T03:35:38.014826+0000","last_active":"2024-09-07T03:35:38.014826+0000","last_peered":"2024-09-07T03:35:38.014826+0000","last_clean":"2024-09-07T03:35:38.014826+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:35:38.014826+0000","last_undegraded":"2024-09-07T03:35:38.014826+0000","last_fullsized":"2024-09-07T03:35:38.014826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.014735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.014735+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.014735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:41.966197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273091+0000","last_change":"2024-09-07T03:32:16.130854+0000","last_active":"2024-09-07T03:32:50.273091+0000","last_peered":"2024-09-07T03:32:50.273091+0000","last_clean":"2024-09-07T03:32:50.273091+0000","last_became_active":"2024-09-07T03:32:16.130091+0000","last_became_peered":"2024-09-07T03:32:16.130091+0000","last_unstale":"2024-09-07T03:32:50.273091+0000","last_undegraded":"2024-09-07T03:32:50.273091+0000","last_fullsized":"2024-09-07T03:32:50.273091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:20.097492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.692496+0000","last_change":"2024-09-07T03:32:18.132376+0000","last_active":"2024-09-07T03:35:30.692496+0000","last_peered":"2024-09-07T03:35:30.692496+0000","last_clean":"2024-09-07T03:35:30.692496+0000","last_became_active":"2024-09-07T03:32:18.132111+0000","last_became_peered":"2024-09-07T03:32:18.132111+0000","last_unstale":"2024-09-07T03:35:30.692496+0000","last_undegraded":"2024-09-07T03:35:30.692496+0000","last_fullsized":"2024-09-07T03:35:30.692496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272816+0000","last_change":"2024-09-07T03:32:20.143405+0000","last_active":"2024-09-07T03:32:50.272816+0000","last_peered":"2024-09-07T03:32:50.272816+0000","last_clean":"2024-09-07T03:32:50.272816+0000","last_became_active":"2024-09-07T03:32:20.143072+0000","last_became_peered":"2024-09-07T03:32:20.143072+0000","last_unstale":"2024-09-07T03:32:50.272816+0000","last_undegraded":"2024-09-07T03:32:50.272816+0000","last_fullsized":"2024-09-07T03:32:50.272816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:35:06.275781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276617+0000","last_change":"2024-09-07T03:32:22.139462+0000","last_active":"2024-09-07T03:32:50.276617+0000","last_peered":"2024-09-07T03:32:50.276617+0000","last_clean":"2024-09-07T03:32:50.276617+0000","last_became_active":"2024-09-07T03:32:22.139150+0000","last_became_peered":"2024-09-07T03:32:22.139150+0000","last_unstale":"2024-09-07T03:32:50.276617+0000","last_undegraded":"2024-09-07T03:32:50.276617+0000","last_fullsized":"2024-09-07T03:32:50.276617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:16:29.302047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275974+0000","last_change":"2024-09-07T03:32:22.138596+0000","last_active":"2024-09-07T03:32:50.275974+0000","last_peered":"2024-09-07T03:32:50.275974+0000","last_clean":"2024-09-07T03:32:50.275974+0000","last_became_active":"2024-09-07T03:32:22.138315+0000","last_became_peered":"2024-09-07T03:32:22.138315+0000","last_unstale":"2024-09-07T03:32:50.275974+0000","last_undegraded":"2024-09-07T03:32:50.275974+0000","last_fullsized":"2024-09-07T03:32:50.275974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:54:59.992625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.048117+0000","last_change":"2024-09-07T03:35:51.048117+0000","last_active":"2024-09-07T03:35:51.048117+0000","last_peered":"2024-09-07T03:35:51.048117+0000","last_clean":"2024-09-07T03:35:51.048117+0000","last_became_active":"2024-09-07T03:32:14.112744+0000","last_became_peered":"2024-09-07T03:32:14.112744+0000","last_unstale":"2024-09-07T03:35:51.048117+0000","last_undegraded":"2024-09-07T03:35:51.048117+0000","last_fullsized":"2024-09-07T03:35:51.048117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:51.047998+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:51.047998+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.047998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:02.216514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'5","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.016566+0000","last_change":"2024-09-07T03:35:48.016566+0000","last_active":"2024-09-07T03:35:48.016566+0000","last_peered":"2024-09-07T03:35:48.016566+0000","last_clean":"2024-09-07T03:35:48.016566+0000","last_became_active":"2024-09-07T03:32:12.132715+0000","last_became_peered":"2024-09-07T03:32:12.132715+0000","last_unstale":"2024-09-07T03:35:48.016566+0000","last_undegraded":"2024-09-07T03:35:48.016566+0000","last_fullsized":"2024-09-07T03:35:48.016566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-07T03:35:48.016483+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-07T03:35:48.016483+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.016483+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:57:37.498255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470337+0000","last_change":"2024-09-07T03:32:16.125307+0000","last_active":"2024-09-07T03:32:50.470337+0000","last_peered":"2024-09-07T03:32:50.470337+0000","last_clean":"2024-09-07T03:32:50.470337+0000","last_became_active":"2024-09-07T03:32:16.124681+0000","last_became_peered":"2024-09-07T03:32:16.124681+0000","last_unstale":"2024-09-07T03:32:50.470337+0000","last_undegraded":"2024-09-07T03:32:50.470337+0000","last_fullsized":"2024-09-07T03:32:50.470337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:30.622001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.603642+0000","last_change":"2024-09-07T03:32:18.134183+0000","last_active":"2024-09-07T03:35:30.603642+0000","last_peered":"2024-09-07T03:35:30.603642+0000","last_clean":"2024-09-07T03:35:30.603642+0000","last_became_active":"2024-09-07T03:32:18.133844+0000","last_became_peered":"2024-09-07T03:32:18.133844+0000","last_unstale":"2024-09-07T03:35:30.603642+0000","last_undegraded":"2024-09-07T03:35:30.603642+0000","last_fullsized":"2024-09-07T03:35:30.603642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:10:39.060137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271616+0000","last_change":"2024-09-07T03:32:20.149175+0000","last_active":"2024-09-07T03:32:50.271616+0000","last_peered":"2024-09-07T03:32:50.271616+0000","last_clean":"2024-09-07T03:32:50.271616+0000","last_became_active":"2024-09-07T03:32:20.148900+0000","last_became_peered":"2024-09-07T03:32:20.148900+0000","last_unstale":"2024-09-07T03:32:50.271616+0000","last_undegraded":"2024-09-07T03:32:50.271616+0000","last_fullsized":"2024-09-07T03:32:50.271616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:25.130015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:20.895399+0000","last_change":"2024-09-07T03:32:22.150451+0000","last_active":"2024-09-07T03:34:20.895399+0000","last_peered":"2024-09-07T03:34:20.895399+0000","last_clean":"2024-09-07T03:34:20.895399+0000","last_became_active":"2024-09-07T03:32:22.150168+0000","last_became_peered":"2024-09-07T03:32:22.150168+0000","last_unstale":"2024-09-07T03:34:20.895399+0000","last_undegraded":"2024-09-07T03:34:20.895399+0000","last_fullsized":"2024-09-07T03:34:20.895399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:01:52.113292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.985573+0000","last_change":"2024-09-07T03:32:14.111906+0000","last_active":"2024-09-07T03:33:38.985573+0000","last_peered":"2024-09-07T03:33:38.985573+0000","last_clean":"2024-09-07T03:33:38.985573+0000","last_became_active":"2024-09-07T03:32:14.111499+0000","last_became_peered":"2024-09-07T03:32:14.111499+0000","last_unstale":"2024-09-07T03:33:38.985573+0000","last_undegraded":"2024-09-07T03:33:38.985573+0000","last_fullsized":"2024-09-07T03:33:38.985573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:32.319913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.155440+0000","last_change":"2024-09-07T03:35:38.155440+0000","last_active":"2024-09-07T03:35:38.155440+0000","last_peered":"2024-09-07T03:35:38.155440+0000","last_clean":"2024-09-07T03:35:38.155440+0000","last_became_active":"2024-09-07T03:32:12.128737+0000","last_became_peered":"2024-09-07T03:32:12.128737+0000","last_unstale":"2024-09-07T03:35:38.155440+0000","last_undegraded":"2024-09-07T03:35:38.155440+0000","last_fullsized":"2024-09-07T03:35:38.155440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.155355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.155355+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.155355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:27.815801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272857+0000","last_change":"2024-09-07T03:32:16.125714+0000","last_active":"2024-09-07T03:32:50.272857+0000","last_peered":"2024-09-07T03:32:50.272857+0000","last_clean":"2024-09-07T03:32:50.272857+0000","last_became_active":"2024-09-07T03:32:16.125418+0000","last_became_peered":"2024-09-07T03:32:16.125418+0000","last_unstale":"2024-09-07T03:32:50.272857+0000","last_undegraded":"2024-09-07T03:32:50.272857+0000","last_fullsized":"2024-09-07T03:32:50.272857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:50:42.403817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.992476+0000","last_change":"2024-09-07T03:32:18.134208+0000","last_active":"2024-09-07T03:35:22.992476+0000","last_peered":"2024-09-07T03:35:22.992476+0000","last_clean":"2024-09-07T03:35:22.992476+0000","last_became_active":"2024-09-07T03:32:18.133770+0000","last_became_peered":"2024-09-07T03:32:18.133770+0000","last_unstale":"2024-09-07T03:35:22.992476+0000","last_undegraded":"2024-09-07T03:35:22.992476+0000","last_fullsized":"2024-09-07T03:35:22.992476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:01:16.182582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276619+0000","last_change":"2024-09-07T03:32:20.142736+0000","last_active":"2024-09-07T03:32:50.276619+0000","last_peered":"2024-09-07T03:32:50.276619+0000","last_clean":"2024-09-07T03:32:50.276619+0000","last_became_active":"2024-09-07T03:32:20.140729+0000","last_became_peered":"2024-09-07T03:32:20.140729+0000","last_unstale":"2024-09-07T03:32:50.276619+0000","last_undegraded":"2024-09-07T03:32:50.276619+0000","last_fullsized":"2024-09-07T03:32:50.276619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:48:10.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471241+0000","last_change":"2024-09-07T03:32:22.147660+0000","last_active":"2024-09-07T03:32:50.471241+0000","last_peered":"2024-09-07T03:32:50.471241+0000","last_clean":"2024-09-07T03:32:50.471241+0000","last_became_active":"2024-09-07T03:32:22.147374+0000","last_became_peered":"2024-09-07T03:32:22.147374+0000","last_unstale":"2024-09-07T03:32:50.471241+0000","last_undegraded":"2024-09-07T03:32:50.471241+0000","last_fullsized":"2024-09-07T03:32:50.471241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:06.728131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843420+0000","last_change":"2024-09-07T03:32:14.123487+0000","last_active":"2024-09-07T03:35:23.843420+0000","last_peered":"2024-09-07T03:35:23.843420+0000","last_clean":"2024-09-07T03:35:23.843420+0000","last_became_active":"2024-09-07T03:32:14.123172+0000","last_became_peered":"2024-09-07T03:32:14.123172+0000","last_unstale":"2024-09-07T03:35:23.843420+0000","last_undegraded":"2024-09-07T03:35:23.843420+0000","last_fullsized":"2024-09-07T03:35:23.843420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:51.273125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.019482+0000","last_change":"2024-09-07T03:35:49.019482+0000","last_active":"2024-09-07T03:35:49.019482+0000","last_peered":"2024-09-07T03:35:49.019482+0000","last_clean":"2024-09-07T03:35:49.019482+0000","last_became_active":"2024-09-07T03:32:12.124180+0000","last_became_peered":"2024-09-07T03:32:12.124180+0000","last_unstale":"2024-09-07T03:35:49.019482+0000","last_undegraded":"2024-09-07T03:35:49.019482+0000","last_fullsized":"2024-09-07T03:35:49.019482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:49.019399+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:49.019399+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.019399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:20.661216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277690+0000","last_change":"2024-09-07T03:32:16.124337+0000","last_active":"2024-09-07T03:32:50.277690+0000","last_peered":"2024-09-07T03:32:50.277690+0000","last_clean":"2024-09-07T03:32:50.277690+0000","last_became_active":"2024-09-07T03:32:16.123695+0000","last_became_peered":"2024-09-07T03:32:16.123695+0000","last_unstale":"2024-09-07T03:32:50.277690+0000","last_undegraded":"2024-09-07T03:32:50.277690+0000","last_fullsized":"2024-09-07T03:32:50.277690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:12:34.370044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'44","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.677944+0000","last_change":"2024-09-07T03:32:18.129794+0000","last_active":"2024-09-07T03:35:30.677944+0000","last_peered":"2024-09-07T03:35:30.677944+0000","last_clean":"2024-09-07T03:35:30.677944+0000","last_became_active":"2024-09-07T03:32:18.129502+0000","last_became_peered":"2024-09-07T03:32:18.129502+0000","last_unstale":"2024-09-07T03:35:30.677944+0000","last_undegraded":"2024-09-07T03:35:30.677944+0000","last_fullsized":"2024-09-07T03:35:30.677944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:35:55.771599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470189+0000","last_change":"2024-09-07T03:32:20.147965+0000","last_active":"2024-09-07T03:32:50.470189+0000","last_peered":"2024-09-07T03:32:50.470189+0000","last_clean":"2024-09-07T03:32:50.470189+0000","last_became_active":"2024-09-07T03:32:20.147588+0000","last_became_peered":"2024-09-07T03:32:20.147588+0000","last_unstale":"2024-09-07T03:32:50.470189+0000","last_undegraded":"2024-09-07T03:32:50.470189+0000","last_fullsized":"2024-09-07T03:32:50.470189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:33:20.522441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.433021+0000","last_change":"2024-09-07T03:32:22.146381+0000","last_active":"2024-09-07T03:34:19.433021+0000","last_peered":"2024-09-07T03:34:19.433021+0000","last_clean":"2024-09-07T03:34:19.433021+0000","last_became_active":"2024-09-07T03:32:22.146106+0000","last_became_peered":"2024-09-07T03:32:22.146106+0000","last_unstale":"2024-09-07T03:34:19.433021+0000","last_undegraded":"2024-09-07T03:34:19.433021+0000","last_fullsized":"2024-09-07T03:34:19.433021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:05:28.655126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.025001+0000","last_change":"2024-09-07T03:32:14.128094+0000","last_active":"2024-09-07T03:32:57.025001+0000","last_peered":"2024-09-07T03:32:57.025001+0000","last_clean":"2024-09-07T03:32:57.025001+0000","last_became_active":"2024-09-07T03:32:14.127334+0000","last_became_peered":"2024-09-07T03:32:14.127334+0000","last_unstale":"2024-09-07T03:32:57.025001+0000","last_undegraded":"2024-09-07T03:32:57.025001+0000","last_fullsized":"2024-09-07T03:32:57.025001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:23:03.931202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.177120+0000","last_change":"2024-09-07T03:35:45.177120+0000","last_active":"2024-09-07T03:35:45.177120+0000","last_peered":"2024-09-07T03:35:45.177120+0000","last_clean":"2024-09-07T03:35:45.177120+0000","last_became_active":"2024-09-07T03:32:12.134823+0000","last_became_peered":"2024-09-07T03:32:12.134823+0000","last_unstale":"2024-09-07T03:35:45.177120+0000","last_undegraded":"2024-09-07T03:35:45.177120+0000","last_fullsized":"2024-09-07T03:35:45.177120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:45.177031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:45.177031+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.177031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:35:01.639248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271764+0000","last_change":"2024-09-07T03:32:16.127981+0000","last_active":"2024-09-07T03:32:50.271764+0000","last_peered":"2024-09-07T03:32:50.271764+0000","last_clean":"2024-09-07T03:32:50.271764+0000","last_became_active":"2024-09-07T03:32:16.127615+0000","last_became_peered":"2024-09-07T03:32:16.127615+0000","last_unstale":"2024-09-07T03:32:50.271764+0000","last_undegraded":"2024-09-07T03:32:50.271764+0000","last_fullsized":"2024-09-07T03:32:50.271764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:04.434836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'35","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.669249+0000","last_change":"2024-09-07T03:32:18.130169+0000","last_active":"2024-09-07T03:35:30.669249+0000","last_peered":"2024-09-07T03:35:30.669249+0000","last_clean":"2024-09-07T03:35:30.669249+0000","last_became_active":"2024-09-07T03:32:18.129919+0000","last_became_peered":"2024-09-07T03:32:18.129919+0000","last_unstale":"2024-09-07T03:35:30.669249+0000","last_undegraded":"2024-09-07T03:35:30.669249+0000","last_fullsized":"2024-09-07T03:35:30.669249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:09.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275040+0000","last_change":"2024-09-07T03:32:20.145306+0000","last_active":"2024-09-07T03:32:50.275040+0000","last_peered":"2024-09-07T03:32:50.275040+0000","last_clean":"2024-09-07T03:32:50.275040+0000","last_became_active":"2024-09-07T03:32:20.143640+0000","last_became_peered":"2024-09-07T03:32:20.143640+0000","last_unstale":"2024-09-07T03:32:50.275040+0000","last_undegraded":"2024-09-07T03:32:50.275040+0000","last_fullsized":"2024-09-07T03:32:50.275040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:24:26.189411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282148+0000","last_change":"2024-09-07T03:32:14.123340+0000","last_active":"2024-09-07T03:32:50.282148+0000","last_peered":"2024-09-07T03:32:50.282148+0000","last_clean":"2024-09-07T03:32:50.282148+0000","last_became_active":"2024-09-07T03:32:14.123017+0000","last_became_peered":"2024-09-07T03:32:14.123017+0000","last_unstale":"2024-09-07T03:32:50.282148+0000","last_undegraded":"2024-09-07T03:32:50.282148+0000","last_fullsized":"2024-09-07T03:32:50.282148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:08.821201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.017539+0000","last_change":"2024-09-07T03:35:41.017539+0000","last_active":"2024-09-07T03:35:41.017539+0000","last_peered":"2024-09-07T03:35:41.017539+0000","last_clean":"2024-09-07T03:35:41.017539+0000","last_became_active":"2024-09-07T03:32:12.143142+0000","last_became_peered":"2024-09-07T03:32:12.143142+0000","last_unstale":"2024-09-07T03:35:41.017539+0000","last_undegraded":"2024-09-07T03:35:41.017539+0000","last_fullsized":"2024-09-07T03:35:41.017539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.017443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.017443+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.017443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:02:36.762725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471726+0000","last_change":"2024-09-07T03:32:16.124471+0000","last_active":"2024-09-07T03:32:50.471726+0000","last_peered":"2024-09-07T03:32:50.471726+0000","last_clean":"2024-09-07T03:32:50.471726+0000","last_became_active":"2024-09-07T03:32:16.124188+0000","last_became_peered":"2024-09-07T03:32:16.124188+0000","last_unstale":"2024-09-07T03:32:50.471726+0000","last_undegraded":"2024-09-07T03:32:50.471726+0000","last_fullsized":"2024-09-07T03:32:50.471726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:20.601144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'66","reported_seq":137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.657676+0000","last_change":"2024-09-07T03:32:18.127241+0000","last_active":"2024-09-07T03:35:30.657676+0000","last_peered":"2024-09-07T03:35:30.657676+0000","last_clean":"2024-09-07T03:35:30.657676+0000","last_became_active":"2024-09-07T03:32:18.126946+0000","last_became_peered":"2024-09-07T03:32:18.126946+0000","last_unstale":"2024-09-07T03:35:30.657676+0000","last_undegraded":"2024-09-07T03:35:30.657676+0000","last_fullsized":"2024-09-07T03:35:30.657676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:12:23.096494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275569+0000","last_change":"2024-09-07T03:32:20.144697+0000","last_active":"2024-09-07T03:32:50.275569+0000","last_peered":"2024-09-07T03:32:50.275569+0000","last_clean":"2024-09-07T03:32:50.275569+0000","last_became_active":"2024-09-07T03:32:20.144417+0000","last_became_peered":"2024-09-07T03:32:20.144417+0000","last_unstale":"2024-09-07T03:32:50.275569+0000","last_undegraded":"2024-09-07T03:32:50.275569+0000","last_fullsized":"2024-09-07T03:32:50.275569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:37:54.709062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'16","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.592808+0000","last_change":"2024-09-07T03:32:22.149726+0000","last_active":"2024-09-07T03:35:23.592808+0000","last_peered":"2024-09-07T03:35:23.592808+0000","last_clean":"2024-09-07T03:35:23.592808+0000","last_became_active":"2024-09-07T03:32:22.149442+0000","last_became_peered":"2024-09-07T03:32:22.149442+0000","last_unstale":"2024-09-07T03:35:23.592808+0000","last_undegraded":"2024-09-07T03:35:23.592808+0000","last_fullsized":"2024-09-07T03:35:23.592808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:25.687323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'9","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.849698+0000","last_change":"2024-09-07T03:32:14.114246+0000","last_active":"2024-09-07T03:35:23.849698+0000","last_peered":"2024-09-07T03:35:23.849698+0000","last_clean":"2024-09-07T03:35:23.849698+0000","last_became_active":"2024-09-07T03:32:14.111795+0000","last_became_peered":"2024-09-07T03:32:14.111795+0000","last_unstale":"2024-09-07T03:35:23.849698+0000","last_undegraded":"2024-09-07T03:35:23.849698+0000","last_fullsized":"2024-09-07T03:35:23.849698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:41:31.009147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.150563+0000","last_change":"2024-09-07T03:35:41.150563+0000","last_active":"2024-09-07T03:35:41.150563+0000","last_peered":"2024-09-07T03:35:41.150563+0000","last_clean":"2024-09-07T03:35:41.150563+0000","last_became_active":"2024-09-07T03:32:12.136258+0000","last_became_peered":"2024-09-07T03:32:12.136258+0000","last_unstale":"2024-09-07T03:35:41.150563+0000","last_undegraded":"2024-09-07T03:35:41.150563+0000","last_fullsized":"2024-09-07T03:35:41.150563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.150478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.150478+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.150478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.517403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281863+0000","last_change":"2024-09-07T03:32:16.122569+0000","last_active":"2024-09-07T03:32:50.281863+0000","last_peered":"2024-09-07T03:32:50.281863+0000","last_clean":"2024-09-07T03:32:50.281863+0000","last_became_active":"2024-09-07T03:32:16.122316+0000","last_became_peered":"2024-09-07T03:32:16.122316+0000","last_unstale":"2024-09-07T03:32:50.281863+0000","last_undegraded":"2024-09-07T03:32:50.281863+0000","last_fullsized":"2024-09-07T03:32:50.281863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:09:15.334063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.672169+0000","last_change":"2024-09-07T03:32:18.132401+0000","last_active":"2024-09-07T03:35:30.672169+0000","last_peered":"2024-09-07T03:35:30.672169+0000","last_clean":"2024-09-07T03:35:30.672169+0000","last_became_active":"2024-09-07T03:32:18.132084+0000","last_became_peered":"2024-09-07T03:32:18.132084+0000","last_unstale":"2024-09-07T03:35:30.672169+0000","last_undegraded":"2024-09-07T03:35:30.672169+0000","last_fullsized":"2024-09-07T03:35:30.672169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:21:08.328913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471012+0000","last_change":"2024-09-07T03:32:20.143643+0000","last_active":"2024-09-07T03:32:50.471012+0000","last_peered":"2024-09-07T03:32:50.471012+0000","last_clean":"2024-09-07T03:32:50.471012+0000","last_became_active":"2024-09-07T03:32:20.143377+0000","last_became_peered":"2024-09-07T03:32:20.143377+0000","last_unstale":"2024-09-07T03:32:50.471012+0000","last_undegraded":"2024-09-07T03:32:50.471012+0000","last_fullsized":"2024-09-07T03:32:50.471012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:11.431453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278297+0000","last_change":"2024-09-07T03:32:22.146527+0000","last_active":"2024-09-07T03:32:50.278297+0000","last_peered":"2024-09-07T03:32:50.278297+0000","last_clean":"2024-09-07T03:32:50.278297+0000","last_became_active":"2024-09-07T03:32:22.146237+0000","last_became_peered":"2024-09-07T03:32:22.146237+0000","last_unstale":"2024-09-07T03:32:50.278297+0000","last_undegraded":"2024-09-07T03:32:50.278297+0000","last_fullsized":"2024-09-07T03:32:50.278297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:13:05.478773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570991+0000","last_change":"2024-09-07T03:32:14.126016+0000","last_active":"2024-09-07T03:32:56.570991+0000","last_peered":"2024-09-07T03:32:56.570991+0000","last_clean":"2024-09-07T03:32:56.570991+0000","last_became_active":"2024-09-07T03:32:14.125706+0000","last_became_peered":"2024-09-07T03:32:14.125706+0000","last_unstale":"2024-09-07T03:32:56.570991+0000","last_undegraded":"2024-09-07T03:32:56.570991+0000","last_fullsized":"2024-09-07T03:32:56.570991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:01.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.051788+0000","last_change":"2024-09-07T03:35:51.051788+0000","last_active":"2024-09-07T03:35:51.051788+0000","last_peered":"2024-09-07T03:35:51.051788+0000","last_clean":"2024-09-07T03:35:51.051788+0000","last_became_active":"2024-09-07T03:32:12.125261+0000","last_became_peered":"2024-09-07T03:32:12.125261+0000","last_unstale":"2024-09-07T03:35:51.051788+0000","last_undegraded":"2024-09-07T03:35:51.051788+0000","last_fullsized":"2024-09-07T03:35:51.051788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:51.051700+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:51.051700+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.051700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:26:24.675430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280234+0000","last_change":"2024-09-07T03:32:16.124615+0000","last_active":"2024-09-07T03:32:50.280234+0000","last_peered":"2024-09-07T03:32:50.280234+0000","last_clean":"2024-09-07T03:32:50.280234+0000","last_became_active":"2024-09-07T03:32:16.124314+0000","last_became_peered":"2024-09-07T03:32:16.124314+0000","last_unstale":"2024-09-07T03:32:50.280234+0000","last_undegraded":"2024-09-07T03:32:50.280234+0000","last_fullsized":"2024-09-07T03:32:50.280234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:44:43.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'41","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.616251+0000","last_change":"2024-09-07T03:32:18.129996+0000","last_active":"2024-09-07T03:35:30.616251+0000","last_peered":"2024-09-07T03:35:30.616251+0000","last_clean":"2024-09-07T03:35:30.616251+0000","last_became_active":"2024-09-07T03:32:18.129700+0000","last_became_peered":"2024-09-07T03:32:18.129700+0000","last_unstale":"2024-09-07T03:35:30.616251+0000","last_undegraded":"2024-09-07T03:35:30.616251+0000","last_fullsized":"2024-09-07T03:35:30.616251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:38:03.778044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471615+0000","last_change":"2024-09-07T03:32:20.142983+0000","last_active":"2024-09-07T03:32:50.471615+0000","last_peered":"2024-09-07T03:32:50.471615+0000","last_clean":"2024-09-07T03:32:50.471615+0000","last_became_active":"2024-09-07T03:32:20.142695+0000","last_became_peered":"2024-09-07T03:32:20.142695+0000","last_unstale":"2024-09-07T03:32:50.471615+0000","last_undegraded":"2024-09-07T03:32:50.471615+0000","last_fullsized":"2024-09-07T03:32:50.471615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:29.846270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.959036+0000","last_change":"2024-09-07T03:32:22.143270+0000","last_active":"2024-09-07T03:34:22.959036+0000","last_peered":"2024-09-07T03:34:22.959036+0000","last_clean":"2024-09-07T03:34:22.959036+0000","last_became_active":"2024-09-07T03:32:22.143053+0000","last_became_peered":"2024-09-07T03:32:22.143053+0000","last_unstale":"2024-09-07T03:34:22.959036+0000","last_undegraded":"2024-09-07T03:34:22.959036+0000","last_fullsized":"2024-09-07T03:34:22.959036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:05:14.463803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.116308+0000","last_change":"2024-09-07T03:35:49.116308+0000","last_active":"2024-09-07T03:35:49.116308+0000","last_peered":"2024-09-07T03:35:49.116308+0000","last_clean":"2024-09-07T03:35:49.116308+0000","last_became_active":"2024-09-07T03:32:14.117608+0000","last_became_peered":"2024-09-07T03:32:14.117608+0000","last_unstale":"2024-09-07T03:35:49.116308+0000","last_undegraded":"2024-09-07T03:35:49.116308+0000","last_fullsized":"2024-09-07T03:35:49.116308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:49.116226+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:49.116226+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.116226+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:26.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.931398+0000","last_change":"2024-09-07T03:35:42.931398+0000","last_active":"2024-09-07T03:35:42.931398+0000","last_peered":"2024-09-07T03:35:42.931398+0000","last_clean":"2024-09-07T03:35:42.931398+0000","last_became_active":"2024-09-07T03:32:12.135523+0000","last_became_peered":"2024-09-07T03:32:12.135523+0000","last_unstale":"2024-09-07T03:35:42.931398+0000","last_undegraded":"2024-09-07T03:35:42.931398+0000","last_fullsized":"2024-09-07T03:35:42.931398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:42.931312+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:42.931312+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.931312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:46.882774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:51.215438+0000","last_change":"2024-09-07T03:32:50.279386+0000","last_active":"2024-09-07T03:32:51.215438+0000","last_peered":"2024-09-07T03:32:51.215438+0000","last_clean":"2024-09-07T03:32:51.215438+0000","last_became_active":"2024-09-07T03:32:50.279004+0000","last_became_peered":"2024-09-07T03:32:50.279004+0000","last_unstale":"2024-09-07T03:32:51.215438+0000","last_undegraded":"2024-09-07T03:32:51.215438+0000","last_fullsized":"2024-09-07T03:32:51.215438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:52.172562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"34'18","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273667+0000","last_change":"2024-09-07T03:32:18.127389+0000","last_active":"2024-09-07T03:32:50.273667+0000","last_peered":"2024-09-07T03:32:50.273667+0000","last_clean":"2024-09-07T03:32:50.273667+0000","last_became_active":"2024-09-07T03:32:18.127007+0000","last_became_peered":"2024-09-07T03:32:18.127007+0000","last_unstale":"2024-09-07T03:32:50.273667+0000","last_undegraded":"2024-09-07T03:32:50.273667+0000","last_fullsized":"2024-09-07T03:32:50.273667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:32:04.955651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":370,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.536750+0000","last_change":"2024-09-07T03:32:20.147075+0000","last_active":"2024-09-07T03:35:30.536750+0000","last_peered":"2024-09-07T03:35:30.536750+0000","last_clean":"2024-09-07T03:35:30.536750+0000","last_became_active":"2024-09-07T03:32:20.146738+0000","last_became_peered":"2024-09-07T03:32:20.146738+0000","last_unstale":"2024-09-07T03:35:30.536750+0000","last_undegraded":"2024-09-07T03:35:30.536750+0000","last_fullsized":"2024-09-07T03:35:30.536750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:39.886530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.568340+0000","last_change":"2024-09-07T03:32:22.151158+0000","last_active":"2024-09-07T03:32:56.568340+0000","last_peered":"2024-09-07T03:32:56.568340+0000","last_clean":"2024-09-07T03:32:56.568340+0000","last_became_active":"2024-09-07T03:32:22.150886+0000","last_became_peered":"2024-09-07T03:32:22.150886+0000","last_unstale":"2024-09-07T03:32:56.568340+0000","last_undegraded":"2024-09-07T03:32:56.568340+0000","last_fullsized":"2024-09-07T03:32:56.568340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:57:06.666886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'18","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843569+0000","last_change":"2024-09-07T03:32:14.127180+0000","last_active":"2024-09-07T03:35:23.843569+0000","last_peered":"2024-09-07T03:35:23.843569+0000","last_clean":"2024-09-07T03:35:23.843569+0000","last_became_active":"2024-09-07T03:32:14.126901+0000","last_became_peered":"2024-09-07T03:32:14.126901+0000","last_unstale":"2024-09-07T03:35:23.843569+0000","last_undegraded":"2024-09-07T03:35:23.843569+0000","last_fullsized":"2024-09-07T03:35:23.843569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:14.334950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.209553+0000","last_change":"2024-09-07T03:35:44.209553+0000","last_active":"2024-09-07T03:35:44.209553+0000","last_peered":"2024-09-07T03:35:44.209553+0000","last_clean":"2024-09-07T03:35:44.209553+0000","last_became_active":"2024-09-07T03:32:12.133876+0000","last_became_peered":"2024-09-07T03:32:12.133876+0000","last_unstale":"2024-09-07T03:35:44.209553+0000","last_undegraded":"2024-09-07T03:35:44.209553+0000","last_fullsized":"2024-09-07T03:35:44.209553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.209464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.209464+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.209464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:02.025918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'1","reported_seq":221,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.512095+0000","last_change":"2024-09-07T03:32:16.122534+0000","last_active":"2024-09-07T03:35:30.512095+0000","last_peered":"2024-09-07T03:35:30.512095+0000","last_clean":"2024-09-07T03:35:30.512095+0000","last_became_active":"2024-09-07T03:32:16.120952+0000","last_became_peered":"2024-09-07T03:32:16.120952+0000","last_unstale":"2024-09-07T03:35:30.512095+0000","last_undegraded":"2024-09-07T03:35:30.512095+0000","last_fullsized":"2024-09-07T03:35:30.512095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:35.686701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'66","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.635641+0000","last_change":"2024-09-07T03:32:18.133969+0000","last_active":"2024-09-07T03:35:30.635641+0000","last_peered":"2024-09-07T03:35:30.635641+0000","last_clean":"2024-09-07T03:35:30.635641+0000","last_became_active":"2024-09-07T03:32:18.133705+0000","last_became_peered":"2024-09-07T03:32:18.133705+0000","last_unstale":"2024-09-07T03:35:30.635641+0000","last_undegraded":"2024-09-07T03:35:30.635641+0000","last_fullsized":"2024-09-07T03:35:30.635641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:02.433602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271613+0000","last_change":"2024-09-07T03:32:20.137011+0000","last_active":"2024-09-07T03:32:50.271613+0000","last_peered":"2024-09-07T03:32:50.271613+0000","last_clean":"2024-09-07T03:32:50.271613+0000","last_became_active":"2024-09-07T03:32:20.135211+0000","last_became_peered":"2024-09-07T03:32:20.135211+0000","last_unstale":"2024-09-07T03:32:50.271613+0000","last_undegraded":"2024-09-07T03:32:50.271613+0000","last_fullsized":"2024-09-07T03:32:50.271613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:33.033993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.028862+0000","last_change":"2024-09-07T03:32:22.141840+0000","last_active":"2024-09-07T03:32:57.028862+0000","last_peered":"2024-09-07T03:32:57.028862+0000","last_clean":"2024-09-07T03:32:57.028862+0000","last_became_active":"2024-09-07T03:32:22.141533+0000","last_became_peered":"2024-09-07T03:32:22.141533+0000","last_unstale":"2024-09-07T03:32:57.028862+0000","last_undegraded":"2024-09-07T03:32:57.028862+0000","last_fullsized":"2024-09-07T03:32:57.028862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:32:37.743868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'20","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806061+0000","last_change":"2024-09-07T03:32:14.123194+0000","last_active":"2024-09-07T03:35:23.806061+0000","last_peered":"2024-09-07T03:35:23.806061+0000","last_clean":"2024-09-07T03:35:23.806061+0000","last_became_active":"2024-09-07T03:32:14.122929+0000","last_became_peered":"2024-09-07T03:32:14.122929+0000","last_unstale":"2024-09-07T03:35:23.806061+0000","last_undegraded":"2024-09-07T03:35:23.806061+0000","last_fullsized":"2024-09-07T03:35:23.806061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:27:08.474145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.018984+0000","last_change":"2024-09-07T03:35:50.018984+0000","last_active":"2024-09-07T03:35:50.018984+0000","last_peered":"2024-09-07T03:35:50.018984+0000","last_clean":"2024-09-07T03:35:50.018984+0000","last_became_active":"2024-09-07T03:32:12.124610+0000","last_became_peered":"2024-09-07T03:32:12.124610+0000","last_unstale":"2024-09-07T03:35:50.018984+0000","last_undegraded":"2024-09-07T03:35:50.018984+0000","last_fullsized":"2024-09-07T03:35:50.018984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:50.018888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:50.018888+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.018888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:55.010719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278654+0000","last_change":"2024-09-07T03:32:16.116613+0000","last_active":"2024-09-07T03:32:50.278654+0000","last_peered":"2024-09-07T03:32:50.278654+0000","last_clean":"2024-09-07T03:32:50.278654+0000","last_became_active":"2024-09-07T03:32:16.116296+0000","last_became_peered":"2024-09-07T03:32:16.116296+0000","last_unstale":"2024-09-07T03:32:50.278654+0000","last_undegraded":"2024-09-07T03:32:50.278654+0000","last_fullsized":"2024-09-07T03:32:50.278654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:40:46.166456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'40","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.638598+0000","last_change":"2024-09-07T03:32:18.134892+0000","last_active":"2024-09-07T03:35:30.638598+0000","last_peered":"2024-09-07T03:35:30.638598+0000","last_clean":"2024-09-07T03:35:30.638598+0000","last_became_active":"2024-09-07T03:32:18.134533+0000","last_became_peered":"2024-09-07T03:32:18.134533+0000","last_unstale":"2024-09-07T03:35:30.638598+0000","last_undegraded":"2024-09-07T03:35:30.638598+0000","last_fullsized":"2024-09-07T03:35:30.638598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:15:18.375395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278010+0000","last_change":"2024-09-07T03:32:20.146986+0000","last_active":"2024-09-07T03:32:50.278010+0000","last_peered":"2024-09-07T03:32:50.278010+0000","last_clean":"2024-09-07T03:32:50.278010+0000","last_became_active":"2024-09-07T03:32:20.146631+0000","last_became_peered":"2024-09-07T03:32:20.146631+0000","last_unstale":"2024-09-07T03:32:50.278010+0000","last_undegraded":"2024-09-07T03:32:50.278010+0000","last_fullsized":"2024-09-07T03:32:50.278010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:56.243102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275464+0000","last_change":"2024-09-07T03:32:22.152021+0000","last_active":"2024-09-07T03:32:50.275464+0000","last_peered":"2024-09-07T03:32:50.275464+0000","last_clean":"2024-09-07T03:32:50.275464+0000","last_became_active":"2024-09-07T03:32:22.151709+0000","last_became_peered":"2024-09-07T03:32:22.151709+0000","last_unstale":"2024-09-07T03:32:50.275464+0000","last_undegraded":"2024-09-07T03:32:50.275464+0000","last_fullsized":"2024-09-07T03:32:50.275464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:01.162547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.963490+0000","last_change":"2024-09-07T03:32:14.127708+0000","last_active":"2024-09-07T03:34:22.963490+0000","last_peered":"2024-09-07T03:34:22.963490+0000","last_clean":"2024-09-07T03:34:22.963490+0000","last_became_active":"2024-09-07T03:32:14.127451+0000","last_became_peered":"2024-09-07T03:32:14.127451+0000","last_unstale":"2024-09-07T03:34:22.963490+0000","last_undegraded":"2024-09-07T03:34:22.963490+0000","last_fullsized":"2024-09-07T03:34:22.963490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:19.822962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.970187+0000","last_change":"2024-09-07T03:35:41.970187+0000","last_active":"2024-09-07T03:35:41.970187+0000","last_peered":"2024-09-07T03:35:41.970187+0000","last_clean":"2024-09-07T03:35:41.970187+0000","last_became_active":"2024-09-07T03:32:12.124552+0000","last_became_peered":"2024-09-07T03:32:12.124552+0000","last_unstale":"2024-09-07T03:35:41.970187+0000","last_undegraded":"2024-09-07T03:35:41.970187+0000","last_fullsized":"2024-09-07T03:35:41.970187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.970083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.970083+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.970083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:38:37.531358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469800+0000","last_change":"2024-09-07T03:32:16.125669+0000","last_active":"2024-09-07T03:32:50.469800+0000","last_peered":"2024-09-07T03:32:50.469800+0000","last_clean":"2024-09-07T03:32:50.469800+0000","last_became_active":"2024-09-07T03:32:16.123423+0000","last_became_peered":"2024-09-07T03:32:16.123423+0000","last_unstale":"2024-09-07T03:32:50.469800+0000","last_undegraded":"2024-09-07T03:32:50.469800+0000","last_fullsized":"2024-09-07T03:32:50.469800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:06:37.923895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'35","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.610398+0000","last_change":"2024-09-07T03:32:18.129106+0000","last_active":"2024-09-07T03:35:30.610398+0000","last_peered":"2024-09-07T03:35:30.610398+0000","last_clean":"2024-09-07T03:35:30.610398+0000","last_became_active":"2024-09-07T03:32:18.128812+0000","last_became_peered":"2024-09-07T03:32:18.128812+0000","last_unstale":"2024-09-07T03:35:30.610398+0000","last_undegraded":"2024-09-07T03:35:30.610398+0000","last_fullsized":"2024-09-07T03:35:30.610398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:51.897402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279344+0000","last_change":"2024-09-07T03:32:20.132779+0000","last_active":"2024-09-07T03:32:50.279344+0000","last_peered":"2024-09-07T03:32:50.279344+0000","last_clean":"2024-09-07T03:32:50.279344+0000","last_became_active":"2024-09-07T03:32:20.132396+0000","last_became_peered":"2024-09-07T03:32:20.132396+0000","last_unstale":"2024-09-07T03:32:50.279344+0000","last_undegraded":"2024-09-07T03:32:50.279344+0000","last_fullsized":"2024-09-07T03:32:50.279344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:29:30.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.210747+0000","last_change":"2024-09-07T03:32:22.152253+0000","last_active":"2024-09-07T03:34:21.210747+0000","last_peered":"2024-09-07T03:34:21.210747+0000","last_clean":"2024-09-07T03:34:21.210747+0000","last_became_active":"2024-09-07T03:32:22.151697+0000","last_became_peered":"2024-09-07T03:32:22.151697+0000","last_unstale":"2024-09-07T03:34:21.210747+0000","last_undegraded":"2024-09-07T03:34:21.210747+0000","last_fullsized":"2024-09-07T03:34:21.210747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:12:47.655977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806035+0000","last_change":"2024-09-07T03:32:14.113037+0000","last_active":"2024-09-07T03:35:23.806035+0000","last_peered":"2024-09-07T03:35:23.806035+0000","last_clean":"2024-09-07T03:35:23.806035+0000","last_became_active":"2024-09-07T03:32:14.112336+0000","last_became_peered":"2024-09-07T03:32:14.112336+0000","last_unstale":"2024-09-07T03:35:23.806035+0000","last_undegraded":"2024-09-07T03:35:23.806035+0000","last_fullsized":"2024-09-07T03:35:23.806035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:16:13.535633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.070310+0000","last_change":"2024-09-07T03:35:48.070310+0000","last_active":"2024-09-07T03:35:48.070310+0000","last_peered":"2024-09-07T03:35:48.070310+0000","last_clean":"2024-09-07T03:35:48.070310+0000","last_became_active":"2024-09-07T03:32:12.136020+0000","last_became_peered":"2024-09-07T03:32:12.136020+0000","last_unstale":"2024-09-07T03:35:48.070310+0000","last_undegraded":"2024-09-07T03:35:48.070310+0000","last_fullsized":"2024-09-07T03:35:48.070310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:48.070194+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:48.070194+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.070194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:06:09.533250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.817388+0000","last_change":"2024-09-07T03:32:16.129863+0000","last_active":"2024-09-07T03:34:19.817388+0000","last_peered":"2024-09-07T03:34:19.817388+0000","last_clean":"2024-09-07T03:34:19.817388+0000","last_became_active":"2024-09-07T03:32:16.129161+0000","last_became_peered":"2024-09-07T03:32:16.129161+0000","last_unstale":"2024-09-07T03:34:19.817388+0000","last_undegraded":"2024-09-07T03:34:19.817388+0000","last_fullsized":"2024-09-07T03:34:19.817388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:08:23.197757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'48","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.619879+0000","last_change":"2024-09-07T03:32:18.132380+0000","last_active":"2024-09-07T03:35:30.619879+0000","last_peered":"2024-09-07T03:35:30.619879+0000","last_clean":"2024-09-07T03:35:30.619879+0000","last_became_active":"2024-09-07T03:32:18.132072+0000","last_became_peered":"2024-09-07T03:32:18.132072+0000","last_unstale":"2024-09-07T03:35:30.619879+0000","last_undegraded":"2024-09-07T03:35:30.619879+0000","last_fullsized":"2024-09-07T03:35:30.619879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:37.568436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274904+0000","last_change":"2024-09-07T03:32:20.145649+0000","last_active":"2024-09-07T03:32:50.274904+0000","last_peered":"2024-09-07T03:32:50.274904+0000","last_clean":"2024-09-07T03:32:50.274904+0000","last_became_active":"2024-09-07T03:32:20.144977+0000","last_became_peered":"2024-09-07T03:32:20.144977+0000","last_unstale":"2024-09-07T03:32:50.274904+0000","last_undegraded":"2024-09-07T03:32:50.274904+0000","last_fullsized":"2024-09-07T03:32:50.274904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:56.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.213631+0000","last_change":"2024-09-07T03:32:22.141987+0000","last_active":"2024-09-07T03:34:21.213631+0000","last_peered":"2024-09-07T03:34:21.213631+0000","last_clean":"2024-09-07T03:34:21.213631+0000","last_became_active":"2024-09-07T03:32:22.141633+0000","last_became_peered":"2024-09-07T03:32:22.141633+0000","last_unstale":"2024-09-07T03:34:21.213631+0000","last_undegraded":"2024-09-07T03:34:21.213631+0000","last_fullsized":"2024-09-07T03:34:21.213631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:45.392294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.478248+0000","last_change":"2024-09-07T03:32:14.114021+0000","last_active":"2024-09-07T03:35:23.478248+0000","last_peered":"2024-09-07T03:35:23.478248+0000","last_clean":"2024-09-07T03:35:23.478248+0000","last_became_active":"2024-09-07T03:32:14.111950+0000","last_became_peered":"2024-09-07T03:32:14.111950+0000","last_unstale":"2024-09-07T03:35:23.478248+0000","last_undegraded":"2024-09-07T03:35:23.478248+0000","last_fullsized":"2024-09-07T03:35:23.478248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:42:20.068850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.115987+0000","last_change":"2024-09-07T03:35:37.115987+0000","last_active":"2024-09-07T03:35:37.115987+0000","last_peered":"2024-09-07T03:35:37.115987+0000","last_clean":"2024-09-07T03:35:37.115987+0000","last_became_active":"2024-09-07T03:32:12.132814+0000","last_became_peered":"2024-09-07T03:32:12.132814+0000","last_unstale":"2024-09-07T03:35:37.115987+0000","last_undegraded":"2024-09-07T03:35:37.115987+0000","last_fullsized":"2024-09-07T03:35:37.115987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.115869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.115869+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.115869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:47:45.209898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843863+0000","last_change":"2024-09-07T03:32:14.115342+0000","last_active":"2024-09-07T03:35:23.843863+0000","last_peered":"2024-09-07T03:35:23.843863+0000","last_clean":"2024-09-07T03:35:23.843863+0000","last_became_active":"2024-09-07T03:32:14.114966+0000","last_became_peered":"2024-09-07T03:32:14.114966+0000","last_unstale":"2024-09-07T03:35:23.843863+0000","last_undegraded":"2024-09-07T03:35:23.843863+0000","last_fullsized":"2024-09-07T03:35:23.843863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:07:27.478728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.132979+0000","last_change":"2024-09-07T03:35:39.132979+0000","last_active":"2024-09-07T03:35:39.132979+0000","last_peered":"2024-09-07T03:35:39.132979+0000","last_clean":"2024-09-07T03:35:39.132979+0000","last_became_active":"2024-09-07T03:32:12.132662+0000","last_became_peered":"2024-09-07T03:32:12.132662+0000","last_unstale":"2024-09-07T03:35:39.132979+0000","last_undegraded":"2024-09-07T03:35:39.132979+0000","last_fullsized":"2024-09-07T03:35:39.132979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:39.132883+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:39.132883+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.132883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:45:43.737374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.739589+0000","last_change":"2024-09-07T03:32:14.122593+0000","last_active":"2024-09-07T03:35:23.739589+0000","last_peered":"2024-09-07T03:35:23.739589+0000","last_clean":"2024-09-07T03:35:23.739589+0000","last_became_active":"2024-09-07T03:32:14.122301+0000","last_became_peered":"2024-09-07T03:32:14.122301+0000","last_unstale":"2024-09-07T03:35:23.739589+0000","last_undegraded":"2024-09-07T03:35:23.739589+0000","last_fullsized":"2024-09-07T03:35:23.739589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:43:48.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.859938+0000","last_change":"2024-09-07T03:35:48.859938+0000","last_active":"2024-09-07T03:35:48.859938+0000","last_peered":"2024-09-07T03:35:48.859938+0000","last_clean":"2024-09-07T03:35:48.859938+0000","last_became_active":"2024-09-07T03:32:12.137561+0000","last_became_peered":"2024-09-07T03:32:12.137561+0000","last_unstale":"2024-09-07T03:35:48.859938+0000","last_undegraded":"2024-09-07T03:35:48.859938+0000","last_fullsized":"2024-09-07T03:35:48.859938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:48.859832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:48.859832+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.859832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:48:54.026056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435902+0000","last_change":"2024-09-07T03:32:14.114337+0000","last_active":"2024-09-07T03:34:19.435902+0000","last_peered":"2024-09-07T03:34:19.435902+0000","last_clean":"2024-09-07T03:34:19.435902+0000","last_became_active":"2024-09-07T03:32:14.114055+0000","last_became_peered":"2024-09-07T03:32:14.114055+0000","last_unstale":"2024-09-07T03:34:19.435902+0000","last_undegraded":"2024-09-07T03:34:19.435902+0000","last_fullsized":"2024-09-07T03:34:19.435902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:55:05.807784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.117553+0000","last_change":"2024-09-07T03:35:40.117553+0000","last_active":"2024-09-07T03:35:40.117553+0000","last_peered":"2024-09-07T03:35:40.117553+0000","last_clean":"2024-09-07T03:35:40.117553+0000","last_became_active":"2024-09-07T03:32:12.132471+0000","last_became_peered":"2024-09-07T03:32:12.132471+0000","last_unstale":"2024-09-07T03:35:40.117553+0000","last_undegraded":"2024-09-07T03:35:40.117553+0000","last_fullsized":"2024-09-07T03:35:40.117553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.117422+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.117422+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.117422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:29:20.922622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803876+0000","last_change":"2024-09-07T03:32:50.285566+0000","last_active":"2024-09-07T03:35:23.803876+0000","last_peered":"2024-09-07T03:35:23.803876+0000","last_clean":"2024-09-07T03:35:23.803876+0000","last_became_active":"2024-09-07T03:32:50.280656+0000","last_became_peered":"2024-09-07T03:32:50.280656+0000","last_unstale":"2024-09-07T03:35:23.803876+0000","last_undegraded":"2024-09-07T03:35:23.803876+0000","last_fullsized":"2024-09-07T03:35:23.803876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:19:49.958031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.896274+0000","last_change":"2024-09-07T03:35:43.896274+0000","last_active":"2024-09-07T03:35:43.896274+0000","last_peered":"2024-09-07T03:35:43.896274+0000","last_clean":"2024-09-07T03:35:43.896274+0000","last_became_active":"2024-09-07T03:32:12.140393+0000","last_became_peered":"2024-09-07T03:32:12.140393+0000","last_unstale":"2024-09-07T03:35:43.896274+0000","last_undegraded":"2024-09-07T03:35:43.896274+0000","last_fullsized":"2024-09-07T03:35:43.896274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.896191+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.896191+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.896191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:06:33.074408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"36'10","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.803631+0000","last_change":"2024-09-07T03:32:14.114468+0000","last_active":"2024-09-07T03:35:23.803631+0000","last_peered":"2024-09-07T03:35:23.803631+0000","last_clean":"2024-09-07T03:35:23.803631+0000","last_became_active":"2024-09-07T03:32:14.113830+0000","last_became_peered":"2024-09-07T03:32:14.113830+0000","last_unstale":"2024-09-07T03:35:23.803631+0000","last_undegraded":"2024-09-07T03:35:23.803631+0000","last_fullsized":"2024-09-07T03:35:23.803631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:00.736940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.149266+0000","last_change":"2024-09-07T03:35:42.149266+0000","last_active":"2024-09-07T03:35:42.149266+0000","last_peered":"2024-09-07T03:35:42.149266+0000","last_clean":"2024-09-07T03:35:42.149266+0000","last_became_active":"2024-09-07T03:32:12.134287+0000","last_became_peered":"2024-09-07T03:32:12.134287+0000","last_unstale":"2024-09-07T03:35:42.149266+0000","last_undegraded":"2024-09-07T03:35:42.149266+0000","last_fullsized":"2024-09-07T03:35:42.149266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:42.149177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:42.149177+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.149177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:37:52.961968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'17","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228255+0000","last_change":"2024-09-07T03:32:14.126278+0000","last_active":"2024-09-07T03:34:21.228255+0000","last_peered":"2024-09-07T03:34:21.228255+0000","last_clean":"2024-09-07T03:34:21.228255+0000","last_became_active":"2024-09-07T03:32:14.125990+0000","last_became_peered":"2024-09-07T03:32:14.125990+0000","last_unstale":"2024-09-07T03:34:21.228255+0000","last_undegraded":"2024-09-07T03:34:21.228255+0000","last_fullsized":"2024-09-07T03:34:21.228255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:31:20.993802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.081766+0000","last_change":"2024-09-07T03:35:42.081766+0000","last_active":"2024-09-07T03:35:42.081766+0000","last_peered":"2024-09-07T03:35:42.081766+0000","last_clean":"2024-09-07T03:35:42.081766+0000","last_became_active":"2024-09-07T03:32:12.128807+0000","last_became_peered":"2024-09-07T03:32:12.128807+0000","last_unstale":"2024-09-07T03:35:42.081766+0000","last_undegraded":"2024-09-07T03:35:42.081766+0000","last_fullsized":"2024-09-07T03:35:42.081766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:42.081678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:42.081678+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.081678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:31:00.820127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806043+0000","last_change":"2024-09-07T03:32:14.110088+0000","last_active":"2024-09-07T03:35:23.806043+0000","last_peered":"2024-09-07T03:35:23.806043+0000","last_clean":"2024-09-07T03:35:23.806043+0000","last_became_active":"2024-09-07T03:32:14.109799+0000","last_became_peered":"2024-09-07T03:32:14.109799+0000","last_unstale":"2024-09-07T03:35:23.806043+0000","last_undegraded":"2024-09-07T03:35:23.806043+0000","last_fullsized":"2024-09-07T03:35:23.806043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.877468+0000","last_change":"2024-09-07T03:35:44.877468+0000","last_active":"2024-09-07T03:35:44.877468+0000","last_peered":"2024-09-07T03:35:44.877468+0000","last_clean":"2024-09-07T03:35:44.877468+0000","last_became_active":"2024-09-07T03:32:12.130563+0000","last_became_peered":"2024-09-07T03:32:12.130563+0000","last_unstale":"2024-09-07T03:35:44.877468+0000","last_undegraded":"2024-09-07T03:35:44.877468+0000","last_fullsized":"2024-09-07T03:35:44.877468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.877377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.877377+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.877377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:28:27.432331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806088+0000","last_change":"2024-09-07T03:32:14.115326+0000","last_active":"2024-09-07T03:35:23.806088+0000","last_peered":"2024-09-07T03:35:23.806088+0000","last_clean":"2024-09-07T03:35:23.806088+0000","last_became_active":"2024-09-07T03:32:14.115000+0000","last_became_peered":"2024-09-07T03:32:14.115000+0000","last_unstale":"2024-09-07T03:35:23.806088+0000","last_undegraded":"2024-09-07T03:35:23.806088+0000","last_fullsized":"2024-09-07T03:35:23.806088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:20.852806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.890896+0000","last_change":"2024-09-07T03:35:45.890896+0000","last_active":"2024-09-07T03:35:45.890896+0000","last_peered":"2024-09-07T03:35:45.890896+0000","last_clean":"2024-09-07T03:35:45.890896+0000","last_became_active":"2024-09-07T03:32:12.142315+0000","last_became_peered":"2024-09-07T03:32:12.142315+0000","last_unstale":"2024-09-07T03:35:45.890896+0000","last_undegraded":"2024-09-07T03:35:45.890896+0000","last_fullsized":"2024-09-07T03:35:45.890896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:45.890810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:45.890810+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.890810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:29:01.485471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276218+0000","last_change":"2024-09-07T03:32:14.127846+0000","last_active":"2024-09-07T03:32:50.276218+0000","last_peered":"2024-09-07T03:32:50.276218+0000","last_clean":"2024-09-07T03:32:50.276218+0000","last_became_active":"2024-09-07T03:32:14.127560+0000","last_became_peered":"2024-09-07T03:32:14.127560+0000","last_unstale":"2024-09-07T03:32:50.276218+0000","last_undegraded":"2024-09-07T03:32:50.276218+0000","last_fullsized":"2024-09-07T03:32:50.276218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:10.373384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.873531+0000","last_change":"2024-09-07T03:35:47.873531+0000","last_active":"2024-09-07T03:35:47.873531+0000","last_peered":"2024-09-07T03:35:47.873531+0000","last_clean":"2024-09-07T03:35:47.873531+0000","last_became_active":"2024-09-07T03:32:12.138745+0000","last_became_peered":"2024-09-07T03:32:12.138745+0000","last_unstale":"2024-09-07T03:35:47.873531+0000","last_undegraded":"2024-09-07T03:35:47.873531+0000","last_fullsized":"2024-09-07T03:35:47.873531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:47.873426+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:47.873426+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.873426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:54:29.688161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.805976+0000","last_change":"2024-09-07T03:32:14.123012+0000","last_active":"2024-09-07T03:35:23.805976+0000","last_peered":"2024-09-07T03:35:23.805976+0000","last_clean":"2024-09-07T03:35:23.805976+0000","last_became_active":"2024-09-07T03:32:14.122699+0000","last_became_peered":"2024-09-07T03:32:14.122699+0000","last_unstale":"2024-09-07T03:35:23.805976+0000","last_undegraded":"2024-09-07T03:35:23.805976+0000","last_fullsized":"2024-09-07T03:35:23.805976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:12.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280233+0000","last_change":"2024-09-07T03:32:12.133952+0000","last_active":"2024-09-07T03:32:50.280233+0000","last_peered":"2024-09-07T03:32:50.280233+0000","last_clean":"2024-09-07T03:32:50.280233+0000","last_became_active":"2024-09-07T03:32:12.133145+0000","last_became_peered":"2024-09-07T03:32:12.133145+0000","last_unstale":"2024-09-07T03:32:50.280233+0000","last_undegraded":"2024-09-07T03:32:50.280233+0000","last_fullsized":"2024-09-07T03:32:50.280233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:02.480411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"36'16","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.587715+0000","last_change":"2024-09-07T03:32:14.112126+0000","last_active":"2024-09-07T03:35:23.587715+0000","last_peered":"2024-09-07T03:35:23.587715+0000","last_clean":"2024-09-07T03:35:23.587715+0000","last_became_active":"2024-09-07T03:32:14.111759+0000","last_became_peered":"2024-09-07T03:32:14.111759+0000","last_unstale":"2024-09-07T03:35:23.587715+0000","last_undegraded":"2024-09-07T03:35:23.587715+0000","last_fullsized":"2024-09-07T03:35:23.587715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:09:14.003758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":44,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.180733+0000","last_change":"2024-09-07T03:35:43.180733+0000","last_active":"2024-09-07T03:35:43.180733+0000","last_peered":"2024-09-07T03:35:43.180733+0000","last_clean":"2024-09-07T03:35:43.180733+0000","last_became_active":"2024-09-07T03:32:12.134151+0000","last_became_peered":"2024-09-07T03:32:12.134151+0000","last_unstale":"2024-09-07T03:35:43.180733+0000","last_undegraded":"2024-09-07T03:35:43.180733+0000","last_fullsized":"2024-09-07T03:35:43.180733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.180633+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.180633+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.180633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:50:19.691547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'30","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731159+0000","last_change":"2024-09-07T03:32:14.124493+0000","last_active":"2024-09-07T03:35:23.731159+0000","last_peered":"2024-09-07T03:35:23.731159+0000","last_clean":"2024-09-07T03:35:23.731159+0000","last_became_active":"2024-09-07T03:32:14.124258+0000","last_became_peered":"2024-09-07T03:32:14.124258+0000","last_unstale":"2024-09-07T03:35:23.731159+0000","last_undegraded":"2024-09-07T03:35:23.731159+0000","last_fullsized":"2024-09-07T03:35:23.731159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":111,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.921691+0000","last_change":"2024-09-07T03:35:46.921691+0000","last_active":"2024-09-07T03:35:46.921691+0000","last_peered":"2024-09-07T03:35:46.921691+0000","last_clean":"2024-09-07T03:35:46.921691+0000","last_became_active":"2024-09-07T03:32:12.140243+0000","last_became_peered":"2024-09-07T03:32:12.140243+0000","last_unstale":"2024-09-07T03:35:46.921691+0000","last_undegraded":"2024-09-07T03:35:46.921691+0000","last_fullsized":"2024-09-07T03:35:46.921691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.921593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.921593+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.921593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:41:38.191780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.570857+0000","last_change":"2024-09-07T03:32:14.113597+0000","last_active":"2024-09-07T03:32:56.570857+0000","last_peered":"2024-09-07T03:32:56.570857+0000","last_clean":"2024-09-07T03:32:56.570857+0000","last_became_active":"2024-09-07T03:32:14.113016+0000","last_became_peered":"2024-09-07T03:32:14.113016+0000","last_unstale":"2024-09-07T03:32:56.570857+0000","last_undegraded":"2024-09-07T03:32:56.570857+0000","last_fullsized":"2024-09-07T03:32:56.570857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:38:17.720862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.941687+0000","last_change":"2024-09-07T03:35:50.941687+0000","last_active":"2024-09-07T03:35:50.941687+0000","last_peered":"2024-09-07T03:35:50.941687+0000","last_clean":"2024-09-07T03:35:50.941687+0000","last_became_active":"2024-09-07T03:32:12.135936+0000","last_became_peered":"2024-09-07T03:32:12.135936+0000","last_unstale":"2024-09-07T03:35:50.941687+0000","last_undegraded":"2024-09-07T03:35:50.941687+0000","last_fullsized":"2024-09-07T03:35:50.941687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:50.941592+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:50.941592+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.941592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:06:51.841561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.731153+0000","last_change":"2024-09-07T03:32:14.128701+0000","last_active":"2024-09-07T03:35:23.731153+0000","last_peered":"2024-09-07T03:35:23.731153+0000","last_clean":"2024-09-07T03:35:23.731153+0000","last_became_active":"2024-09-07T03:32:14.127982+0000","last_became_peered":"2024-09-07T03:32:14.127982+0000","last_unstale":"2024-09-07T03:35:23.731153+0000","last_undegraded":"2024-09-07T03:35:23.731153+0000","last_fullsized":"2024-09-07T03:35:23.731153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:42:28.045587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.155078+0000","last_change":"2024-09-07T03:35:44.155078+0000","last_active":"2024-09-07T03:35:44.155078+0000","last_peered":"2024-09-07T03:35:44.155078+0000","last_clean":"2024-09-07T03:35:44.155078+0000","last_became_active":"2024-09-07T03:32:12.133720+0000","last_became_peered":"2024-09-07T03:32:12.133720+0000","last_unstale":"2024-09-07T03:35:44.155078+0000","last_undegraded":"2024-09-07T03:35:44.155078+0000","last_fullsized":"2024-09-07T03:35:44.155078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.154970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.154970+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.154970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:08:12.195152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843615+0000","last_change":"2024-09-07T03:32:14.124677+0000","last_active":"2024-09-07T03:35:23.843615+0000","last_peered":"2024-09-07T03:35:23.843615+0000","last_clean":"2024-09-07T03:35:23.843615+0000","last_became_active":"2024-09-07T03:32:14.124462+0000","last_became_peered":"2024-09-07T03:32:14.124462+0000","last_unstale":"2024-09-07T03:35:23.843615+0000","last_undegraded":"2024-09-07T03:35:23.843615+0000","last_fullsized":"2024-09-07T03:35:23.843615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:45:22.457075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.907020+0000","last_change":"2024-09-07T03:32:12.141303+0000","last_active":"2024-09-07T03:34:22.907020+0000","last_peered":"2024-09-07T03:34:22.907020+0000","last_clean":"2024-09-07T03:34:22.907020+0000","last_became_active":"2024-09-07T03:32:12.140957+0000","last_became_peered":"2024-09-07T03:32:12.140957+0000","last_unstale":"2024-09-07T03:34:22.907020+0000","last_undegraded":"2024-09-07T03:34:22.907020+0000","last_fullsized":"2024-09-07T03:34:22.907020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:19:10.920973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278119+0000","last_change":"2024-09-07T03:32:12.133925+0000","last_active":"2024-09-07T03:32:50.278119+0000","last_peered":"2024-09-07T03:32:50.278119+0000","last_clean":"2024-09-07T03:32:50.278119+0000","last_became_active":"2024-09-07T03:32:12.133460+0000","last_became_peered":"2024-09-07T03:32:12.133460+0000","last_unstale":"2024-09-07T03:32:50.278119+0000","last_undegraded":"2024-09-07T03:32:50.278119+0000","last_fullsized":"2024-09-07T03:32:50.278119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:11.084431+0000","last_clean_scrub_stamp":"2024-09-07T03:32:11.084431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:50:56.419019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.435937+0000","last_change":"2024-09-07T03:32:14.123815+0000","last_active":"2024-09-07T03:34:19.435937+0000","last_peered":"2024-09-07T03:34:19.435937+0000","last_clean":"2024-09-07T03:34:19.435937+0000","last_became_active":"2024-09-07T03:32:14.123554+0000","last_became_peered":"2024-09-07T03:32:14.123554+0000","last_unstale":"2024-09-07T03:34:19.435937+0000","last_undegraded":"2024-09-07T03:34:19.435937+0000","last_fullsized":"2024-09-07T03:34:19.435937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:12:13.928369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.090384+0000","last_change":"2024-09-07T03:35:47.090384+0000","last_active":"2024-09-07T03:35:47.090384+0000","last_peered":"2024-09-07T03:35:47.090384+0000","last_clean":"2024-09-07T03:35:47.090384+0000","last_became_active":"2024-09-07T03:32:12.134650+0000","last_became_peered":"2024-09-07T03:32:12.134650+0000","last_unstale":"2024-09-07T03:35:47.090384+0000","last_undegraded":"2024-09-07T03:35:47.090384+0000","last_fullsized":"2024-09-07T03:35:47.090384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:47.090289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:47.090289+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.090289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:17:09.392606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.843565+0000","last_change":"2024-09-07T03:32:14.127747+0000","last_active":"2024-09-07T03:35:23.843565+0000","last_peered":"2024-09-07T03:35:23.843565+0000","last_clean":"2024-09-07T03:35:23.843565+0000","last_became_active":"2024-09-07T03:32:14.127493+0000","last_became_peered":"2024-09-07T03:32:14.127493+0000","last_unstale":"2024-09-07T03:35:23.843565+0000","last_undegraded":"2024-09-07T03:35:23.843565+0000","last_fullsized":"2024-09-07T03:35:23.843565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:45:11.748356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1570,"ondisk_log_size":1570,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1666,"num_read_kb":1556,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640308,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":450560,"data_stored":155820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640308,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":744671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640308,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":158016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705715,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40560,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331280,"statfs":{"total":96636764160,"available":96595230720,"internally_reserved":0,"allocated":1081344,"data_stored":748249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:35:55.559 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.559 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.559 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.559 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.559 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.559 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.560 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.560 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.560 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.560 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.560 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.560 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.560 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.560 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.560 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.561 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.561 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.561 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.561 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.561 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.561 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.561 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.561 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.561 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.562 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.562 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.562 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.562 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.562 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.562 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.562 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.562 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.562 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.563 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.563 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.563 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.563 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.563 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.563 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.563 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.563 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.563 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.564 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.564 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.564 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.564 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.564 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.564 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.564 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.564 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.564 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.565 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.565 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.565 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.565 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.565 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.565 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.565 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.565 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.566 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.566 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.566 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.566 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.566 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.566 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.566 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.566 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.566 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.567 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.567 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.567 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.567 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.567 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.567 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.567 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.567 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.567 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.568 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.568 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.568 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.568 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.568 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.568 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.568 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.568 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.568 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.569 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.569 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.569 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.569 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.569 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.569 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.569 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.569 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.569 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.570 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.570 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.570 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.570 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.570 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.570 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.571 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.571 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.571 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.571 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.571 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.571 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.572 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.572 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.572 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.572 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.572 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.572 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.572 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.572 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.573 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.573 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.573 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.573 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.573 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.573 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.573 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.573 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.573 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.574 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.574 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.574 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.574 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.574 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.574 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.574 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.574 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.574 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.575 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.575 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.575 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.575 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.575 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.575 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.575 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.575 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.575 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.576 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.576 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.576 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.576 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.576 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.576 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.576 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.576 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.576 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.577 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.577 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.577 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.577 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.577 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.577 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.577 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.577 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.578 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.578 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.578 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.578 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.578 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.578 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.578 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.578 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.578 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.579 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.579 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.579 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.579 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.579 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.579 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.579 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.579 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.579 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.580 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.580 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.580 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.580 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.580 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.580 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.580 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.580 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.581 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.581 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.581 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.581 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.581 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.581 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-07T03:32:11.084431+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.581 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.581 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:35:55.582 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-07T03:36:15.582 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:36:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.692+0000 7f643d82b640 1 Processor -- start 2024-09-07T03:36:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.692+0000 7f643d82b640 1 -- start start 2024-09-07T03:36:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.692+0000 7f643d82b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6438129d80 0x7f643812a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.692+0000 7f643d82b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f643806dc00 con 0x7f643812a6a0 2024-09-07T03:36:15.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.692+0000 7f643d82b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f64381299c0 con 0x7f6438129d80 2024-09-07T03:36:15.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.693+0000 7f6436ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6438129d80 0x7f643812a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:15.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.693+0000 7f64367fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f643812a6a0 0x7f6438110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:48058/0 (socket says 172.21.15.104:48058) 2024-09-07T03:36:15.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.693+0000 7f64367fc640 1 -- 172.21.15.104:0/4022001662 learned_addr learned my addr 172.21.15.104:0/4022001662 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:36:15.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.693+0000 7f6436ffd640 1 -- 172.21.15.104:0/4022001662 >> v1:172.21.15.104:6789/0 conn(0x7f643812a6a0 legacy=0x7f6438110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:15.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.693+0000 7f6436ffd640 1 -- 172.21.15.104:0/4022001662 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6438114d20 con 0x7f6438129d80 2024-09-07T03:36:15.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f6436ffd640 1 --2- 172.21.15.104:0/4022001662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 0x7f643812a160 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6428009720 tx=0x7f642802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ebc2419c8e007e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:15.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f6435ffb640 1 -- 172.21.15.104:0/4022001662 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6428037070 con 0x7f6438129d80 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f6435ffb640 1 -- 172.21.15.104:0/4022001662 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642802ad90 con 0x7f6438129d80 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f6435ffb640 1 -- 172.21.15.104:0/4022001662 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6428032590 con 0x7f6438129d80 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f643d82b640 1 -- 172.21.15.104:0/4022001662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 msgr2=0x7f643812a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f643d82b640 1 --2- 172.21.15.104:0/4022001662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 0x7f643812a160 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6428009720 tx=0x7f642802a110 comp rx=0 tx=0).stop 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f643d82b640 1 -- 172.21.15.104:0/4022001662 shutdown_connections 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f643d82b640 1 --2- 172.21.15.104:0/4022001662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 0x7f643812a160 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f643d82b640 1 -- 172.21.15.104:0/4022001662 >> 172.21.15.104:0/4022001662 conn(0x7f6438070850 msgr2=0x7f6438072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f643d82b640 1 -- 172.21.15.104:0/4022001662 shutdown_connections 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.694+0000 7f643d82b640 1 -- 172.21.15.104:0/4022001662 wait complete. 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.695+0000 7f643d82b640 1 Processor -- start 2024-09-07T03:36:15.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.695+0000 7f643d82b640 1 -- start start 2024-09-07T03:36:15.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f643d82b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 0x7f64381c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:15.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f643d82b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6438114940 con 0x7f6438129d80 2024-09-07T03:36:15.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 0x7f64381c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:15.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 0x7f64381c0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59538/0 (socket says 172.21.15.104:59538) 2024-09-07T03:36:15.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f6436ffd640 1 -- 172.21.15.104:0/1010291357 learned_addr learned my addr 172.21.15.104:0/1010291357 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:36:15.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f6436ffd640 1 -- 172.21.15.104:0/1010291357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643811fc10 con 0x7f6438129d80 2024-09-07T03:36:15.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f6436ffd640 1 --2- 172.21.15.104:0/1010291357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 0x7f64381c0d70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6428009840 tx=0x7f64280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f641ffff640 1 -- 172.21.15.104:0/1010291357 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6428041020 con 0x7f6438129d80 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f641ffff640 1 -- 172.21.15.104:0/1010291357 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642803d550 con 0x7f6438129d80 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643811fea0 con 0x7f6438129d80 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.696+0000 7f641ffff640 1 -- 172.21.15.104:0/1010291357 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6428037040 con 0x7f6438129d80 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.697+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64381c1490 con 0x7f6438129d80 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.697+0000 7f641ffff640 1 -- 172.21.15.104:0/1010291357 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6428044020 con 0x7f6438129d80 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.697+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64381119e0 con 0x7f6438129d80 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.698+0000 7f641ffff640 1 --2- 172.21.15.104:0/1010291357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f642403de90 0x7f6424040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.698+0000 7f641ffff640 1 -- 172.21.15.104:0/1010291357 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6428073420 con 0x7f6438129d80 2024-09-07T03:36:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.698+0000 7f64367fc640 1 --2- 172.21.15.104:0/1010291357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f642403de90 0x7f6424040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:15.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.699+0000 7f64367fc640 1 --2- 172.21.15.104:0/1010291357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f642403de90 0x7f6424040350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f642c007fd0 tx=0x7f642c007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:15.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.702+0000 7f641ffff640 1 -- 172.21.15.104:0/1010291357 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f642804b030 con 0x7f6438129d80 2024-09-07T03:36:15.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.873+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6438114010 con 0x7f642403de90 2024-09-07T03:36:15.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.884+0000 7f641ffff640 1 -- 172.21.15.104:0/1010291357 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666181 (secure 0 0 0) 0x7f6438114010 con 0x7f642403de90 2024-09-07T03:36:15.892 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:36:15.898 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.888+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f642403de90 msgr2=0x7f6424040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.889+0000 7f643d82b640 1 --2- 172.21.15.104:0/1010291357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f642403de90 0x7f6424040350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f642c007fd0 tx=0x7f642c007aa0 comp rx=0 tx=0).stop 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.889+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 msgr2=0x7f64381c0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.889+0000 7f643d82b640 1 --2- 172.21.15.104:0/1010291357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 0x7f64381c0d70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6428009840 tx=0x7f64280046c0 comp rx=0 tx=0).stop 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.889+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 shutdown_connections 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.889+0000 7f643d82b640 1 --2- 172.21.15.104:0/1010291357 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f642403de90 0x7f6424040350 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.889+0000 7f643d82b640 1 --2- 172.21.15.104:0/1010291357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6438129d80 0x7f64381c0d70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.889+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 >> 172.21.15.104:0/1010291357 conn(0x7f6438070850 msgr2=0x7f6438126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.889+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 shutdown_connections 2024-09-07T03:36:15.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:15.889+0000 7f643d82b640 1 -- 172.21.15.104:0/1010291357 wait complete. 2024-09-07T03:36:15.902 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-07T03:36:15.277062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5430,"num_read_kb":4984,"num_write":2317,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4796,"ondisk_log_size":4796,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160992,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326368,"statfs":{"total":386547056640,"available":386382200832,"internally_reserved":0,"allocated":3047424,"data_stored":1806756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003748"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:59.050308+0000","last_change":"2024-09-07T03:35:59.050308+0000","last_active":"2024-09-07T03:35:59.050308+0000","last_peered":"2024-09-07T03:35:59.050308+0000","last_clean":"2024-09-07T03:35:59.050308+0000","last_became_active":"2024-09-07T03:32:12.133110+0000","last_became_peered":"2024-09-07T03:32:12.133110+0000","last_unstale":"2024-09-07T03:35:59.050308+0000","last_undegraded":"2024-09-07T03:35:59.050308+0000","last_fullsized":"2024-09-07T03:35:59.050308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:59.050226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:59.050226+0000","last_clean_scrub_stamp":"2024-09-07T03:35:59.050226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:16:40.480940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.974172+0000","last_change":"2024-09-07T03:36:10.974172+0000","last_active":"2024-09-07T03:36:10.974172+0000","last_peered":"2024-09-07T03:36:10.974172+0000","last_clean":"2024-09-07T03:36:10.974172+0000","last_became_active":"2024-09-07T03:32:14.109379+0000","last_became_peered":"2024-09-07T03:32:14.109379+0000","last_unstale":"2024-09-07T03:36:10.974172+0000","last_undegraded":"2024-09-07T03:36:10.974172+0000","last_fullsized":"2024-09-07T03:36:10.974172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:10.974093+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:10.974093+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.974093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:49:43.847718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.129075+0000","last_change":"2024-09-07T03:35:46.129075+0000","last_active":"2024-09-07T03:35:46.129075+0000","last_peered":"2024-09-07T03:35:46.129075+0000","last_clean":"2024-09-07T03:35:46.129075+0000","last_became_active":"2024-09-07T03:32:12.135945+0000","last_became_peered":"2024-09-07T03:32:12.135945+0000","last_unstale":"2024-09-07T03:35:46.129075+0000","last_undegraded":"2024-09-07T03:35:46.129075+0000","last_fullsized":"2024-09-07T03:35:46.129075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.128991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.128991+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.128991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:16:00.699297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'18","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.938208+0000","last_change":"2024-09-07T03:35:56.938208+0000","last_active":"2024-09-07T03:35:56.938208+0000","last_peered":"2024-09-07T03:35:56.938208+0000","last_clean":"2024-09-07T03:35:56.938208+0000","last_became_active":"2024-09-07T03:32:50.279755+0000","last_became_peered":"2024-09-07T03:32:50.279755+0000","last_unstale":"2024-09-07T03:35:56.938208+0000","last_undegraded":"2024-09-07T03:35:56.938208+0000","last_fullsized":"2024-09-07T03:35:56.938208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-07T03:35:56.938103+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-07T03:35:56.938103+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.938103+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:02:14.443754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.041470+0000","last_change":"2024-09-07T03:35:55.041470+0000","last_active":"2024-09-07T03:35:55.041470+0000","last_peered":"2024-09-07T03:35:55.041470+0000","last_clean":"2024-09-07T03:35:55.041470+0000","last_became_active":"2024-09-07T03:32:12.138176+0000","last_became_peered":"2024-09-07T03:32:12.138176+0000","last_unstale":"2024-09-07T03:35:55.041470+0000","last_undegraded":"2024-09-07T03:35:55.041470+0000","last_fullsized":"2024-09-07T03:35:55.041470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:55.041382+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:55.041382+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.041382+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:00.033213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:59.973498+0000","last_change":"2024-09-07T03:35:59.973498+0000","last_active":"2024-09-07T03:35:59.973498+0000","last_peered":"2024-09-07T03:35:59.973498+0000","last_clean":"2024-09-07T03:35:59.973498+0000","last_became_active":"2024-09-07T03:32:50.282086+0000","last_became_peered":"2024-09-07T03:32:50.282086+0000","last_unstale":"2024-09-07T03:35:59.973498+0000","last_undegraded":"2024-09-07T03:35:59.973498+0000","last_fullsized":"2024-09-07T03:35:59.973498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:59.973408+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:59.973408+0000","last_clean_scrub_stamp":"2024-09-07T03:35:59.973408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:05:23.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.102800+0000","last_change":"2024-09-07T03:35:41.102738+0000","last_active":"2024-09-07T03:35:41.102800+0000","last_peered":"2024-09-07T03:35:41.102800+0000","last_clean":"2024-09-07T03:35:41.102800+0000","last_became_active":"2024-09-07T03:32:12.128937+0000","last_became_peered":"2024-09-07T03:32:12.128937+0000","last_unstale":"2024-09-07T03:35:41.102800+0000","last_undegraded":"2024-09-07T03:35:41.102800+0000","last_fullsized":"2024-09-07T03:35:41.102800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.102653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.102653+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.102653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:22:21.638223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.029774+0000","last_change":"2024-09-07T03:36:11.029774+0000","last_active":"2024-09-07T03:36:11.029774+0000","last_peered":"2024-09-07T03:36:11.029774+0000","last_clean":"2024-09-07T03:36:11.029774+0000","last_became_active":"2024-09-07T03:32:14.122611+0000","last_became_peered":"2024-09-07T03:32:14.122611+0000","last_unstale":"2024-09-07T03:36:11.029774+0000","last_undegraded":"2024-09-07T03:36:11.029774+0000","last_fullsized":"2024-09-07T03:36:11.029774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:11.029689+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:11.029689+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.029689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:41:54.209339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.069994+0000","last_change":"2024-09-07T03:35:57.069994+0000","last_active":"2024-09-07T03:35:57.069994+0000","last_peered":"2024-09-07T03:35:57.069994+0000","last_clean":"2024-09-07T03:35:57.069994+0000","last_became_active":"2024-09-07T03:32:12.123986+0000","last_became_peered":"2024-09-07T03:32:12.123986+0000","last_unstale":"2024-09-07T03:35:57.069994+0000","last_undegraded":"2024-09-07T03:35:57.069994+0000","last_fullsized":"2024-09-07T03:35:57.069994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:57.069905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:57.069905+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.069905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:37:06.077291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.300816+0000","last_change":"2024-09-07T03:36:09.300748+0000","last_active":"2024-09-07T03:36:09.300816+0000","last_peered":"2024-09-07T03:36:09.300816+0000","last_clean":"2024-09-07T03:36:09.300816+0000","last_became_active":"2024-09-07T03:32:14.124523+0000","last_became_peered":"2024-09-07T03:32:14.124523+0000","last_unstale":"2024-09-07T03:36:09.300816+0000","last_undegraded":"2024-09-07T03:36:09.300816+0000","last_fullsized":"2024-09-07T03:36:09.300816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:09.300663+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:09.300663+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.300663+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:37:22.563920+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.021706+0000","last_change":"2024-09-07T03:35:56.021706+0000","last_active":"2024-09-07T03:35:56.021706+0000","last_peered":"2024-09-07T03:35:56.021706+0000","last_clean":"2024-09-07T03:35:56.021706+0000","last_became_active":"2024-09-07T03:32:12.133597+0000","last_became_peered":"2024-09-07T03:32:12.133597+0000","last_unstale":"2024-09-07T03:35:56.021706+0000","last_undegraded":"2024-09-07T03:35:56.021706+0000","last_fullsized":"2024-09-07T03:35:56.021706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:56.021606+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:56.021606+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.021606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:09.105320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.571091+0000","last_change":"2024-09-07T03:32:14.113584+0000","last_active":"2024-09-07T03:32:56.571091+0000","last_peered":"2024-09-07T03:32:56.571091+0000","last_clean":"2024-09-07T03:32:56.571091+0000","last_became_active":"2024-09-07T03:32:14.112622+0000","last_became_peered":"2024-09-07T03:32:14.112622+0000","last_unstale":"2024-09-07T03:32:56.571091+0000","last_undegraded":"2024-09-07T03:32:56.571091+0000","last_fullsized":"2024-09-07T03:32:56.571091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:37:52.320086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.989460+0000","last_change":"2024-09-07T03:35:51.989460+0000","last_active":"2024-09-07T03:35:51.989460+0000","last_peered":"2024-09-07T03:35:51.989460+0000","last_clean":"2024-09-07T03:35:51.989460+0000","last_became_active":"2024-09-07T03:32:12.140221+0000","last_became_peered":"2024-09-07T03:32:12.140221+0000","last_unstale":"2024-09-07T03:35:51.989460+0000","last_undegraded":"2024-09-07T03:35:51.989460+0000","last_fullsized":"2024-09-07T03:35:51.989460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:51.989364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:51.989364+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.989364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:59.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.300068+0000","last_change":"2024-09-07T03:32:14.114929+0000","last_active":"2024-09-07T03:32:56.300068+0000","last_peered":"2024-09-07T03:32:56.300068+0000","last_clean":"2024-09-07T03:32:56.300068+0000","last_became_active":"2024-09-07T03:32:14.114529+0000","last_became_peered":"2024-09-07T03:32:14.114529+0000","last_unstale":"2024-09-07T03:32:56.300068+0000","last_undegraded":"2024-09-07T03:32:56.300068+0000","last_fullsized":"2024-09-07T03:32:56.300068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.909080+0000","last_change":"2024-09-07T03:35:49.909080+0000","last_active":"2024-09-07T03:35:49.909080+0000","last_peered":"2024-09-07T03:35:49.909080+0000","last_clean":"2024-09-07T03:35:49.909080+0000","last_became_active":"2024-09-07T03:32:12.143209+0000","last_became_peered":"2024-09-07T03:32:12.143209+0000","last_unstale":"2024-09-07T03:35:49.909080+0000","last_undegraded":"2024-09-07T03:35:49.909080+0000","last_fullsized":"2024-09-07T03:35:49.909080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:49.908949+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:49.908949+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.908949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:33:51.713150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.019575+0000","last_change":"2024-09-07T03:36:01.019575+0000","last_active":"2024-09-07T03:36:01.019575+0000","last_peered":"2024-09-07T03:36:01.019575+0000","last_clean":"2024-09-07T03:36:01.019575+0000","last_became_active":"2024-09-07T03:32:14.124135+0000","last_became_peered":"2024-09-07T03:32:14.124135+0000","last_unstale":"2024-09-07T03:36:01.019575+0000","last_undegraded":"2024-09-07T03:36:01.019575+0000","last_fullsized":"2024-09-07T03:36:01.019575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:01.019492+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:01.019492+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.019492+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:05:20.506138+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'14","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.806118+0000","last_change":"2024-09-07T03:32:14.109787+0000","last_active":"2024-09-07T03:35:23.806118+0000","last_peered":"2024-09-07T03:35:23.806118+0000","last_clean":"2024-09-07T03:35:23.806118+0000","last_became_active":"2024-09-07T03:32:14.109280+0000","last_became_peered":"2024-09-07T03:32:14.109280+0000","last_unstale":"2024-09-07T03:35:23.806118+0000","last_undegraded":"2024-09-07T03:35:23.806118+0000","last_fullsized":"2024-09-07T03:35:23.806118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:13.089127+0000","last_clean_scrub_stamp":"2024-09-07T03:32:13.089127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:09.908912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.074893+0000","last_change":"2024-09-07T03:35:49.074893+0000","last_active":"2024-09-07T03:35:49.074893+0000","last_peered":"2024-09-07T03:35:49.074893+0000","last_clean":"2024-09-07T03:35:49.074893+0000","last_became_active":"2024-09-07T03:32:12.134379+0000","last_became_peered":"2024-09-07T03:32:12.134379+0000","last_unstale":"2024-09-07T03:35:49.074893+0000","last_undegraded":"2024-09-07T03:35:49.074893+0000","last_fullsized":"2024-09-07T03:35:49.074893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:49.074793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:49.074793+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.074793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:58:33.349796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.036322+0000","last_change":"2024-09-07T03:36:09.036322+0000","last_active":"2024-09-07T03:36:09.036322+0000","last_peered":"2024-09-07T03:36:09.036322+0000","last_clean":"2024-09-07T03:36:09.036322+0000","last_became_active":"2024-09-07T03:32:14.111769+0000","last_became_peered":"2024-09-07T03:32:14.111769+0000","last_unstale":"2024-09-07T03:36:09.036322+0000","last_undegraded":"2024-09-07T03:36:09.036322+0000","last_fullsized":"2024-09-07T03:36:09.036322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:09.036222+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:09.036222+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.036222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:29:52.053942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.132801+0000","last_change":"2024-09-07T03:35:47.132801+0000","last_active":"2024-09-07T03:35:47.132801+0000","last_peered":"2024-09-07T03:35:47.132801+0000","last_clean":"2024-09-07T03:35:47.132801+0000","last_became_active":"2024-09-07T03:32:12.129310+0000","last_became_peered":"2024-09-07T03:32:12.129310+0000","last_unstale":"2024-09-07T03:35:47.132801+0000","last_undegraded":"2024-09-07T03:35:47.132801+0000","last_fullsized":"2024-09-07T03:35:47.132801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:47.132683+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:47.132683+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.132683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:14:40.445362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.987197+0000","last_change":"2024-09-07T03:36:09.987197+0000","last_active":"2024-09-07T03:36:09.987197+0000","last_peered":"2024-09-07T03:36:09.987197+0000","last_clean":"2024-09-07T03:36:09.987197+0000","last_became_active":"2024-09-07T03:32:14.109177+0000","last_became_peered":"2024-09-07T03:32:14.109177+0000","last_unstale":"2024-09-07T03:36:09.987197+0000","last_undegraded":"2024-09-07T03:36:09.987197+0000","last_fullsized":"2024-09-07T03:36:09.987197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:09.987089+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:09.987089+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.987089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:31:02.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.057087+0000","last_change":"2024-09-07T03:35:55.057087+0000","last_active":"2024-09-07T03:35:55.057087+0000","last_peered":"2024-09-07T03:35:55.057087+0000","last_clean":"2024-09-07T03:35:55.057087+0000","last_became_active":"2024-09-07T03:32:12.120449+0000","last_became_peered":"2024-09-07T03:32:12.120449+0000","last_unstale":"2024-09-07T03:35:55.057087+0000","last_undegraded":"2024-09-07T03:35:55.057087+0000","last_fullsized":"2024-09-07T03:35:55.057087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:55.057003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:55.057003+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.057003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:23:58.048916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.917436+0000","last_change":"2024-09-07T03:35:57.917436+0000","last_active":"2024-09-07T03:35:57.917436+0000","last_peered":"2024-09-07T03:35:57.917436+0000","last_clean":"2024-09-07T03:35:57.917436+0000","last_became_active":"2024-09-07T03:32:14.125065+0000","last_became_peered":"2024-09-07T03:32:14.125065+0000","last_unstale":"2024-09-07T03:35:57.917436+0000","last_undegraded":"2024-09-07T03:35:57.917436+0000","last_fullsized":"2024-09-07T03:35:57.917436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:57.917354+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:57.917354+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.917354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:24.450901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.065046+0000","last_change":"2024-09-07T03:35:54.065046+0000","last_active":"2024-09-07T03:35:54.065046+0000","last_peered":"2024-09-07T03:35:54.065046+0000","last_clean":"2024-09-07T03:35:54.065046+0000","last_became_active":"2024-09-07T03:32:12.124516+0000","last_became_peered":"2024-09-07T03:32:12.124516+0000","last_unstale":"2024-09-07T03:35:54.065046+0000","last_undegraded":"2024-09-07T03:35:54.065046+0000","last_fullsized":"2024-09-07T03:35:54.065046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:54.064958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:54.064958+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.064958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:49:59.421840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.976481+0000","last_change":"2024-09-07T03:35:55.976481+0000","last_active":"2024-09-07T03:35:55.976481+0000","last_peered":"2024-09-07T03:35:55.976481+0000","last_clean":"2024-09-07T03:35:55.976481+0000","last_became_active":"2024-09-07T03:32:14.112477+0000","last_became_peered":"2024-09-07T03:32:14.112477+0000","last_unstale":"2024-09-07T03:35:55.976481+0000","last_undegraded":"2024-09-07T03:35:55.976481+0000","last_fullsized":"2024-09-07T03:35:55.976481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:55.976398+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:55.976398+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.976398+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:42:44.572113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.035524+0000","last_change":"2024-09-07T03:35:53.035524+0000","last_active":"2024-09-07T03:35:53.035524+0000","last_peered":"2024-09-07T03:35:53.035524+0000","last_clean":"2024-09-07T03:35:53.035524+0000","last_became_active":"2024-09-07T03:32:12.136801+0000","last_became_peered":"2024-09-07T03:32:12.136801+0000","last_unstale":"2024-09-07T03:35:53.035524+0000","last_undegraded":"2024-09-07T03:35:53.035524+0000","last_fullsized":"2024-09-07T03:35:53.035524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:53.035439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:53.035439+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.035439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:57:42.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.128171+0000","last_change":"2024-09-07T03:36:04.128171+0000","last_active":"2024-09-07T03:36:04.128171+0000","last_peered":"2024-09-07T03:36:04.128171+0000","last_clean":"2024-09-07T03:36:04.128171+0000","last_became_active":"2024-09-07T03:32:14.109167+0000","last_became_peered":"2024-09-07T03:32:14.109167+0000","last_unstale":"2024-09-07T03:36:04.128171+0000","last_undegraded":"2024-09-07T03:36:04.128171+0000","last_fullsized":"2024-09-07T03:36:04.128171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:04.128085+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:04.128085+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.128085+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.065768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.070160+0000","last_change":"2024-09-07T03:35:56.070160+0000","last_active":"2024-09-07T03:35:56.070160+0000","last_peered":"2024-09-07T03:35:56.070160+0000","last_clean":"2024-09-07T03:35:56.070160+0000","last_became_active":"2024-09-07T03:32:12.138105+0000","last_became_peered":"2024-09-07T03:32:12.138105+0000","last_unstale":"2024-09-07T03:35:56.070160+0000","last_undegraded":"2024-09-07T03:35:56.070160+0000","last_fullsized":"2024-09-07T03:35:56.070160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:56.070061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:56.070061+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.070061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:26:29.693791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.773106+0000","last_change":"2024-09-07T03:32:22.149626+0000","last_active":"2024-09-07T03:35:23.773106+0000","last_peered":"2024-09-07T03:35:23.773106+0000","last_clean":"2024-09-07T03:35:23.773106+0000","last_became_active":"2024-09-07T03:32:22.149337+0000","last_became_peered":"2024-09-07T03:32:22.149337+0000","last_unstale":"2024-09-07T03:35:23.773106+0000","last_undegraded":"2024-09-07T03:35:23.773106+0000","last_fullsized":"2024-09-07T03:35:23.773106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:00:45.310817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.093818+0000","last_change":"2024-09-07T03:36:03.093818+0000","last_active":"2024-09-07T03:36:03.093818+0000","last_peered":"2024-09-07T03:36:03.093818+0000","last_clean":"2024-09-07T03:36:03.093818+0000","last_became_active":"2024-09-07T03:32:14.126222+0000","last_became_peered":"2024-09-07T03:32:14.126222+0000","last_unstale":"2024-09-07T03:36:03.093818+0000","last_undegraded":"2024-09-07T03:36:03.093818+0000","last_fullsized":"2024-09-07T03:36:03.093818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:03.093725+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:03.093725+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.093725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:40:44.367176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.063889+0000","last_change":"2024-09-07T03:35:40.063889+0000","last_active":"2024-09-07T03:35:40.063889+0000","last_peered":"2024-09-07T03:35:40.063889+0000","last_clean":"2024-09-07T03:35:40.063889+0000","last_became_active":"2024-09-07T03:32:12.124815+0000","last_became_peered":"2024-09-07T03:32:12.124815+0000","last_unstale":"2024-09-07T03:35:40.063889+0000","last_undegraded":"2024-09-07T03:35:40.063889+0000","last_fullsized":"2024-09-07T03:35:40.063889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:40.063781+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.063781+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.063781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:11.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275282+0000","last_change":"2024-09-07T03:32:16.127792+0000","last_active":"2024-09-07T03:32:50.275282+0000","last_peered":"2024-09-07T03:32:50.275282+0000","last_clean":"2024-09-07T03:32:50.275282+0000","last_became_active":"2024-09-07T03:32:16.127430+0000","last_became_peered":"2024-09-07T03:32:16.127430+0000","last_unstale":"2024-09-07T03:32:50.275282+0000","last_undegraded":"2024-09-07T03:32:50.275282+0000","last_fullsized":"2024-09-07T03:32:50.275282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:46.752720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.588157+0000","last_change":"2024-09-07T03:32:18.130430+0000","last_active":"2024-09-07T03:35:30.588157+0000","last_peered":"2024-09-07T03:35:30.588157+0000","last_clean":"2024-09-07T03:35:30.588157+0000","last_became_active":"2024-09-07T03:32:18.130101+0000","last_became_peered":"2024-09-07T03:32:18.130101+0000","last_unstale":"2024-09-07T03:35:30.588157+0000","last_undegraded":"2024-09-07T03:35:30.588157+0000","last_fullsized":"2024-09-07T03:35:30.588157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:18:55.756545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280723+0000","last_change":"2024-09-07T03:32:20.147157+0000","last_active":"2024-09-07T03:32:50.280723+0000","last_peered":"2024-09-07T03:32:50.280723+0000","last_clean":"2024-09-07T03:32:50.280723+0000","last_became_active":"2024-09-07T03:32:20.146716+0000","last_became_peered":"2024-09-07T03:32:20.146716+0000","last_unstale":"2024-09-07T03:32:50.280723+0000","last_undegraded":"2024-09-07T03:32:50.280723+0000","last_fullsized":"2024-09-07T03:32:50.280723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:23.679745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"36'9","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.982420+0000","last_change":"2024-09-07T03:32:22.143355+0000","last_active":"2024-09-07T03:33:38.982420+0000","last_peered":"2024-09-07T03:33:38.982420+0000","last_clean":"2024-09-07T03:33:38.982420+0000","last_became_active":"2024-09-07T03:32:22.143092+0000","last_became_peered":"2024-09-07T03:32:22.143092+0000","last_unstale":"2024-09-07T03:33:38.982420+0000","last_undegraded":"2024-09-07T03:33:38.982420+0000","last_fullsized":"2024-09-07T03:33:38.982420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:30:18.450771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'8","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.113532+0000","last_change":"2024-09-07T03:36:02.113532+0000","last_active":"2024-09-07T03:36:02.113532+0000","last_peered":"2024-09-07T03:36:02.113532+0000","last_clean":"2024-09-07T03:36:02.113532+0000","last_became_active":"2024-09-07T03:32:14.121998+0000","last_became_peered":"2024-09-07T03:32:14.121998+0000","last_unstale":"2024-09-07T03:36:02.113532+0000","last_undegraded":"2024-09-07T03:36:02.113532+0000","last_fullsized":"2024-09-07T03:36:02.113532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:02.113425+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:02.113425+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.113425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:18:16.347758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.036982+0000","last_change":"2024-09-07T03:35:35.036982+0000","last_active":"2024-09-07T03:35:35.036982+0000","last_peered":"2024-09-07T03:35:35.036982+0000","last_clean":"2024-09-07T03:35:35.036982+0000","last_became_active":"2024-09-07T03:32:12.129979+0000","last_became_peered":"2024-09-07T03:32:12.129979+0000","last_unstale":"2024-09-07T03:35:35.036982+0000","last_undegraded":"2024-09-07T03:35:35.036982+0000","last_fullsized":"2024-09-07T03:35:35.036982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:35.036881+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:35.036881+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.036881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:32:01.763051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275223+0000","last_change":"2024-09-07T03:32:16.126421+0000","last_active":"2024-09-07T03:32:50.275223+0000","last_peered":"2024-09-07T03:32:50.275223+0000","last_clean":"2024-09-07T03:32:50.275223+0000","last_became_active":"2024-09-07T03:32:16.126116+0000","last_became_peered":"2024-09-07T03:32:16.126116+0000","last_unstale":"2024-09-07T03:32:50.275223+0000","last_undegraded":"2024-09-07T03:32:50.275223+0000","last_fullsized":"2024-09-07T03:32:50.275223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:07:32.152302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472267+0000","last_change":"2024-09-07T03:32:18.132461+0000","last_active":"2024-09-07T03:32:50.472267+0000","last_peered":"2024-09-07T03:32:50.472267+0000","last_clean":"2024-09-07T03:32:50.472267+0000","last_became_active":"2024-09-07T03:32:18.132152+0000","last_became_peered":"2024-09-07T03:32:18.132152+0000","last_unstale":"2024-09-07T03:32:50.472267+0000","last_undegraded":"2024-09-07T03:32:50.472267+0000","last_fullsized":"2024-09-07T03:32:50.472267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:45:42.859622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280341+0000","last_change":"2024-09-07T03:32:20.146991+0000","last_active":"2024-09-07T03:32:50.280341+0000","last_peered":"2024-09-07T03:32:50.280341+0000","last_clean":"2024-09-07T03:32:50.280341+0000","last_became_active":"2024-09-07T03:32:20.146457+0000","last_became_peered":"2024-09-07T03:32:20.146457+0000","last_unstale":"2024-09-07T03:32:50.280341+0000","last_undegraded":"2024-09-07T03:32:50.280341+0000","last_fullsized":"2024-09-07T03:32:50.280341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.222346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"36'10","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.807540+0000","last_change":"2024-09-07T03:32:22.144066+0000","last_active":"2024-09-07T03:35:23.807540+0000","last_peered":"2024-09-07T03:35:23.807540+0000","last_clean":"2024-09-07T03:35:23.807540+0000","last_became_active":"2024-09-07T03:32:22.143751+0000","last_became_peered":"2024-09-07T03:32:22.143751+0000","last_unstale":"2024-09-07T03:35:23.807540+0000","last_undegraded":"2024-09-07T03:35:23.807540+0000","last_fullsized":"2024-09-07T03:35:23.807540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:14.926443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"36'20","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.105456+0000","last_change":"2024-09-07T03:36:06.105456+0000","last_active":"2024-09-07T03:36:06.105456+0000","last_peered":"2024-09-07T03:36:06.105456+0000","last_clean":"2024-09-07T03:36:06.105456+0000","last_became_active":"2024-09-07T03:32:14.130544+0000","last_became_peered":"2024-09-07T03:32:14.130544+0000","last_unstale":"2024-09-07T03:36:06.105456+0000","last_undegraded":"2024-09-07T03:36:06.105456+0000","last_fullsized":"2024-09-07T03:36:06.105456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-07T03:36:06.105376+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-07T03:36:06.105376+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.105376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:13:52.000035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.060884+0000","last_change":"2024-09-07T03:35:47.060884+0000","last_active":"2024-09-07T03:35:47.060884+0000","last_peered":"2024-09-07T03:35:47.060884+0000","last_clean":"2024-09-07T03:35:47.060884+0000","last_became_active":"2024-09-07T03:32:12.124808+0000","last_became_peered":"2024-09-07T03:32:12.124808+0000","last_unstale":"2024-09-07T03:35:47.060884+0000","last_undegraded":"2024-09-07T03:35:47.060884+0000","last_fullsized":"2024-09-07T03:35:47.060884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:47.060791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:47.060791+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.060791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:54.421614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276016+0000","last_change":"2024-09-07T03:32:16.126571+0000","last_active":"2024-09-07T03:32:50.276016+0000","last_peered":"2024-09-07T03:32:50.276016+0000","last_clean":"2024-09-07T03:32:50.276016+0000","last_became_active":"2024-09-07T03:32:16.126318+0000","last_became_peered":"2024-09-07T03:32:16.126318+0000","last_unstale":"2024-09-07T03:32:50.276016+0000","last_undegraded":"2024-09-07T03:32:50.276016+0000","last_fullsized":"2024-09-07T03:32:50.276016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:51.962540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'29","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.110590+0000","last_change":"2024-09-07T03:36:10.110590+0000","last_active":"2024-09-07T03:36:10.110590+0000","last_peered":"2024-09-07T03:36:10.110590+0000","last_clean":"2024-09-07T03:36:10.110590+0000","last_became_active":"2024-09-07T03:32:18.128391+0000","last_became_peered":"2024-09-07T03:32:18.128391+0000","last_unstale":"2024-09-07T03:36:10.110590+0000","last_undegraded":"2024-09-07T03:36:10.110590+0000","last_fullsized":"2024-09-07T03:36:10.110590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'29","last_scrub_stamp":"2024-09-07T03:36:10.110477+0000","last_deep_scrub":"36'29","last_deep_scrub_stamp":"2024-09-07T03:36:10.110477+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.110477+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:52:05.773456+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.539513+0000","last_change":"2024-09-07T03:32:20.140796+0000","last_active":"2024-09-07T03:35:30.539513+0000","last_peered":"2024-09-07T03:35:30.539513+0000","last_clean":"2024-09-07T03:35:30.539513+0000","last_became_active":"2024-09-07T03:32:20.140249+0000","last_became_peered":"2024-09-07T03:32:20.140249+0000","last_unstale":"2024-09-07T03:35:30.539513+0000","last_undegraded":"2024-09-07T03:35:30.539513+0000","last_fullsized":"2024-09-07T03:35:30.539513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:12.918865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274799+0000","last_change":"2024-09-07T03:32:22.141118+0000","last_active":"2024-09-07T03:32:50.274799+0000","last_peered":"2024-09-07T03:32:50.274799+0000","last_clean":"2024-09-07T03:32:50.274799+0000","last_became_active":"2024-09-07T03:32:22.139829+0000","last_became_peered":"2024-09-07T03:32:22.139829+0000","last_unstale":"2024-09-07T03:32:50.274799+0000","last_undegraded":"2024-09-07T03:32:50.274799+0000","last_fullsized":"2024-09-07T03:32:50.274799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:55:30.425595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.135909+0000","last_change":"2024-09-07T03:36:04.135909+0000","last_active":"2024-09-07T03:36:04.135909+0000","last_peered":"2024-09-07T03:36:04.135909+0000","last_clean":"2024-09-07T03:36:04.135909+0000","last_became_active":"2024-09-07T03:32:14.126140+0000","last_became_peered":"2024-09-07T03:32:14.126140+0000","last_unstale":"2024-09-07T03:36:04.135909+0000","last_undegraded":"2024-09-07T03:36:04.135909+0000","last_fullsized":"2024-09-07T03:36:04.135909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:04.135822+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:04.135822+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.135822+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:04:21.287355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.015724+0000","last_change":"2024-09-07T03:35:46.015724+0000","last_active":"2024-09-07T03:35:46.015724+0000","last_peered":"2024-09-07T03:35:46.015724+0000","last_clean":"2024-09-07T03:35:46.015724+0000","last_became_active":"2024-09-07T03:32:12.133270+0000","last_became_peered":"2024-09-07T03:32:12.133270+0000","last_unstale":"2024-09-07T03:35:46.015724+0000","last_undegraded":"2024-09-07T03:35:46.015724+0000","last_fullsized":"2024-09-07T03:35:46.015724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.015616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.015616+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.015616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:06:46.915585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281906+0000","last_change":"2024-09-07T03:32:16.117091+0000","last_active":"2024-09-07T03:32:50.281906+0000","last_peered":"2024-09-07T03:32:50.281906+0000","last_clean":"2024-09-07T03:32:50.281906+0000","last_became_active":"2024-09-07T03:32:16.116761+0000","last_became_peered":"2024-09-07T03:32:16.116761+0000","last_unstale":"2024-09-07T03:32:50.281906+0000","last_undegraded":"2024-09-07T03:32:50.281906+0000","last_fullsized":"2024-09-07T03:32:50.281906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:07:07.674647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'41","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.680636+0000","last_change":"2024-09-07T03:32:18.129567+0000","last_active":"2024-09-07T03:35:30.680636+0000","last_peered":"2024-09-07T03:35:30.680636+0000","last_clean":"2024-09-07T03:35:30.680636+0000","last_became_active":"2024-09-07T03:32:18.128901+0000","last_became_peered":"2024-09-07T03:32:18.128901+0000","last_unstale":"2024-09-07T03:35:30.680636+0000","last_undegraded":"2024-09-07T03:35:30.680636+0000","last_fullsized":"2024-09-07T03:35:30.680636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:42:21.711836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.545527+0000","last_change":"2024-09-07T03:32:20.142693+0000","last_active":"2024-09-07T03:35:30.545527+0000","last_peered":"2024-09-07T03:35:30.545527+0000","last_clean":"2024-09-07T03:35:30.545527+0000","last_became_active":"2024-09-07T03:32:20.142390+0000","last_became_peered":"2024-09-07T03:32:20.142390+0000","last_unstale":"2024-09-07T03:35:30.545527+0000","last_undegraded":"2024-09-07T03:35:30.545527+0000","last_fullsized":"2024-09-07T03:35:30.545527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:51:20.882177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.993231+0000","last_change":"2024-09-07T03:35:58.993231+0000","last_active":"2024-09-07T03:35:58.993231+0000","last_peered":"2024-09-07T03:35:58.993231+0000","last_clean":"2024-09-07T03:35:58.993231+0000","last_became_active":"2024-09-07T03:32:14.122806+0000","last_became_peered":"2024-09-07T03:32:14.122806+0000","last_unstale":"2024-09-07T03:35:58.993231+0000","last_undegraded":"2024-09-07T03:35:58.993231+0000","last_fullsized":"2024-09-07T03:35:58.993231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:58.993132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:58.993132+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.993132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:24:01.985044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.958364+0000","last_change":"2024-09-07T03:35:43.958364+0000","last_active":"2024-09-07T03:35:43.958364+0000","last_peered":"2024-09-07T03:35:43.958364+0000","last_clean":"2024-09-07T03:35:43.958364+0000","last_became_active":"2024-09-07T03:32:12.124564+0000","last_became_peered":"2024-09-07T03:32:12.124564+0000","last_unstale":"2024-09-07T03:35:43.958364+0000","last_undegraded":"2024-09-07T03:35:43.958364+0000","last_fullsized":"2024-09-07T03:35:43.958364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.958249+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.958249+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.958249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:56:10.343804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.250760+0000","last_change":"2024-09-07T03:36:08.250760+0000","last_active":"2024-09-07T03:36:08.250760+0000","last_peered":"2024-09-07T03:36:08.250760+0000","last_clean":"2024-09-07T03:36:08.250760+0000","last_became_active":"2024-09-07T03:32:16.128519+0000","last_became_peered":"2024-09-07T03:32:16.128519+0000","last_unstale":"2024-09-07T03:36:08.250760+0000","last_undegraded":"2024-09-07T03:36:08.250760+0000","last_fullsized":"2024-09-07T03:36:08.250760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:08.250675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:08.250675+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.250675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:43.461236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'49","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.600626+0000","last_change":"2024-09-07T03:32:18.133115+0000","last_active":"2024-09-07T03:35:30.600626+0000","last_peered":"2024-09-07T03:35:30.600626+0000","last_clean":"2024-09-07T03:35:30.600626+0000","last_became_active":"2024-09-07T03:32:18.132867+0000","last_became_peered":"2024-09-07T03:32:18.132867+0000","last_unstale":"2024-09-07T03:35:30.600626+0000","last_undegraded":"2024-09-07T03:35:30.600626+0000","last_fullsized":"2024-09-07T03:35:30.600626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:21.167694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470403+0000","last_change":"2024-09-07T03:32:20.140261+0000","last_active":"2024-09-07T03:32:50.470403+0000","last_peered":"2024-09-07T03:32:50.470403+0000","last_clean":"2024-09-07T03:32:50.470403+0000","last_became_active":"2024-09-07T03:32:20.139806+0000","last_became_peered":"2024-09-07T03:32:20.139806+0000","last_unstale":"2024-09-07T03:32:50.470403+0000","last_undegraded":"2024-09-07T03:32:50.470403+0000","last_fullsized":"2024-09-07T03:32:50.470403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:38:36.923114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.784797+0000","last_change":"2024-09-07T03:32:22.148464+0000","last_active":"2024-09-07T03:35:23.784797+0000","last_peered":"2024-09-07T03:35:23.784797+0000","last_clean":"2024-09-07T03:35:23.784797+0000","last_became_active":"2024-09-07T03:32:22.148149+0000","last_became_peered":"2024-09-07T03:32:22.148149+0000","last_unstale":"2024-09-07T03:35:23.784797+0000","last_undegraded":"2024-09-07T03:35:23.784797+0000","last_fullsized":"2024-09-07T03:35:23.784797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:22.630172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.127054+0000","last_change":"2024-09-07T03:35:45.127054+0000","last_active":"2024-09-07T03:35:45.127054+0000","last_peered":"2024-09-07T03:35:45.127054+0000","last_clean":"2024-09-07T03:35:45.127054+0000","last_became_active":"2024-09-07T03:32:50.279097+0000","last_became_peered":"2024-09-07T03:32:50.279097+0000","last_unstale":"2024-09-07T03:35:45.127054+0000","last_undegraded":"2024-09-07T03:35:45.127054+0000","last_fullsized":"2024-09-07T03:35:45.127054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:45.126957+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:45.126957+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.126957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:52:31.656890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.977163+0000","last_change":"2024-09-07T03:35:44.977163+0000","last_active":"2024-09-07T03:35:44.977163+0000","last_peered":"2024-09-07T03:35:44.977163+0000","last_clean":"2024-09-07T03:35:44.977163+0000","last_became_active":"2024-09-07T03:32:12.123895+0000","last_became_peered":"2024-09-07T03:32:12.123895+0000","last_unstale":"2024-09-07T03:35:44.977163+0000","last_undegraded":"2024-09-07T03:35:44.977163+0000","last_fullsized":"2024-09-07T03:35:44.977163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:44.977080+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:44.977080+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.977080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:31:52.221278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.066306+0000","last_change":"2024-09-07T03:36:03.066306+0000","last_active":"2024-09-07T03:36:03.066306+0000","last_peered":"2024-09-07T03:36:03.066306+0000","last_clean":"2024-09-07T03:36:03.066306+0000","last_became_active":"2024-09-07T03:32:16.128471+0000","last_became_peered":"2024-09-07T03:32:16.128471+0000","last_unstale":"2024-09-07T03:36:03.066306+0000","last_undegraded":"2024-09-07T03:36:03.066306+0000","last_fullsized":"2024-09-07T03:36:03.066306+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:03.066219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:03.066219+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.066219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:00.394560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'39","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.641623+0000","last_change":"2024-09-07T03:32:18.127995+0000","last_active":"2024-09-07T03:35:30.641623+0000","last_peered":"2024-09-07T03:35:30.641623+0000","last_clean":"2024-09-07T03:35:30.641623+0000","last_became_active":"2024-09-07T03:32:18.127674+0000","last_became_peered":"2024-09-07T03:32:18.127674+0000","last_unstale":"2024-09-07T03:35:30.641623+0000","last_undegraded":"2024-09-07T03:35:30.641623+0000","last_fullsized":"2024-09-07T03:35:30.641623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:39:30.847124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272008+0000","last_change":"2024-09-07T03:32:20.142615+0000","last_active":"2024-09-07T03:32:50.272008+0000","last_peered":"2024-09-07T03:32:50.272008+0000","last_clean":"2024-09-07T03:32:50.272008+0000","last_became_active":"2024-09-07T03:32:20.142322+0000","last_became_peered":"2024-09-07T03:32:20.142322+0000","last_unstale":"2024-09-07T03:32:50.272008+0000","last_undegraded":"2024-09-07T03:32:50.272008+0000","last_fullsized":"2024-09-07T03:32:50.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:20:24.113543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:33.274480+0000","last_change":"2024-09-07T03:32:22.140060+0000","last_active":"2024-09-07T03:33:33.274480+0000","last_peered":"2024-09-07T03:33:33.274480+0000","last_clean":"2024-09-07T03:33:33.274480+0000","last_became_active":"2024-09-07T03:32:22.139771+0000","last_became_peered":"2024-09-07T03:32:22.139771+0000","last_unstale":"2024-09-07T03:33:33.274480+0000","last_undegraded":"2024-09-07T03:33:33.274480+0000","last_fullsized":"2024-09-07T03:33:33.274480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:32:56.498480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:00.054612+0000","last_change":"2024-09-07T03:36:00.054612+0000","last_active":"2024-09-07T03:36:00.054612+0000","last_peered":"2024-09-07T03:36:00.054612+0000","last_clean":"2024-09-07T03:36:00.054612+0000","last_became_active":"2024-09-07T03:32:14.122182+0000","last_became_peered":"2024-09-07T03:32:14.122182+0000","last_unstale":"2024-09-07T03:36:00.054612+0000","last_undegraded":"2024-09-07T03:36:00.054612+0000","last_fullsized":"2024-09-07T03:36:00.054612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:00.054529+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:00.054529+0000","last_clean_scrub_stamp":"2024-09-07T03:36:00.054529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:19.965534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.971146+0000","last_change":"2024-09-07T03:35:42.971146+0000","last_active":"2024-09-07T03:35:42.971146+0000","last_peered":"2024-09-07T03:35:42.971146+0000","last_clean":"2024-09-07T03:35:42.971146+0000","last_became_active":"2024-09-07T03:32:12.120464+0000","last_became_peered":"2024-09-07T03:32:12.120464+0000","last_unstale":"2024-09-07T03:35:42.971146+0000","last_undegraded":"2024-09-07T03:35:42.971146+0000","last_fullsized":"2024-09-07T03:35:42.971146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:42.971064+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:42.971064+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.971064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:22:31.004500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.065138+0000","last_change":"2024-09-07T03:36:05.065138+0000","last_active":"2024-09-07T03:36:05.065138+0000","last_peered":"2024-09-07T03:36:05.065138+0000","last_clean":"2024-09-07T03:36:05.065138+0000","last_became_active":"2024-09-07T03:32:16.124297+0000","last_became_peered":"2024-09-07T03:32:16.124297+0000","last_unstale":"2024-09-07T03:36:05.065138+0000","last_undegraded":"2024-09-07T03:36:05.065138+0000","last_fullsized":"2024-09-07T03:36:05.065138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:05.065024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:05.065024+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.065024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:25:49.643840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'52","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.607217+0000","last_change":"2024-09-07T03:32:18.130149+0000","last_active":"2024-09-07T03:35:30.607217+0000","last_peered":"2024-09-07T03:35:30.607217+0000","last_clean":"2024-09-07T03:35:30.607217+0000","last_became_active":"2024-09-07T03:32:18.129944+0000","last_became_peered":"2024-09-07T03:32:18.129944+0000","last_unstale":"2024-09-07T03:35:30.607217+0000","last_undegraded":"2024-09-07T03:35:30.607217+0000","last_fullsized":"2024-09-07T03:35:30.607217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:27:30.361760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":352,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.546808+0000","last_change":"2024-09-07T03:32:20.144523+0000","last_active":"2024-09-07T03:35:30.546808+0000","last_peered":"2024-09-07T03:35:30.546808+0000","last_clean":"2024-09-07T03:35:30.546808+0000","last_became_active":"2024-09-07T03:32:20.144077+0000","last_became_peered":"2024-09-07T03:32:20.144077+0000","last_unstale":"2024-09-07T03:35:30.546808+0000","last_undegraded":"2024-09-07T03:35:30.546808+0000","last_fullsized":"2024-09-07T03:35:30.546808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:25.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471098+0000","last_change":"2024-09-07T03:32:22.146228+0000","last_active":"2024-09-07T03:32:50.471098+0000","last_peered":"2024-09-07T03:32:50.471098+0000","last_clean":"2024-09-07T03:32:50.471098+0000","last_became_active":"2024-09-07T03:32:22.145690+0000","last_became_peered":"2024-09-07T03:32:22.145690+0000","last_unstale":"2024-09-07T03:32:50.471098+0000","last_undegraded":"2024-09-07T03:32:50.471098+0000","last_fullsized":"2024-09-07T03:32:50.471098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:59:34.851122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'7","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.092414+0000","last_change":"2024-09-07T03:35:50.092414+0000","last_active":"2024-09-07T03:35:50.092414+0000","last_peered":"2024-09-07T03:35:50.092414+0000","last_clean":"2024-09-07T03:35:50.092414+0000","last_became_active":"2024-09-07T03:32:14.113104+0000","last_became_peered":"2024-09-07T03:32:14.113104+0000","last_unstale":"2024-09-07T03:35:50.092414+0000","last_undegraded":"2024-09-07T03:35:50.092414+0000","last_fullsized":"2024-09-07T03:35:50.092414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-07T03:35:50.092309+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-07T03:35:50.092309+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.092309+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:22:24.668039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.984704+0000","last_change":"2024-09-07T03:35:41.984704+0000","last_active":"2024-09-07T03:35:41.984704+0000","last_peered":"2024-09-07T03:35:41.984704+0000","last_clean":"2024-09-07T03:35:41.984704+0000","last_became_active":"2024-09-07T03:32:12.125172+0000","last_became_peered":"2024-09-07T03:32:12.125172+0000","last_unstale":"2024-09-07T03:35:41.984704+0000","last_undegraded":"2024-09-07T03:35:41.984704+0000","last_fullsized":"2024-09-07T03:35:41.984704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.984625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.984625+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.984625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:03:57.662456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.044663+0000","last_change":"2024-09-07T03:36:04.044663+0000","last_active":"2024-09-07T03:36:04.044663+0000","last_peered":"2024-09-07T03:36:04.044663+0000","last_clean":"2024-09-07T03:36:04.044663+0000","last_became_active":"2024-09-07T03:32:16.125618+0000","last_became_peered":"2024-09-07T03:32:16.125618+0000","last_unstale":"2024-09-07T03:36:04.044663+0000","last_undegraded":"2024-09-07T03:36:04.044663+0000","last_fullsized":"2024-09-07T03:36:04.044663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:04.044581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:04.044581+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.044581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:31:12.541438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'72","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.650570+0000","last_change":"2024-09-07T03:32:18.134274+0000","last_active":"2024-09-07T03:35:30.650570+0000","last_peered":"2024-09-07T03:35:30.650570+0000","last_clean":"2024-09-07T03:35:30.650570+0000","last_became_active":"2024-09-07T03:32:18.134005+0000","last_became_peered":"2024-09-07T03:32:18.134005+0000","last_unstale":"2024-09-07T03:35:30.650570+0000","last_undegraded":"2024-09-07T03:35:30.650570+0000","last_fullsized":"2024-09-07T03:35:30.650570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:07.792695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.137535+0000","last_change":"2024-09-07T03:36:11.137535+0000","last_active":"2024-09-07T03:36:11.137535+0000","last_peered":"2024-09-07T03:36:11.137535+0000","last_clean":"2024-09-07T03:36:11.137535+0000","last_became_active":"2024-09-07T03:32:20.145119+0000","last_became_peered":"2024-09-07T03:32:20.145119+0000","last_unstale":"2024-09-07T03:36:11.137535+0000","last_undegraded":"2024-09-07T03:36:11.137535+0000","last_fullsized":"2024-09-07T03:36:11.137535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:11.137456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:11.137456+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.137456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:48:09.966265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.058175+0000","last_change":"2024-09-07T03:32:22.149484+0000","last_active":"2024-09-07T03:35:24.058175+0000","last_peered":"2024-09-07T03:35:24.058175+0000","last_clean":"2024-09-07T03:35:24.058175+0000","last_became_active":"2024-09-07T03:32:22.149203+0000","last_became_peered":"2024-09-07T03:32:22.149203+0000","last_unstale":"2024-09-07T03:35:24.058175+0000","last_undegraded":"2024-09-07T03:35:24.058175+0000","last_fullsized":"2024-09-07T03:35:24.058175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:17:33.166034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.151181+0000","last_change":"2024-09-07T03:35:53.151181+0000","last_active":"2024-09-07T03:35:53.151181+0000","last_peered":"2024-09-07T03:35:53.151181+0000","last_clean":"2024-09-07T03:35:53.151181+0000","last_became_active":"2024-09-07T03:32:14.124120+0000","last_became_peered":"2024-09-07T03:32:14.124120+0000","last_unstale":"2024-09-07T03:35:53.151181+0000","last_undegraded":"2024-09-07T03:35:53.151181+0000","last_fullsized":"2024-09-07T03:35:53.151181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:35:53.151087+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:35:53.151087+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.151087+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:29:35.373709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.127043+0000","last_change":"2024-09-07T03:35:38.127043+0000","last_active":"2024-09-07T03:35:38.127043+0000","last_peered":"2024-09-07T03:35:38.127043+0000","last_clean":"2024-09-07T03:35:38.127043+0000","last_became_active":"2024-09-07T03:32:12.133434+0000","last_became_peered":"2024-09-07T03:32:12.133434+0000","last_unstale":"2024-09-07T03:35:38.127043+0000","last_undegraded":"2024-09-07T03:35:38.127043+0000","last_fullsized":"2024-09-07T03:35:38.127043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.126948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.126948+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.126948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:20:49.410859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.060042+0000","last_change":"2024-09-07T03:36:06.060042+0000","last_active":"2024-09-07T03:36:06.060042+0000","last_peered":"2024-09-07T03:36:06.060042+0000","last_clean":"2024-09-07T03:36:06.060042+0000","last_became_active":"2024-09-07T03:32:16.121256+0000","last_became_peered":"2024-09-07T03:32:16.121256+0000","last_unstale":"2024-09-07T03:36:06.060042+0000","last_undegraded":"2024-09-07T03:36:06.060042+0000","last_fullsized":"2024-09-07T03:36:06.060042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:06.059956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:06.059956+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.059956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:16.523793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.654116+0000","last_change":"2024-09-07T03:32:18.128938+0000","last_active":"2024-09-07T03:35:30.654116+0000","last_peered":"2024-09-07T03:35:30.654116+0000","last_clean":"2024-09-07T03:35:30.654116+0000","last_became_active":"2024-09-07T03:32:18.128470+0000","last_became_peered":"2024-09-07T03:32:18.128470+0000","last_unstale":"2024-09-07T03:35:30.654116+0000","last_undegraded":"2024-09-07T03:35:30.654116+0000","last_fullsized":"2024-09-07T03:35:30.654116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:15:06.767791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276446+0000","last_change":"2024-09-07T03:32:20.136526+0000","last_active":"2024-09-07T03:32:50.276446+0000","last_peered":"2024-09-07T03:32:50.276446+0000","last_clean":"2024-09-07T03:32:50.276446+0000","last_became_active":"2024-09-07T03:32:20.134892+0000","last_became_peered":"2024-09-07T03:32:20.134892+0000","last_unstale":"2024-09-07T03:32:50.276446+0000","last_undegraded":"2024-09-07T03:32:50.276446+0000","last_fullsized":"2024-09-07T03:32:50.276446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:28.142767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228166+0000","last_change":"2024-09-07T03:32:22.153373+0000","last_active":"2024-09-07T03:34:21.228166+0000","last_peered":"2024-09-07T03:34:21.228166+0000","last_clean":"2024-09-07T03:34:21.228166+0000","last_became_active":"2024-09-07T03:32:22.153134+0000","last_became_peered":"2024-09-07T03:32:22.153134+0000","last_unstale":"2024-09-07T03:34:21.228166+0000","last_undegraded":"2024-09-07T03:34:21.228166+0000","last_fullsized":"2024-09-07T03:34:21.228166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:54.932378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.022341+0000","last_change":"2024-09-07T03:36:04.022341+0000","last_active":"2024-09-07T03:36:04.022341+0000","last_peered":"2024-09-07T03:36:04.022341+0000","last_clean":"2024-09-07T03:36:04.022341+0000","last_became_active":"2024-09-07T03:32:14.113243+0000","last_became_peered":"2024-09-07T03:32:14.113243+0000","last_unstale":"2024-09-07T03:36:04.022341+0000","last_undegraded":"2024-09-07T03:36:04.022341+0000","last_fullsized":"2024-09-07T03:36:04.022341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:04.022255+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:04.022255+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.022255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:20:24.399977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.990026+0000","last_change":"2024-09-07T03:35:40.990026+0000","last_active":"2024-09-07T03:35:40.990026+0000","last_peered":"2024-09-07T03:35:40.990026+0000","last_clean":"2024-09-07T03:35:40.990026+0000","last_became_active":"2024-09-07T03:32:12.120531+0000","last_became_peered":"2024-09-07T03:32:12.120531+0000","last_unstale":"2024-09-07T03:35:40.990026+0000","last_undegraded":"2024-09-07T03:35:40.990026+0000","last_fullsized":"2024-09-07T03:35:40.990026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.989938+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.989938+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.989938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:58:08.481418+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.330556+0000","last_change":"2024-09-07T03:36:11.330556+0000","last_active":"2024-09-07T03:36:11.330556+0000","last_peered":"2024-09-07T03:36:11.330556+0000","last_clean":"2024-09-07T03:36:11.330556+0000","last_became_active":"2024-09-07T03:32:16.124100+0000","last_became_peered":"2024-09-07T03:32:16.124100+0000","last_unstale":"2024-09-07T03:36:11.330556+0000","last_undegraded":"2024-09-07T03:36:11.330556+0000","last_fullsized":"2024-09-07T03:36:11.330556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:11.330470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:11.330470+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.330470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:05:30.256377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.062144+0000","last_change":"2024-09-07T03:36:08.062144+0000","last_active":"2024-09-07T03:36:08.062144+0000","last_peered":"2024-09-07T03:36:08.062144+0000","last_clean":"2024-09-07T03:36:08.062144+0000","last_became_active":"2024-09-07T03:32:18.130120+0000","last_became_peered":"2024-09-07T03:32:18.130120+0000","last_unstale":"2024-09-07T03:36:08.062144+0000","last_undegraded":"2024-09-07T03:36:08.062144+0000","last_fullsized":"2024-09-07T03:36:08.062144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-07T03:36:08.062043+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-07T03:36:08.062043+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.062043+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:30:18.972937+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.540272+0000","last_change":"2024-09-07T03:32:20.146795+0000","last_active":"2024-09-07T03:35:30.540272+0000","last_peered":"2024-09-07T03:35:30.540272+0000","last_clean":"2024-09-07T03:35:30.540272+0000","last_became_active":"2024-09-07T03:32:20.146408+0000","last_became_peered":"2024-09-07T03:32:20.146408+0000","last_unstale":"2024-09-07T03:35:30.540272+0000","last_undegraded":"2024-09-07T03:35:30.540272+0000","last_fullsized":"2024-09-07T03:35:30.540272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:35:41.611972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'14","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:28.230053+0000","last_change":"2024-09-07T03:32:22.147032+0000","last_active":"2024-09-07T03:34:28.230053+0000","last_peered":"2024-09-07T03:34:28.230053+0000","last_clean":"2024-09-07T03:34:28.230053+0000","last_became_active":"2024-09-07T03:32:22.145911+0000","last_became_peered":"2024-09-07T03:32:22.145911+0000","last_unstale":"2024-09-07T03:34:28.230053+0000","last_undegraded":"2024-09-07T03:34:28.230053+0000","last_fullsized":"2024-09-07T03:34:28.230053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:59:11.588353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.101986+0000","last_change":"2024-09-07T03:35:48.101986+0000","last_active":"2024-09-07T03:35:48.101986+0000","last_peered":"2024-09-07T03:35:48.101986+0000","last_clean":"2024-09-07T03:35:48.101986+0000","last_became_active":"2024-09-07T03:32:14.112499+0000","last_became_peered":"2024-09-07T03:32:14.112499+0000","last_unstale":"2024-09-07T03:35:48.101986+0000","last_undegraded":"2024-09-07T03:35:48.101986+0000","last_fullsized":"2024-09-07T03:35:48.101986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:48.101897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:48.101897+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.101897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:11:08.140746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.054642+0000","last_change":"2024-09-07T03:35:36.054642+0000","last_active":"2024-09-07T03:35:36.054642+0000","last_peered":"2024-09-07T03:35:36.054642+0000","last_clean":"2024-09-07T03:35:36.054642+0000","last_became_active":"2024-09-07T03:32:12.132462+0000","last_became_peered":"2024-09-07T03:32:12.132462+0000","last_unstale":"2024-09-07T03:35:36.054642+0000","last_undegraded":"2024-09-07T03:35:36.054642+0000","last_fullsized":"2024-09-07T03:35:36.054642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:36.054527+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:36.054527+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.054527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:13:11.473174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'7","reported_seq":617,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.522508+0000","last_change":"2024-09-07T03:32:16.124805+0000","last_active":"2024-09-07T03:35:30.522508+0000","last_peered":"2024-09-07T03:35:30.522508+0000","last_clean":"2024-09-07T03:35:30.522508+0000","last_became_active":"2024-09-07T03:32:16.124500+0000","last_became_peered":"2024-09-07T03:32:16.124500+0000","last_unstale":"2024-09-07T03:35:30.522508+0000","last_undegraded":"2024-09-07T03:35:30.522508+0000","last_fullsized":"2024-09-07T03:35:30.522508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:21:20.333446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'11","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:36.230563+0000","last_change":"2024-09-07T03:32:50.286792+0000","last_active":"2024-09-07T03:34:36.230563+0000","last_peered":"2024-09-07T03:34:36.230563+0000","last_clean":"2024-09-07T03:34:36.230563+0000","last_became_active":"2024-09-07T03:32:50.278739+0000","last_became_peered":"2024-09-07T03:32:50.278739+0000","last_unstale":"2024-09-07T03:34:36.230563+0000","last_undegraded":"2024-09-07T03:34:36.230563+0000","last_fullsized":"2024-09-07T03:34:36.230563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:41.377209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.541844+0000","last_change":"2024-09-07T03:32:20.140656+0000","last_active":"2024-09-07T03:35:30.541844+0000","last_peered":"2024-09-07T03:35:30.541844+0000","last_clean":"2024-09-07T03:35:30.541844+0000","last_became_active":"2024-09-07T03:32:20.140148+0000","last_became_peered":"2024-09-07T03:32:20.140148+0000","last_unstale":"2024-09-07T03:35:30.541844+0000","last_undegraded":"2024-09-07T03:35:30.541844+0000","last_fullsized":"2024-09-07T03:35:30.541844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:10.352295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.602934+0000","last_change":"2024-09-07T03:32:22.147355+0000","last_active":"2024-09-07T03:34:22.602934+0000","last_peered":"2024-09-07T03:34:22.602934+0000","last_clean":"2024-09-07T03:34:22.602934+0000","last_became_active":"2024-09-07T03:32:22.147049+0000","last_became_peered":"2024-09-07T03:32:22.147049+0000","last_unstale":"2024-09-07T03:34:22.602934+0000","last_undegraded":"2024-09-07T03:34:22.602934+0000","last_fullsized":"2024-09-07T03:34:22.602934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:16.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.155584+0000","last_change":"2024-09-07T03:35:54.155584+0000","last_active":"2024-09-07T03:35:54.155584+0000","last_peered":"2024-09-07T03:35:54.155584+0000","last_clean":"2024-09-07T03:35:54.155584+0000","last_became_active":"2024-09-07T03:32:14.124083+0000","last_became_peered":"2024-09-07T03:32:14.124083+0000","last_unstale":"2024-09-07T03:35:54.155584+0000","last_undegraded":"2024-09-07T03:35:54.155584+0000","last_fullsized":"2024-09-07T03:35:54.155584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:54.155500+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:54.155500+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.155500+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:36:53.745026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.109873+0000","last_change":"2024-09-07T03:35:39.109873+0000","last_active":"2024-09-07T03:35:39.109873+0000","last_peered":"2024-09-07T03:35:39.109873+0000","last_clean":"2024-09-07T03:35:39.109873+0000","last_became_active":"2024-09-07T03:32:12.141314+0000","last_became_peered":"2024-09-07T03:32:12.141314+0000","last_unstale":"2024-09-07T03:35:39.109873+0000","last_undegraded":"2024-09-07T03:35:39.109873+0000","last_fullsized":"2024-09-07T03:35:39.109873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:39.109787+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:39.109787+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.109787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:13:50.111247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276435+0000","last_change":"2024-09-07T03:32:16.128496+0000","last_active":"2024-09-07T03:32:50.276435+0000","last_peered":"2024-09-07T03:32:50.276435+0000","last_clean":"2024-09-07T03:32:50.276435+0000","last_became_active":"2024-09-07T03:32:16.128099+0000","last_became_peered":"2024-09-07T03:32:16.128099+0000","last_unstale":"2024-09-07T03:32:50.276435+0000","last_undegraded":"2024-09-07T03:32:50.276435+0000","last_fullsized":"2024-09-07T03:32:50.276435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:54:04.786020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'41","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.591142+0000","last_change":"2024-09-07T03:32:18.129264+0000","last_active":"2024-09-07T03:35:30.591142+0000","last_peered":"2024-09-07T03:35:30.591142+0000","last_clean":"2024-09-07T03:35:30.591142+0000","last_became_active":"2024-09-07T03:32:18.128679+0000","last_became_peered":"2024-09-07T03:32:18.128679+0000","last_unstale":"2024-09-07T03:35:30.591142+0000","last_undegraded":"2024-09-07T03:35:30.591142+0000","last_fullsized":"2024-09-07T03:35:30.591142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:00:04.595879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280409+0000","last_change":"2024-09-07T03:32:20.132823+0000","last_active":"2024-09-07T03:32:50.280409+0000","last_peered":"2024-09-07T03:32:50.280409+0000","last_clean":"2024-09-07T03:32:50.280409+0000","last_became_active":"2024-09-07T03:32:20.132479+0000","last_became_peered":"2024-09-07T03:32:20.132479+0000","last_unstale":"2024-09-07T03:32:50.280409+0000","last_undegraded":"2024-09-07T03:32:50.280409+0000","last_fullsized":"2024-09-07T03:32:50.280409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:52.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:24.060147+0000","last_change":"2024-09-07T03:32:22.140676+0000","last_active":"2024-09-07T03:35:24.060147+0000","last_peered":"2024-09-07T03:35:24.060147+0000","last_clean":"2024-09-07T03:35:24.060147+0000","last_became_active":"2024-09-07T03:32:22.140389+0000","last_became_peered":"2024-09-07T03:32:22.140389+0000","last_unstale":"2024-09-07T03:35:24.060147+0000","last_undegraded":"2024-09-07T03:35:24.060147+0000","last_fullsized":"2024-09-07T03:35:24.060147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:12:54.218779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'14","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.078213+0000","last_change":"2024-09-07T03:35:58.078213+0000","last_active":"2024-09-07T03:35:58.078213+0000","last_peered":"2024-09-07T03:35:58.078213+0000","last_clean":"2024-09-07T03:35:58.078213+0000","last_became_active":"2024-09-07T03:32:14.112612+0000","last_became_peered":"2024-09-07T03:32:14.112612+0000","last_unstale":"2024-09-07T03:35:58.078213+0000","last_undegraded":"2024-09-07T03:35:58.078213+0000","last_fullsized":"2024-09-07T03:35:58.078213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-07T03:35:58.078128+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-07T03:35:58.078128+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.078128+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:18:12.312460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"36'74","reported_seq":155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:34.263530+0000","last_change":"2024-09-07T03:35:34.263470+0000","last_active":"2024-09-07T03:35:34.263530+0000","last_peered":"2024-09-07T03:35:34.263530+0000","last_clean":"2024-09-07T03:35:34.263530+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:35:34.263530+0000","last_undegraded":"2024-09-07T03:35:34.263530+0000","last_fullsized":"2024-09-07T03:35:34.263530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-09-07T03:35:34.263378+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-09-07T03:35:34.263378+0000","last_clean_scrub_stamp":"2024-09-07T03:35:34.263378+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:30:23.857990+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.054987+0000","last_change":"2024-09-07T03:35:36.054987+0000","last_active":"2024-09-07T03:35:36.054987+0000","last_peered":"2024-09-07T03:35:36.054987+0000","last_clean":"2024-09-07T03:35:36.054987+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:35:36.054987+0000","last_undegraded":"2024-09-07T03:35:36.054987+0000","last_fullsized":"2024-09-07T03:35:36.054987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:36.054875+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:36.054875+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.054875+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:03.880806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.060262+0000","last_change":"2024-09-07T03:35:35.060262+0000","last_active":"2024-09-07T03:35:35.060262+0000","last_peered":"2024-09-07T03:35:35.060262+0000","last_clean":"2024-09-07T03:35:35.060262+0000","last_became_active":"2024-09-07T03:32:12.130323+0000","last_became_peered":"2024-09-07T03:32:12.130323+0000","last_unstale":"2024-09-07T03:35:35.060262+0000","last_undegraded":"2024-09-07T03:35:35.060262+0000","last_fullsized":"2024-09-07T03:35:35.060262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:35.060153+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:35.060153+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.060153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:51.353906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.210120+0000","last_change":"2024-09-07T03:36:06.210120+0000","last_active":"2024-09-07T03:36:06.210120+0000","last_peered":"2024-09-07T03:36:06.210120+0000","last_clean":"2024-09-07T03:36:06.210120+0000","last_became_active":"2024-09-07T03:32:16.126915+0000","last_became_peered":"2024-09-07T03:32:16.126915+0000","last_unstale":"2024-09-07T03:36:06.210120+0000","last_undegraded":"2024-09-07T03:36:06.210120+0000","last_fullsized":"2024-09-07T03:36:06.210120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:06.210045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:06.210045+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.210045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:59:32.681075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'93","reported_seq":181,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.689595+0000","last_change":"2024-09-07T03:32:18.129530+0000","last_active":"2024-09-07T03:35:30.689595+0000","last_peered":"2024-09-07T03:35:30.689595+0000","last_clean":"2024-09-07T03:35:30.689595+0000","last_became_active":"2024-09-07T03:32:18.129224+0000","last_became_peered":"2024-09-07T03:32:18.129224+0000","last_unstale":"2024-09-07T03:35:30.689595+0000","last_undegraded":"2024-09-07T03:35:30.689595+0000","last_fullsized":"2024-09-07T03:35:30.689595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:25:57.912545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275577+0000","last_change":"2024-09-07T03:32:20.135113+0000","last_active":"2024-09-07T03:32:50.275577+0000","last_peered":"2024-09-07T03:32:50.275577+0000","last_clean":"2024-09-07T03:32:50.275577+0000","last_became_active":"2024-09-07T03:32:20.134819+0000","last_became_peered":"2024-09-07T03:32:20.134819+0000","last_unstale":"2024-09-07T03:32:50.275577+0000","last_undegraded":"2024-09-07T03:32:50.275577+0000","last_fullsized":"2024-09-07T03:32:50.275577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:24:30.829289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'84","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.852849+0000","last_change":"2024-09-07T03:32:22.152124+0000","last_active":"2024-09-07T03:35:23.852849+0000","last_peered":"2024-09-07T03:35:23.852849+0000","last_clean":"2024-09-07T03:35:23.852849+0000","last_became_active":"2024-09-07T03:32:22.151817+0000","last_became_peered":"2024-09-07T03:32:22.151817+0000","last_unstale":"2024-09-07T03:35:23.852849+0000","last_undegraded":"2024-09-07T03:35:23.852849+0000","last_fullsized":"2024-09-07T03:35:23.852849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:38:00.353389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'16","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.052002+0000","last_change":"2024-09-07T03:35:57.052002+0000","last_active":"2024-09-07T03:35:57.052002+0000","last_peered":"2024-09-07T03:35:57.052002+0000","last_clean":"2024-09-07T03:35:57.052002+0000","last_became_active":"2024-09-07T03:32:14.130484+0000","last_became_peered":"2024-09-07T03:32:14.130484+0000","last_unstale":"2024-09-07T03:35:57.052002+0000","last_undegraded":"2024-09-07T03:35:57.052002+0000","last_fullsized":"2024-09-07T03:35:57.052002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:35:57.051894+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:35:57.051894+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.051894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:57:19.853822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:34.143372+0000","last_change":"2024-09-07T03:35:34.143292+0000","last_active":"2024-09-07T03:35:34.143372+0000","last_peered":"2024-09-07T03:35:34.143372+0000","last_clean":"2024-09-07T03:35:34.143372+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:35:34.143372+0000","last_undegraded":"2024-09-07T03:35:34.143372+0000","last_fullsized":"2024-09-07T03:35:34.143372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:34.143191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:34.143191+0000","last_clean_scrub_stamp":"2024-09-07T03:35:34.143191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:36:29.075222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.174918+0000","last_change":"2024-09-07T03:35:37.174918+0000","last_active":"2024-09-07T03:35:37.174918+0000","last_peered":"2024-09-07T03:35:37.174918+0000","last_clean":"2024-09-07T03:35:37.174918+0000","last_became_active":"2024-09-07T03:32:12.124522+0000","last_became_peered":"2024-09-07T03:32:12.124522+0000","last_unstale":"2024-09-07T03:35:37.174918+0000","last_undegraded":"2024-09-07T03:35:37.174918+0000","last_fullsized":"2024-09-07T03:35:37.174918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.174806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.174806+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.174806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:06:10.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.282885+0000","last_change":"2024-09-07T03:32:16.124594+0000","last_active":"2024-09-07T03:32:50.282885+0000","last_peered":"2024-09-07T03:32:50.282885+0000","last_clean":"2024-09-07T03:32:50.282885+0000","last_became_active":"2024-09-07T03:32:16.124243+0000","last_became_peered":"2024-09-07T03:32:16.124243+0000","last_unstale":"2024-09-07T03:32:50.282885+0000","last_undegraded":"2024-09-07T03:32:50.282885+0000","last_fullsized":"2024-09-07T03:32:50.282885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:00:23.883657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":513,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.687382+0000","last_change":"2024-09-07T03:32:18.132880+0000","last_active":"2024-09-07T03:35:30.687382+0000","last_peered":"2024-09-07T03:35:30.687382+0000","last_clean":"2024-09-07T03:35:30.687382+0000","last_became_active":"2024-09-07T03:32:18.132579+0000","last_became_peered":"2024-09-07T03:32:18.132579+0000","last_unstale":"2024-09-07T03:35:30.687382+0000","last_undegraded":"2024-09-07T03:35:30.687382+0000","last_fullsized":"2024-09-07T03:35:30.687382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:11:51.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272567+0000","last_change":"2024-09-07T03:32:20.141318+0000","last_active":"2024-09-07T03:32:50.272567+0000","last_peered":"2024-09-07T03:32:50.272567+0000","last_clean":"2024-09-07T03:32:50.272567+0000","last_became_active":"2024-09-07T03:32:20.141044+0000","last_became_peered":"2024-09-07T03:32:20.141044+0000","last_unstale":"2024-09-07T03:32:50.272567+0000","last_undegraded":"2024-09-07T03:32:50.272567+0000","last_fullsized":"2024-09-07T03:32:50.272567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:09:44.169617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.806191+0000","last_change":"2024-09-07T03:32:22.143631+0000","last_active":"2024-09-07T03:33:38.806191+0000","last_peered":"2024-09-07T03:33:38.806191+0000","last_clean":"2024-09-07T03:33:38.806191+0000","last_became_active":"2024-09-07T03:32:22.143337+0000","last_became_peered":"2024-09-07T03:32:22.143337+0000","last_unstale":"2024-09-07T03:33:38.806191+0000","last_undegraded":"2024-09-07T03:33:38.806191+0000","last_fullsized":"2024-09-07T03:33:38.806191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:30.421368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":64,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.151332+0000","last_change":"2024-09-07T03:35:52.151332+0000","last_active":"2024-09-07T03:35:52.151332+0000","last_peered":"2024-09-07T03:35:52.151332+0000","last_clean":"2024-09-07T03:35:52.151332+0000","last_became_active":"2024-09-07T03:32:14.127288+0000","last_became_peered":"2024-09-07T03:32:14.127288+0000","last_unstale":"2024-09-07T03:35:52.151332+0000","last_undegraded":"2024-09-07T03:35:52.151332+0000","last_fullsized":"2024-09-07T03:35:52.151332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:52.151246+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:52.151246+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.151246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:14:33.440532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.067219+0000","last_change":"2024-09-07T03:35:36.067219+0000","last_active":"2024-09-07T03:35:36.067219+0000","last_peered":"2024-09-07T03:35:36.067219+0000","last_clean":"2024-09-07T03:35:36.067219+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:35:36.067219+0000","last_undegraded":"2024-09-07T03:35:36.067219+0000","last_fullsized":"2024-09-07T03:35:36.067219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:36.067138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:36.067138+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.067138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:05.511968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.155695+0000","last_change":"2024-09-07T03:35:39.155583+0000","last_active":"2024-09-07T03:35:39.155695+0000","last_peered":"2024-09-07T03:35:39.155695+0000","last_clean":"2024-09-07T03:35:39.155695+0000","last_became_active":"2024-09-07T03:32:12.139224+0000","last_became_peered":"2024-09-07T03:32:12.139224+0000","last_unstale":"2024-09-07T03:35:39.155695+0000","last_undegraded":"2024-09-07T03:35:39.155695+0000","last_fullsized":"2024-09-07T03:35:39.155695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:39.155484+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:39.155484+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.155484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:35:35.465606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.030703+0000","last_change":"2024-09-07T03:36:02.030703+0000","last_active":"2024-09-07T03:36:02.030703+0000","last_peered":"2024-09-07T03:36:02.030703+0000","last_clean":"2024-09-07T03:36:02.030703+0000","last_became_active":"2024-09-07T03:32:16.121817+0000","last_became_peered":"2024-09-07T03:32:16.121817+0000","last_unstale":"2024-09-07T03:36:02.030703+0000","last_undegraded":"2024-09-07T03:36:02.030703+0000","last_fullsized":"2024-09-07T03:36:02.030703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:02.030606+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:02.030606+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.030606+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:38:02.109551+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:21.206736+0000","last_change":"2024-09-07T03:32:18.129607+0000","last_active":"2024-09-07T03:35:21.206736+0000","last_peered":"2024-09-07T03:35:21.206736+0000","last_clean":"2024-09-07T03:35:21.206736+0000","last_became_active":"2024-09-07T03:32:18.129264+0000","last_became_peered":"2024-09-07T03:32:18.129264+0000","last_unstale":"2024-09-07T03:35:21.206736+0000","last_undegraded":"2024-09-07T03:35:21.206736+0000","last_fullsized":"2024-09-07T03:35:21.206736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:52:54.317892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.472271+0000","last_change":"2024-09-07T03:32:20.143074+0000","last_active":"2024-09-07T03:32:50.472271+0000","last_peered":"2024-09-07T03:32:50.472271+0000","last_clean":"2024-09-07T03:32:50.472271+0000","last_became_active":"2024-09-07T03:32:20.142764+0000","last_became_peered":"2024-09-07T03:32:20.142764+0000","last_unstale":"2024-09-07T03:32:50.472271+0000","last_undegraded":"2024-09-07T03:32:50.472271+0000","last_fullsized":"2024-09-07T03:32:50.472271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:18:36.484446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272193+0000","last_change":"2024-09-07T03:32:22.147788+0000","last_active":"2024-09-07T03:32:50.272193+0000","last_peered":"2024-09-07T03:32:50.272193+0000","last_clean":"2024-09-07T03:32:50.272193+0000","last_became_active":"2024-09-07T03:32:22.147510+0000","last_became_peered":"2024-09-07T03:32:22.147510+0000","last_unstale":"2024-09-07T03:32:50.272193+0000","last_undegraded":"2024-09-07T03:32:50.272193+0000","last_fullsized":"2024-09-07T03:32:50.272193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:37.758327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.126506+0000","last_change":"2024-09-07T03:35:51.126506+0000","last_active":"2024-09-07T03:35:51.126506+0000","last_peered":"2024-09-07T03:35:51.126506+0000","last_clean":"2024-09-07T03:35:51.126506+0000","last_became_active":"2024-09-07T03:32:14.113700+0000","last_became_peered":"2024-09-07T03:32:14.113700+0000","last_unstale":"2024-09-07T03:35:51.126506+0000","last_undegraded":"2024-09-07T03:35:51.126506+0000","last_fullsized":"2024-09-07T03:35:51.126506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:51.126405+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:51.126405+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.126405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:05:32.898918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.101343+0000","last_change":"2024-09-07T03:35:35.101343+0000","last_active":"2024-09-07T03:35:35.101343+0000","last_peered":"2024-09-07T03:35:35.101343+0000","last_clean":"2024-09-07T03:35:35.101343+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:35:35.101343+0000","last_undegraded":"2024-09-07T03:35:35.101343+0000","last_fullsized":"2024-09-07T03:35:35.101343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:35:35.101255+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:35:35.101255+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.101255+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:45:10.988630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.967838+0000","last_change":"2024-09-07T03:35:38.967838+0000","last_active":"2024-09-07T03:35:38.967838+0000","last_peered":"2024-09-07T03:35:38.967838+0000","last_clean":"2024-09-07T03:35:38.967838+0000","last_became_active":"2024-09-07T03:32:12.124390+0000","last_became_peered":"2024-09-07T03:32:12.124390+0000","last_unstale":"2024-09-07T03:35:38.967838+0000","last_undegraded":"2024-09-07T03:35:38.967838+0000","last_fullsized":"2024-09-07T03:35:38.967838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:38.967736+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:38.967736+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.967736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:06:28.145953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.248619+0000","last_change":"2024-09-07T03:36:07.248619+0000","last_active":"2024-09-07T03:36:07.248619+0000","last_peered":"2024-09-07T03:36:07.248619+0000","last_clean":"2024-09-07T03:36:07.248619+0000","last_became_active":"2024-09-07T03:32:16.120933+0000","last_became_peered":"2024-09-07T03:32:16.120933+0000","last_unstale":"2024-09-07T03:36:07.248619+0000","last_undegraded":"2024-09-07T03:36:07.248619+0000","last_fullsized":"2024-09-07T03:36:07.248619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:07.248526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:07.248526+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.248526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:00:33.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.988572+0000","last_change":"2024-09-07T03:32:18.130861+0000","last_active":"2024-09-07T03:35:22.988572+0000","last_peered":"2024-09-07T03:35:22.988572+0000","last_clean":"2024-09-07T03:35:22.988572+0000","last_became_active":"2024-09-07T03:32:18.130557+0000","last_became_peered":"2024-09-07T03:32:18.130557+0000","last_unstale":"2024-09-07T03:35:22.988572+0000","last_undegraded":"2024-09-07T03:35:22.988572+0000","last_fullsized":"2024-09-07T03:35:22.988572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:23:58.249870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276706+0000","last_change":"2024-09-07T03:32:20.143006+0000","last_active":"2024-09-07T03:32:50.276706+0000","last_peered":"2024-09-07T03:32:50.276706+0000","last_clean":"2024-09-07T03:32:50.276706+0000","last_became_active":"2024-09-07T03:32:20.142650+0000","last_became_peered":"2024-09-07T03:32:20.142650+0000","last_unstale":"2024-09-07T03:32:50.276706+0000","last_undegraded":"2024-09-07T03:32:50.276706+0000","last_fullsized":"2024-09-07T03:32:50.276706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:47.155034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.532509+0000","last_change":"2024-09-07T03:32:22.151470+0000","last_active":"2024-09-07T03:34:22.532509+0000","last_peered":"2024-09-07T03:34:22.532509+0000","last_clean":"2024-09-07T03:34:22.532509+0000","last_became_active":"2024-09-07T03:32:22.150981+0000","last_became_peered":"2024-09-07T03:32:22.150981+0000","last_unstale":"2024-09-07T03:34:22.532509+0000","last_undegraded":"2024-09-07T03:34:22.532509+0000","last_fullsized":"2024-09-07T03:34:22.532509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:09.757277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.141859+0000","last_change":"2024-09-07T03:35:46.141859+0000","last_active":"2024-09-07T03:35:46.141859+0000","last_peered":"2024-09-07T03:35:46.141859+0000","last_clean":"2024-09-07T03:35:46.141859+0000","last_became_active":"2024-09-07T03:32:50.282108+0000","last_became_peered":"2024-09-07T03:32:50.282108+0000","last_unstale":"2024-09-07T03:35:46.141859+0000","last_undegraded":"2024-09-07T03:35:46.141859+0000","last_fullsized":"2024-09-07T03:35:46.141859+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:46.141737+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:46.141737+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.141737+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:06.335628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.985231+0000","last_change":"2024-09-07T03:35:39.985231+0000","last_active":"2024-09-07T03:35:39.985231+0000","last_peered":"2024-09-07T03:35:39.985231+0000","last_clean":"2024-09-07T03:35:39.985231+0000","last_became_active":"2024-09-07T03:32:12.121179+0000","last_became_peered":"2024-09-07T03:32:12.121179+0000","last_unstale":"2024-09-07T03:35:39.985231+0000","last_undegraded":"2024-09-07T03:35:39.985231+0000","last_fullsized":"2024-09-07T03:35:39.985231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:39.985147+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:39.985147+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.985147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:39:22.800295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.220713+0000","last_change":"2024-09-07T03:35:36.220654+0000","last_active":"2024-09-07T03:35:36.220713+0000","last_peered":"2024-09-07T03:35:36.220713+0000","last_clean":"2024-09-07T03:35:36.220713+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:35:36.220713+0000","last_undegraded":"2024-09-07T03:35:36.220713+0000","last_fullsized":"2024-09-07T03:35:36.220713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:36.220564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:36.220564+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.220564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:55:02.916343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.967790+0000","last_change":"2024-09-07T03:35:58.967790+0000","last_active":"2024-09-07T03:35:58.967790+0000","last_peered":"2024-09-07T03:35:58.967790+0000","last_clean":"2024-09-07T03:35:58.967790+0000","last_became_active":"2024-09-07T03:32:16.126273+0000","last_became_peered":"2024-09-07T03:32:16.126273+0000","last_unstale":"2024-09-07T03:35:58.967790+0000","last_undegraded":"2024-09-07T03:35:58.967790+0000","last_fullsized":"2024-09-07T03:35:58.967790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:58.967697+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:58.967697+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.967697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:09:06.500393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'80","reported_seq":160,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.683357+0000","last_change":"2024-09-07T03:32:18.132985+0000","last_active":"2024-09-07T03:35:30.683357+0000","last_peered":"2024-09-07T03:35:30.683357+0000","last_clean":"2024-09-07T03:35:30.683357+0000","last_became_active":"2024-09-07T03:32:18.132654+0000","last_became_peered":"2024-09-07T03:32:18.132654+0000","last_unstale":"2024-09-07T03:35:30.683357+0000","last_undegraded":"2024-09-07T03:35:30.683357+0000","last_fullsized":"2024-09-07T03:35:30.683357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:44:58.124761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278034+0000","last_change":"2024-09-07T03:32:20.140348+0000","last_active":"2024-09-07T03:32:50.278034+0000","last_peered":"2024-09-07T03:32:50.278034+0000","last_clean":"2024-09-07T03:32:50.278034+0000","last_became_active":"2024-09-07T03:32:20.140025+0000","last_became_peered":"2024-09-07T03:32:20.140025+0000","last_unstale":"2024-09-07T03:32:50.278034+0000","last_undegraded":"2024-09-07T03:32:50.278034+0000","last_fullsized":"2024-09-07T03:32:50.278034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:18:53.690582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'13","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.873538+0000","last_change":"2024-09-07T03:32:22.140343+0000","last_active":"2024-09-07T03:34:22.873538+0000","last_peered":"2024-09-07T03:34:22.873538+0000","last_clean":"2024-09-07T03:34:22.873538+0000","last_became_active":"2024-09-07T03:32:22.140043+0000","last_became_peered":"2024-09-07T03:32:22.140043+0000","last_unstale":"2024-09-07T03:34:22.873538+0000","last_undegraded":"2024-09-07T03:34:22.873538+0000","last_fullsized":"2024-09-07T03:34:22.873538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:42:55.502696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'12","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.099558+0000","last_change":"2024-09-07T03:35:50.099558+0000","last_active":"2024-09-07T03:35:50.099558+0000","last_peered":"2024-09-07T03:35:50.099558+0000","last_clean":"2024-09-07T03:35:50.099558+0000","last_became_active":"2024-09-07T03:32:14.126663+0000","last_became_peered":"2024-09-07T03:32:14.126663+0000","last_unstale":"2024-09-07T03:35:50.099558+0000","last_undegraded":"2024-09-07T03:35:50.099558+0000","last_fullsized":"2024-09-07T03:35:50.099558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:50.099477+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:50.099477+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.099477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:27:04.417756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.116801+0000","last_change":"2024-09-07T03:35:40.116801+0000","last_active":"2024-09-07T03:35:40.116801+0000","last_peered":"2024-09-07T03:35:40.116801+0000","last_clean":"2024-09-07T03:35:40.116801+0000","last_became_active":"2024-09-07T03:32:12.133974+0000","last_became_peered":"2024-09-07T03:32:12.133974+0000","last_unstale":"2024-09-07T03:35:40.116801+0000","last_undegraded":"2024-09-07T03:35:40.116801+0000","last_fullsized":"2024-09-07T03:35:40.116801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.116697+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.116697+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.116697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:35.362673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.014367+0000","last_change":"2024-09-07T03:35:37.014367+0000","last_active":"2024-09-07T03:35:37.014367+0000","last_peered":"2024-09-07T03:35:37.014367+0000","last_clean":"2024-09-07T03:35:37.014367+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:35:37.014367+0000","last_undegraded":"2024-09-07T03:35:37.014367+0000","last_fullsized":"2024-09-07T03:35:37.014367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.014282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.014282+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.014282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:46:10.364315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278673+0000","last_change":"2024-09-07T03:32:16.122232+0000","last_active":"2024-09-07T03:32:50.278673+0000","last_peered":"2024-09-07T03:32:50.278673+0000","last_clean":"2024-09-07T03:32:50.278673+0000","last_became_active":"2024-09-07T03:32:16.121921+0000","last_became_peered":"2024-09-07T03:32:16.121921+0000","last_unstale":"2024-09-07T03:32:50.278673+0000","last_undegraded":"2024-09-07T03:32:50.278673+0000","last_fullsized":"2024-09-07T03:32:50.278673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:01:24.806960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469770+0000","last_change":"2024-09-07T03:32:18.134018+0000","last_active":"2024-09-07T03:32:50.469770+0000","last_peered":"2024-09-07T03:32:50.469770+0000","last_clean":"2024-09-07T03:32:50.469770+0000","last_became_active":"2024-09-07T03:32:18.133689+0000","last_became_peered":"2024-09-07T03:32:18.133689+0000","last_unstale":"2024-09-07T03:32:50.469770+0000","last_undegraded":"2024-09-07T03:32:50.469770+0000","last_fullsized":"2024-09-07T03:32:50.469770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:16.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":350,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.537865+0000","last_change":"2024-09-07T03:32:20.143562+0000","last_active":"2024-09-07T03:35:30.537865+0000","last_peered":"2024-09-07T03:35:30.537865+0000","last_clean":"2024-09-07T03:35:30.537865+0000","last_became_active":"2024-09-07T03:32:20.143293+0000","last_became_peered":"2024-09-07T03:32:20.143293+0000","last_unstale":"2024-09-07T03:35:30.537865+0000","last_undegraded":"2024-09-07T03:35:30.537865+0000","last_fullsized":"2024-09-07T03:35:30.537865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:51.121820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273729+0000","last_change":"2024-09-07T03:32:22.147306+0000","last_active":"2024-09-07T03:32:50.273729+0000","last_peered":"2024-09-07T03:32:50.273729+0000","last_clean":"2024-09-07T03:32:50.273729+0000","last_became_active":"2024-09-07T03:32:22.147036+0000","last_became_peered":"2024-09-07T03:32:22.147036+0000","last_unstale":"2024-09-07T03:32:50.273729+0000","last_undegraded":"2024-09-07T03:32:50.273729+0000","last_fullsized":"2024-09-07T03:32:50.273729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:02.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.022185+0000","last_change":"2024-09-07T03:35:58.022185+0000","last_active":"2024-09-07T03:35:58.022185+0000","last_peered":"2024-09-07T03:35:58.022185+0000","last_clean":"2024-09-07T03:35:58.022185+0000","last_became_active":"2024-09-07T03:32:14.126350+0000","last_became_peered":"2024-09-07T03:32:14.126350+0000","last_unstale":"2024-09-07T03:35:58.022185+0000","last_undegraded":"2024-09-07T03:35:58.022185+0000","last_fullsized":"2024-09-07T03:35:58.022185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:58.022069+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:58.022069+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.022069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:50:03.378951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.090380+0000","last_change":"2024-09-07T03:35:37.090380+0000","last_active":"2024-09-07T03:35:37.090380+0000","last_peered":"2024-09-07T03:35:37.090380+0000","last_clean":"2024-09-07T03:35:37.090380+0000","last_became_active":"2024-09-07T03:32:12.130058+0000","last_became_peered":"2024-09-07T03:32:12.130058+0000","last_unstale":"2024-09-07T03:35:37.090380+0000","last_undegraded":"2024-09-07T03:35:37.090380+0000","last_fullsized":"2024-09-07T03:35:37.090380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.090296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.090296+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.090296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:10:30.746067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.254145+0000","last_change":"2024-09-07T03:35:35.254145+0000","last_active":"2024-09-07T03:35:35.254145+0000","last_peered":"2024-09-07T03:35:35.254145+0000","last_clean":"2024-09-07T03:35:35.254145+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:35:35.254145+0000","last_undegraded":"2024-09-07T03:35:35.254145+0000","last_fullsized":"2024-09-07T03:35:35.254145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:35.254064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:35.254064+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.254064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:11:50.660290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279335+0000","last_change":"2024-09-07T03:32:16.117328+0000","last_active":"2024-09-07T03:32:50.279335+0000","last_peered":"2024-09-07T03:32:50.279335+0000","last_clean":"2024-09-07T03:32:50.279335+0000","last_became_active":"2024-09-07T03:32:16.117025+0000","last_became_peered":"2024-09-07T03:32:16.117025+0000","last_unstale":"2024-09-07T03:32:50.279335+0000","last_undegraded":"2024-09-07T03:32:50.279335+0000","last_fullsized":"2024-09-07T03:32:50.279335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:43:01.270179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273099+0000","last_change":"2024-09-07T03:32:18.124974+0000","last_active":"2024-09-07T03:32:50.273099+0000","last_peered":"2024-09-07T03:32:50.273099+0000","last_clean":"2024-09-07T03:32:50.273099+0000","last_became_active":"2024-09-07T03:32:18.124641+0000","last_became_peered":"2024-09-07T03:32:18.124641+0000","last_unstale":"2024-09-07T03:32:50.273099+0000","last_undegraded":"2024-09-07T03:32:50.273099+0000","last_fullsized":"2024-09-07T03:32:50.273099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:36:49.839182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.544102+0000","last_change":"2024-09-07T03:32:20.149232+0000","last_active":"2024-09-07T03:35:30.544102+0000","last_peered":"2024-09-07T03:35:30.544102+0000","last_clean":"2024-09-07T03:35:30.544102+0000","last_became_active":"2024-09-07T03:32:20.148768+0000","last_became_peered":"2024-09-07T03:32:20.148768+0000","last_unstale":"2024-09-07T03:35:30.544102+0000","last_undegraded":"2024-09-07T03:35:30.544102+0000","last_fullsized":"2024-09-07T03:35:30.544102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:15:20.986169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470656+0000","last_change":"2024-09-07T03:32:22.148714+0000","last_active":"2024-09-07T03:32:50.470656+0000","last_peered":"2024-09-07T03:32:50.470656+0000","last_clean":"2024-09-07T03:32:50.470656+0000","last_became_active":"2024-09-07T03:32:22.148444+0000","last_became_peered":"2024-09-07T03:32:22.148444+0000","last_unstale":"2024-09-07T03:32:50.470656+0000","last_undegraded":"2024-09-07T03:32:50.470656+0000","last_fullsized":"2024-09-07T03:32:50.470656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:23.271638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'10","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.115335+0000","last_change":"2024-09-07T03:35:43.115335+0000","last_active":"2024-09-07T03:35:43.115335+0000","last_peered":"2024-09-07T03:35:43.115335+0000","last_clean":"2024-09-07T03:35:43.115335+0000","last_became_active":"2024-09-07T03:32:14.113077+0000","last_became_peered":"2024-09-07T03:32:14.113077+0000","last_unstale":"2024-09-07T03:35:43.115335+0000","last_undegraded":"2024-09-07T03:35:43.115335+0000","last_fullsized":"2024-09-07T03:35:43.115335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:43.115240+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:43.115240+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.115240+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:13:08.170005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.154058+0000","last_change":"2024-09-07T03:35:38.154058+0000","last_active":"2024-09-07T03:35:38.154058+0000","last_peered":"2024-09-07T03:35:38.154058+0000","last_clean":"2024-09-07T03:35:38.154058+0000","last_became_active":"2024-09-07T03:32:12.124398+0000","last_became_peered":"2024-09-07T03:32:12.124398+0000","last_unstale":"2024-09-07T03:35:38.154058+0000","last_undegraded":"2024-09-07T03:35:38.154058+0000","last_fullsized":"2024-09-07T03:35:38.154058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:38.153969+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:38.153969+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.153969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:07:56.086318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.014826+0000","last_change":"2024-09-07T03:35:38.014826+0000","last_active":"2024-09-07T03:35:38.014826+0000","last_peered":"2024-09-07T03:35:38.014826+0000","last_clean":"2024-09-07T03:35:38.014826+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:35:38.014826+0000","last_undegraded":"2024-09-07T03:35:38.014826+0000","last_fullsized":"2024-09-07T03:35:38.014826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.014735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.014735+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.014735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:41.966197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273091+0000","last_change":"2024-09-07T03:32:16.130854+0000","last_active":"2024-09-07T03:32:50.273091+0000","last_peered":"2024-09-07T03:32:50.273091+0000","last_clean":"2024-09-07T03:32:50.273091+0000","last_became_active":"2024-09-07T03:32:16.130091+0000","last_became_peered":"2024-09-07T03:32:16.130091+0000","last_unstale":"2024-09-07T03:32:50.273091+0000","last_undegraded":"2024-09-07T03:32:50.273091+0000","last_fullsized":"2024-09-07T03:32:50.273091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:44:20.097492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.692496+0000","last_change":"2024-09-07T03:32:18.132376+0000","last_active":"2024-09-07T03:35:30.692496+0000","last_peered":"2024-09-07T03:35:30.692496+0000","last_clean":"2024-09-07T03:35:30.692496+0000","last_became_active":"2024-09-07T03:32:18.132111+0000","last_became_peered":"2024-09-07T03:32:18.132111+0000","last_unstale":"2024-09-07T03:35:30.692496+0000","last_undegraded":"2024-09-07T03:35:30.692496+0000","last_fullsized":"2024-09-07T03:35:30.692496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:25.201374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272816+0000","last_change":"2024-09-07T03:32:20.143405+0000","last_active":"2024-09-07T03:32:50.272816+0000","last_peered":"2024-09-07T03:32:50.272816+0000","last_clean":"2024-09-07T03:32:50.272816+0000","last_became_active":"2024-09-07T03:32:20.143072+0000","last_became_peered":"2024-09-07T03:32:20.143072+0000","last_unstale":"2024-09-07T03:32:50.272816+0000","last_undegraded":"2024-09-07T03:32:50.272816+0000","last_fullsized":"2024-09-07T03:32:50.272816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:35:06.275781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276617+0000","last_change":"2024-09-07T03:32:22.139462+0000","last_active":"2024-09-07T03:32:50.276617+0000","last_peered":"2024-09-07T03:32:50.276617+0000","last_clean":"2024-09-07T03:32:50.276617+0000","last_became_active":"2024-09-07T03:32:22.139150+0000","last_became_peered":"2024-09-07T03:32:22.139150+0000","last_unstale":"2024-09-07T03:32:50.276617+0000","last_undegraded":"2024-09-07T03:32:50.276617+0000","last_fullsized":"2024-09-07T03:32:50.276617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:16:29.302047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275974+0000","last_change":"2024-09-07T03:32:22.138596+0000","last_active":"2024-09-07T03:32:50.275974+0000","last_peered":"2024-09-07T03:32:50.275974+0000","last_clean":"2024-09-07T03:32:50.275974+0000","last_became_active":"2024-09-07T03:32:22.138315+0000","last_became_peered":"2024-09-07T03:32:22.138315+0000","last_unstale":"2024-09-07T03:32:50.275974+0000","last_undegraded":"2024-09-07T03:32:50.275974+0000","last_fullsized":"2024-09-07T03:32:50.275974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:54:59.992625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.048117+0000","last_change":"2024-09-07T03:35:51.048117+0000","last_active":"2024-09-07T03:35:51.048117+0000","last_peered":"2024-09-07T03:35:51.048117+0000","last_clean":"2024-09-07T03:35:51.048117+0000","last_became_active":"2024-09-07T03:32:14.112744+0000","last_became_peered":"2024-09-07T03:32:14.112744+0000","last_unstale":"2024-09-07T03:35:51.048117+0000","last_undegraded":"2024-09-07T03:35:51.048117+0000","last_fullsized":"2024-09-07T03:35:51.048117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:51.047998+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:51.047998+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.047998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:02.216514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'5","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.016566+0000","last_change":"2024-09-07T03:35:48.016566+0000","last_active":"2024-09-07T03:35:48.016566+0000","last_peered":"2024-09-07T03:35:48.016566+0000","last_clean":"2024-09-07T03:35:48.016566+0000","last_became_active":"2024-09-07T03:32:12.132715+0000","last_became_peered":"2024-09-07T03:32:12.132715+0000","last_unstale":"2024-09-07T03:35:48.016566+0000","last_undegraded":"2024-09-07T03:35:48.016566+0000","last_fullsized":"2024-09-07T03:35:48.016566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-07T03:35:48.016483+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-07T03:35:48.016483+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.016483+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:57:37.498255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.325231+0000","last_change":"2024-09-07T03:36:10.325231+0000","last_active":"2024-09-07T03:36:10.325231+0000","last_peered":"2024-09-07T03:36:10.325231+0000","last_clean":"2024-09-07T03:36:10.325231+0000","last_became_active":"2024-09-07T03:32:16.124681+0000","last_became_peered":"2024-09-07T03:32:16.124681+0000","last_unstale":"2024-09-07T03:36:10.325231+0000","last_undegraded":"2024-09-07T03:36:10.325231+0000","last_fullsized":"2024-09-07T03:36:10.325231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:10.325144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:10.325144+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.325144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:15:29.763693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'42","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.603642+0000","last_change":"2024-09-07T03:32:18.134183+0000","last_active":"2024-09-07T03:35:30.603642+0000","last_peered":"2024-09-07T03:35:30.603642+0000","last_clean":"2024-09-07T03:35:30.603642+0000","last_became_active":"2024-09-07T03:32:18.133844+0000","last_became_peered":"2024-09-07T03:32:18.133844+0000","last_unstale":"2024-09-07T03:35:30.603642+0000","last_undegraded":"2024-09-07T03:35:30.603642+0000","last_fullsized":"2024-09-07T03:35:30.603642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:10:39.060137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271616+0000","last_change":"2024-09-07T03:32:20.149175+0000","last_active":"2024-09-07T03:32:50.271616+0000","last_peered":"2024-09-07T03:32:50.271616+0000","last_clean":"2024-09-07T03:32:50.271616+0000","last_became_active":"2024-09-07T03:32:20.148900+0000","last_became_peered":"2024-09-07T03:32:20.148900+0000","last_unstale":"2024-09-07T03:32:50.271616+0000","last_undegraded":"2024-09-07T03:32:50.271616+0000","last_fullsized":"2024-09-07T03:32:50.271616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:25.130015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:20.895399+0000","last_change":"2024-09-07T03:32:22.150451+0000","last_active":"2024-09-07T03:34:20.895399+0000","last_peered":"2024-09-07T03:34:20.895399+0000","last_clean":"2024-09-07T03:34:20.895399+0000","last_became_active":"2024-09-07T03:32:22.150168+0000","last_became_peered":"2024-09-07T03:32:22.150168+0000","last_unstale":"2024-09-07T03:34:20.895399+0000","last_undegraded":"2024-09-07T03:34:20.895399+0000","last_fullsized":"2024-09-07T03:34:20.895399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:01:52.113292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.127642+0000","last_change":"2024-09-07T03:35:55.127642+0000","last_active":"2024-09-07T03:35:55.127642+0000","last_peered":"2024-09-07T03:35:55.127642+0000","last_clean":"2024-09-07T03:35:55.127642+0000","last_became_active":"2024-09-07T03:32:14.111499+0000","last_became_peered":"2024-09-07T03:32:14.111499+0000","last_unstale":"2024-09-07T03:35:55.127642+0000","last_undegraded":"2024-09-07T03:35:55.127642+0000","last_fullsized":"2024-09-07T03:35:55.127642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:55.127521+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:55.127521+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.127521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:49:35.128217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.155440+0000","last_change":"2024-09-07T03:35:38.155440+0000","last_active":"2024-09-07T03:35:38.155440+0000","last_peered":"2024-09-07T03:35:38.155440+0000","last_clean":"2024-09-07T03:35:38.155440+0000","last_became_active":"2024-09-07T03:32:12.128737+0000","last_became_peered":"2024-09-07T03:32:12.128737+0000","last_unstale":"2024-09-07T03:35:38.155440+0000","last_undegraded":"2024-09-07T03:35:38.155440+0000","last_fullsized":"2024-09-07T03:35:38.155440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.155355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.155355+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.155355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:27.815801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272857+0000","last_change":"2024-09-07T03:32:16.125714+0000","last_active":"2024-09-07T03:32:50.272857+0000","last_peered":"2024-09-07T03:32:50.272857+0000","last_clean":"2024-09-07T03:32:50.272857+0000","last_became_active":"2024-09-07T03:32:16.125418+0000","last_became_peered":"2024-09-07T03:32:16.125418+0000","last_unstale":"2024-09-07T03:32:50.272857+0000","last_undegraded":"2024-09-07T03:32:50.272857+0000","last_fullsized":"2024-09-07T03:32:50.272857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:50:42.403817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:22.992476+0000","last_change":"2024-09-07T03:32:18.134208+0000","last_active":"2024-09-07T03:35:22.992476+0000","last_peered":"2024-09-07T03:35:22.992476+0000","last_clean":"2024-09-07T03:35:22.992476+0000","last_became_active":"2024-09-07T03:32:18.133770+0000","last_became_peered":"2024-09-07T03:32:18.133770+0000","last_unstale":"2024-09-07T03:35:22.992476+0000","last_undegraded":"2024-09-07T03:35:22.992476+0000","last_fullsized":"2024-09-07T03:35:22.992476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:01:16.182582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276619+0000","last_change":"2024-09-07T03:32:20.142736+0000","last_active":"2024-09-07T03:32:50.276619+0000","last_peered":"2024-09-07T03:32:50.276619+0000","last_clean":"2024-09-07T03:32:50.276619+0000","last_became_active":"2024-09-07T03:32:20.140729+0000","last_became_peered":"2024-09-07T03:32:20.140729+0000","last_unstale":"2024-09-07T03:32:50.276619+0000","last_undegraded":"2024-09-07T03:32:50.276619+0000","last_fullsized":"2024-09-07T03:32:50.276619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:48:10.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471241+0000","last_change":"2024-09-07T03:32:22.147660+0000","last_active":"2024-09-07T03:32:50.471241+0000","last_peered":"2024-09-07T03:32:50.471241+0000","last_clean":"2024-09-07T03:32:50.471241+0000","last_became_active":"2024-09-07T03:32:22.147374+0000","last_became_peered":"2024-09-07T03:32:22.147374+0000","last_unstale":"2024-09-07T03:32:50.471241+0000","last_undegraded":"2024-09-07T03:32:50.471241+0000","last_fullsized":"2024-09-07T03:32:50.471241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:06.728131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:00.038805+0000","last_change":"2024-09-07T03:36:00.038805+0000","last_active":"2024-09-07T03:36:00.038805+0000","last_peered":"2024-09-07T03:36:00.038805+0000","last_clean":"2024-09-07T03:36:00.038805+0000","last_became_active":"2024-09-07T03:32:14.123172+0000","last_became_peered":"2024-09-07T03:32:14.123172+0000","last_unstale":"2024-09-07T03:36:00.038805+0000","last_undegraded":"2024-09-07T03:36:00.038805+0000","last_fullsized":"2024-09-07T03:36:00.038805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:00.038722+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:00.038722+0000","last_clean_scrub_stamp":"2024-09-07T03:36:00.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:18:27.231373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.019482+0000","last_change":"2024-09-07T03:35:49.019482+0000","last_active":"2024-09-07T03:35:49.019482+0000","last_peered":"2024-09-07T03:35:49.019482+0000","last_clean":"2024-09-07T03:35:49.019482+0000","last_became_active":"2024-09-07T03:32:12.124180+0000","last_became_peered":"2024-09-07T03:32:12.124180+0000","last_unstale":"2024-09-07T03:35:49.019482+0000","last_undegraded":"2024-09-07T03:35:49.019482+0000","last_fullsized":"2024-09-07T03:35:49.019482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:49.019399+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:49.019399+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.019399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:20.661216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.277690+0000","last_change":"2024-09-07T03:32:16.124337+0000","last_active":"2024-09-07T03:32:50.277690+0000","last_peered":"2024-09-07T03:32:50.277690+0000","last_clean":"2024-09-07T03:32:50.277690+0000","last_became_active":"2024-09-07T03:32:16.123695+0000","last_became_peered":"2024-09-07T03:32:16.123695+0000","last_unstale":"2024-09-07T03:32:50.277690+0000","last_undegraded":"2024-09-07T03:32:50.277690+0000","last_fullsized":"2024-09-07T03:32:50.277690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:12:34.370044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'44","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.677944+0000","last_change":"2024-09-07T03:32:18.129794+0000","last_active":"2024-09-07T03:35:30.677944+0000","last_peered":"2024-09-07T03:35:30.677944+0000","last_clean":"2024-09-07T03:35:30.677944+0000","last_became_active":"2024-09-07T03:32:18.129502+0000","last_became_peered":"2024-09-07T03:32:18.129502+0000","last_unstale":"2024-09-07T03:35:30.677944+0000","last_undegraded":"2024-09-07T03:35:30.677944+0000","last_fullsized":"2024-09-07T03:35:30.677944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:35:55.771599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470189+0000","last_change":"2024-09-07T03:32:20.147965+0000","last_active":"2024-09-07T03:32:50.470189+0000","last_peered":"2024-09-07T03:32:50.470189+0000","last_clean":"2024-09-07T03:32:50.470189+0000","last_became_active":"2024-09-07T03:32:20.147588+0000","last_became_peered":"2024-09-07T03:32:20.147588+0000","last_unstale":"2024-09-07T03:32:50.470189+0000","last_undegraded":"2024-09-07T03:32:50.470189+0000","last_fullsized":"2024-09-07T03:32:50.470189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:33:20.522441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.433021+0000","last_change":"2024-09-07T03:32:22.146381+0000","last_active":"2024-09-07T03:34:19.433021+0000","last_peered":"2024-09-07T03:34:19.433021+0000","last_clean":"2024-09-07T03:34:19.433021+0000","last_became_active":"2024-09-07T03:32:22.146106+0000","last_became_peered":"2024-09-07T03:32:22.146106+0000","last_unstale":"2024-09-07T03:34:19.433021+0000","last_undegraded":"2024-09-07T03:34:19.433021+0000","last_fullsized":"2024-09-07T03:34:19.433021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:05:28.655126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.081325+0000","last_change":"2024-09-07T03:36:01.081325+0000","last_active":"2024-09-07T03:36:01.081325+0000","last_peered":"2024-09-07T03:36:01.081325+0000","last_clean":"2024-09-07T03:36:01.081325+0000","last_became_active":"2024-09-07T03:32:14.127334+0000","last_became_peered":"2024-09-07T03:32:14.127334+0000","last_unstale":"2024-09-07T03:36:01.081325+0000","last_undegraded":"2024-09-07T03:36:01.081325+0000","last_fullsized":"2024-09-07T03:36:01.081325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:01.081243+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:01.081243+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.081243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:05:10.149352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.177120+0000","last_change":"2024-09-07T03:35:45.177120+0000","last_active":"2024-09-07T03:35:45.177120+0000","last_peered":"2024-09-07T03:35:45.177120+0000","last_clean":"2024-09-07T03:35:45.177120+0000","last_became_active":"2024-09-07T03:32:12.134823+0000","last_became_peered":"2024-09-07T03:32:12.134823+0000","last_unstale":"2024-09-07T03:35:45.177120+0000","last_undegraded":"2024-09-07T03:35:45.177120+0000","last_fullsized":"2024-09-07T03:35:45.177120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:45.177031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:45.177031+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.177031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:35:01.639248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271764+0000","last_change":"2024-09-07T03:32:16.127981+0000","last_active":"2024-09-07T03:32:50.271764+0000","last_peered":"2024-09-07T03:32:50.271764+0000","last_clean":"2024-09-07T03:32:50.271764+0000","last_became_active":"2024-09-07T03:32:16.127615+0000","last_became_peered":"2024-09-07T03:32:16.127615+0000","last_unstale":"2024-09-07T03:32:50.271764+0000","last_undegraded":"2024-09-07T03:32:50.271764+0000","last_fullsized":"2024-09-07T03:32:50.271764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:04.434836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'35","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.669249+0000","last_change":"2024-09-07T03:32:18.130169+0000","last_active":"2024-09-07T03:35:30.669249+0000","last_peered":"2024-09-07T03:35:30.669249+0000","last_clean":"2024-09-07T03:35:30.669249+0000","last_became_active":"2024-09-07T03:32:18.129919+0000","last_became_peered":"2024-09-07T03:32:18.129919+0000","last_unstale":"2024-09-07T03:35:30.669249+0000","last_undegraded":"2024-09-07T03:35:30.669249+0000","last_fullsized":"2024-09-07T03:35:30.669249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:36:09.015980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275040+0000","last_change":"2024-09-07T03:32:20.145306+0000","last_active":"2024-09-07T03:32:50.275040+0000","last_peered":"2024-09-07T03:32:50.275040+0000","last_clean":"2024-09-07T03:32:50.275040+0000","last_became_active":"2024-09-07T03:32:20.143640+0000","last_became_peered":"2024-09-07T03:32:20.143640+0000","last_unstale":"2024-09-07T03:32:50.275040+0000","last_undegraded":"2024-09-07T03:32:50.275040+0000","last_fullsized":"2024-09-07T03:32:50.275040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:24:26.189411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.013164+0000","last_change":"2024-09-07T03:36:03.013164+0000","last_active":"2024-09-07T03:36:03.013164+0000","last_peered":"2024-09-07T03:36:03.013164+0000","last_clean":"2024-09-07T03:36:03.013164+0000","last_became_active":"2024-09-07T03:32:14.123017+0000","last_became_peered":"2024-09-07T03:32:14.123017+0000","last_unstale":"2024-09-07T03:36:03.013164+0000","last_undegraded":"2024-09-07T03:36:03.013164+0000","last_fullsized":"2024-09-07T03:36:03.013164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:36:03.013063+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:36:03.013063+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.013063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:29:49.767075+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.017539+0000","last_change":"2024-09-07T03:35:41.017539+0000","last_active":"2024-09-07T03:35:41.017539+0000","last_peered":"2024-09-07T03:35:41.017539+0000","last_clean":"2024-09-07T03:35:41.017539+0000","last_became_active":"2024-09-07T03:32:12.143142+0000","last_became_peered":"2024-09-07T03:32:12.143142+0000","last_unstale":"2024-09-07T03:35:41.017539+0000","last_undegraded":"2024-09-07T03:35:41.017539+0000","last_fullsized":"2024-09-07T03:35:41.017539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.017443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.017443+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.017443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:02:36.762725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471726+0000","last_change":"2024-09-07T03:32:16.124471+0000","last_active":"2024-09-07T03:32:50.471726+0000","last_peered":"2024-09-07T03:32:50.471726+0000","last_clean":"2024-09-07T03:32:50.471726+0000","last_became_active":"2024-09-07T03:32:16.124188+0000","last_became_peered":"2024-09-07T03:32:16.124188+0000","last_unstale":"2024-09-07T03:32:50.471726+0000","last_undegraded":"2024-09-07T03:32:50.471726+0000","last_fullsized":"2024-09-07T03:32:50.471726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:01:20.601144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'66","reported_seq":137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.657676+0000","last_change":"2024-09-07T03:32:18.127241+0000","last_active":"2024-09-07T03:35:30.657676+0000","last_peered":"2024-09-07T03:35:30.657676+0000","last_clean":"2024-09-07T03:35:30.657676+0000","last_became_active":"2024-09-07T03:32:18.126946+0000","last_became_peered":"2024-09-07T03:32:18.126946+0000","last_unstale":"2024-09-07T03:35:30.657676+0000","last_undegraded":"2024-09-07T03:35:30.657676+0000","last_fullsized":"2024-09-07T03:35:30.657676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:12:23.096494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275569+0000","last_change":"2024-09-07T03:32:20.144697+0000","last_active":"2024-09-07T03:32:50.275569+0000","last_peered":"2024-09-07T03:32:50.275569+0000","last_clean":"2024-09-07T03:32:50.275569+0000","last_became_active":"2024-09-07T03:32:20.144417+0000","last_became_peered":"2024-09-07T03:32:20.144417+0000","last_unstale":"2024-09-07T03:32:50.275569+0000","last_undegraded":"2024-09-07T03:32:50.275569+0000","last_fullsized":"2024-09-07T03:32:50.275569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:37:54.709062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'16","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.592808+0000","last_change":"2024-09-07T03:32:22.149726+0000","last_active":"2024-09-07T03:35:23.592808+0000","last_peered":"2024-09-07T03:35:23.592808+0000","last_clean":"2024-09-07T03:35:23.592808+0000","last_became_active":"2024-09-07T03:32:22.149442+0000","last_became_peered":"2024-09-07T03:32:22.149442+0000","last_unstale":"2024-09-07T03:35:23.592808+0000","last_undegraded":"2024-09-07T03:35:23.592808+0000","last_fullsized":"2024-09-07T03:35:23.592808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:25.687323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.171719+0000","last_change":"2024-09-07T03:35:56.171662+0000","last_active":"2024-09-07T03:35:56.171719+0000","last_peered":"2024-09-07T03:35:56.171719+0000","last_clean":"2024-09-07T03:35:56.171719+0000","last_became_active":"2024-09-07T03:32:14.111795+0000","last_became_peered":"2024-09-07T03:32:14.111795+0000","last_unstale":"2024-09-07T03:35:56.171719+0000","last_undegraded":"2024-09-07T03:35:56.171719+0000","last_fullsized":"2024-09-07T03:35:56.171719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:56.171585+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:56.171585+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.171585+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:20.317653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.150563+0000","last_change":"2024-09-07T03:35:41.150563+0000","last_active":"2024-09-07T03:35:41.150563+0000","last_peered":"2024-09-07T03:35:41.150563+0000","last_clean":"2024-09-07T03:35:41.150563+0000","last_became_active":"2024-09-07T03:32:12.136258+0000","last_became_peered":"2024-09-07T03:32:12.136258+0000","last_unstale":"2024-09-07T03:35:41.150563+0000","last_undegraded":"2024-09-07T03:35:41.150563+0000","last_fullsized":"2024-09-07T03:35:41.150563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.150478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.150478+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.150478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.517403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.281863+0000","last_change":"2024-09-07T03:32:16.122569+0000","last_active":"2024-09-07T03:32:50.281863+0000","last_peered":"2024-09-07T03:32:50.281863+0000","last_clean":"2024-09-07T03:32:50.281863+0000","last_became_active":"2024-09-07T03:32:16.122316+0000","last_became_peered":"2024-09-07T03:32:16.122316+0000","last_unstale":"2024-09-07T03:32:50.281863+0000","last_undegraded":"2024-09-07T03:32:50.281863+0000","last_fullsized":"2024-09-07T03:32:50.281863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:09:15.334063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.672169+0000","last_change":"2024-09-07T03:32:18.132401+0000","last_active":"2024-09-07T03:35:30.672169+0000","last_peered":"2024-09-07T03:35:30.672169+0000","last_clean":"2024-09-07T03:35:30.672169+0000","last_became_active":"2024-09-07T03:32:18.132084+0000","last_became_peered":"2024-09-07T03:32:18.132084+0000","last_unstale":"2024-09-07T03:35:30.672169+0000","last_undegraded":"2024-09-07T03:35:30.672169+0000","last_fullsized":"2024-09-07T03:35:30.672169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:21:08.328913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471012+0000","last_change":"2024-09-07T03:32:20.143643+0000","last_active":"2024-09-07T03:32:50.471012+0000","last_peered":"2024-09-07T03:32:50.471012+0000","last_clean":"2024-09-07T03:32:50.471012+0000","last_became_active":"2024-09-07T03:32:20.143377+0000","last_became_peered":"2024-09-07T03:32:20.143377+0000","last_unstale":"2024-09-07T03:32:50.471012+0000","last_undegraded":"2024-09-07T03:32:50.471012+0000","last_fullsized":"2024-09-07T03:32:50.471012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:11.431453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278297+0000","last_change":"2024-09-07T03:32:22.146527+0000","last_active":"2024-09-07T03:32:50.278297+0000","last_peered":"2024-09-07T03:32:50.278297+0000","last_clean":"2024-09-07T03:32:50.278297+0000","last_became_active":"2024-09-07T03:32:22.146237+0000","last_became_peered":"2024-09-07T03:32:22.146237+0000","last_unstale":"2024-09-07T03:32:50.278297+0000","last_undegraded":"2024-09-07T03:32:50.278297+0000","last_fullsized":"2024-09-07T03:32:50.278297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:13:05.478773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.068178+0000","last_change":"2024-09-07T03:36:07.068178+0000","last_active":"2024-09-07T03:36:07.068178+0000","last_peered":"2024-09-07T03:36:07.068178+0000","last_clean":"2024-09-07T03:36:07.068178+0000","last_became_active":"2024-09-07T03:32:14.125706+0000","last_became_peered":"2024-09-07T03:32:14.125706+0000","last_unstale":"2024-09-07T03:36:07.068178+0000","last_undegraded":"2024-09-07T03:36:07.068178+0000","last_fullsized":"2024-09-07T03:36:07.068178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:07.068080+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:07.068080+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.068080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:12:24.604557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.051788+0000","last_change":"2024-09-07T03:35:51.051788+0000","last_active":"2024-09-07T03:35:51.051788+0000","last_peered":"2024-09-07T03:35:51.051788+0000","last_clean":"2024-09-07T03:35:51.051788+0000","last_became_active":"2024-09-07T03:32:12.125261+0000","last_became_peered":"2024-09-07T03:32:12.125261+0000","last_unstale":"2024-09-07T03:35:51.051788+0000","last_undegraded":"2024-09-07T03:35:51.051788+0000","last_fullsized":"2024-09-07T03:35:51.051788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:51.051700+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:51.051700+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.051700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:26:24.675430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280234+0000","last_change":"2024-09-07T03:32:16.124615+0000","last_active":"2024-09-07T03:32:50.280234+0000","last_peered":"2024-09-07T03:32:50.280234+0000","last_clean":"2024-09-07T03:32:50.280234+0000","last_became_active":"2024-09-07T03:32:16.124314+0000","last_became_peered":"2024-09-07T03:32:16.124314+0000","last_unstale":"2024-09-07T03:32:50.280234+0000","last_undegraded":"2024-09-07T03:32:50.280234+0000","last_fullsized":"2024-09-07T03:32:50.280234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:44:43.059235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'41","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.616251+0000","last_change":"2024-09-07T03:32:18.129996+0000","last_active":"2024-09-07T03:35:30.616251+0000","last_peered":"2024-09-07T03:35:30.616251+0000","last_clean":"2024-09-07T03:35:30.616251+0000","last_became_active":"2024-09-07T03:32:18.129700+0000","last_became_peered":"2024-09-07T03:32:18.129700+0000","last_unstale":"2024-09-07T03:35:30.616251+0000","last_undegraded":"2024-09-07T03:35:30.616251+0000","last_fullsized":"2024-09-07T03:35:30.616251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:38:03.778044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471615+0000","last_change":"2024-09-07T03:32:20.142983+0000","last_active":"2024-09-07T03:32:50.471615+0000","last_peered":"2024-09-07T03:32:50.471615+0000","last_clean":"2024-09-07T03:32:50.471615+0000","last_became_active":"2024-09-07T03:32:20.142695+0000","last_became_peered":"2024-09-07T03:32:20.142695+0000","last_unstale":"2024-09-07T03:32:50.471615+0000","last_undegraded":"2024-09-07T03:32:50.471615+0000","last_fullsized":"2024-09-07T03:32:50.471615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:47:29.846270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.959036+0000","last_change":"2024-09-07T03:32:22.143270+0000","last_active":"2024-09-07T03:34:22.959036+0000","last_peered":"2024-09-07T03:34:22.959036+0000","last_clean":"2024-09-07T03:34:22.959036+0000","last_became_active":"2024-09-07T03:32:22.143053+0000","last_became_peered":"2024-09-07T03:32:22.143053+0000","last_unstale":"2024-09-07T03:34:22.959036+0000","last_undegraded":"2024-09-07T03:34:22.959036+0000","last_fullsized":"2024-09-07T03:34:22.959036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:05:14.463803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.116308+0000","last_change":"2024-09-07T03:35:49.116308+0000","last_active":"2024-09-07T03:35:49.116308+0000","last_peered":"2024-09-07T03:35:49.116308+0000","last_clean":"2024-09-07T03:35:49.116308+0000","last_became_active":"2024-09-07T03:32:14.117608+0000","last_became_peered":"2024-09-07T03:32:14.117608+0000","last_unstale":"2024-09-07T03:35:49.116308+0000","last_undegraded":"2024-09-07T03:35:49.116308+0000","last_fullsized":"2024-09-07T03:35:49.116308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:49.116226+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:49.116226+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.116226+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:26.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.931398+0000","last_change":"2024-09-07T03:35:42.931398+0000","last_active":"2024-09-07T03:35:42.931398+0000","last_peered":"2024-09-07T03:35:42.931398+0000","last_clean":"2024-09-07T03:35:42.931398+0000","last_became_active":"2024-09-07T03:32:12.135523+0000","last_became_peered":"2024-09-07T03:32:12.135523+0000","last_unstale":"2024-09-07T03:35:42.931398+0000","last_undegraded":"2024-09-07T03:35:42.931398+0000","last_fullsized":"2024-09-07T03:35:42.931398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:42.931312+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:42.931312+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.931312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:46.882774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.074094+0000","last_change":"2024-09-07T03:36:07.074094+0000","last_active":"2024-09-07T03:36:07.074094+0000","last_peered":"2024-09-07T03:36:07.074094+0000","last_clean":"2024-09-07T03:36:07.074094+0000","last_became_active":"2024-09-07T03:32:50.279004+0000","last_became_peered":"2024-09-07T03:32:50.279004+0000","last_unstale":"2024-09-07T03:36:07.074094+0000","last_undegraded":"2024-09-07T03:36:07.074094+0000","last_fullsized":"2024-09-07T03:36:07.074094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:07.074012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:07.074012+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.074012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:24.180913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"34'18","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273667+0000","last_change":"2024-09-07T03:32:18.127389+0000","last_active":"2024-09-07T03:32:50.273667+0000","last_peered":"2024-09-07T03:32:50.273667+0000","last_clean":"2024-09-07T03:32:50.273667+0000","last_became_active":"2024-09-07T03:32:18.127007+0000","last_became_peered":"2024-09-07T03:32:18.127007+0000","last_unstale":"2024-09-07T03:32:50.273667+0000","last_undegraded":"2024-09-07T03:32:50.273667+0000","last_fullsized":"2024-09-07T03:32:50.273667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:32:04.955651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":370,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.536750+0000","last_change":"2024-09-07T03:32:20.147075+0000","last_active":"2024-09-07T03:35:30.536750+0000","last_peered":"2024-09-07T03:35:30.536750+0000","last_clean":"2024-09-07T03:35:30.536750+0000","last_became_active":"2024-09-07T03:32:20.146738+0000","last_became_peered":"2024-09-07T03:32:20.146738+0000","last_unstale":"2024-09-07T03:35:30.536750+0000","last_undegraded":"2024-09-07T03:35:30.536750+0000","last_fullsized":"2024-09-07T03:35:30.536750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:27:39.886530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.568340+0000","last_change":"2024-09-07T03:32:22.151158+0000","last_active":"2024-09-07T03:32:56.568340+0000","last_peered":"2024-09-07T03:32:56.568340+0000","last_clean":"2024-09-07T03:32:56.568340+0000","last_became_active":"2024-09-07T03:32:22.150886+0000","last_became_peered":"2024-09-07T03:32:22.150886+0000","last_unstale":"2024-09-07T03:32:56.568340+0000","last_undegraded":"2024-09-07T03:32:56.568340+0000","last_fullsized":"2024-09-07T03:32:56.568340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:57:06.666886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'18","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.057071+0000","last_change":"2024-09-07T03:35:53.057071+0000","last_active":"2024-09-07T03:35:53.057071+0000","last_peered":"2024-09-07T03:35:53.057071+0000","last_clean":"2024-09-07T03:35:53.057071+0000","last_became_active":"2024-09-07T03:32:14.126901+0000","last_became_peered":"2024-09-07T03:32:14.126901+0000","last_unstale":"2024-09-07T03:35:53.057071+0000","last_undegraded":"2024-09-07T03:35:53.057071+0000","last_fullsized":"2024-09-07T03:35:53.057071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-07T03:35:53.056989+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-07T03:35:53.056989+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.056989+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:48:19.164483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.209553+0000","last_change":"2024-09-07T03:35:44.209553+0000","last_active":"2024-09-07T03:35:44.209553+0000","last_peered":"2024-09-07T03:35:44.209553+0000","last_clean":"2024-09-07T03:35:44.209553+0000","last_became_active":"2024-09-07T03:32:12.133876+0000","last_became_peered":"2024-09-07T03:32:12.133876+0000","last_unstale":"2024-09-07T03:35:44.209553+0000","last_undegraded":"2024-09-07T03:35:44.209553+0000","last_fullsized":"2024-09-07T03:35:44.209553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.209464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.209464+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.209464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:02.025918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'1","reported_seq":221,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.512095+0000","last_change":"2024-09-07T03:32:16.122534+0000","last_active":"2024-09-07T03:35:30.512095+0000","last_peered":"2024-09-07T03:35:30.512095+0000","last_clean":"2024-09-07T03:35:30.512095+0000","last_became_active":"2024-09-07T03:32:16.120952+0000","last_became_peered":"2024-09-07T03:32:16.120952+0000","last_unstale":"2024-09-07T03:35:30.512095+0000","last_undegraded":"2024-09-07T03:35:30.512095+0000","last_fullsized":"2024-09-07T03:35:30.512095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:44:35.686701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'66","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.635641+0000","last_change":"2024-09-07T03:32:18.133969+0000","last_active":"2024-09-07T03:35:30.635641+0000","last_peered":"2024-09-07T03:35:30.635641+0000","last_clean":"2024-09-07T03:35:30.635641+0000","last_became_active":"2024-09-07T03:32:18.133705+0000","last_became_peered":"2024-09-07T03:32:18.133705+0000","last_unstale":"2024-09-07T03:35:30.635641+0000","last_undegraded":"2024-09-07T03:35:30.635641+0000","last_fullsized":"2024-09-07T03:35:30.635641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:02.433602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271613+0000","last_change":"2024-09-07T03:32:20.137011+0000","last_active":"2024-09-07T03:32:50.271613+0000","last_peered":"2024-09-07T03:32:50.271613+0000","last_clean":"2024-09-07T03:32:50.271613+0000","last_became_active":"2024-09-07T03:32:20.135211+0000","last_became_peered":"2024-09-07T03:32:20.135211+0000","last_unstale":"2024-09-07T03:32:50.271613+0000","last_undegraded":"2024-09-07T03:32:50.271613+0000","last_fullsized":"2024-09-07T03:32:50.271613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:33.033993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.028862+0000","last_change":"2024-09-07T03:32:22.141840+0000","last_active":"2024-09-07T03:32:57.028862+0000","last_peered":"2024-09-07T03:32:57.028862+0000","last_clean":"2024-09-07T03:32:57.028862+0000","last_became_active":"2024-09-07T03:32:22.141533+0000","last_became_peered":"2024-09-07T03:32:22.141533+0000","last_unstale":"2024-09-07T03:32:57.028862+0000","last_undegraded":"2024-09-07T03:32:57.028862+0000","last_fullsized":"2024-09-07T03:32:57.028862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:32:37.743868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'20","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.044148+0000","last_change":"2024-09-07T03:36:05.044148+0000","last_active":"2024-09-07T03:36:05.044148+0000","last_peered":"2024-09-07T03:36:05.044148+0000","last_clean":"2024-09-07T03:36:05.044148+0000","last_became_active":"2024-09-07T03:32:14.122929+0000","last_became_peered":"2024-09-07T03:32:14.122929+0000","last_unstale":"2024-09-07T03:36:05.044148+0000","last_undegraded":"2024-09-07T03:36:05.044148+0000","last_fullsized":"2024-09-07T03:36:05.044148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-07T03:36:05.044058+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-07T03:36:05.044058+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.044058+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:49.195578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.018984+0000","last_change":"2024-09-07T03:35:50.018984+0000","last_active":"2024-09-07T03:35:50.018984+0000","last_peered":"2024-09-07T03:35:50.018984+0000","last_clean":"2024-09-07T03:35:50.018984+0000","last_became_active":"2024-09-07T03:32:12.124610+0000","last_became_peered":"2024-09-07T03:32:12.124610+0000","last_unstale":"2024-09-07T03:35:50.018984+0000","last_undegraded":"2024-09-07T03:35:50.018984+0000","last_fullsized":"2024-09-07T03:35:50.018984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:50.018888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:50.018888+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.018888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:55.010719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278654+0000","last_change":"2024-09-07T03:32:16.116613+0000","last_active":"2024-09-07T03:32:50.278654+0000","last_peered":"2024-09-07T03:32:50.278654+0000","last_clean":"2024-09-07T03:32:50.278654+0000","last_became_active":"2024-09-07T03:32:16.116296+0000","last_became_peered":"2024-09-07T03:32:16.116296+0000","last_unstale":"2024-09-07T03:32:50.278654+0000","last_undegraded":"2024-09-07T03:32:50.278654+0000","last_fullsized":"2024-09-07T03:32:50.278654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:40:46.166456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'45","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.105865+0000","last_change":"2024-09-07T03:36:09.105865+0000","last_active":"2024-09-07T03:36:09.105865+0000","last_peered":"2024-09-07T03:36:09.105865+0000","last_clean":"2024-09-07T03:36:09.105865+0000","last_became_active":"2024-09-07T03:32:18.134533+0000","last_became_peered":"2024-09-07T03:32:18.134533+0000","last_unstale":"2024-09-07T03:36:09.105865+0000","last_undegraded":"2024-09-07T03:36:09.105865+0000","last_fullsized":"2024-09-07T03:36:09.105865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-07T03:36:09.105777+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-07T03:36:09.105777+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.105777+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:52:38.222360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278010+0000","last_change":"2024-09-07T03:32:20.146986+0000","last_active":"2024-09-07T03:32:50.278010+0000","last_peered":"2024-09-07T03:32:50.278010+0000","last_clean":"2024-09-07T03:32:50.278010+0000","last_became_active":"2024-09-07T03:32:20.146631+0000","last_became_peered":"2024-09-07T03:32:20.146631+0000","last_unstale":"2024-09-07T03:32:50.278010+0000","last_undegraded":"2024-09-07T03:32:50.278010+0000","last_fullsized":"2024-09-07T03:32:50.278010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:56.243102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275464+0000","last_change":"2024-09-07T03:32:22.152021+0000","last_active":"2024-09-07T03:32:50.275464+0000","last_peered":"2024-09-07T03:32:50.275464+0000","last_clean":"2024-09-07T03:32:50.275464+0000","last_became_active":"2024-09-07T03:32:22.151709+0000","last_became_peered":"2024-09-07T03:32:22.151709+0000","last_unstale":"2024-09-07T03:32:50.275464+0000","last_undegraded":"2024-09-07T03:32:50.275464+0000","last_fullsized":"2024-09-07T03:32:50.275464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:01.162547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.091041+0000","last_change":"2024-09-07T03:36:05.091041+0000","last_active":"2024-09-07T03:36:05.091041+0000","last_peered":"2024-09-07T03:36:05.091041+0000","last_clean":"2024-09-07T03:36:05.091041+0000","last_became_active":"2024-09-07T03:32:14.127451+0000","last_became_peered":"2024-09-07T03:32:14.127451+0000","last_unstale":"2024-09-07T03:36:05.091041+0000","last_undegraded":"2024-09-07T03:36:05.091041+0000","last_fullsized":"2024-09-07T03:36:05.091041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:05.090946+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:05.090946+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.090946+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:25.001951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.970246+0000","last_change":"2024-09-07T03:35:41.970187+0000","last_active":"2024-09-07T03:35:41.970246+0000","last_peered":"2024-09-07T03:35:41.970246+0000","last_clean":"2024-09-07T03:35:41.970246+0000","last_became_active":"2024-09-07T03:32:12.124552+0000","last_became_peered":"2024-09-07T03:32:12.124552+0000","last_unstale":"2024-09-07T03:35:41.970246+0000","last_undegraded":"2024-09-07T03:35:41.970246+0000","last_fullsized":"2024-09-07T03:35:41.970246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.970083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.970083+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.970083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:38:37.531358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.469800+0000","last_change":"2024-09-07T03:32:16.125669+0000","last_active":"2024-09-07T03:32:50.469800+0000","last_peered":"2024-09-07T03:32:50.469800+0000","last_clean":"2024-09-07T03:32:50.469800+0000","last_became_active":"2024-09-07T03:32:16.123423+0000","last_became_peered":"2024-09-07T03:32:16.123423+0000","last_unstale":"2024-09-07T03:32:50.469800+0000","last_undegraded":"2024-09-07T03:32:50.469800+0000","last_fullsized":"2024-09-07T03:32:50.469800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:15.098110+0000","last_clean_scrub_stamp":"2024-09-07T03:32:15.098110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:06:37.923895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'35","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.610398+0000","last_change":"2024-09-07T03:32:18.129106+0000","last_active":"2024-09-07T03:35:30.610398+0000","last_peered":"2024-09-07T03:35:30.610398+0000","last_clean":"2024-09-07T03:35:30.610398+0000","last_became_active":"2024-09-07T03:32:18.128812+0000","last_became_peered":"2024-09-07T03:32:18.128812+0000","last_unstale":"2024-09-07T03:35:30.610398+0000","last_undegraded":"2024-09-07T03:35:30.610398+0000","last_fullsized":"2024-09-07T03:35:30.610398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:51.897402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279344+0000","last_change":"2024-09-07T03:32:20.132779+0000","last_active":"2024-09-07T03:32:50.279344+0000","last_peered":"2024-09-07T03:32:50.279344+0000","last_clean":"2024-09-07T03:32:50.279344+0000","last_became_active":"2024-09-07T03:32:20.132396+0000","last_became_peered":"2024-09-07T03:32:20.132396+0000","last_unstale":"2024-09-07T03:32:50.279344+0000","last_undegraded":"2024-09-07T03:32:50.279344+0000","last_fullsized":"2024-09-07T03:32:50.279344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:29:30.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.210747+0000","last_change":"2024-09-07T03:32:22.152253+0000","last_active":"2024-09-07T03:34:21.210747+0000","last_peered":"2024-09-07T03:34:21.210747+0000","last_clean":"2024-09-07T03:34:21.210747+0000","last_became_active":"2024-09-07T03:32:22.151697+0000","last_became_peered":"2024-09-07T03:32:22.151697+0000","last_unstale":"2024-09-07T03:34:21.210747+0000","last_undegraded":"2024-09-07T03:34:21.210747+0000","last_fullsized":"2024-09-07T03:34:21.210747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:12:47.655977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.046264+0000","last_change":"2024-09-07T03:36:01.046264+0000","last_active":"2024-09-07T03:36:01.046264+0000","last_peered":"2024-09-07T03:36:01.046264+0000","last_clean":"2024-09-07T03:36:01.046264+0000","last_became_active":"2024-09-07T03:32:14.112336+0000","last_became_peered":"2024-09-07T03:32:14.112336+0000","last_unstale":"2024-09-07T03:36:01.046264+0000","last_undegraded":"2024-09-07T03:36:01.046264+0000","last_fullsized":"2024-09-07T03:36:01.046264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:01.046172+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:01.046172+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.046172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:13:46.940832+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.070310+0000","last_change":"2024-09-07T03:35:48.070310+0000","last_active":"2024-09-07T03:35:48.070310+0000","last_peered":"2024-09-07T03:35:48.070310+0000","last_clean":"2024-09-07T03:35:48.070310+0000","last_became_active":"2024-09-07T03:32:12.136020+0000","last_became_peered":"2024-09-07T03:32:12.136020+0000","last_unstale":"2024-09-07T03:35:48.070310+0000","last_undegraded":"2024-09-07T03:35:48.070310+0000","last_fullsized":"2024-09-07T03:35:48.070310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:48.070194+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:48.070194+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.070194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:06:09.533250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:12.289519+0000","last_change":"2024-09-07T03:36:12.289519+0000","last_active":"2024-09-07T03:36:12.289519+0000","last_peered":"2024-09-07T03:36:12.289519+0000","last_clean":"2024-09-07T03:36:12.289519+0000","last_became_active":"2024-09-07T03:32:16.129161+0000","last_became_peered":"2024-09-07T03:32:16.129161+0000","last_unstale":"2024-09-07T03:36:12.289519+0000","last_undegraded":"2024-09-07T03:36:12.289519+0000","last_fullsized":"2024-09-07T03:36:12.289519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:36:12.289436+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:36:12.289436+0000","last_clean_scrub_stamp":"2024-09-07T03:36:12.289436+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:48:15.876669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'48","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.619879+0000","last_change":"2024-09-07T03:32:18.132380+0000","last_active":"2024-09-07T03:35:30.619879+0000","last_peered":"2024-09-07T03:35:30.619879+0000","last_clean":"2024-09-07T03:35:30.619879+0000","last_became_active":"2024-09-07T03:32:18.132072+0000","last_became_peered":"2024-09-07T03:32:18.132072+0000","last_unstale":"2024-09-07T03:35:30.619879+0000","last_undegraded":"2024-09-07T03:35:30.619879+0000","last_fullsized":"2024-09-07T03:35:30.619879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:37.568436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.274904+0000","last_change":"2024-09-07T03:32:20.145649+0000","last_active":"2024-09-07T03:32:50.274904+0000","last_peered":"2024-09-07T03:32:50.274904+0000","last_clean":"2024-09-07T03:32:50.274904+0000","last_became_active":"2024-09-07T03:32:20.144977+0000","last_became_peered":"2024-09-07T03:32:20.144977+0000","last_unstale":"2024-09-07T03:32:50.274904+0000","last_undegraded":"2024-09-07T03:32:50.274904+0000","last_fullsized":"2024-09-07T03:32:50.274904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:56.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.213631+0000","last_change":"2024-09-07T03:32:22.141987+0000","last_active":"2024-09-07T03:34:21.213631+0000","last_peered":"2024-09-07T03:34:21.213631+0000","last_clean":"2024-09-07T03:34:21.213631+0000","last_became_active":"2024-09-07T03:32:22.141633+0000","last_became_peered":"2024-09-07T03:32:22.141633+0000","last_unstale":"2024-09-07T03:34:21.213631+0000","last_undegraded":"2024-09-07T03:34:21.213631+0000","last_fullsized":"2024-09-07T03:34:21.213631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:45.392294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'8","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.132708+0000","last_change":"2024-09-07T03:36:02.132708+0000","last_active":"2024-09-07T03:36:02.132708+0000","last_peered":"2024-09-07T03:36:02.132708+0000","last_clean":"2024-09-07T03:36:02.132708+0000","last_became_active":"2024-09-07T03:32:14.111950+0000","last_became_peered":"2024-09-07T03:32:14.111950+0000","last_unstale":"2024-09-07T03:36:02.132708+0000","last_undegraded":"2024-09-07T03:36:02.132708+0000","last_fullsized":"2024-09-07T03:36:02.132708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:02.132614+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:02.132614+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.132614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:45.086077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.115987+0000","last_change":"2024-09-07T03:35:37.115987+0000","last_active":"2024-09-07T03:35:37.115987+0000","last_peered":"2024-09-07T03:35:37.115987+0000","last_clean":"2024-09-07T03:35:37.115987+0000","last_became_active":"2024-09-07T03:32:12.132814+0000","last_became_peered":"2024-09-07T03:32:12.132814+0000","last_unstale":"2024-09-07T03:35:37.115987+0000","last_undegraded":"2024-09-07T03:35:37.115987+0000","last_fullsized":"2024-09-07T03:35:37.115987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.115869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.115869+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.115869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:47:45.209898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.152698+0000","last_change":"2024-09-07T03:35:58.152698+0000","last_active":"2024-09-07T03:35:58.152698+0000","last_peered":"2024-09-07T03:35:58.152698+0000","last_clean":"2024-09-07T03:35:58.152698+0000","last_became_active":"2024-09-07T03:32:14.114966+0000","last_became_peered":"2024-09-07T03:32:14.114966+0000","last_unstale":"2024-09-07T03:35:58.152698+0000","last_undegraded":"2024-09-07T03:35:58.152698+0000","last_fullsized":"2024-09-07T03:35:58.152698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:35:58.152588+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:35:58.152588+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.152588+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:25:57.639946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.132979+0000","last_change":"2024-09-07T03:35:39.132979+0000","last_active":"2024-09-07T03:35:39.132979+0000","last_peered":"2024-09-07T03:35:39.132979+0000","last_clean":"2024-09-07T03:35:39.132979+0000","last_became_active":"2024-09-07T03:32:12.132662+0000","last_became_peered":"2024-09-07T03:32:12.132662+0000","last_unstale":"2024-09-07T03:35:39.132979+0000","last_undegraded":"2024-09-07T03:35:39.132979+0000","last_fullsized":"2024-09-07T03:35:39.132979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:39.132883+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:39.132883+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.132883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:45:43.737374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'12","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.079643+0000","last_change":"2024-09-07T03:36:06.079643+0000","last_active":"2024-09-07T03:36:06.079643+0000","last_peered":"2024-09-07T03:36:06.079643+0000","last_clean":"2024-09-07T03:36:06.079643+0000","last_became_active":"2024-09-07T03:32:14.122301+0000","last_became_peered":"2024-09-07T03:32:14.122301+0000","last_unstale":"2024-09-07T03:36:06.079643+0000","last_undegraded":"2024-09-07T03:36:06.079643+0000","last_fullsized":"2024-09-07T03:36:06.079643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:36:06.079527+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:36:06.079527+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.079527+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:10:45.982132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.859938+0000","last_change":"2024-09-07T03:35:48.859938+0000","last_active":"2024-09-07T03:35:48.859938+0000","last_peered":"2024-09-07T03:35:48.859938+0000","last_clean":"2024-09-07T03:35:48.859938+0000","last_became_active":"2024-09-07T03:32:12.137561+0000","last_became_peered":"2024-09-07T03:32:12.137561+0000","last_unstale":"2024-09-07T03:35:48.859938+0000","last_undegraded":"2024-09-07T03:35:48.859938+0000","last_fullsized":"2024-09-07T03:35:48.859938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:48.859832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:48.859832+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.859832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:48:54.026056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:59.114219+0000","last_change":"2024-09-07T03:35:59.114219+0000","last_active":"2024-09-07T03:35:59.114219+0000","last_peered":"2024-09-07T03:35:59.114219+0000","last_clean":"2024-09-07T03:35:59.114219+0000","last_became_active":"2024-09-07T03:32:14.114055+0000","last_became_peered":"2024-09-07T03:32:14.114055+0000","last_unstale":"2024-09-07T03:35:59.114219+0000","last_undegraded":"2024-09-07T03:35:59.114219+0000","last_fullsized":"2024-09-07T03:35:59.114219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:59.114136+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:59.114136+0000","last_clean_scrub_stamp":"2024-09-07T03:35:59.114136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:46.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.117553+0000","last_change":"2024-09-07T03:35:40.117553+0000","last_active":"2024-09-07T03:35:40.117553+0000","last_peered":"2024-09-07T03:35:40.117553+0000","last_clean":"2024-09-07T03:35:40.117553+0000","last_became_active":"2024-09-07T03:32:12.132471+0000","last_became_peered":"2024-09-07T03:32:12.132471+0000","last_unstale":"2024-09-07T03:35:40.117553+0000","last_undegraded":"2024-09-07T03:35:40.117553+0000","last_fullsized":"2024-09-07T03:35:40.117553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.117422+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.117422+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.117422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:29:20.922622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"36'12","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.021206+0000","last_change":"2024-09-07T03:35:55.021206+0000","last_active":"2024-09-07T03:35:55.021206+0000","last_peered":"2024-09-07T03:35:55.021206+0000","last_clean":"2024-09-07T03:35:55.021206+0000","last_became_active":"2024-09-07T03:32:50.280656+0000","last_became_peered":"2024-09-07T03:32:50.280656+0000","last_unstale":"2024-09-07T03:35:55.021206+0000","last_undegraded":"2024-09-07T03:35:55.021206+0000","last_fullsized":"2024-09-07T03:35:55.021206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:55.021115+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:55.021115+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.021115+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:26:34.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.896274+0000","last_change":"2024-09-07T03:35:43.896274+0000","last_active":"2024-09-07T03:35:43.896274+0000","last_peered":"2024-09-07T03:35:43.896274+0000","last_clean":"2024-09-07T03:35:43.896274+0000","last_became_active":"2024-09-07T03:32:12.140393+0000","last_became_peered":"2024-09-07T03:32:12.140393+0000","last_unstale":"2024-09-07T03:35:43.896274+0000","last_undegraded":"2024-09-07T03:35:43.896274+0000","last_fullsized":"2024-09-07T03:35:43.896274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.896191+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.896191+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.896191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:06:33.074408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"36'10","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.166318+0000","last_change":"2024-09-07T03:35:57.166318+0000","last_active":"2024-09-07T03:35:57.166318+0000","last_peered":"2024-09-07T03:35:57.166318+0000","last_clean":"2024-09-07T03:35:57.166318+0000","last_became_active":"2024-09-07T03:32:14.113830+0000","last_became_peered":"2024-09-07T03:32:14.113830+0000","last_unstale":"2024-09-07T03:35:57.166318+0000","last_undegraded":"2024-09-07T03:35:57.166318+0000","last_fullsized":"2024-09-07T03:35:57.166318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:57.166234+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:57.166234+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.166234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:39:08.856653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.149266+0000","last_change":"2024-09-07T03:35:42.149266+0000","last_active":"2024-09-07T03:35:42.149266+0000","last_peered":"2024-09-07T03:35:42.149266+0000","last_clean":"2024-09-07T03:35:42.149266+0000","last_became_active":"2024-09-07T03:32:12.134287+0000","last_became_peered":"2024-09-07T03:32:12.134287+0000","last_unstale":"2024-09-07T03:35:42.149266+0000","last_undegraded":"2024-09-07T03:35:42.149266+0000","last_fullsized":"2024-09-07T03:35:42.149266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:42.149177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:42.149177+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.149177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:37:52.961968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.088917+0000","last_change":"2024-09-07T03:36:08.088917+0000","last_active":"2024-09-07T03:36:08.088917+0000","last_peered":"2024-09-07T03:36:08.088917+0000","last_clean":"2024-09-07T03:36:08.088917+0000","last_became_active":"2024-09-07T03:32:14.125990+0000","last_became_peered":"2024-09-07T03:32:14.125990+0000","last_unstale":"2024-09-07T03:36:08.088917+0000","last_undegraded":"2024-09-07T03:36:08.088917+0000","last_fullsized":"2024-09-07T03:36:08.088917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-07T03:36:08.088808+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-07T03:36:08.088808+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.088808+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:29:54.842821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.081766+0000","last_change":"2024-09-07T03:35:42.081766+0000","last_active":"2024-09-07T03:35:42.081766+0000","last_peered":"2024-09-07T03:35:42.081766+0000","last_clean":"2024-09-07T03:35:42.081766+0000","last_became_active":"2024-09-07T03:32:12.128807+0000","last_became_peered":"2024-09-07T03:32:12.128807+0000","last_unstale":"2024-09-07T03:35:42.081766+0000","last_undegraded":"2024-09-07T03:35:42.081766+0000","last_fullsized":"2024-09-07T03:35:42.081766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:42.081678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:42.081678+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.081678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:31:00.820127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.022570+0000","last_change":"2024-09-07T03:36:02.022570+0000","last_active":"2024-09-07T03:36:02.022570+0000","last_peered":"2024-09-07T03:36:02.022570+0000","last_clean":"2024-09-07T03:36:02.022570+0000","last_became_active":"2024-09-07T03:32:14.109799+0000","last_became_peered":"2024-09-07T03:32:14.109799+0000","last_unstale":"2024-09-07T03:36:02.022570+0000","last_undegraded":"2024-09-07T03:36:02.022570+0000","last_fullsized":"2024-09-07T03:36:02.022570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:36:02.022470+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:36:02.022470+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.022470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:00:09.783003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.877468+0000","last_change":"2024-09-07T03:35:44.877468+0000","last_active":"2024-09-07T03:35:44.877468+0000","last_peered":"2024-09-07T03:35:44.877468+0000","last_clean":"2024-09-07T03:35:44.877468+0000","last_became_active":"2024-09-07T03:32:12.130563+0000","last_became_peered":"2024-09-07T03:32:12.130563+0000","last_unstale":"2024-09-07T03:35:44.877468+0000","last_undegraded":"2024-09-07T03:35:44.877468+0000","last_fullsized":"2024-09-07T03:35:44.877468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.877377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.877377+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.877377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:28:27.432331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'8","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.159910+0000","last_change":"2024-09-07T03:36:03.159910+0000","last_active":"2024-09-07T03:36:03.159910+0000","last_peered":"2024-09-07T03:36:03.159910+0000","last_clean":"2024-09-07T03:36:03.159910+0000","last_became_active":"2024-09-07T03:32:14.115000+0000","last_became_peered":"2024-09-07T03:32:14.115000+0000","last_unstale":"2024-09-07T03:36:03.159910+0000","last_undegraded":"2024-09-07T03:36:03.159910+0000","last_fullsized":"2024-09-07T03:36:03.159910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:03.159816+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:03.159816+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.159816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:26.711029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.890896+0000","last_change":"2024-09-07T03:35:45.890896+0000","last_active":"2024-09-07T03:35:45.890896+0000","last_peered":"2024-09-07T03:35:45.890896+0000","last_clean":"2024-09-07T03:35:45.890896+0000","last_became_active":"2024-09-07T03:32:12.142315+0000","last_became_peered":"2024-09-07T03:32:12.142315+0000","last_unstale":"2024-09-07T03:35:45.890896+0000","last_undegraded":"2024-09-07T03:35:45.890896+0000","last_fullsized":"2024-09-07T03:35:45.890896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:45.890810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:45.890810+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.890810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:29:01.485471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.094544+0000","last_change":"2024-09-07T03:36:09.094544+0000","last_active":"2024-09-07T03:36:09.094544+0000","last_peered":"2024-09-07T03:36:09.094544+0000","last_clean":"2024-09-07T03:36:09.094544+0000","last_became_active":"2024-09-07T03:32:14.127560+0000","last_became_peered":"2024-09-07T03:32:14.127560+0000","last_unstale":"2024-09-07T03:36:09.094544+0000","last_undegraded":"2024-09-07T03:36:09.094544+0000","last_fullsized":"2024-09-07T03:36:09.094544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:09.094457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:09.094457+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.094457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:55:48.663875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.873531+0000","last_change":"2024-09-07T03:35:47.873531+0000","last_active":"2024-09-07T03:35:47.873531+0000","last_peered":"2024-09-07T03:35:47.873531+0000","last_clean":"2024-09-07T03:35:47.873531+0000","last_became_active":"2024-09-07T03:32:12.138745+0000","last_became_peered":"2024-09-07T03:32:12.138745+0000","last_unstale":"2024-09-07T03:35:47.873531+0000","last_undegraded":"2024-09-07T03:35:47.873531+0000","last_fullsized":"2024-09-07T03:35:47.873531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:47.873426+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:47.873426+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.873426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:54:29.688161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.055838+0000","last_change":"2024-09-07T03:35:52.055838+0000","last_active":"2024-09-07T03:35:52.055838+0000","last_peered":"2024-09-07T03:35:52.055838+0000","last_clean":"2024-09-07T03:35:52.055838+0000","last_became_active":"2024-09-07T03:32:14.122699+0000","last_became_peered":"2024-09-07T03:32:14.122699+0000","last_unstale":"2024-09-07T03:35:52.055838+0000","last_undegraded":"2024-09-07T03:35:52.055838+0000","last_fullsized":"2024-09-07T03:35:52.055838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:52.055707+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:52.055707+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.055707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:52:43.293149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.065851+0000","last_change":"2024-09-07T03:35:52.065851+0000","last_active":"2024-09-07T03:35:52.065851+0000","last_peered":"2024-09-07T03:35:52.065851+0000","last_clean":"2024-09-07T03:35:52.065851+0000","last_became_active":"2024-09-07T03:32:12.133145+0000","last_became_peered":"2024-09-07T03:32:12.133145+0000","last_unstale":"2024-09-07T03:35:52.065851+0000","last_undegraded":"2024-09-07T03:35:52.065851+0000","last_fullsized":"2024-09-07T03:35:52.065851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:52.065764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:52.065764+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.065764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:26:56.647887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"36'16","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.140944+0000","last_change":"2024-09-07T03:36:01.140944+0000","last_active":"2024-09-07T03:36:01.140944+0000","last_peered":"2024-09-07T03:36:01.140944+0000","last_clean":"2024-09-07T03:36:01.140944+0000","last_became_active":"2024-09-07T03:32:14.111759+0000","last_became_peered":"2024-09-07T03:32:14.111759+0000","last_unstale":"2024-09-07T03:36:01.140944+0000","last_undegraded":"2024-09-07T03:36:01.140944+0000","last_fullsized":"2024-09-07T03:36:01.140944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:36:01.140835+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:36:01.140835+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.140835+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:43:12.824330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":44,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.180733+0000","last_change":"2024-09-07T03:35:43.180733+0000","last_active":"2024-09-07T03:35:43.180733+0000","last_peered":"2024-09-07T03:35:43.180733+0000","last_clean":"2024-09-07T03:35:43.180733+0000","last_became_active":"2024-09-07T03:32:12.134151+0000","last_became_peered":"2024-09-07T03:32:12.134151+0000","last_unstale":"2024-09-07T03:35:43.180733+0000","last_undegraded":"2024-09-07T03:35:43.180733+0000","last_fullsized":"2024-09-07T03:35:43.180733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.180633+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.180633+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.180633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:50:19.691547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'30","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.063680+0000","last_change":"2024-09-07T03:36:08.063680+0000","last_active":"2024-09-07T03:36:08.063680+0000","last_peered":"2024-09-07T03:36:08.063680+0000","last_clean":"2024-09-07T03:36:08.063680+0000","last_became_active":"2024-09-07T03:32:14.124258+0000","last_became_peered":"2024-09-07T03:32:14.124258+0000","last_unstale":"2024-09-07T03:36:08.063680+0000","last_undegraded":"2024-09-07T03:36:08.063680+0000","last_fullsized":"2024-09-07T03:36:08.063680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-07T03:36:08.063566+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-07T03:36:08.063566+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.063566+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:42.604250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":111,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.921691+0000","last_change":"2024-09-07T03:35:46.921691+0000","last_active":"2024-09-07T03:35:46.921691+0000","last_peered":"2024-09-07T03:35:46.921691+0000","last_clean":"2024-09-07T03:35:46.921691+0000","last_became_active":"2024-09-07T03:32:12.140243+0000","last_became_peered":"2024-09-07T03:32:12.140243+0000","last_unstale":"2024-09-07T03:35:46.921691+0000","last_undegraded":"2024-09-07T03:35:46.921691+0000","last_fullsized":"2024-09-07T03:35:46.921691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.921593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.921593+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.921593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:41:38.191780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:00.126598+0000","last_change":"2024-09-07T03:36:00.126598+0000","last_active":"2024-09-07T03:36:00.126598+0000","last_peered":"2024-09-07T03:36:00.126598+0000","last_clean":"2024-09-07T03:36:00.126598+0000","last_became_active":"2024-09-07T03:32:14.113016+0000","last_became_peered":"2024-09-07T03:32:14.113016+0000","last_unstale":"2024-09-07T03:36:00.126598+0000","last_undegraded":"2024-09-07T03:36:00.126598+0000","last_fullsized":"2024-09-07T03:36:00.126598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:36:00.126510+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:36:00.126510+0000","last_clean_scrub_stamp":"2024-09-07T03:36:00.126510+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:54:09.635230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.941687+0000","last_change":"2024-09-07T03:35:50.941687+0000","last_active":"2024-09-07T03:35:50.941687+0000","last_peered":"2024-09-07T03:35:50.941687+0000","last_clean":"2024-09-07T03:35:50.941687+0000","last_became_active":"2024-09-07T03:32:12.135936+0000","last_became_peered":"2024-09-07T03:32:12.135936+0000","last_unstale":"2024-09-07T03:35:50.941687+0000","last_undegraded":"2024-09-07T03:35:50.941687+0000","last_fullsized":"2024-09-07T03:35:50.941687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:50.941592+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:50.941592+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.941592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:06:51.841561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'12","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.076421+0000","last_change":"2024-09-07T03:36:10.076421+0000","last_active":"2024-09-07T03:36:10.076421+0000","last_peered":"2024-09-07T03:36:10.076421+0000","last_clean":"2024-09-07T03:36:10.076421+0000","last_became_active":"2024-09-07T03:32:14.127982+0000","last_became_peered":"2024-09-07T03:32:14.127982+0000","last_unstale":"2024-09-07T03:36:10.076421+0000","last_undegraded":"2024-09-07T03:36:10.076421+0000","last_fullsized":"2024-09-07T03:36:10.076421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:36:10.076339+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:36:10.076339+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.076339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:56:41.547939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.155078+0000","last_change":"2024-09-07T03:35:44.155078+0000","last_active":"2024-09-07T03:35:44.155078+0000","last_peered":"2024-09-07T03:35:44.155078+0000","last_clean":"2024-09-07T03:35:44.155078+0000","last_became_active":"2024-09-07T03:32:12.133720+0000","last_became_peered":"2024-09-07T03:32:12.133720+0000","last_unstale":"2024-09-07T03:35:44.155078+0000","last_undegraded":"2024-09-07T03:35:44.155078+0000","last_fullsized":"2024-09-07T03:35:44.155078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.154970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.154970+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.154970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:08:12.195152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.092133+0000","last_change":"2024-09-07T03:36:07.092133+0000","last_active":"2024-09-07T03:36:07.092133+0000","last_peered":"2024-09-07T03:36:07.092133+0000","last_clean":"2024-09-07T03:36:07.092133+0000","last_became_active":"2024-09-07T03:32:14.124462+0000","last_became_peered":"2024-09-07T03:32:14.124462+0000","last_unstale":"2024-09-07T03:36:07.092133+0000","last_undegraded":"2024-09-07T03:36:07.092133+0000","last_fullsized":"2024-09-07T03:36:07.092133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:07.092039+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:07.092039+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.092039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:55:55.628550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.021307+0000","last_change":"2024-09-07T03:35:54.021307+0000","last_active":"2024-09-07T03:35:54.021307+0000","last_peered":"2024-09-07T03:35:54.021307+0000","last_clean":"2024-09-07T03:35:54.021307+0000","last_became_active":"2024-09-07T03:32:12.140957+0000","last_became_peered":"2024-09-07T03:32:12.140957+0000","last_unstale":"2024-09-07T03:35:54.021307+0000","last_undegraded":"2024-09-07T03:35:54.021307+0000","last_fullsized":"2024-09-07T03:35:54.021307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:54.021157+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:54.021157+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.021157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:21:11.328839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.020195+0000","last_change":"2024-09-07T03:35:53.020195+0000","last_active":"2024-09-07T03:35:53.020195+0000","last_peered":"2024-09-07T03:35:53.020195+0000","last_clean":"2024-09-07T03:35:53.020195+0000","last_became_active":"2024-09-07T03:32:12.133460+0000","last_became_peered":"2024-09-07T03:32:12.133460+0000","last_unstale":"2024-09-07T03:35:53.020195+0000","last_undegraded":"2024-09-07T03:35:53.020195+0000","last_fullsized":"2024-09-07T03:35:53.020195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:53.020088+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:53.020088+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.020088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:50:01.451093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.052185+0000","last_change":"2024-09-07T03:35:54.052185+0000","last_active":"2024-09-07T03:35:54.052185+0000","last_peered":"2024-09-07T03:35:54.052185+0000","last_clean":"2024-09-07T03:35:54.052185+0000","last_became_active":"2024-09-07T03:32:14.123554+0000","last_became_peered":"2024-09-07T03:32:14.123554+0000","last_unstale":"2024-09-07T03:35:54.052185+0000","last_undegraded":"2024-09-07T03:35:54.052185+0000","last_fullsized":"2024-09-07T03:35:54.052185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:54.052099+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:54.052099+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.052099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:35:00.695163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.090384+0000","last_change":"2024-09-07T03:35:47.090384+0000","last_active":"2024-09-07T03:35:47.090384+0000","last_peered":"2024-09-07T03:35:47.090384+0000","last_clean":"2024-09-07T03:35:47.090384+0000","last_became_active":"2024-09-07T03:32:12.134650+0000","last_became_peered":"2024-09-07T03:32:12.134650+0000","last_unstale":"2024-09-07T03:35:47.090384+0000","last_undegraded":"2024-09-07T03:35:47.090384+0000","last_fullsized":"2024-09-07T03:35:47.090384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:47.090289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:47.090289+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.090289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:17:09.392606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.176461+0000","last_change":"2024-09-07T03:36:05.176461+0000","last_active":"2024-09-07T03:36:05.176461+0000","last_peered":"2024-09-07T03:36:05.176461+0000","last_clean":"2024-09-07T03:36:05.176461+0000","last_became_active":"2024-09-07T03:32:14.127493+0000","last_became_peered":"2024-09-07T03:32:14.127493+0000","last_unstale":"2024-09-07T03:36:05.176461+0000","last_undegraded":"2024-09-07T03:36:05.176461+0000","last_fullsized":"2024-09-07T03:36:05.176461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:05.176380+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:05.176380+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.176380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:05:49.424788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1589,"ondisk_log_size":1589,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1666,"num_read_kb":1556,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640312,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":450560,"data_stored":155820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640312,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":744671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640312,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":158016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705719,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40560,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331280,"statfs":{"total":96636764160,"available":96595230720,"internally_reserved":0,"allocated":1081344,"data_stored":748249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:36:15.912 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.912 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.912 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-07T03:32:13.089127+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=13, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.913 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.913 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.913 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.913 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.913 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.913 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.913 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.913 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.914 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.914 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.914 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.914 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.914 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.914 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.914 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.914 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.915 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.915 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.915 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.915 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.915 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.915 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.915 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.915 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.916 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.916 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.916 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.916 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.916 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.916 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.916 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.917 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.917 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.917 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.917 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.917 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.917 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.917 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.917 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.918 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.918 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.918 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.918 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.918 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.918 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.918 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.918 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.918 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.919 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.919 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.919 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.919 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.919 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.919 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.919 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.920 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.920 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.920 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.920 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.920 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.920 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.920 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.920 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.920 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.921 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.921 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.921 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.921 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.921 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.921 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.921 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.921 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.922 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.922 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.922 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.922 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.922 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.922 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.922 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.922 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.922 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.923 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.923 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.923 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.923 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.923 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.923 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.923 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.923 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.923 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.924 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.924 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.924 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.924 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.924 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.924 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.924 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.925 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.925 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.925 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.925 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.925 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.925 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.925 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.925 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-07T03:32:15.098110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=15, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.925 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.926 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.926 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.926 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.926 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.926 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:15.927 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-07T03:36:35.927 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:36:36.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.035+0000 7f66280f7640 1 Processor -- start 2024-09-07T03:36:36.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.035+0000 7f66280f7640 1 -- start start 2024-09-07T03:36:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.035+0000 7f66280f7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6620130270 0x7f6620132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.035+0000 7f66280f7640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f662006dc00 con 0x7f6620129d80 2024-09-07T03:36:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.035+0000 7f66280f7640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f66201299c0 con 0x7f6620130270 2024-09-07T03:36:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.036+0000 7f6625692640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6620130270 0x7f6620132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.036+0000 7f6625e93640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6620129d80 0x7f662012a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:36770/0 (socket says 172.21.15.104:36770) 2024-09-07T03:36:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.036+0000 7f6625e93640 1 -- 172.21.15.104:0/3137064841 learned_addr learned my addr 172.21.15.104:0/3137064841 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:36:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.036+0000 7f6625692640 1 -- 172.21.15.104:0/3137064841 >> v1:172.21.15.104:6789/0 conn(0x7f6620129d80 legacy=0x7f662012a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.036+0000 7f6624e91640 1 -- 172.21.15.104:0/3137064841 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330197829 0 0) 0x7f662006dc00 con 0x7f6620129d80 2024-09-07T03:36:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.036+0000 7f6625692640 1 -- 172.21.15.104:0/3137064841 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662012a870 con 0x7f6620130270 2024-09-07T03:36:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f6625692640 1 --2- 172.21.15.104:0/3137064841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620130270 0x7f6620132660 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6610009720 tx=0x7f661002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbdba0c5b100179 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f6624e91640 1 -- 172.21.15.104:0/3137064841 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610037070 con 0x7f6620130270 2024-09-07T03:36:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f6624e91640 1 -- 172.21.15.104:0/3137064841 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661002ad90 con 0x7f6620130270 2024-09-07T03:36:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f6624e91640 1 -- 172.21.15.104:0/3137064841 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610032590 con 0x7f6620130270 2024-09-07T03:36:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f66280f7640 1 -- 172.21.15.104:0/3137064841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620130270 msgr2=0x7f6620132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f66280f7640 1 --2- 172.21.15.104:0/3137064841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620130270 0x7f6620132660 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6610009720 tx=0x7f661002a110 comp rx=0 tx=0).stop 2024-09-07T03:36:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f66280f7640 1 -- 172.21.15.104:0/3137064841 shutdown_connections 2024-09-07T03:36:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f66280f7640 1 --2- 172.21.15.104:0/3137064841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620130270 0x7f6620132660 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f66280f7640 1 -- 172.21.15.104:0/3137064841 >> 172.21.15.104:0/3137064841 conn(0x7f6620070850 msgr2=0x7f6620072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:36:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f66280f7640 1 -- 172.21.15.104:0/3137064841 shutdown_connections 2024-09-07T03:36:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.037+0000 7f66280f7640 1 -- 172.21.15.104:0/3137064841 wait complete. 2024-09-07T03:36:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.038+0000 7f66280f7640 1 Processor -- start 2024-09-07T03:36:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.038+0000 7f66280f7640 1 -- start start 2024-09-07T03:36:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f66280f7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620129d80 0x7f6620115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f66280f7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6620073a10 con 0x7f6620129d80 2024-09-07T03:36:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f6625e93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620129d80 0x7f6620115750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f6625e93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620129d80 0x7f6620115750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36796/0 (socket says 172.21.15.104:36796) 2024-09-07T03:36:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f6625e93640 1 -- 172.21.15.104:0/1280836234 learned_addr learned my addr 172.21.15.104:0/1280836234 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:36:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f6625e93640 1 -- 172.21.15.104:0/1280836234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6620117520 con 0x7f6620129d80 2024-09-07T03:36:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f6625e93640 1 --2- 172.21.15.104:0/1280836234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620129d80 0x7f6620115750 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c3d0 tx=0x7f661c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f66167fc640 1 -- 172.21.15.104:0/1280836234 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661c0074d0 con 0x7f6620129d80 2024-09-07T03:36:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f66167fc640 1 -- 172.21.15.104:0/1280836234 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661c0047e0 con 0x7f6620129d80 2024-09-07T03:36:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6620118520 con 0x7f6620129d80 2024-09-07T03:36:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f66167fc640 1 -- 172.21.15.104:0/1280836234 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661c007670 con 0x7f6620129d80 2024-09-07T03:36:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.039+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6620118960 con 0x7f6620129d80 2024-09-07T03:36:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.040+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f662012a160 con 0x7f6620129d80 2024-09-07T03:36:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.040+0000 7f66167fc640 1 -- 172.21.15.104:0/1280836234 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f661c011070 con 0x7f6620129d80 2024-09-07T03:36:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.040+0000 7f66167fc640 1 --2- 172.21.15.104:0/1280836234 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f660403de90 0x7f6604040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.041+0000 7f66167fc640 1 -- 172.21.15.104:0/1280836234 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f661c052960 con 0x7f6620129d80 2024-09-07T03:36:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.041+0000 7f6625692640 1 --2- 172.21.15.104:0/1280836234 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f660403de90 0x7f6604040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.041+0000 7f6625692640 1 --2- 172.21.15.104:0/1280836234 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f660403de90 0x7f6604040350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6610034000 tx=0x7f661002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:36.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.045+0000 7f66167fc640 1 -- 172.21.15.104:0/1280836234 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f661c012dd0 con 0x7f6620129d80 2024-09-07T03:36:36.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.219+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6620068da0 con 0x7f660403de90 2024-09-07T03:36:36.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.229+0000 7f66167fc640 1 -- 172.21.15.104:0/1280836234 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666163 (secure 0 0 0) 0x7f6620068da0 con 0x7f660403de90 2024-09-07T03:36:36.241 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:36:36.247 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:36:36.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f660403de90 msgr2=0x7f6604040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:36.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 --2- 172.21.15.104:0/1280836234 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f660403de90 0x7f6604040350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6610034000 tx=0x7f661002e000 comp rx=0 tx=0).stop 2024-09-07T03:36:36.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620129d80 msgr2=0x7f6620115750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:36.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 --2- 172.21.15.104:0/1280836234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620129d80 0x7f6620115750 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c3d0 tx=0x7f661c00c890 comp rx=0 tx=0).stop 2024-09-07T03:36:36.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 shutdown_connections 2024-09-07T03:36:36.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 --2- 172.21.15.104:0/1280836234 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f660403de90 0x7f6604040350 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:36.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 --2- 172.21.15.104:0/1280836234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6620129d80 0x7f6620115750 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:36.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 >> 172.21.15.104:0/1280836234 conn(0x7f6620070850 msgr2=0x7f66201282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:36:36.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 shutdown_connections 2024-09-07T03:36:36.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:36.234+0000 7f66280f7640 1 -- 172.21.15.104:0/1280836234 wait complete. 2024-09-07T03:36:36.251 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-07T03:36:35.283533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5430,"num_read_kb":4984,"num_write":2317,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2079,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4976,"ondisk_log_size":4976,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160992,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326368,"statfs":{"total":386547056640,"available":386382200832,"internally_reserved":0,"allocated":3047424,"data_stored":1806756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1055,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003833"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:59.050366+0000","last_change":"2024-09-07T03:35:59.050308+0000","last_active":"2024-09-07T03:35:59.050366+0000","last_peered":"2024-09-07T03:35:59.050366+0000","last_clean":"2024-09-07T03:35:59.050366+0000","last_became_active":"2024-09-07T03:32:12.133110+0000","last_became_peered":"2024-09-07T03:32:12.133110+0000","last_unstale":"2024-09-07T03:35:59.050366+0000","last_undegraded":"2024-09-07T03:35:59.050366+0000","last_fullsized":"2024-09-07T03:35:59.050366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:59.050226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:59.050226+0000","last_clean_scrub_stamp":"2024-09-07T03:35:59.050226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:16:40.480940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.974172+0000","last_change":"2024-09-07T03:36:10.974172+0000","last_active":"2024-09-07T03:36:10.974172+0000","last_peered":"2024-09-07T03:36:10.974172+0000","last_clean":"2024-09-07T03:36:10.974172+0000","last_became_active":"2024-09-07T03:32:14.109379+0000","last_became_peered":"2024-09-07T03:32:14.109379+0000","last_unstale":"2024-09-07T03:36:10.974172+0000","last_undegraded":"2024-09-07T03:36:10.974172+0000","last_fullsized":"2024-09-07T03:36:10.974172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:10.974093+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:10.974093+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.974093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:49:43.847718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.129154+0000","last_change":"2024-09-07T03:35:46.129075+0000","last_active":"2024-09-07T03:35:46.129154+0000","last_peered":"2024-09-07T03:35:46.129154+0000","last_clean":"2024-09-07T03:35:46.129154+0000","last_became_active":"2024-09-07T03:32:12.135945+0000","last_became_peered":"2024-09-07T03:32:12.135945+0000","last_unstale":"2024-09-07T03:35:46.129154+0000","last_undegraded":"2024-09-07T03:35:46.129154+0000","last_fullsized":"2024-09-07T03:35:46.129154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.128991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.128991+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.128991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:16:00.699297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'18","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.938208+0000","last_change":"2024-09-07T03:35:56.938208+0000","last_active":"2024-09-07T03:35:56.938208+0000","last_peered":"2024-09-07T03:35:56.938208+0000","last_clean":"2024-09-07T03:35:56.938208+0000","last_became_active":"2024-09-07T03:32:50.279755+0000","last_became_peered":"2024-09-07T03:32:50.279755+0000","last_unstale":"2024-09-07T03:35:56.938208+0000","last_undegraded":"2024-09-07T03:35:56.938208+0000","last_fullsized":"2024-09-07T03:35:56.938208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-07T03:35:56.938103+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-07T03:35:56.938103+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.938103+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:02:14.443754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.041544+0000","last_change":"2024-09-07T03:35:55.041470+0000","last_active":"2024-09-07T03:35:55.041544+0000","last_peered":"2024-09-07T03:35:55.041544+0000","last_clean":"2024-09-07T03:35:55.041544+0000","last_became_active":"2024-09-07T03:32:12.138176+0000","last_became_peered":"2024-09-07T03:32:12.138176+0000","last_unstale":"2024-09-07T03:35:55.041544+0000","last_undegraded":"2024-09-07T03:35:55.041544+0000","last_fullsized":"2024-09-07T03:35:55.041544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:55.041382+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:55.041382+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.041382+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:00.033213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:59.973498+0000","last_change":"2024-09-07T03:35:59.973498+0000","last_active":"2024-09-07T03:35:59.973498+0000","last_peered":"2024-09-07T03:35:59.973498+0000","last_clean":"2024-09-07T03:35:59.973498+0000","last_became_active":"2024-09-07T03:32:50.282086+0000","last_became_peered":"2024-09-07T03:32:50.282086+0000","last_unstale":"2024-09-07T03:35:59.973498+0000","last_undegraded":"2024-09-07T03:35:59.973498+0000","last_fullsized":"2024-09-07T03:35:59.973498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:59.973408+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:59.973408+0000","last_clean_scrub_stamp":"2024-09-07T03:35:59.973408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:05:23.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.102800+0000","last_change":"2024-09-07T03:35:41.102738+0000","last_active":"2024-09-07T03:35:41.102800+0000","last_peered":"2024-09-07T03:35:41.102800+0000","last_clean":"2024-09-07T03:35:41.102800+0000","last_became_active":"2024-09-07T03:32:12.128937+0000","last_became_peered":"2024-09-07T03:32:12.128937+0000","last_unstale":"2024-09-07T03:35:41.102800+0000","last_undegraded":"2024-09-07T03:35:41.102800+0000","last_fullsized":"2024-09-07T03:35:41.102800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.102653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.102653+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.102653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:22:21.638223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.029774+0000","last_change":"2024-09-07T03:36:11.029774+0000","last_active":"2024-09-07T03:36:11.029774+0000","last_peered":"2024-09-07T03:36:11.029774+0000","last_clean":"2024-09-07T03:36:11.029774+0000","last_became_active":"2024-09-07T03:32:14.122611+0000","last_became_peered":"2024-09-07T03:32:14.122611+0000","last_unstale":"2024-09-07T03:36:11.029774+0000","last_undegraded":"2024-09-07T03:36:11.029774+0000","last_fullsized":"2024-09-07T03:36:11.029774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:11.029689+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:11.029689+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.029689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:41:54.209339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.069994+0000","last_change":"2024-09-07T03:35:57.069994+0000","last_active":"2024-09-07T03:35:57.069994+0000","last_peered":"2024-09-07T03:35:57.069994+0000","last_clean":"2024-09-07T03:35:57.069994+0000","last_became_active":"2024-09-07T03:32:12.123986+0000","last_became_peered":"2024-09-07T03:32:12.123986+0000","last_unstale":"2024-09-07T03:35:57.069994+0000","last_undegraded":"2024-09-07T03:35:57.069994+0000","last_fullsized":"2024-09-07T03:35:57.069994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:57.069905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:57.069905+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.069905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:37:06.077291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.300816+0000","last_change":"2024-09-07T03:36:09.300748+0000","last_active":"2024-09-07T03:36:09.300816+0000","last_peered":"2024-09-07T03:36:09.300816+0000","last_clean":"2024-09-07T03:36:09.300816+0000","last_became_active":"2024-09-07T03:32:14.124523+0000","last_became_peered":"2024-09-07T03:32:14.124523+0000","last_unstale":"2024-09-07T03:36:09.300816+0000","last_undegraded":"2024-09-07T03:36:09.300816+0000","last_fullsized":"2024-09-07T03:36:09.300816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:09.300663+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:09.300663+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.300663+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:37:22.563920+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.021706+0000","last_change":"2024-09-07T03:35:56.021706+0000","last_active":"2024-09-07T03:35:56.021706+0000","last_peered":"2024-09-07T03:35:56.021706+0000","last_clean":"2024-09-07T03:35:56.021706+0000","last_became_active":"2024-09-07T03:32:12.133597+0000","last_became_peered":"2024-09-07T03:32:12.133597+0000","last_unstale":"2024-09-07T03:35:56.021706+0000","last_undegraded":"2024-09-07T03:35:56.021706+0000","last_fullsized":"2024-09-07T03:35:56.021706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:56.021606+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:56.021606+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.021606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:09.105320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.975499+0000","last_change":"2024-09-07T03:36:11.975426+0000","last_active":"2024-09-07T03:36:11.975499+0000","last_peered":"2024-09-07T03:36:11.975499+0000","last_clean":"2024-09-07T03:36:11.975499+0000","last_became_active":"2024-09-07T03:32:14.112622+0000","last_became_peered":"2024-09-07T03:32:14.112622+0000","last_unstale":"2024-09-07T03:36:11.975499+0000","last_undegraded":"2024-09-07T03:36:11.975499+0000","last_fullsized":"2024-09-07T03:36:11.975499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:11.975345+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:11.975345+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.975345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:30:26.279685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.989460+0000","last_change":"2024-09-07T03:35:51.989460+0000","last_active":"2024-09-07T03:35:51.989460+0000","last_peered":"2024-09-07T03:35:51.989460+0000","last_clean":"2024-09-07T03:35:51.989460+0000","last_became_active":"2024-09-07T03:32:12.140221+0000","last_became_peered":"2024-09-07T03:32:12.140221+0000","last_unstale":"2024-09-07T03:35:51.989460+0000","last_undegraded":"2024-09-07T03:35:51.989460+0000","last_fullsized":"2024-09-07T03:35:51.989460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:51.989364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:51.989364+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.989364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:59.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:15.934652+0000","last_change":"2024-09-07T03:36:15.934566+0000","last_active":"2024-09-07T03:36:15.934652+0000","last_peered":"2024-09-07T03:36:15.934652+0000","last_clean":"2024-09-07T03:36:15.934652+0000","last_became_active":"2024-09-07T03:32:14.114529+0000","last_became_peered":"2024-09-07T03:32:14.114529+0000","last_unstale":"2024-09-07T03:36:15.934652+0000","last_undegraded":"2024-09-07T03:36:15.934652+0000","last_fullsized":"2024-09-07T03:36:15.934652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:15.934434+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:15.934434+0000","last_clean_scrub_stamp":"2024-09-07T03:36:15.934434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:36:00.389538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.909080+0000","last_change":"2024-09-07T03:35:49.909080+0000","last_active":"2024-09-07T03:35:49.909080+0000","last_peered":"2024-09-07T03:35:49.909080+0000","last_clean":"2024-09-07T03:35:49.909080+0000","last_became_active":"2024-09-07T03:32:12.143209+0000","last_became_peered":"2024-09-07T03:32:12.143209+0000","last_unstale":"2024-09-07T03:35:49.909080+0000","last_undegraded":"2024-09-07T03:35:49.909080+0000","last_fullsized":"2024-09-07T03:35:49.909080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:49.908949+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:49.908949+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.908949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:33:51.713150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.019646+0000","last_change":"2024-09-07T03:36:01.019575+0000","last_active":"2024-09-07T03:36:01.019646+0000","last_peered":"2024-09-07T03:36:01.019646+0000","last_clean":"2024-09-07T03:36:01.019646+0000","last_became_active":"2024-09-07T03:32:14.124135+0000","last_became_peered":"2024-09-07T03:32:14.124135+0000","last_unstale":"2024-09-07T03:36:01.019646+0000","last_undegraded":"2024-09-07T03:36:01.019646+0000","last_fullsized":"2024-09-07T03:36:01.019646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:01.019492+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:01.019492+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.019492+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:05:20.506138+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'14","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:13.946676+0000","last_change":"2024-09-07T03:36:13.946676+0000","last_active":"2024-09-07T03:36:13.946676+0000","last_peered":"2024-09-07T03:36:13.946676+0000","last_clean":"2024-09-07T03:36:13.946676+0000","last_became_active":"2024-09-07T03:32:14.109280+0000","last_became_peered":"2024-09-07T03:32:14.109280+0000","last_unstale":"2024-09-07T03:36:13.946676+0000","last_undegraded":"2024-09-07T03:36:13.946676+0000","last_fullsized":"2024-09-07T03:36:13.946676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-07T03:36:13.946590+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-07T03:36:13.946590+0000","last_clean_scrub_stamp":"2024-09-07T03:36:13.946590+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:55:54.326418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.074893+0000","last_change":"2024-09-07T03:35:49.074893+0000","last_active":"2024-09-07T03:35:49.074893+0000","last_peered":"2024-09-07T03:35:49.074893+0000","last_clean":"2024-09-07T03:35:49.074893+0000","last_became_active":"2024-09-07T03:32:12.134379+0000","last_became_peered":"2024-09-07T03:32:12.134379+0000","last_unstale":"2024-09-07T03:35:49.074893+0000","last_undegraded":"2024-09-07T03:35:49.074893+0000","last_fullsized":"2024-09-07T03:35:49.074893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:49.074793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:49.074793+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.074793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:58:33.349796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.036322+0000","last_change":"2024-09-07T03:36:09.036322+0000","last_active":"2024-09-07T03:36:09.036322+0000","last_peered":"2024-09-07T03:36:09.036322+0000","last_clean":"2024-09-07T03:36:09.036322+0000","last_became_active":"2024-09-07T03:32:14.111769+0000","last_became_peered":"2024-09-07T03:32:14.111769+0000","last_unstale":"2024-09-07T03:36:09.036322+0000","last_undegraded":"2024-09-07T03:36:09.036322+0000","last_fullsized":"2024-09-07T03:36:09.036322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:09.036222+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:09.036222+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.036222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:29:52.053942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.132801+0000","last_change":"2024-09-07T03:35:47.132801+0000","last_active":"2024-09-07T03:35:47.132801+0000","last_peered":"2024-09-07T03:35:47.132801+0000","last_clean":"2024-09-07T03:35:47.132801+0000","last_became_active":"2024-09-07T03:32:12.129310+0000","last_became_peered":"2024-09-07T03:32:12.129310+0000","last_unstale":"2024-09-07T03:35:47.132801+0000","last_undegraded":"2024-09-07T03:35:47.132801+0000","last_fullsized":"2024-09-07T03:35:47.132801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:47.132683+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:47.132683+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.132683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:14:40.445362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.987197+0000","last_change":"2024-09-07T03:36:09.987197+0000","last_active":"2024-09-07T03:36:09.987197+0000","last_peered":"2024-09-07T03:36:09.987197+0000","last_clean":"2024-09-07T03:36:09.987197+0000","last_became_active":"2024-09-07T03:32:14.109177+0000","last_became_peered":"2024-09-07T03:32:14.109177+0000","last_unstale":"2024-09-07T03:36:09.987197+0000","last_undegraded":"2024-09-07T03:36:09.987197+0000","last_fullsized":"2024-09-07T03:36:09.987197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:09.987089+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:09.987089+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.987089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:31:02.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.057087+0000","last_change":"2024-09-07T03:35:55.057087+0000","last_active":"2024-09-07T03:35:55.057087+0000","last_peered":"2024-09-07T03:35:55.057087+0000","last_clean":"2024-09-07T03:35:55.057087+0000","last_became_active":"2024-09-07T03:32:12.120449+0000","last_became_peered":"2024-09-07T03:32:12.120449+0000","last_unstale":"2024-09-07T03:35:55.057087+0000","last_undegraded":"2024-09-07T03:35:55.057087+0000","last_fullsized":"2024-09-07T03:35:55.057087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:55.057003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:55.057003+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.057003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:23:58.048916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.917436+0000","last_change":"2024-09-07T03:35:57.917436+0000","last_active":"2024-09-07T03:35:57.917436+0000","last_peered":"2024-09-07T03:35:57.917436+0000","last_clean":"2024-09-07T03:35:57.917436+0000","last_became_active":"2024-09-07T03:32:14.125065+0000","last_became_peered":"2024-09-07T03:32:14.125065+0000","last_unstale":"2024-09-07T03:35:57.917436+0000","last_undegraded":"2024-09-07T03:35:57.917436+0000","last_fullsized":"2024-09-07T03:35:57.917436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:57.917354+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:57.917354+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.917354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:24.450901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.065046+0000","last_change":"2024-09-07T03:35:54.065046+0000","last_active":"2024-09-07T03:35:54.065046+0000","last_peered":"2024-09-07T03:35:54.065046+0000","last_clean":"2024-09-07T03:35:54.065046+0000","last_became_active":"2024-09-07T03:32:12.124516+0000","last_became_peered":"2024-09-07T03:32:12.124516+0000","last_unstale":"2024-09-07T03:35:54.065046+0000","last_undegraded":"2024-09-07T03:35:54.065046+0000","last_fullsized":"2024-09-07T03:35:54.065046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:54.064958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:54.064958+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.064958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:49:59.421840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.976481+0000","last_change":"2024-09-07T03:35:55.976481+0000","last_active":"2024-09-07T03:35:55.976481+0000","last_peered":"2024-09-07T03:35:55.976481+0000","last_clean":"2024-09-07T03:35:55.976481+0000","last_became_active":"2024-09-07T03:32:14.112477+0000","last_became_peered":"2024-09-07T03:32:14.112477+0000","last_unstale":"2024-09-07T03:35:55.976481+0000","last_undegraded":"2024-09-07T03:35:55.976481+0000","last_fullsized":"2024-09-07T03:35:55.976481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:55.976398+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:55.976398+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.976398+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:42:44.572113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.035524+0000","last_change":"2024-09-07T03:35:53.035524+0000","last_active":"2024-09-07T03:35:53.035524+0000","last_peered":"2024-09-07T03:35:53.035524+0000","last_clean":"2024-09-07T03:35:53.035524+0000","last_became_active":"2024-09-07T03:32:12.136801+0000","last_became_peered":"2024-09-07T03:32:12.136801+0000","last_unstale":"2024-09-07T03:35:53.035524+0000","last_undegraded":"2024-09-07T03:35:53.035524+0000","last_fullsized":"2024-09-07T03:35:53.035524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:53.035439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:53.035439+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.035439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:57:42.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.128171+0000","last_change":"2024-09-07T03:36:04.128171+0000","last_active":"2024-09-07T03:36:04.128171+0000","last_peered":"2024-09-07T03:36:04.128171+0000","last_clean":"2024-09-07T03:36:04.128171+0000","last_became_active":"2024-09-07T03:32:14.109167+0000","last_became_peered":"2024-09-07T03:32:14.109167+0000","last_unstale":"2024-09-07T03:36:04.128171+0000","last_undegraded":"2024-09-07T03:36:04.128171+0000","last_fullsized":"2024-09-07T03:36:04.128171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:04.128085+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:04.128085+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.128085+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.065768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.070160+0000","last_change":"2024-09-07T03:35:56.070160+0000","last_active":"2024-09-07T03:35:56.070160+0000","last_peered":"2024-09-07T03:35:56.070160+0000","last_clean":"2024-09-07T03:35:56.070160+0000","last_became_active":"2024-09-07T03:32:12.138105+0000","last_became_peered":"2024-09-07T03:32:12.138105+0000","last_unstale":"2024-09-07T03:35:56.070160+0000","last_undegraded":"2024-09-07T03:35:56.070160+0000","last_fullsized":"2024-09-07T03:35:56.070160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:56.070061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:56.070061+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.070061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:26:29.693791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.773106+0000","last_change":"2024-09-07T03:32:22.149626+0000","last_active":"2024-09-07T03:35:23.773106+0000","last_peered":"2024-09-07T03:35:23.773106+0000","last_clean":"2024-09-07T03:35:23.773106+0000","last_became_active":"2024-09-07T03:32:22.149337+0000","last_became_peered":"2024-09-07T03:32:22.149337+0000","last_unstale":"2024-09-07T03:35:23.773106+0000","last_undegraded":"2024-09-07T03:35:23.773106+0000","last_fullsized":"2024-09-07T03:35:23.773106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:00:45.310817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.093818+0000","last_change":"2024-09-07T03:36:03.093818+0000","last_active":"2024-09-07T03:36:03.093818+0000","last_peered":"2024-09-07T03:36:03.093818+0000","last_clean":"2024-09-07T03:36:03.093818+0000","last_became_active":"2024-09-07T03:32:14.126222+0000","last_became_peered":"2024-09-07T03:32:14.126222+0000","last_unstale":"2024-09-07T03:36:03.093818+0000","last_undegraded":"2024-09-07T03:36:03.093818+0000","last_fullsized":"2024-09-07T03:36:03.093818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:03.093725+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:03.093725+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.093725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:40:44.367176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.063889+0000","last_change":"2024-09-07T03:35:40.063889+0000","last_active":"2024-09-07T03:35:40.063889+0000","last_peered":"2024-09-07T03:35:40.063889+0000","last_clean":"2024-09-07T03:35:40.063889+0000","last_became_active":"2024-09-07T03:32:12.124815+0000","last_became_peered":"2024-09-07T03:32:12.124815+0000","last_unstale":"2024-09-07T03:35:40.063889+0000","last_undegraded":"2024-09-07T03:35:40.063889+0000","last_fullsized":"2024-09-07T03:35:40.063889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:40.063781+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.063781+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.063781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:11.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:17.080488+0000","last_change":"2024-09-07T03:36:17.080488+0000","last_active":"2024-09-07T03:36:17.080488+0000","last_peered":"2024-09-07T03:36:17.080488+0000","last_clean":"2024-09-07T03:36:17.080488+0000","last_became_active":"2024-09-07T03:32:16.127430+0000","last_became_peered":"2024-09-07T03:32:16.127430+0000","last_unstale":"2024-09-07T03:36:17.080488+0000","last_undegraded":"2024-09-07T03:36:17.080488+0000","last_fullsized":"2024-09-07T03:36:17.080488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:17.080386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:17.080386+0000","last_clean_scrub_stamp":"2024-09-07T03:36:17.080386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:30:31.384725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'51","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:26.097269+0000","last_change":"2024-09-07T03:36:26.097269+0000","last_active":"2024-09-07T03:36:26.097269+0000","last_peered":"2024-09-07T03:36:26.097269+0000","last_clean":"2024-09-07T03:36:26.097269+0000","last_became_active":"2024-09-07T03:32:18.130101+0000","last_became_peered":"2024-09-07T03:32:18.130101+0000","last_unstale":"2024-09-07T03:36:26.097269+0000","last_undegraded":"2024-09-07T03:36:26.097269+0000","last_fullsized":"2024-09-07T03:36:26.097269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-07T03:36:26.097170+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-07T03:36:26.097170+0000","last_clean_scrub_stamp":"2024-09-07T03:36:26.097170+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:48:12.217362+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280723+0000","last_change":"2024-09-07T03:32:20.147157+0000","last_active":"2024-09-07T03:32:50.280723+0000","last_peered":"2024-09-07T03:32:50.280723+0000","last_clean":"2024-09-07T03:32:50.280723+0000","last_became_active":"2024-09-07T03:32:20.146716+0000","last_became_peered":"2024-09-07T03:32:20.146716+0000","last_unstale":"2024-09-07T03:32:50.280723+0000","last_undegraded":"2024-09-07T03:32:50.280723+0000","last_fullsized":"2024-09-07T03:32:50.280723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:23.679745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"36'9","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.982420+0000","last_change":"2024-09-07T03:32:22.143355+0000","last_active":"2024-09-07T03:33:38.982420+0000","last_peered":"2024-09-07T03:33:38.982420+0000","last_clean":"2024-09-07T03:33:38.982420+0000","last_became_active":"2024-09-07T03:32:22.143092+0000","last_became_peered":"2024-09-07T03:32:22.143092+0000","last_unstale":"2024-09-07T03:33:38.982420+0000","last_undegraded":"2024-09-07T03:33:38.982420+0000","last_fullsized":"2024-09-07T03:33:38.982420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:30:18.450771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'8","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.113532+0000","last_change":"2024-09-07T03:36:02.113532+0000","last_active":"2024-09-07T03:36:02.113532+0000","last_peered":"2024-09-07T03:36:02.113532+0000","last_clean":"2024-09-07T03:36:02.113532+0000","last_became_active":"2024-09-07T03:32:14.121998+0000","last_became_peered":"2024-09-07T03:32:14.121998+0000","last_unstale":"2024-09-07T03:36:02.113532+0000","last_undegraded":"2024-09-07T03:36:02.113532+0000","last_fullsized":"2024-09-07T03:36:02.113532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:02.113425+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:02.113425+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.113425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:18:16.347758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.036982+0000","last_change":"2024-09-07T03:35:35.036982+0000","last_active":"2024-09-07T03:35:35.036982+0000","last_peered":"2024-09-07T03:35:35.036982+0000","last_clean":"2024-09-07T03:35:35.036982+0000","last_became_active":"2024-09-07T03:32:12.129979+0000","last_became_peered":"2024-09-07T03:32:12.129979+0000","last_unstale":"2024-09-07T03:35:35.036982+0000","last_undegraded":"2024-09-07T03:35:35.036982+0000","last_fullsized":"2024-09-07T03:35:35.036982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:35.036881+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:35.036881+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.036881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:32:01.763051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:16.119034+0000","last_change":"2024-09-07T03:36:16.119034+0000","last_active":"2024-09-07T03:36:16.119034+0000","last_peered":"2024-09-07T03:36:16.119034+0000","last_clean":"2024-09-07T03:36:16.119034+0000","last_became_active":"2024-09-07T03:32:16.126116+0000","last_became_peered":"2024-09-07T03:32:16.126116+0000","last_unstale":"2024-09-07T03:36:16.119034+0000","last_undegraded":"2024-09-07T03:36:16.119034+0000","last_fullsized":"2024-09-07T03:36:16.119034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:16.118946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:16.118946+0000","last_clean_scrub_stamp":"2024-09-07T03:36:16.118946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:49:48.992571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'16","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:20.248591+0000","last_change":"2024-09-07T03:36:20.248591+0000","last_active":"2024-09-07T03:36:20.248591+0000","last_peered":"2024-09-07T03:36:20.248591+0000","last_clean":"2024-09-07T03:36:20.248591+0000","last_became_active":"2024-09-07T03:32:18.132152+0000","last_became_peered":"2024-09-07T03:32:18.132152+0000","last_unstale":"2024-09-07T03:36:20.248591+0000","last_undegraded":"2024-09-07T03:36:20.248591+0000","last_fullsized":"2024-09-07T03:36:20.248591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:36:20.248480+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:36:20.248480+0000","last_clean_scrub_stamp":"2024-09-07T03:36:20.248480+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:26.643652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280341+0000","last_change":"2024-09-07T03:32:20.146991+0000","last_active":"2024-09-07T03:32:50.280341+0000","last_peered":"2024-09-07T03:32:50.280341+0000","last_clean":"2024-09-07T03:32:50.280341+0000","last_became_active":"2024-09-07T03:32:20.146457+0000","last_became_peered":"2024-09-07T03:32:20.146457+0000","last_unstale":"2024-09-07T03:32:50.280341+0000","last_undegraded":"2024-09-07T03:32:50.280341+0000","last_fullsized":"2024-09-07T03:32:50.280341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.222346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"36'10","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.807540+0000","last_change":"2024-09-07T03:32:22.144066+0000","last_active":"2024-09-07T03:35:23.807540+0000","last_peered":"2024-09-07T03:35:23.807540+0000","last_clean":"2024-09-07T03:35:23.807540+0000","last_became_active":"2024-09-07T03:32:22.143751+0000","last_became_peered":"2024-09-07T03:32:22.143751+0000","last_unstale":"2024-09-07T03:35:23.807540+0000","last_undegraded":"2024-09-07T03:35:23.807540+0000","last_fullsized":"2024-09-07T03:35:23.807540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:14.926443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"36'20","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.105456+0000","last_change":"2024-09-07T03:36:06.105456+0000","last_active":"2024-09-07T03:36:06.105456+0000","last_peered":"2024-09-07T03:36:06.105456+0000","last_clean":"2024-09-07T03:36:06.105456+0000","last_became_active":"2024-09-07T03:32:14.130544+0000","last_became_peered":"2024-09-07T03:32:14.130544+0000","last_unstale":"2024-09-07T03:36:06.105456+0000","last_undegraded":"2024-09-07T03:36:06.105456+0000","last_fullsized":"2024-09-07T03:36:06.105456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-07T03:36:06.105376+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-07T03:36:06.105376+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.105376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:13:52.000035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.060884+0000","last_change":"2024-09-07T03:35:47.060884+0000","last_active":"2024-09-07T03:35:47.060884+0000","last_peered":"2024-09-07T03:35:47.060884+0000","last_clean":"2024-09-07T03:35:47.060884+0000","last_became_active":"2024-09-07T03:32:12.124808+0000","last_became_peered":"2024-09-07T03:32:12.124808+0000","last_unstale":"2024-09-07T03:35:47.060884+0000","last_undegraded":"2024-09-07T03:35:47.060884+0000","last_fullsized":"2024-09-07T03:35:47.060884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:47.060791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:47.060791+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.060791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:54.421614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:18.096289+0000","last_change":"2024-09-07T03:36:18.096289+0000","last_active":"2024-09-07T03:36:18.096289+0000","last_peered":"2024-09-07T03:36:18.096289+0000","last_clean":"2024-09-07T03:36:18.096289+0000","last_became_active":"2024-09-07T03:32:16.126318+0000","last_became_peered":"2024-09-07T03:32:16.126318+0000","last_unstale":"2024-09-07T03:36:18.096289+0000","last_undegraded":"2024-09-07T03:36:18.096289+0000","last_fullsized":"2024-09-07T03:36:18.096289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:18.096194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:18.096194+0000","last_clean_scrub_stamp":"2024-09-07T03:36:18.096194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:18:12.581343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'29","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.110590+0000","last_change":"2024-09-07T03:36:10.110590+0000","last_active":"2024-09-07T03:36:10.110590+0000","last_peered":"2024-09-07T03:36:10.110590+0000","last_clean":"2024-09-07T03:36:10.110590+0000","last_became_active":"2024-09-07T03:32:18.128391+0000","last_became_peered":"2024-09-07T03:32:18.128391+0000","last_unstale":"2024-09-07T03:36:10.110590+0000","last_undegraded":"2024-09-07T03:36:10.110590+0000","last_fullsized":"2024-09-07T03:36:10.110590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'29","last_scrub_stamp":"2024-09-07T03:36:10.110477+0000","last_deep_scrub":"36'29","last_deep_scrub_stamp":"2024-09-07T03:36:10.110477+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.110477+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:52:05.773456+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.539513+0000","last_change":"2024-09-07T03:32:20.140796+0000","last_active":"2024-09-07T03:35:30.539513+0000","last_peered":"2024-09-07T03:35:30.539513+0000","last_clean":"2024-09-07T03:35:30.539513+0000","last_became_active":"2024-09-07T03:32:20.140249+0000","last_became_peered":"2024-09-07T03:32:20.140249+0000","last_unstale":"2024-09-07T03:35:30.539513+0000","last_undegraded":"2024-09-07T03:35:30.539513+0000","last_fullsized":"2024-09-07T03:35:30.539513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:12.918865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:24.167354+0000","last_change":"2024-09-07T03:36:24.167354+0000","last_active":"2024-09-07T03:36:24.167354+0000","last_peered":"2024-09-07T03:36:24.167354+0000","last_clean":"2024-09-07T03:36:24.167354+0000","last_became_active":"2024-09-07T03:32:22.139829+0000","last_became_peered":"2024-09-07T03:32:22.139829+0000","last_unstale":"2024-09-07T03:36:24.167354+0000","last_undegraded":"2024-09-07T03:36:24.167354+0000","last_fullsized":"2024-09-07T03:36:24.167354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:24.167258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:24.167258+0000","last_clean_scrub_stamp":"2024-09-07T03:36:24.167258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:58:17.544015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.135909+0000","last_change":"2024-09-07T03:36:04.135909+0000","last_active":"2024-09-07T03:36:04.135909+0000","last_peered":"2024-09-07T03:36:04.135909+0000","last_clean":"2024-09-07T03:36:04.135909+0000","last_became_active":"2024-09-07T03:32:14.126140+0000","last_became_peered":"2024-09-07T03:32:14.126140+0000","last_unstale":"2024-09-07T03:36:04.135909+0000","last_undegraded":"2024-09-07T03:36:04.135909+0000","last_fullsized":"2024-09-07T03:36:04.135909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:04.135822+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:04.135822+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.135822+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:04:21.287355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.015724+0000","last_change":"2024-09-07T03:35:46.015724+0000","last_active":"2024-09-07T03:35:46.015724+0000","last_peered":"2024-09-07T03:35:46.015724+0000","last_clean":"2024-09-07T03:35:46.015724+0000","last_became_active":"2024-09-07T03:32:12.133270+0000","last_became_peered":"2024-09-07T03:32:12.133270+0000","last_unstale":"2024-09-07T03:35:46.015724+0000","last_undegraded":"2024-09-07T03:35:46.015724+0000","last_fullsized":"2024-09-07T03:35:46.015724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.015616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.015616+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.015616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:06:46.915585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:17.936199+0000","last_change":"2024-09-07T03:36:17.936199+0000","last_active":"2024-09-07T03:36:17.936199+0000","last_peered":"2024-09-07T03:36:17.936199+0000","last_clean":"2024-09-07T03:36:17.936199+0000","last_became_active":"2024-09-07T03:32:16.116761+0000","last_became_peered":"2024-09-07T03:32:16.116761+0000","last_unstale":"2024-09-07T03:36:17.936199+0000","last_undegraded":"2024-09-07T03:36:17.936199+0000","last_fullsized":"2024-09-07T03:36:17.936199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:17.936114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:17.936114+0000","last_clean_scrub_stamp":"2024-09-07T03:36:17.936114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:38:09.852326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'41","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.680636+0000","last_change":"2024-09-07T03:32:18.129567+0000","last_active":"2024-09-07T03:35:30.680636+0000","last_peered":"2024-09-07T03:35:30.680636+0000","last_clean":"2024-09-07T03:35:30.680636+0000","last_became_active":"2024-09-07T03:32:18.128901+0000","last_became_peered":"2024-09-07T03:32:18.128901+0000","last_unstale":"2024-09-07T03:35:30.680636+0000","last_undegraded":"2024-09-07T03:35:30.680636+0000","last_fullsized":"2024-09-07T03:35:30.680636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:42:21.711836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.545527+0000","last_change":"2024-09-07T03:32:20.142693+0000","last_active":"2024-09-07T03:35:30.545527+0000","last_peered":"2024-09-07T03:35:30.545527+0000","last_clean":"2024-09-07T03:35:30.545527+0000","last_became_active":"2024-09-07T03:32:20.142390+0000","last_became_peered":"2024-09-07T03:32:20.142390+0000","last_unstale":"2024-09-07T03:35:30.545527+0000","last_undegraded":"2024-09-07T03:35:30.545527+0000","last_fullsized":"2024-09-07T03:35:30.545527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:51:20.882177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.993231+0000","last_change":"2024-09-07T03:35:58.993231+0000","last_active":"2024-09-07T03:35:58.993231+0000","last_peered":"2024-09-07T03:35:58.993231+0000","last_clean":"2024-09-07T03:35:58.993231+0000","last_became_active":"2024-09-07T03:32:14.122806+0000","last_became_peered":"2024-09-07T03:32:14.122806+0000","last_unstale":"2024-09-07T03:35:58.993231+0000","last_undegraded":"2024-09-07T03:35:58.993231+0000","last_fullsized":"2024-09-07T03:35:58.993231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:58.993132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:58.993132+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.993132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:24:01.985044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.958364+0000","last_change":"2024-09-07T03:35:43.958364+0000","last_active":"2024-09-07T03:35:43.958364+0000","last_peered":"2024-09-07T03:35:43.958364+0000","last_clean":"2024-09-07T03:35:43.958364+0000","last_became_active":"2024-09-07T03:32:12.124564+0000","last_became_peered":"2024-09-07T03:32:12.124564+0000","last_unstale":"2024-09-07T03:35:43.958364+0000","last_undegraded":"2024-09-07T03:35:43.958364+0000","last_fullsized":"2024-09-07T03:35:43.958364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.958249+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.958249+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.958249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:56:10.343804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.250760+0000","last_change":"2024-09-07T03:36:08.250760+0000","last_active":"2024-09-07T03:36:08.250760+0000","last_peered":"2024-09-07T03:36:08.250760+0000","last_clean":"2024-09-07T03:36:08.250760+0000","last_became_active":"2024-09-07T03:32:16.128519+0000","last_became_peered":"2024-09-07T03:32:16.128519+0000","last_unstale":"2024-09-07T03:36:08.250760+0000","last_undegraded":"2024-09-07T03:36:08.250760+0000","last_fullsized":"2024-09-07T03:36:08.250760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:08.250675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:08.250675+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.250675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:43.461236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'59","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:27.945347+0000","last_change":"2024-09-07T03:36:27.945347+0000","last_active":"2024-09-07T03:36:27.945347+0000","last_peered":"2024-09-07T03:36:27.945347+0000","last_clean":"2024-09-07T03:36:27.945347+0000","last_became_active":"2024-09-07T03:32:18.132867+0000","last_became_peered":"2024-09-07T03:32:18.132867+0000","last_unstale":"2024-09-07T03:36:27.945347+0000","last_undegraded":"2024-09-07T03:36:27.945347+0000","last_fullsized":"2024-09-07T03:36:27.945347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'59","last_scrub_stamp":"2024-09-07T03:36:27.945252+0000","last_deep_scrub":"36'59","last_deep_scrub_stamp":"2024-09-07T03:36:27.945252+0000","last_clean_scrub_stamp":"2024-09-07T03:36:27.945252+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:01:06.014289+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:24.298825+0000","last_change":"2024-09-07T03:36:24.298825+0000","last_active":"2024-09-07T03:36:24.298825+0000","last_peered":"2024-09-07T03:36:24.298825+0000","last_clean":"2024-09-07T03:36:24.298825+0000","last_became_active":"2024-09-07T03:32:20.139806+0000","last_became_peered":"2024-09-07T03:32:20.139806+0000","last_unstale":"2024-09-07T03:36:24.298825+0000","last_undegraded":"2024-09-07T03:36:24.298825+0000","last_fullsized":"2024-09-07T03:36:24.298825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:24.298723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:24.298723+0000","last_clean_scrub_stamp":"2024-09-07T03:36:24.298723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:09:16.113807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:19.113499+0000","last_change":"2024-09-07T03:36:19.113447+0000","last_active":"2024-09-07T03:36:19.113499+0000","last_peered":"2024-09-07T03:36:19.113499+0000","last_clean":"2024-09-07T03:36:19.113499+0000","last_became_active":"2024-09-07T03:32:22.148149+0000","last_became_peered":"2024-09-07T03:32:22.148149+0000","last_unstale":"2024-09-07T03:36:19.113499+0000","last_undegraded":"2024-09-07T03:36:19.113499+0000","last_fullsized":"2024-09-07T03:36:19.113499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-07T03:36:19.113370+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-07T03:36:19.113370+0000","last_clean_scrub_stamp":"2024-09-07T03:36:19.113370+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:29:18.830939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.127054+0000","last_change":"2024-09-07T03:35:45.127054+0000","last_active":"2024-09-07T03:35:45.127054+0000","last_peered":"2024-09-07T03:35:45.127054+0000","last_clean":"2024-09-07T03:35:45.127054+0000","last_became_active":"2024-09-07T03:32:50.279097+0000","last_became_peered":"2024-09-07T03:32:50.279097+0000","last_unstale":"2024-09-07T03:35:45.127054+0000","last_undegraded":"2024-09-07T03:35:45.127054+0000","last_fullsized":"2024-09-07T03:35:45.127054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:45.126957+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:45.126957+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.126957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:52:31.656890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.977163+0000","last_change":"2024-09-07T03:35:44.977163+0000","last_active":"2024-09-07T03:35:44.977163+0000","last_peered":"2024-09-07T03:35:44.977163+0000","last_clean":"2024-09-07T03:35:44.977163+0000","last_became_active":"2024-09-07T03:32:12.123895+0000","last_became_peered":"2024-09-07T03:32:12.123895+0000","last_unstale":"2024-09-07T03:35:44.977163+0000","last_undegraded":"2024-09-07T03:35:44.977163+0000","last_fullsized":"2024-09-07T03:35:44.977163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:44.977080+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:44.977080+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.977080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:31:52.221278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.066306+0000","last_change":"2024-09-07T03:36:03.066306+0000","last_active":"2024-09-07T03:36:03.066306+0000","last_peered":"2024-09-07T03:36:03.066306+0000","last_clean":"2024-09-07T03:36:03.066306+0000","last_became_active":"2024-09-07T03:32:16.128471+0000","last_became_peered":"2024-09-07T03:32:16.128471+0000","last_unstale":"2024-09-07T03:36:03.066306+0000","last_undegraded":"2024-09-07T03:36:03.066306+0000","last_fullsized":"2024-09-07T03:36:03.066306+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:03.066219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:03.066219+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.066219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:00.394560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'44","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:21.065118+0000","last_change":"2024-09-07T03:36:21.065118+0000","last_active":"2024-09-07T03:36:21.065118+0000","last_peered":"2024-09-07T03:36:21.065118+0000","last_clean":"2024-09-07T03:36:21.065118+0000","last_became_active":"2024-09-07T03:32:18.127674+0000","last_became_peered":"2024-09-07T03:32:18.127674+0000","last_unstale":"2024-09-07T03:36:21.065118+0000","last_undegraded":"2024-09-07T03:36:21.065118+0000","last_fullsized":"2024-09-07T03:36:21.065118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'44","last_scrub_stamp":"2024-09-07T03:36:21.065015+0000","last_deep_scrub":"36'44","last_deep_scrub_stamp":"2024-09-07T03:36:21.065015+0000","last_clean_scrub_stamp":"2024-09-07T03:36:21.065015+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:36:05.520119+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272008+0000","last_change":"2024-09-07T03:32:20.142615+0000","last_active":"2024-09-07T03:32:50.272008+0000","last_peered":"2024-09-07T03:32:50.272008+0000","last_clean":"2024-09-07T03:32:50.272008+0000","last_became_active":"2024-09-07T03:32:20.142322+0000","last_became_peered":"2024-09-07T03:32:20.142322+0000","last_unstale":"2024-09-07T03:32:50.272008+0000","last_undegraded":"2024-09-07T03:32:50.272008+0000","last_fullsized":"2024-09-07T03:32:50.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:20:24.113543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:29.408557+0000","last_change":"2024-09-07T03:36:29.408498+0000","last_active":"2024-09-07T03:36:29.408557+0000","last_peered":"2024-09-07T03:36:29.408557+0000","last_clean":"2024-09-07T03:36:29.408557+0000","last_became_active":"2024-09-07T03:32:22.139771+0000","last_became_peered":"2024-09-07T03:32:22.139771+0000","last_unstale":"2024-09-07T03:36:29.408557+0000","last_undegraded":"2024-09-07T03:36:29.408557+0000","last_fullsized":"2024-09-07T03:36:29.408557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:29.408383+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:29.408383+0000","last_clean_scrub_stamp":"2024-09-07T03:36:29.408383+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:32:25.559203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:00.054612+0000","last_change":"2024-09-07T03:36:00.054612+0000","last_active":"2024-09-07T03:36:00.054612+0000","last_peered":"2024-09-07T03:36:00.054612+0000","last_clean":"2024-09-07T03:36:00.054612+0000","last_became_active":"2024-09-07T03:32:14.122182+0000","last_became_peered":"2024-09-07T03:32:14.122182+0000","last_unstale":"2024-09-07T03:36:00.054612+0000","last_undegraded":"2024-09-07T03:36:00.054612+0000","last_fullsized":"2024-09-07T03:36:00.054612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:00.054529+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:00.054529+0000","last_clean_scrub_stamp":"2024-09-07T03:36:00.054529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:19.965534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.971146+0000","last_change":"2024-09-07T03:35:42.971146+0000","last_active":"2024-09-07T03:35:42.971146+0000","last_peered":"2024-09-07T03:35:42.971146+0000","last_clean":"2024-09-07T03:35:42.971146+0000","last_became_active":"2024-09-07T03:32:12.120464+0000","last_became_peered":"2024-09-07T03:32:12.120464+0000","last_unstale":"2024-09-07T03:35:42.971146+0000","last_undegraded":"2024-09-07T03:35:42.971146+0000","last_fullsized":"2024-09-07T03:35:42.971146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:42.971064+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:42.971064+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.971064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:22:31.004500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.065138+0000","last_change":"2024-09-07T03:36:05.065138+0000","last_active":"2024-09-07T03:36:05.065138+0000","last_peered":"2024-09-07T03:36:05.065138+0000","last_clean":"2024-09-07T03:36:05.065138+0000","last_became_active":"2024-09-07T03:32:16.124297+0000","last_became_peered":"2024-09-07T03:32:16.124297+0000","last_unstale":"2024-09-07T03:36:05.065138+0000","last_undegraded":"2024-09-07T03:36:05.065138+0000","last_fullsized":"2024-09-07T03:36:05.065138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:05.065024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:05.065024+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.065024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:25:49.643840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'61","reported_seq":131,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:26.941042+0000","last_change":"2024-09-07T03:36:26.941042+0000","last_active":"2024-09-07T03:36:26.941042+0000","last_peered":"2024-09-07T03:36:26.941042+0000","last_clean":"2024-09-07T03:36:26.941042+0000","last_became_active":"2024-09-07T03:32:18.129944+0000","last_became_peered":"2024-09-07T03:32:18.129944+0000","last_unstale":"2024-09-07T03:36:26.941042+0000","last_undegraded":"2024-09-07T03:36:26.941042+0000","last_fullsized":"2024-09-07T03:36:26.941042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'61","last_scrub_stamp":"2024-09-07T03:36:26.940938+0000","last_deep_scrub":"36'61","last_deep_scrub_stamp":"2024-09-07T03:36:26.940938+0000","last_clean_scrub_stamp":"2024-09-07T03:36:26.940938+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:45:53.093731+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'286","reported_seq":361,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:13.224845+0000","last_change":"2024-09-07T03:36:13.224845+0000","last_active":"2024-09-07T03:36:13.224845+0000","last_peered":"2024-09-07T03:36:13.224845+0000","last_clean":"2024-09-07T03:36:13.224845+0000","last_became_active":"2024-09-07T03:32:20.144077+0000","last_became_peered":"2024-09-07T03:32:20.144077+0000","last_unstale":"2024-09-07T03:36:13.224845+0000","last_undegraded":"2024-09-07T03:36:13.224845+0000","last_fullsized":"2024-09-07T03:36:13.224845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:13.224759+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:13.224759+0000","last_clean_scrub_stamp":"2024-09-07T03:36:13.224759+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:36:08.999718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:31.389824+0000","last_change":"2024-09-07T03:36:31.389824+0000","last_active":"2024-09-07T03:36:31.389824+0000","last_peered":"2024-09-07T03:36:31.389824+0000","last_clean":"2024-09-07T03:36:31.389824+0000","last_became_active":"2024-09-07T03:32:22.145690+0000","last_became_peered":"2024-09-07T03:32:22.145690+0000","last_unstale":"2024-09-07T03:36:31.389824+0000","last_undegraded":"2024-09-07T03:36:31.389824+0000","last_fullsized":"2024-09-07T03:36:31.389824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:31.389724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:31.389724+0000","last_clean_scrub_stamp":"2024-09-07T03:36:31.389724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:57:07.352696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'7","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.092414+0000","last_change":"2024-09-07T03:35:50.092414+0000","last_active":"2024-09-07T03:35:50.092414+0000","last_peered":"2024-09-07T03:35:50.092414+0000","last_clean":"2024-09-07T03:35:50.092414+0000","last_became_active":"2024-09-07T03:32:14.113104+0000","last_became_peered":"2024-09-07T03:32:14.113104+0000","last_unstale":"2024-09-07T03:35:50.092414+0000","last_undegraded":"2024-09-07T03:35:50.092414+0000","last_fullsized":"2024-09-07T03:35:50.092414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-07T03:35:50.092309+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-07T03:35:50.092309+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.092309+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:22:24.668039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.984704+0000","last_change":"2024-09-07T03:35:41.984704+0000","last_active":"2024-09-07T03:35:41.984704+0000","last_peered":"2024-09-07T03:35:41.984704+0000","last_clean":"2024-09-07T03:35:41.984704+0000","last_became_active":"2024-09-07T03:32:12.125172+0000","last_became_peered":"2024-09-07T03:32:12.125172+0000","last_unstale":"2024-09-07T03:35:41.984704+0000","last_undegraded":"2024-09-07T03:35:41.984704+0000","last_fullsized":"2024-09-07T03:35:41.984704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.984625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.984625+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.984625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:03:57.662456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.044663+0000","last_change":"2024-09-07T03:36:04.044663+0000","last_active":"2024-09-07T03:36:04.044663+0000","last_peered":"2024-09-07T03:36:04.044663+0000","last_clean":"2024-09-07T03:36:04.044663+0000","last_became_active":"2024-09-07T03:32:16.125618+0000","last_became_peered":"2024-09-07T03:32:16.125618+0000","last_unstale":"2024-09-07T03:36:04.044663+0000","last_undegraded":"2024-09-07T03:36:04.044663+0000","last_fullsized":"2024-09-07T03:36:04.044663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:04.044581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:04.044581+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.044581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:31:12.541438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'79","reported_seq":164,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:22.096434+0000","last_change":"2024-09-07T03:36:22.096434+0000","last_active":"2024-09-07T03:36:22.096434+0000","last_peered":"2024-09-07T03:36:22.096434+0000","last_clean":"2024-09-07T03:36:22.096434+0000","last_became_active":"2024-09-07T03:32:18.134005+0000","last_became_peered":"2024-09-07T03:32:18.134005+0000","last_unstale":"2024-09-07T03:36:22.096434+0000","last_undegraded":"2024-09-07T03:36:22.096434+0000","last_fullsized":"2024-09-07T03:36:22.096434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'79","last_scrub_stamp":"2024-09-07T03:36:22.096345+0000","last_deep_scrub":"36'79","last_deep_scrub_stamp":"2024-09-07T03:36:22.096345+0000","last_clean_scrub_stamp":"2024-09-07T03:36:22.096345+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:11.974302+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.137535+0000","last_change":"2024-09-07T03:36:11.137535+0000","last_active":"2024-09-07T03:36:11.137535+0000","last_peered":"2024-09-07T03:36:11.137535+0000","last_clean":"2024-09-07T03:36:11.137535+0000","last_became_active":"2024-09-07T03:32:20.145119+0000","last_became_peered":"2024-09-07T03:32:20.145119+0000","last_unstale":"2024-09-07T03:36:11.137535+0000","last_undegraded":"2024-09-07T03:36:11.137535+0000","last_fullsized":"2024-09-07T03:36:11.137535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:11.137456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:11.137456+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.137456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:48:09.966265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:32.434239+0000","last_change":"2024-09-07T03:36:32.434239+0000","last_active":"2024-09-07T03:36:32.434239+0000","last_peered":"2024-09-07T03:36:32.434239+0000","last_clean":"2024-09-07T03:36:32.434239+0000","last_became_active":"2024-09-07T03:32:22.149203+0000","last_became_peered":"2024-09-07T03:32:22.149203+0000","last_unstale":"2024-09-07T03:36:32.434239+0000","last_undegraded":"2024-09-07T03:36:32.434239+0000","last_fullsized":"2024-09-07T03:36:32.434239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-07T03:36:32.434140+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-07T03:36:32.434140+0000","last_clean_scrub_stamp":"2024-09-07T03:36:32.434140+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:29:15.586564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.151181+0000","last_change":"2024-09-07T03:35:53.151181+0000","last_active":"2024-09-07T03:35:53.151181+0000","last_peered":"2024-09-07T03:35:53.151181+0000","last_clean":"2024-09-07T03:35:53.151181+0000","last_became_active":"2024-09-07T03:32:14.124120+0000","last_became_peered":"2024-09-07T03:32:14.124120+0000","last_unstale":"2024-09-07T03:35:53.151181+0000","last_undegraded":"2024-09-07T03:35:53.151181+0000","last_fullsized":"2024-09-07T03:35:53.151181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:35:53.151087+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:35:53.151087+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.151087+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:29:35.373709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.127043+0000","last_change":"2024-09-07T03:35:38.127043+0000","last_active":"2024-09-07T03:35:38.127043+0000","last_peered":"2024-09-07T03:35:38.127043+0000","last_clean":"2024-09-07T03:35:38.127043+0000","last_became_active":"2024-09-07T03:32:12.133434+0000","last_became_peered":"2024-09-07T03:32:12.133434+0000","last_unstale":"2024-09-07T03:35:38.127043+0000","last_undegraded":"2024-09-07T03:35:38.127043+0000","last_fullsized":"2024-09-07T03:35:38.127043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.126948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.126948+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.126948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:20:49.410859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.060042+0000","last_change":"2024-09-07T03:36:06.060042+0000","last_active":"2024-09-07T03:36:06.060042+0000","last_peered":"2024-09-07T03:36:06.060042+0000","last_clean":"2024-09-07T03:36:06.060042+0000","last_became_active":"2024-09-07T03:32:16.121256+0000","last_became_peered":"2024-09-07T03:32:16.121256+0000","last_unstale":"2024-09-07T03:36:06.060042+0000","last_undegraded":"2024-09-07T03:36:06.060042+0000","last_fullsized":"2024-09-07T03:36:06.060042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:06.059956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:06.059956+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.059956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:16.523793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'48","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:28.917647+0000","last_change":"2024-09-07T03:36:28.917647+0000","last_active":"2024-09-07T03:36:28.917647+0000","last_peered":"2024-09-07T03:36:28.917647+0000","last_clean":"2024-09-07T03:36:28.917647+0000","last_became_active":"2024-09-07T03:32:18.128470+0000","last_became_peered":"2024-09-07T03:32:18.128470+0000","last_unstale":"2024-09-07T03:36:28.917647+0000","last_undegraded":"2024-09-07T03:36:28.917647+0000","last_fullsized":"2024-09-07T03:36:28.917647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-07T03:36:28.917533+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-07T03:36:28.917533+0000","last_clean_scrub_stamp":"2024-09-07T03:36:28.917533+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:57:04.902875+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276446+0000","last_change":"2024-09-07T03:32:20.136526+0000","last_active":"2024-09-07T03:32:50.276446+0000","last_peered":"2024-09-07T03:32:50.276446+0000","last_clean":"2024-09-07T03:32:50.276446+0000","last_became_active":"2024-09-07T03:32:20.134892+0000","last_became_peered":"2024-09-07T03:32:20.134892+0000","last_unstale":"2024-09-07T03:32:50.276446+0000","last_undegraded":"2024-09-07T03:32:50.276446+0000","last_fullsized":"2024-09-07T03:32:50.276446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:28.142767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.947552+0000","last_change":"2024-09-07T03:32:22.153373+0000","last_active":"2024-09-07T03:35:23.947552+0000","last_peered":"2024-09-07T03:35:23.947552+0000","last_clean":"2024-09-07T03:35:23.947552+0000","last_became_active":"2024-09-07T03:32:22.153134+0000","last_became_peered":"2024-09-07T03:32:22.153134+0000","last_unstale":"2024-09-07T03:35:23.947552+0000","last_undegraded":"2024-09-07T03:35:23.947552+0000","last_fullsized":"2024-09-07T03:35:23.947552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.022341+0000","last_change":"2024-09-07T03:36:04.022341+0000","last_active":"2024-09-07T03:36:04.022341+0000","last_peered":"2024-09-07T03:36:04.022341+0000","last_clean":"2024-09-07T03:36:04.022341+0000","last_became_active":"2024-09-07T03:32:14.113243+0000","last_became_peered":"2024-09-07T03:32:14.113243+0000","last_unstale":"2024-09-07T03:36:04.022341+0000","last_undegraded":"2024-09-07T03:36:04.022341+0000","last_fullsized":"2024-09-07T03:36:04.022341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:04.022255+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:04.022255+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.022255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:20:24.399977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.990088+0000","last_change":"2024-09-07T03:35:40.990026+0000","last_active":"2024-09-07T03:35:40.990088+0000","last_peered":"2024-09-07T03:35:40.990088+0000","last_clean":"2024-09-07T03:35:40.990088+0000","last_became_active":"2024-09-07T03:32:12.120531+0000","last_became_peered":"2024-09-07T03:32:12.120531+0000","last_unstale":"2024-09-07T03:35:40.990088+0000","last_undegraded":"2024-09-07T03:35:40.990088+0000","last_fullsized":"2024-09-07T03:35:40.990088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.989938+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.989938+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.989938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:58:08.481418+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.330556+0000","last_change":"2024-09-07T03:36:11.330556+0000","last_active":"2024-09-07T03:36:11.330556+0000","last_peered":"2024-09-07T03:36:11.330556+0000","last_clean":"2024-09-07T03:36:11.330556+0000","last_became_active":"2024-09-07T03:32:16.124100+0000","last_became_peered":"2024-09-07T03:32:16.124100+0000","last_unstale":"2024-09-07T03:36:11.330556+0000","last_undegraded":"2024-09-07T03:36:11.330556+0000","last_fullsized":"2024-09-07T03:36:11.330556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:11.330470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:11.330470+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.330470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:05:30.256377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.062144+0000","last_change":"2024-09-07T03:36:08.062144+0000","last_active":"2024-09-07T03:36:08.062144+0000","last_peered":"2024-09-07T03:36:08.062144+0000","last_clean":"2024-09-07T03:36:08.062144+0000","last_became_active":"2024-09-07T03:32:18.130120+0000","last_became_peered":"2024-09-07T03:32:18.130120+0000","last_unstale":"2024-09-07T03:36:08.062144+0000","last_undegraded":"2024-09-07T03:36:08.062144+0000","last_fullsized":"2024-09-07T03:36:08.062144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-07T03:36:08.062043+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-07T03:36:08.062043+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.062043+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:30:18.972937+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'286","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:12.184718+0000","last_change":"2024-09-07T03:36:12.184718+0000","last_active":"2024-09-07T03:36:12.184718+0000","last_peered":"2024-09-07T03:36:12.184718+0000","last_clean":"2024-09-07T03:36:12.184718+0000","last_became_active":"2024-09-07T03:32:20.146408+0000","last_became_peered":"2024-09-07T03:32:20.146408+0000","last_unstale":"2024-09-07T03:36:12.184718+0000","last_undegraded":"2024-09-07T03:36:12.184718+0000","last_fullsized":"2024-09-07T03:36:12.184718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:12.184620+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:12.184620+0000","last_clean_scrub_stamp":"2024-09-07T03:36:12.184620+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:24:53.862170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:28.360069+0000","last_change":"2024-09-07T03:36:28.360011+0000","last_active":"2024-09-07T03:36:28.360069+0000","last_peered":"2024-09-07T03:36:28.360069+0000","last_clean":"2024-09-07T03:36:28.360069+0000","last_became_active":"2024-09-07T03:32:22.145911+0000","last_became_peered":"2024-09-07T03:32:22.145911+0000","last_unstale":"2024-09-07T03:36:28.360069+0000","last_undegraded":"2024-09-07T03:36:28.360069+0000","last_fullsized":"2024-09-07T03:36:28.360069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-07T03:36:28.359908+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-07T03:36:28.359908+0000","last_clean_scrub_stamp":"2024-09-07T03:36:28.359908+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:06:23.061063+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.101986+0000","last_change":"2024-09-07T03:35:48.101986+0000","last_active":"2024-09-07T03:35:48.101986+0000","last_peered":"2024-09-07T03:35:48.101986+0000","last_clean":"2024-09-07T03:35:48.101986+0000","last_became_active":"2024-09-07T03:32:14.112499+0000","last_became_peered":"2024-09-07T03:32:14.112499+0000","last_unstale":"2024-09-07T03:35:48.101986+0000","last_undegraded":"2024-09-07T03:35:48.101986+0000","last_fullsized":"2024-09-07T03:35:48.101986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:48.101897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:48.101897+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.101897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:11:08.140746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.054699+0000","last_change":"2024-09-07T03:35:36.054642+0000","last_active":"2024-09-07T03:35:36.054699+0000","last_peered":"2024-09-07T03:35:36.054699+0000","last_clean":"2024-09-07T03:35:36.054699+0000","last_became_active":"2024-09-07T03:32:12.132462+0000","last_became_peered":"2024-09-07T03:32:12.132462+0000","last_unstale":"2024-09-07T03:35:36.054699+0000","last_undegraded":"2024-09-07T03:35:36.054699+0000","last_fullsized":"2024-09-07T03:35:36.054699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:36.054527+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:36.054527+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.054527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:13:11.473174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'10","reported_seq":628,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:21.911416+0000","last_change":"2024-09-07T03:36:21.911416+0000","last_active":"2024-09-07T03:36:21.911416+0000","last_peered":"2024-09-07T03:36:21.911416+0000","last_clean":"2024-09-07T03:36:21.911416+0000","last_became_active":"2024-09-07T03:32:16.124500+0000","last_became_peered":"2024-09-07T03:32:16.124500+0000","last_unstale":"2024-09-07T03:36:21.911416+0000","last_undegraded":"2024-09-07T03:36:21.911416+0000","last_fullsized":"2024-09-07T03:36:21.911416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:36:21.911303+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:36:21.911303+0000","last_clean_scrub_stamp":"2024-09-07T03:36:21.911303+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:17:52.572910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'16","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:23.081728+0000","last_change":"2024-09-07T03:36:23.081728+0000","last_active":"2024-09-07T03:36:23.081728+0000","last_peered":"2024-09-07T03:36:23.081728+0000","last_clean":"2024-09-07T03:36:23.081728+0000","last_became_active":"2024-09-07T03:32:50.278739+0000","last_became_peered":"2024-09-07T03:32:50.278739+0000","last_unstale":"2024-09-07T03:36:23.081728+0000","last_undegraded":"2024-09-07T03:36:23.081728+0000","last_fullsized":"2024-09-07T03:36:23.081728+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:36:23.081619+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:36:23.081619+0000","last_clean_scrub_stamp":"2024-09-07T03:36:23.081619+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:38:14.997831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.541844+0000","last_change":"2024-09-07T03:32:20.140656+0000","last_active":"2024-09-07T03:35:30.541844+0000","last_peered":"2024-09-07T03:35:30.541844+0000","last_clean":"2024-09-07T03:35:30.541844+0000","last_became_active":"2024-09-07T03:32:20.140148+0000","last_became_peered":"2024-09-07T03:32:20.140148+0000","last_unstale":"2024-09-07T03:35:30.541844+0000","last_undegraded":"2024-09-07T03:35:30.541844+0000","last_fullsized":"2024-09-07T03:35:30.541844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:49:10.352295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:18.066024+0000","last_change":"2024-09-07T03:36:18.065963+0000","last_active":"2024-09-07T03:36:18.066024+0000","last_peered":"2024-09-07T03:36:18.066024+0000","last_clean":"2024-09-07T03:36:18.066024+0000","last_became_active":"2024-09-07T03:32:22.147049+0000","last_became_peered":"2024-09-07T03:32:22.147049+0000","last_unstale":"2024-09-07T03:36:18.066024+0000","last_undegraded":"2024-09-07T03:36:18.066024+0000","last_fullsized":"2024-09-07T03:36:18.066024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:18.065859+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:18.065859+0000","last_clean_scrub_stamp":"2024-09-07T03:36:18.065859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:36:07.319592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.155584+0000","last_change":"2024-09-07T03:35:54.155584+0000","last_active":"2024-09-07T03:35:54.155584+0000","last_peered":"2024-09-07T03:35:54.155584+0000","last_clean":"2024-09-07T03:35:54.155584+0000","last_became_active":"2024-09-07T03:32:14.124083+0000","last_became_peered":"2024-09-07T03:32:14.124083+0000","last_unstale":"2024-09-07T03:35:54.155584+0000","last_undegraded":"2024-09-07T03:35:54.155584+0000","last_fullsized":"2024-09-07T03:35:54.155584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:54.155500+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:54.155500+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.155500+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:36:53.745026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.109943+0000","last_change":"2024-09-07T03:35:39.109873+0000","last_active":"2024-09-07T03:35:39.109943+0000","last_peered":"2024-09-07T03:35:39.109943+0000","last_clean":"2024-09-07T03:35:39.109943+0000","last_became_active":"2024-09-07T03:32:12.141314+0000","last_became_peered":"2024-09-07T03:32:12.141314+0000","last_unstale":"2024-09-07T03:35:39.109943+0000","last_undegraded":"2024-09-07T03:35:39.109943+0000","last_fullsized":"2024-09-07T03:35:39.109943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:39.109787+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:39.109787+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.109787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:13:50.111247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:13.021335+0000","last_change":"2024-09-07T03:36:13.021335+0000","last_active":"2024-09-07T03:36:13.021335+0000","last_peered":"2024-09-07T03:36:13.021335+0000","last_clean":"2024-09-07T03:36:13.021335+0000","last_became_active":"2024-09-07T03:32:16.128099+0000","last_became_peered":"2024-09-07T03:32:16.128099+0000","last_unstale":"2024-09-07T03:36:13.021335+0000","last_undegraded":"2024-09-07T03:36:13.021335+0000","last_fullsized":"2024-09-07T03:36:13.021335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:13.021226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:13.021226+0000","last_clean_scrub_stamp":"2024-09-07T03:36:13.021226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:38:22.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:29.876811+0000","last_change":"2024-09-07T03:36:29.876811+0000","last_active":"2024-09-07T03:36:29.876811+0000","last_peered":"2024-09-07T03:36:29.876811+0000","last_clean":"2024-09-07T03:36:29.876811+0000","last_became_active":"2024-09-07T03:32:18.128679+0000","last_became_peered":"2024-09-07T03:32:18.128679+0000","last_unstale":"2024-09-07T03:36:29.876811+0000","last_undegraded":"2024-09-07T03:36:29.876811+0000","last_fullsized":"2024-09-07T03:36:29.876811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-07T03:36:29.876725+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-07T03:36:29.876725+0000","last_clean_scrub_stamp":"2024-09-07T03:36:29.876725+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:12:58.364983+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.280409+0000","last_change":"2024-09-07T03:32:20.132823+0000","last_active":"2024-09-07T03:32:50.280409+0000","last_peered":"2024-09-07T03:32:50.280409+0000","last_clean":"2024-09-07T03:32:50.280409+0000","last_became_active":"2024-09-07T03:32:20.132479+0000","last_became_peered":"2024-09-07T03:32:20.132479+0000","last_unstale":"2024-09-07T03:32:50.280409+0000","last_undegraded":"2024-09-07T03:32:50.280409+0000","last_fullsized":"2024-09-07T03:32:50.280409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:52.924800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'10","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:30.430448+0000","last_change":"2024-09-07T03:36:30.430336+0000","last_active":"2024-09-07T03:36:30.430448+0000","last_peered":"2024-09-07T03:36:30.430448+0000","last_clean":"2024-09-07T03:36:30.430448+0000","last_became_active":"2024-09-07T03:32:22.140389+0000","last_became_peered":"2024-09-07T03:32:22.140389+0000","last_unstale":"2024-09-07T03:36:30.430448+0000","last_undegraded":"2024-09-07T03:36:30.430448+0000","last_fullsized":"2024-09-07T03:36:30.430448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:36:30.430238+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:36:30.430238+0000","last_clean_scrub_stamp":"2024-09-07T03:36:30.430238+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:32:00.684293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'14","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.078269+0000","last_change":"2024-09-07T03:35:58.078213+0000","last_active":"2024-09-07T03:35:58.078269+0000","last_peered":"2024-09-07T03:35:58.078269+0000","last_clean":"2024-09-07T03:35:58.078269+0000","last_became_active":"2024-09-07T03:32:14.112612+0000","last_became_peered":"2024-09-07T03:32:14.112612+0000","last_unstale":"2024-09-07T03:35:58.078269+0000","last_undegraded":"2024-09-07T03:35:58.078269+0000","last_fullsized":"2024-09-07T03:35:58.078269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-07T03:35:58.078128+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-07T03:35:58.078128+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.078128+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:18:12.312460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"36'74","reported_seq":155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:34.263530+0000","last_change":"2024-09-07T03:35:34.263470+0000","last_active":"2024-09-07T03:35:34.263530+0000","last_peered":"2024-09-07T03:35:34.263530+0000","last_clean":"2024-09-07T03:35:34.263530+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:35:34.263530+0000","last_undegraded":"2024-09-07T03:35:34.263530+0000","last_fullsized":"2024-09-07T03:35:34.263530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-09-07T03:35:34.263378+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-09-07T03:35:34.263378+0000","last_clean_scrub_stamp":"2024-09-07T03:35:34.263378+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:30:23.857990+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.055044+0000","last_change":"2024-09-07T03:35:36.054987+0000","last_active":"2024-09-07T03:35:36.055044+0000","last_peered":"2024-09-07T03:35:36.055044+0000","last_clean":"2024-09-07T03:35:36.055044+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:35:36.055044+0000","last_undegraded":"2024-09-07T03:35:36.055044+0000","last_fullsized":"2024-09-07T03:35:36.055044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:36.054875+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:36.054875+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.054875+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:03.880806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.060353+0000","last_change":"2024-09-07T03:35:35.060262+0000","last_active":"2024-09-07T03:35:35.060353+0000","last_peered":"2024-09-07T03:35:35.060353+0000","last_clean":"2024-09-07T03:35:35.060353+0000","last_became_active":"2024-09-07T03:32:12.130323+0000","last_became_peered":"2024-09-07T03:32:12.130323+0000","last_unstale":"2024-09-07T03:35:35.060353+0000","last_undegraded":"2024-09-07T03:35:35.060353+0000","last_fullsized":"2024-09-07T03:35:35.060353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:35.060153+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:35.060153+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.060153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:51.353906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.210182+0000","last_change":"2024-09-07T03:36:06.210120+0000","last_active":"2024-09-07T03:36:06.210182+0000","last_peered":"2024-09-07T03:36:06.210182+0000","last_clean":"2024-09-07T03:36:06.210182+0000","last_became_active":"2024-09-07T03:32:16.126915+0000","last_became_peered":"2024-09-07T03:32:16.126915+0000","last_unstale":"2024-09-07T03:36:06.210182+0000","last_undegraded":"2024-09-07T03:36:06.210182+0000","last_fullsized":"2024-09-07T03:36:06.210182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:06.210045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:06.210045+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.210045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:59:32.681075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'99","reported_seq":195,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:25.897608+0000","last_change":"2024-09-07T03:36:25.897608+0000","last_active":"2024-09-07T03:36:25.897608+0000","last_peered":"2024-09-07T03:36:25.897608+0000","last_clean":"2024-09-07T03:36:25.897608+0000","last_became_active":"2024-09-07T03:32:18.129224+0000","last_became_peered":"2024-09-07T03:32:18.129224+0000","last_unstale":"2024-09-07T03:36:25.897608+0000","last_undegraded":"2024-09-07T03:36:25.897608+0000","last_fullsized":"2024-09-07T03:36:25.897608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'99","last_scrub_stamp":"2024-09-07T03:36:25.897515+0000","last_deep_scrub":"36'99","last_deep_scrub_stamp":"2024-09-07T03:36:25.897515+0000","last_clean_scrub_stamp":"2024-09-07T03:36:25.897515+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:25:22.289081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:31.086369+0000","last_change":"2024-09-07T03:36:31.086369+0000","last_active":"2024-09-07T03:36:31.086369+0000","last_peered":"2024-09-07T03:36:31.086369+0000","last_clean":"2024-09-07T03:36:31.086369+0000","last_became_active":"2024-09-07T03:32:20.134819+0000","last_became_peered":"2024-09-07T03:32:20.134819+0000","last_unstale":"2024-09-07T03:36:31.086369+0000","last_undegraded":"2024-09-07T03:36:31.086369+0000","last_fullsized":"2024-09-07T03:36:31.086369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:31.086289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:31.086289+0000","last_clean_scrub_stamp":"2024-09-07T03:36:31.086289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:28.775498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'84","reported_seq":174,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:20.111631+0000","last_change":"2024-09-07T03:36:20.111631+0000","last_active":"2024-09-07T03:36:20.111631+0000","last_peered":"2024-09-07T03:36:20.111631+0000","last_clean":"2024-09-07T03:36:20.111631+0000","last_became_active":"2024-09-07T03:32:22.151817+0000","last_became_peered":"2024-09-07T03:32:22.151817+0000","last_unstale":"2024-09-07T03:36:20.111631+0000","last_undegraded":"2024-09-07T03:36:20.111631+0000","last_fullsized":"2024-09-07T03:36:20.111631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'84","last_scrub_stamp":"2024-09-07T03:36:20.111549+0000","last_deep_scrub":"36'84","last_deep_scrub_stamp":"2024-09-07T03:36:20.111549+0000","last_clean_scrub_stamp":"2024-09-07T03:36:20.111549+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:21:36.936020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'16","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.052002+0000","last_change":"2024-09-07T03:35:57.052002+0000","last_active":"2024-09-07T03:35:57.052002+0000","last_peered":"2024-09-07T03:35:57.052002+0000","last_clean":"2024-09-07T03:35:57.052002+0000","last_became_active":"2024-09-07T03:32:14.130484+0000","last_became_peered":"2024-09-07T03:32:14.130484+0000","last_unstale":"2024-09-07T03:35:57.052002+0000","last_undegraded":"2024-09-07T03:35:57.052002+0000","last_fullsized":"2024-09-07T03:35:57.052002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:35:57.051894+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:35:57.051894+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.051894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:57:19.853822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:34.143372+0000","last_change":"2024-09-07T03:35:34.143292+0000","last_active":"2024-09-07T03:35:34.143372+0000","last_peered":"2024-09-07T03:35:34.143372+0000","last_clean":"2024-09-07T03:35:34.143372+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:35:34.143372+0000","last_undegraded":"2024-09-07T03:35:34.143372+0000","last_fullsized":"2024-09-07T03:35:34.143372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:34.143191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:34.143191+0000","last_clean_scrub_stamp":"2024-09-07T03:35:34.143191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:36:29.075222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.175022+0000","last_change":"2024-09-07T03:35:37.174918+0000","last_active":"2024-09-07T03:35:37.175022+0000","last_peered":"2024-09-07T03:35:37.175022+0000","last_clean":"2024-09-07T03:35:37.175022+0000","last_became_active":"2024-09-07T03:32:12.124522+0000","last_became_peered":"2024-09-07T03:32:12.124522+0000","last_unstale":"2024-09-07T03:35:37.175022+0000","last_undegraded":"2024-09-07T03:35:37.175022+0000","last_fullsized":"2024-09-07T03:35:37.175022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.174806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.174806+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.174806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:06:10.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:18.931945+0000","last_change":"2024-09-07T03:36:18.931945+0000","last_active":"2024-09-07T03:36:18.931945+0000","last_peered":"2024-09-07T03:36:18.931945+0000","last_clean":"2024-09-07T03:36:18.931945+0000","last_became_active":"2024-09-07T03:32:16.124243+0000","last_became_peered":"2024-09-07T03:32:16.124243+0000","last_unstale":"2024-09-07T03:36:18.931945+0000","last_undegraded":"2024-09-07T03:36:18.931945+0000","last_fullsized":"2024-09-07T03:36:18.931945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:18.931814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:18.931814+0000","last_clean_scrub_stamp":"2024-09-07T03:36:18.931814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:26:06.944290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'301","reported_seq":533,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:18.268583+0000","last_change":"2024-09-07T03:36:18.268524+0000","last_active":"2024-09-07T03:36:18.268583+0000","last_peered":"2024-09-07T03:36:18.268583+0000","last_clean":"2024-09-07T03:36:18.268583+0000","last_became_active":"2024-09-07T03:32:18.132579+0000","last_became_peered":"2024-09-07T03:32:18.132579+0000","last_unstale":"2024-09-07T03:36:18.268583+0000","last_undegraded":"2024-09-07T03:36:18.268583+0000","last_fullsized":"2024-09-07T03:36:18.268583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'301","last_scrub_stamp":"2024-09-07T03:36:18.268410+0000","last_deep_scrub":"36'301","last_deep_scrub_stamp":"2024-09-07T03:36:18.268410+0000","last_clean_scrub_stamp":"2024-09-07T03:36:18.268410+0000","objects_scrubbed":11,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:42:45.312029+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:26.229130+0000","last_change":"2024-09-07T03:32:20.141318+0000","last_active":"2024-09-07T03:34:26.229130+0000","last_peered":"2024-09-07T03:34:26.229130+0000","last_clean":"2024-09-07T03:34:26.229130+0000","last_became_active":"2024-09-07T03:32:20.141044+0000","last_became_peered":"2024-09-07T03:32:20.141044+0000","last_unstale":"2024-09-07T03:34:26.229130+0000","last_undegraded":"2024-09-07T03:34:26.229130+0000","last_fullsized":"2024-09-07T03:34:26.229130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:33:38.806191+0000","last_change":"2024-09-07T03:32:22.143631+0000","last_active":"2024-09-07T03:33:38.806191+0000","last_peered":"2024-09-07T03:33:38.806191+0000","last_clean":"2024-09-07T03:33:38.806191+0000","last_became_active":"2024-09-07T03:32:22.143337+0000","last_became_peered":"2024-09-07T03:32:22.143337+0000","last_unstale":"2024-09-07T03:33:38.806191+0000","last_undegraded":"2024-09-07T03:33:38.806191+0000","last_fullsized":"2024-09-07T03:33:38.806191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:26:30.421368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":64,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.151403+0000","last_change":"2024-09-07T03:35:52.151332+0000","last_active":"2024-09-07T03:35:52.151403+0000","last_peered":"2024-09-07T03:35:52.151403+0000","last_clean":"2024-09-07T03:35:52.151403+0000","last_became_active":"2024-09-07T03:32:14.127288+0000","last_became_peered":"2024-09-07T03:32:14.127288+0000","last_unstale":"2024-09-07T03:35:52.151403+0000","last_undegraded":"2024-09-07T03:35:52.151403+0000","last_fullsized":"2024-09-07T03:35:52.151403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:52.151246+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:52.151246+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.151246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:14:33.440532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.067289+0000","last_change":"2024-09-07T03:35:36.067219+0000","last_active":"2024-09-07T03:35:36.067289+0000","last_peered":"2024-09-07T03:35:36.067289+0000","last_clean":"2024-09-07T03:35:36.067289+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:35:36.067289+0000","last_undegraded":"2024-09-07T03:35:36.067289+0000","last_fullsized":"2024-09-07T03:35:36.067289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:36.067138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:36.067138+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.067138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:05.511968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.155695+0000","last_change":"2024-09-07T03:35:39.155583+0000","last_active":"2024-09-07T03:35:39.155695+0000","last_peered":"2024-09-07T03:35:39.155695+0000","last_clean":"2024-09-07T03:35:39.155695+0000","last_became_active":"2024-09-07T03:32:12.139224+0000","last_became_peered":"2024-09-07T03:32:12.139224+0000","last_unstale":"2024-09-07T03:35:39.155695+0000","last_undegraded":"2024-09-07T03:35:39.155695+0000","last_fullsized":"2024-09-07T03:35:39.155695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:39.155484+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:39.155484+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.155484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:35:35.465606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.030703+0000","last_change":"2024-09-07T03:36:02.030703+0000","last_active":"2024-09-07T03:36:02.030703+0000","last_peered":"2024-09-07T03:36:02.030703+0000","last_clean":"2024-09-07T03:36:02.030703+0000","last_became_active":"2024-09-07T03:32:16.121817+0000","last_became_peered":"2024-09-07T03:32:16.121817+0000","last_unstale":"2024-09-07T03:36:02.030703+0000","last_undegraded":"2024-09-07T03:36:02.030703+0000","last_fullsized":"2024-09-07T03:36:02.030703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:02.030606+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:02.030606+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.030606+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:38:02.109551+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'24","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:24.878326+0000","last_change":"2024-09-07T03:36:24.878216+0000","last_active":"2024-09-07T03:36:24.878326+0000","last_peered":"2024-09-07T03:36:24.878326+0000","last_clean":"2024-09-07T03:36:24.878326+0000","last_became_active":"2024-09-07T03:32:18.129264+0000","last_became_peered":"2024-09-07T03:32:18.129264+0000","last_unstale":"2024-09-07T03:36:24.878326+0000","last_undegraded":"2024-09-07T03:36:24.878326+0000","last_fullsized":"2024-09-07T03:36:24.878326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-07T03:36:24.878113+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-07T03:36:24.878113+0000","last_clean_scrub_stamp":"2024-09-07T03:36:24.878113+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:04:55.841497+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:23.275876+0000","last_change":"2024-09-07T03:36:23.275764+0000","last_active":"2024-09-07T03:36:23.275876+0000","last_peered":"2024-09-07T03:36:23.275876+0000","last_clean":"2024-09-07T03:36:23.275876+0000","last_became_active":"2024-09-07T03:32:20.142764+0000","last_became_peered":"2024-09-07T03:32:20.142764+0000","last_unstale":"2024-09-07T03:36:23.275876+0000","last_undegraded":"2024-09-07T03:36:23.275876+0000","last_fullsized":"2024-09-07T03:36:23.275876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:23.275673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:23.275673+0000","last_clean_scrub_stamp":"2024-09-07T03:36:23.275673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:55.667173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.272193+0000","last_change":"2024-09-07T03:32:22.147788+0000","last_active":"2024-09-07T03:32:50.272193+0000","last_peered":"2024-09-07T03:32:50.272193+0000","last_clean":"2024-09-07T03:32:50.272193+0000","last_became_active":"2024-09-07T03:32:22.147510+0000","last_became_peered":"2024-09-07T03:32:22.147510+0000","last_unstale":"2024-09-07T03:32:50.272193+0000","last_undegraded":"2024-09-07T03:32:50.272193+0000","last_fullsized":"2024-09-07T03:32:50.272193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:11:37.758327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.126616+0000","last_change":"2024-09-07T03:35:51.126506+0000","last_active":"2024-09-07T03:35:51.126616+0000","last_peered":"2024-09-07T03:35:51.126616+0000","last_clean":"2024-09-07T03:35:51.126616+0000","last_became_active":"2024-09-07T03:32:14.113700+0000","last_became_peered":"2024-09-07T03:32:14.113700+0000","last_unstale":"2024-09-07T03:35:51.126616+0000","last_undegraded":"2024-09-07T03:35:51.126616+0000","last_fullsized":"2024-09-07T03:35:51.126616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:51.126405+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:51.126405+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.126405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:05:32.898918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.101415+0000","last_change":"2024-09-07T03:35:35.101343+0000","last_active":"2024-09-07T03:35:35.101415+0000","last_peered":"2024-09-07T03:35:35.101415+0000","last_clean":"2024-09-07T03:35:35.101415+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:35:35.101415+0000","last_undegraded":"2024-09-07T03:35:35.101415+0000","last_fullsized":"2024-09-07T03:35:35.101415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:35:35.101255+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:35:35.101255+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.101255+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:45:10.988630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.967943+0000","last_change":"2024-09-07T03:35:38.967838+0000","last_active":"2024-09-07T03:35:38.967943+0000","last_peered":"2024-09-07T03:35:38.967943+0000","last_clean":"2024-09-07T03:35:38.967943+0000","last_became_active":"2024-09-07T03:32:12.124390+0000","last_became_peered":"2024-09-07T03:32:12.124390+0000","last_unstale":"2024-09-07T03:35:38.967943+0000","last_undegraded":"2024-09-07T03:35:38.967943+0000","last_fullsized":"2024-09-07T03:35:38.967943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:38.967736+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:38.967736+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.967736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:06:28.145953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.248709+0000","last_change":"2024-09-07T03:36:07.248619+0000","last_active":"2024-09-07T03:36:07.248709+0000","last_peered":"2024-09-07T03:36:07.248709+0000","last_clean":"2024-09-07T03:36:07.248709+0000","last_became_active":"2024-09-07T03:32:16.120933+0000","last_became_peered":"2024-09-07T03:32:16.120933+0000","last_unstale":"2024-09-07T03:36:07.248709+0000","last_undegraded":"2024-09-07T03:36:07.248709+0000","last_fullsized":"2024-09-07T03:36:07.248709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:07.248526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:07.248526+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.248526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:00:33.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'21","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:20.041446+0000","last_change":"2024-09-07T03:36:20.041446+0000","last_active":"2024-09-07T03:36:20.041446+0000","last_peered":"2024-09-07T03:36:20.041446+0000","last_clean":"2024-09-07T03:36:20.041446+0000","last_became_active":"2024-09-07T03:32:18.130557+0000","last_became_peered":"2024-09-07T03:32:18.130557+0000","last_unstale":"2024-09-07T03:36:20.041446+0000","last_undegraded":"2024-09-07T03:36:20.041446+0000","last_fullsized":"2024-09-07T03:36:20.041446+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-07T03:36:20.041339+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-07T03:36:20.041339+0000","last_clean_scrub_stamp":"2024-09-07T03:36:20.041339+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:42:17.742410+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.276706+0000","last_change":"2024-09-07T03:32:20.143006+0000","last_active":"2024-09-07T03:32:50.276706+0000","last_peered":"2024-09-07T03:32:50.276706+0000","last_clean":"2024-09-07T03:32:50.276706+0000","last_became_active":"2024-09-07T03:32:20.142650+0000","last_became_peered":"2024-09-07T03:32:20.142650+0000","last_unstale":"2024-09-07T03:32:50.276706+0000","last_undegraded":"2024-09-07T03:32:50.276706+0000","last_fullsized":"2024-09-07T03:32:50.276706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:04:47.155034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.532509+0000","last_change":"2024-09-07T03:32:22.151470+0000","last_active":"2024-09-07T03:34:22.532509+0000","last_peered":"2024-09-07T03:34:22.532509+0000","last_clean":"2024-09-07T03:34:22.532509+0000","last_became_active":"2024-09-07T03:32:22.150981+0000","last_became_peered":"2024-09-07T03:32:22.150981+0000","last_unstale":"2024-09-07T03:34:22.532509+0000","last_undegraded":"2024-09-07T03:34:22.532509+0000","last_fullsized":"2024-09-07T03:34:22.532509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:46:09.757277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.141859+0000","last_change":"2024-09-07T03:35:46.141859+0000","last_active":"2024-09-07T03:35:46.141859+0000","last_peered":"2024-09-07T03:35:46.141859+0000","last_clean":"2024-09-07T03:35:46.141859+0000","last_became_active":"2024-09-07T03:32:50.282108+0000","last_became_peered":"2024-09-07T03:32:50.282108+0000","last_unstale":"2024-09-07T03:35:46.141859+0000","last_undegraded":"2024-09-07T03:35:46.141859+0000","last_fullsized":"2024-09-07T03:35:46.141859+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:46.141737+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:46.141737+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.141737+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:06.335628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.985303+0000","last_change":"2024-09-07T03:35:39.985231+0000","last_active":"2024-09-07T03:35:39.985303+0000","last_peered":"2024-09-07T03:35:39.985303+0000","last_clean":"2024-09-07T03:35:39.985303+0000","last_became_active":"2024-09-07T03:32:12.121179+0000","last_became_peered":"2024-09-07T03:32:12.121179+0000","last_unstale":"2024-09-07T03:35:39.985303+0000","last_undegraded":"2024-09-07T03:35:39.985303+0000","last_fullsized":"2024-09-07T03:35:39.985303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:39.985147+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:39.985147+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.985147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:39:22.800295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.220713+0000","last_change":"2024-09-07T03:35:36.220654+0000","last_active":"2024-09-07T03:35:36.220713+0000","last_peered":"2024-09-07T03:35:36.220713+0000","last_clean":"2024-09-07T03:35:36.220713+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:35:36.220713+0000","last_undegraded":"2024-09-07T03:35:36.220713+0000","last_fullsized":"2024-09-07T03:35:36.220713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:36.220564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:36.220564+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.220564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:55:02.916343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.967847+0000","last_change":"2024-09-07T03:35:58.967790+0000","last_active":"2024-09-07T03:35:58.967847+0000","last_peered":"2024-09-07T03:35:58.967847+0000","last_clean":"2024-09-07T03:35:58.967847+0000","last_became_active":"2024-09-07T03:32:16.126273+0000","last_became_peered":"2024-09-07T03:32:16.126273+0000","last_unstale":"2024-09-07T03:35:58.967847+0000","last_undegraded":"2024-09-07T03:35:58.967847+0000","last_fullsized":"2024-09-07T03:35:58.967847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:58.967697+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:58.967697+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.967697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:09:06.500393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'91","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:16.279074+0000","last_change":"2024-09-07T03:36:16.278980+0000","last_active":"2024-09-07T03:36:16.279074+0000","last_peered":"2024-09-07T03:36:16.279074+0000","last_clean":"2024-09-07T03:36:16.279074+0000","last_became_active":"2024-09-07T03:32:18.132654+0000","last_became_peered":"2024-09-07T03:32:18.132654+0000","last_unstale":"2024-09-07T03:36:16.279074+0000","last_undegraded":"2024-09-07T03:36:16.279074+0000","last_fullsized":"2024-09-07T03:36:16.279074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-09-07T03:36:16.278851+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-09-07T03:36:16.278851+0000","last_clean_scrub_stamp":"2024-09-07T03:36:16.278851+0000","objects_scrubbed":11,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:17.728496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:26.229618+0000","last_change":"2024-09-07T03:32:20.140348+0000","last_active":"2024-09-07T03:34:26.229618+0000","last_peered":"2024-09-07T03:34:26.229618+0000","last_clean":"2024-09-07T03:34:26.229618+0000","last_became_active":"2024-09-07T03:32:20.140025+0000","last_became_peered":"2024-09-07T03:32:20.140025+0000","last_unstale":"2024-09-07T03:34:26.229618+0000","last_undegraded":"2024-09-07T03:34:26.229618+0000","last_fullsized":"2024-09-07T03:34:26.229618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'13","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:22.106790+0000","last_change":"2024-09-07T03:36:22.106790+0000","last_active":"2024-09-07T03:36:22.106790+0000","last_peered":"2024-09-07T03:36:22.106790+0000","last_clean":"2024-09-07T03:36:22.106790+0000","last_became_active":"2024-09-07T03:32:22.140043+0000","last_became_peered":"2024-09-07T03:32:22.140043+0000","last_unstale":"2024-09-07T03:36:22.106790+0000","last_undegraded":"2024-09-07T03:36:22.106790+0000","last_fullsized":"2024-09-07T03:36:22.106790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-07T03:36:22.106683+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-07T03:36:22.106683+0000","last_clean_scrub_stamp":"2024-09-07T03:36:22.106683+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:30:20.991652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'12","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.099613+0000","last_change":"2024-09-07T03:35:50.099558+0000","last_active":"2024-09-07T03:35:50.099613+0000","last_peered":"2024-09-07T03:35:50.099613+0000","last_clean":"2024-09-07T03:35:50.099613+0000","last_became_active":"2024-09-07T03:32:14.126663+0000","last_became_peered":"2024-09-07T03:32:14.126663+0000","last_unstale":"2024-09-07T03:35:50.099613+0000","last_undegraded":"2024-09-07T03:35:50.099613+0000","last_fullsized":"2024-09-07T03:35:50.099613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:50.099477+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:50.099477+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.099477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:27:04.417756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.116893+0000","last_change":"2024-09-07T03:35:40.116801+0000","last_active":"2024-09-07T03:35:40.116893+0000","last_peered":"2024-09-07T03:35:40.116893+0000","last_clean":"2024-09-07T03:35:40.116893+0000","last_became_active":"2024-09-07T03:32:12.133974+0000","last_became_peered":"2024-09-07T03:32:12.133974+0000","last_unstale":"2024-09-07T03:35:40.116893+0000","last_undegraded":"2024-09-07T03:35:40.116893+0000","last_fullsized":"2024-09-07T03:35:40.116893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.116697+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.116697+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.116697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:35.362673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.014439+0000","last_change":"2024-09-07T03:35:37.014367+0000","last_active":"2024-09-07T03:35:37.014439+0000","last_peered":"2024-09-07T03:35:37.014439+0000","last_clean":"2024-09-07T03:35:37.014439+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:35:37.014439+0000","last_undegraded":"2024-09-07T03:35:37.014439+0000","last_fullsized":"2024-09-07T03:35:37.014439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.014282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.014282+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.014282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:46:10.364315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:14.923849+0000","last_change":"2024-09-07T03:36:14.923764+0000","last_active":"2024-09-07T03:36:14.923849+0000","last_peered":"2024-09-07T03:36:14.923849+0000","last_clean":"2024-09-07T03:36:14.923849+0000","last_became_active":"2024-09-07T03:32:16.121921+0000","last_became_peered":"2024-09-07T03:32:16.121921+0000","last_unstale":"2024-09-07T03:36:14.923849+0000","last_undegraded":"2024-09-07T03:36:14.923849+0000","last_fullsized":"2024-09-07T03:36:14.923849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:14.923684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:14.923684+0000","last_clean_scrub_stamp":"2024-09-07T03:36:14.923684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:32:12.839969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'28","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:17.250488+0000","last_change":"2024-09-07T03:36:17.250399+0000","last_active":"2024-09-07T03:36:17.250488+0000","last_peered":"2024-09-07T03:36:17.250488+0000","last_clean":"2024-09-07T03:36:17.250488+0000","last_became_active":"2024-09-07T03:32:18.133689+0000","last_became_peered":"2024-09-07T03:32:18.133689+0000","last_unstale":"2024-09-07T03:36:17.250488+0000","last_undegraded":"2024-09-07T03:36:17.250488+0000","last_fullsized":"2024-09-07T03:36:17.250488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'28","last_scrub_stamp":"2024-09-07T03:36:17.250292+0000","last_deep_scrub":"36'28","last_deep_scrub_stamp":"2024-09-07T03:36:17.250292+0000","last_clean_scrub_stamp":"2024-09-07T03:36:17.250292+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:10:59.637620+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'286","reported_seq":360,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:22.315137+0000","last_change":"2024-09-07T03:36:22.315071+0000","last_active":"2024-09-07T03:36:22.315137+0000","last_peered":"2024-09-07T03:36:22.315137+0000","last_clean":"2024-09-07T03:36:22.315137+0000","last_became_active":"2024-09-07T03:32:20.143293+0000","last_became_peered":"2024-09-07T03:32:20.143293+0000","last_unstale":"2024-09-07T03:36:22.315137+0000","last_undegraded":"2024-09-07T03:36:22.315137+0000","last_fullsized":"2024-09-07T03:36:22.315137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:22.314983+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:22.314983+0000","last_clean_scrub_stamp":"2024-09-07T03:36:22.314983+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:13:19.657854+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.273729+0000","last_change":"2024-09-07T03:32:22.147306+0000","last_active":"2024-09-07T03:32:50.273729+0000","last_peered":"2024-09-07T03:32:50.273729+0000","last_clean":"2024-09-07T03:32:50.273729+0000","last_became_active":"2024-09-07T03:32:22.147036+0000","last_became_peered":"2024-09-07T03:32:22.147036+0000","last_unstale":"2024-09-07T03:32:50.273729+0000","last_undegraded":"2024-09-07T03:32:50.273729+0000","last_fullsized":"2024-09-07T03:32:50.273729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:02.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'2","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.022271+0000","last_change":"2024-09-07T03:35:58.022185+0000","last_active":"2024-09-07T03:35:58.022271+0000","last_peered":"2024-09-07T03:35:58.022271+0000","last_clean":"2024-09-07T03:35:58.022271+0000","last_became_active":"2024-09-07T03:32:14.126350+0000","last_became_peered":"2024-09-07T03:32:14.126350+0000","last_unstale":"2024-09-07T03:35:58.022271+0000","last_undegraded":"2024-09-07T03:35:58.022271+0000","last_fullsized":"2024-09-07T03:35:58.022271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:58.022069+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:58.022069+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.022069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:50:03.378951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.090453+0000","last_change":"2024-09-07T03:35:37.090380+0000","last_active":"2024-09-07T03:35:37.090453+0000","last_peered":"2024-09-07T03:35:37.090453+0000","last_clean":"2024-09-07T03:35:37.090453+0000","last_became_active":"2024-09-07T03:32:12.130058+0000","last_became_peered":"2024-09-07T03:32:12.130058+0000","last_unstale":"2024-09-07T03:35:37.090453+0000","last_undegraded":"2024-09-07T03:35:37.090453+0000","last_fullsized":"2024-09-07T03:35:37.090453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.090296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.090296+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.090296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:10:30.746067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.254202+0000","last_change":"2024-09-07T03:35:35.254145+0000","last_active":"2024-09-07T03:35:35.254202+0000","last_peered":"2024-09-07T03:35:35.254202+0000","last_clean":"2024-09-07T03:35:35.254202+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:35:35.254202+0000","last_undegraded":"2024-09-07T03:35:35.254202+0000","last_fullsized":"2024-09-07T03:35:35.254202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:35.254064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:35.254064+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.254064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:11:50.660290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:12.985077+0000","last_change":"2024-09-07T03:36:12.985015+0000","last_active":"2024-09-07T03:36:12.985077+0000","last_peered":"2024-09-07T03:36:12.985077+0000","last_clean":"2024-09-07T03:36:12.985077+0000","last_became_active":"2024-09-07T03:32:16.117025+0000","last_became_peered":"2024-09-07T03:32:16.117025+0000","last_unstale":"2024-09-07T03:36:12.985077+0000","last_undegraded":"2024-09-07T03:36:12.985077+0000","last_fullsized":"2024-09-07T03:36:12.985077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:12.984919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:12.984919+0000","last_clean_scrub_stamp":"2024-09-07T03:36:12.984919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:18:07.470068+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"36'22","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:19.079059+0000","last_change":"2024-09-07T03:36:19.078996+0000","last_active":"2024-09-07T03:36:19.079059+0000","last_peered":"2024-09-07T03:36:19.079059+0000","last_clean":"2024-09-07T03:36:19.079059+0000","last_became_active":"2024-09-07T03:32:18.124641+0000","last_became_peered":"2024-09-07T03:32:18.124641+0000","last_unstale":"2024-09-07T03:36:19.079059+0000","last_undegraded":"2024-09-07T03:36:19.079059+0000","last_fullsized":"2024-09-07T03:36:19.079059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-07T03:36:19.078898+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-07T03:36:19.078898+0000","last_clean_scrub_stamp":"2024-09-07T03:36:19.078898+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:55:59.458726+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":394,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.701534+0000","last_change":"2024-09-07T03:32:20.149232+0000","last_active":"2024-09-07T03:35:30.701534+0000","last_peered":"2024-09-07T03:35:30.701534+0000","last_clean":"2024-09-07T03:35:30.701534+0000","last_became_active":"2024-09-07T03:32:20.148768+0000","last_became_peered":"2024-09-07T03:32:20.148768+0000","last_unstale":"2024-09-07T03:35:30.701534+0000","last_undegraded":"2024-09-07T03:35:30.701534+0000","last_fullsized":"2024-09-07T03:35:30.701534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.470656+0000","last_change":"2024-09-07T03:32:22.148714+0000","last_active":"2024-09-07T03:32:50.470656+0000","last_peered":"2024-09-07T03:32:50.470656+0000","last_clean":"2024-09-07T03:32:50.470656+0000","last_became_active":"2024-09-07T03:32:22.148444+0000","last_became_peered":"2024-09-07T03:32:22.148444+0000","last_unstale":"2024-09-07T03:32:50.470656+0000","last_undegraded":"2024-09-07T03:32:50.470656+0000","last_fullsized":"2024-09-07T03:32:50.470656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:23.271638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'10","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.115464+0000","last_change":"2024-09-07T03:35:43.115335+0000","last_active":"2024-09-07T03:35:43.115464+0000","last_peered":"2024-09-07T03:35:43.115464+0000","last_clean":"2024-09-07T03:35:43.115464+0000","last_became_active":"2024-09-07T03:32:14.113077+0000","last_became_peered":"2024-09-07T03:32:14.113077+0000","last_unstale":"2024-09-07T03:35:43.115464+0000","last_undegraded":"2024-09-07T03:35:43.115464+0000","last_fullsized":"2024-09-07T03:35:43.115464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:43.115240+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:43.115240+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.115240+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:13:08.170005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.154161+0000","last_change":"2024-09-07T03:35:38.154058+0000","last_active":"2024-09-07T03:35:38.154161+0000","last_peered":"2024-09-07T03:35:38.154161+0000","last_clean":"2024-09-07T03:35:38.154161+0000","last_became_active":"2024-09-07T03:32:12.124398+0000","last_became_peered":"2024-09-07T03:32:12.124398+0000","last_unstale":"2024-09-07T03:35:38.154161+0000","last_undegraded":"2024-09-07T03:35:38.154161+0000","last_fullsized":"2024-09-07T03:35:38.154161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:38.153969+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:38.153969+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.153969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:07:56.086318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.014935+0000","last_change":"2024-09-07T03:35:38.014826+0000","last_active":"2024-09-07T03:35:38.014935+0000","last_peered":"2024-09-07T03:35:38.014935+0000","last_clean":"2024-09-07T03:35:38.014935+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:35:38.014935+0000","last_undegraded":"2024-09-07T03:35:38.014935+0000","last_fullsized":"2024-09-07T03:35:38.014935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.014735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.014735+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.014735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:41.966197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:12.054770+0000","last_change":"2024-09-07T03:36:12.054710+0000","last_active":"2024-09-07T03:36:12.054770+0000","last_peered":"2024-09-07T03:36:12.054770+0000","last_clean":"2024-09-07T03:36:12.054770+0000","last_became_active":"2024-09-07T03:32:16.130091+0000","last_became_peered":"2024-09-07T03:32:16.130091+0000","last_unstale":"2024-09-07T03:36:12.054770+0000","last_undegraded":"2024-09-07T03:36:12.054770+0000","last_fullsized":"2024-09-07T03:36:12.054770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:12.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:12.054602+0000","last_clean_scrub_stamp":"2024-09-07T03:36:12.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:56:00.591114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'106","reported_seq":206,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:22.953746+0000","last_change":"2024-09-07T03:36:22.953679+0000","last_active":"2024-09-07T03:36:22.953746+0000","last_peered":"2024-09-07T03:36:22.953746+0000","last_clean":"2024-09-07T03:36:22.953746+0000","last_became_active":"2024-09-07T03:32:18.132111+0000","last_became_peered":"2024-09-07T03:32:18.132111+0000","last_unstale":"2024-09-07T03:36:22.953746+0000","last_undegraded":"2024-09-07T03:36:22.953746+0000","last_fullsized":"2024-09-07T03:36:22.953746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'106","last_scrub_stamp":"2024-09-07T03:36:22.953573+0000","last_deep_scrub":"36'106","last_deep_scrub_stamp":"2024-09-07T03:36:22.953573+0000","last_clean_scrub_stamp":"2024-09-07T03:36:22.953573+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:19:27.713057+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:30.068205+0000","last_change":"2024-09-07T03:36:30.068136+0000","last_active":"2024-09-07T03:36:30.068205+0000","last_peered":"2024-09-07T03:36:30.068205+0000","last_clean":"2024-09-07T03:36:30.068205+0000","last_became_active":"2024-09-07T03:32:20.143072+0000","last_became_peered":"2024-09-07T03:32:20.143072+0000","last_unstale":"2024-09-07T03:36:30.068205+0000","last_undegraded":"2024-09-07T03:36:30.068205+0000","last_fullsized":"2024-09-07T03:36:30.068205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:30.068003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:30.068003+0000","last_clean_scrub_stamp":"2024-09-07T03:36:30.068003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:59:33.272083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:21.071587+0000","last_change":"2024-09-07T03:36:21.071587+0000","last_active":"2024-09-07T03:36:21.071587+0000","last_peered":"2024-09-07T03:36:21.071587+0000","last_clean":"2024-09-07T03:36:21.071587+0000","last_became_active":"2024-09-07T03:32:22.139150+0000","last_became_peered":"2024-09-07T03:32:22.139150+0000","last_unstale":"2024-09-07T03:36:21.071587+0000","last_undegraded":"2024-09-07T03:36:21.071587+0000","last_fullsized":"2024-09-07T03:36:21.071587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:36:21.071501+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:36:21.071501+0000","last_clean_scrub_stamp":"2024-09-07T03:36:21.071501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:35:22.556347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:23.141765+0000","last_change":"2024-09-07T03:36:23.141699+0000","last_active":"2024-09-07T03:36:23.141765+0000","last_peered":"2024-09-07T03:36:23.141765+0000","last_clean":"2024-09-07T03:36:23.141765+0000","last_became_active":"2024-09-07T03:32:22.138315+0000","last_became_peered":"2024-09-07T03:32:22.138315+0000","last_unstale":"2024-09-07T03:36:23.141765+0000","last_undegraded":"2024-09-07T03:36:23.141765+0000","last_fullsized":"2024-09-07T03:36:23.141765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:23.141621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:23.141621+0000","last_clean_scrub_stamp":"2024-09-07T03:36:23.141621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:17.689589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.048117+0000","last_change":"2024-09-07T03:35:51.048117+0000","last_active":"2024-09-07T03:35:51.048117+0000","last_peered":"2024-09-07T03:35:51.048117+0000","last_clean":"2024-09-07T03:35:51.048117+0000","last_became_active":"2024-09-07T03:32:14.112744+0000","last_became_peered":"2024-09-07T03:32:14.112744+0000","last_unstale":"2024-09-07T03:35:51.048117+0000","last_undegraded":"2024-09-07T03:35:51.048117+0000","last_fullsized":"2024-09-07T03:35:51.048117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:51.047998+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:51.047998+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.047998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:02.216514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'5","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.016566+0000","last_change":"2024-09-07T03:35:48.016566+0000","last_active":"2024-09-07T03:35:48.016566+0000","last_peered":"2024-09-07T03:35:48.016566+0000","last_clean":"2024-09-07T03:35:48.016566+0000","last_became_active":"2024-09-07T03:32:12.132715+0000","last_became_peered":"2024-09-07T03:32:12.132715+0000","last_unstale":"2024-09-07T03:35:48.016566+0000","last_undegraded":"2024-09-07T03:35:48.016566+0000","last_fullsized":"2024-09-07T03:35:48.016566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-07T03:35:48.016483+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-07T03:35:48.016483+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.016483+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:57:37.498255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.325231+0000","last_change":"2024-09-07T03:36:10.325231+0000","last_active":"2024-09-07T03:36:10.325231+0000","last_peered":"2024-09-07T03:36:10.325231+0000","last_clean":"2024-09-07T03:36:10.325231+0000","last_became_active":"2024-09-07T03:32:16.124681+0000","last_became_peered":"2024-09-07T03:32:16.124681+0000","last_unstale":"2024-09-07T03:36:10.325231+0000","last_undegraded":"2024-09-07T03:36:10.325231+0000","last_fullsized":"2024-09-07T03:36:10.325231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:10.325144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:10.325144+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.325144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:15:29.763693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'48","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:24.087098+0000","last_change":"2024-09-07T03:36:24.087098+0000","last_active":"2024-09-07T03:36:24.087098+0000","last_peered":"2024-09-07T03:36:24.087098+0000","last_clean":"2024-09-07T03:36:24.087098+0000","last_became_active":"2024-09-07T03:32:18.133844+0000","last_became_peered":"2024-09-07T03:32:18.133844+0000","last_unstale":"2024-09-07T03:36:24.087098+0000","last_undegraded":"2024-09-07T03:36:24.087098+0000","last_fullsized":"2024-09-07T03:36:24.087098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-07T03:36:24.086978+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-07T03:36:24.086978+0000","last_clean_scrub_stamp":"2024-09-07T03:36:24.086978+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:26:12.099454+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271616+0000","last_change":"2024-09-07T03:32:20.149175+0000","last_active":"2024-09-07T03:32:50.271616+0000","last_peered":"2024-09-07T03:32:50.271616+0000","last_clean":"2024-09-07T03:32:50.271616+0000","last_became_active":"2024-09-07T03:32:20.148900+0000","last_became_peered":"2024-09-07T03:32:20.148900+0000","last_unstale":"2024-09-07T03:32:50.271616+0000","last_undegraded":"2024-09-07T03:32:50.271616+0000","last_fullsized":"2024-09-07T03:32:50.271616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:25.130015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.228393+0000","last_change":"2024-09-07T03:32:22.150451+0000","last_active":"2024-09-07T03:34:21.228393+0000","last_peered":"2024-09-07T03:34:21.228393+0000","last_clean":"2024-09-07T03:34:21.228393+0000","last_became_active":"2024-09-07T03:32:22.150168+0000","last_became_peered":"2024-09-07T03:32:22.150168+0000","last_unstale":"2024-09-07T03:34:21.228393+0000","last_undegraded":"2024-09-07T03:34:21.228393+0000","last_fullsized":"2024-09-07T03:34:21.228393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.127642+0000","last_change":"2024-09-07T03:35:55.127642+0000","last_active":"2024-09-07T03:35:55.127642+0000","last_peered":"2024-09-07T03:35:55.127642+0000","last_clean":"2024-09-07T03:35:55.127642+0000","last_became_active":"2024-09-07T03:32:14.111499+0000","last_became_peered":"2024-09-07T03:32:14.111499+0000","last_unstale":"2024-09-07T03:35:55.127642+0000","last_undegraded":"2024-09-07T03:35:55.127642+0000","last_fullsized":"2024-09-07T03:35:55.127642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:55.127521+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:55.127521+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.127521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:49:35.128217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.155440+0000","last_change":"2024-09-07T03:35:38.155440+0000","last_active":"2024-09-07T03:35:38.155440+0000","last_peered":"2024-09-07T03:35:38.155440+0000","last_clean":"2024-09-07T03:35:38.155440+0000","last_became_active":"2024-09-07T03:32:12.128737+0000","last_became_peered":"2024-09-07T03:32:12.128737+0000","last_unstale":"2024-09-07T03:35:38.155440+0000","last_undegraded":"2024-09-07T03:35:38.155440+0000","last_fullsized":"2024-09-07T03:35:38.155440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.155355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.155355+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.155355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:27.815801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:15.071850+0000","last_change":"2024-09-07T03:36:15.071850+0000","last_active":"2024-09-07T03:36:15.071850+0000","last_peered":"2024-09-07T03:36:15.071850+0000","last_clean":"2024-09-07T03:36:15.071850+0000","last_became_active":"2024-09-07T03:32:16.125418+0000","last_became_peered":"2024-09-07T03:32:16.125418+0000","last_unstale":"2024-09-07T03:36:15.071850+0000","last_undegraded":"2024-09-07T03:36:15.071850+0000","last_fullsized":"2024-09-07T03:36:15.071850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:15.071766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:15.071766+0000","last_clean_scrub_stamp":"2024-09-07T03:36:15.071766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:31:07.096872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:19.292949+0000","last_change":"2024-09-07T03:36:19.292949+0000","last_active":"2024-09-07T03:36:19.292949+0000","last_peered":"2024-09-07T03:36:19.292949+0000","last_clean":"2024-09-07T03:36:19.292949+0000","last_became_active":"2024-09-07T03:32:18.133770+0000","last_became_peered":"2024-09-07T03:32:18.133770+0000","last_unstale":"2024-09-07T03:36:19.292949+0000","last_undegraded":"2024-09-07T03:36:19.292949+0000","last_fullsized":"2024-09-07T03:36:19.292949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:19.292854+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:19.292854+0000","last_clean_scrub_stamp":"2024-09-07T03:36:19.292854+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:32:29.541797+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:15.147133+0000","last_change":"2024-09-07T03:36:15.147133+0000","last_active":"2024-09-07T03:36:15.147133+0000","last_peered":"2024-09-07T03:36:15.147133+0000","last_clean":"2024-09-07T03:36:15.147133+0000","last_became_active":"2024-09-07T03:32:20.140729+0000","last_became_peered":"2024-09-07T03:32:20.140729+0000","last_unstale":"2024-09-07T03:36:15.147133+0000","last_undegraded":"2024-09-07T03:36:15.147133+0000","last_fullsized":"2024-09-07T03:36:15.147133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:15.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:15.147043+0000","last_clean_scrub_stamp":"2024-09-07T03:36:15.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:36.943636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.471241+0000","last_change":"2024-09-07T03:32:22.147660+0000","last_active":"2024-09-07T03:32:50.471241+0000","last_peered":"2024-09-07T03:32:50.471241+0000","last_clean":"2024-09-07T03:32:50.471241+0000","last_became_active":"2024-09-07T03:32:22.147374+0000","last_became_peered":"2024-09-07T03:32:22.147374+0000","last_unstale":"2024-09-07T03:32:50.471241+0000","last_undegraded":"2024-09-07T03:32:50.471241+0000","last_fullsized":"2024-09-07T03:32:50.471241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:06.728131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:00.038805+0000","last_change":"2024-09-07T03:36:00.038805+0000","last_active":"2024-09-07T03:36:00.038805+0000","last_peered":"2024-09-07T03:36:00.038805+0000","last_clean":"2024-09-07T03:36:00.038805+0000","last_became_active":"2024-09-07T03:32:14.123172+0000","last_became_peered":"2024-09-07T03:32:14.123172+0000","last_unstale":"2024-09-07T03:36:00.038805+0000","last_undegraded":"2024-09-07T03:36:00.038805+0000","last_fullsized":"2024-09-07T03:36:00.038805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:00.038722+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:00.038722+0000","last_clean_scrub_stamp":"2024-09-07T03:36:00.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:18:27.231373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.019482+0000","last_change":"2024-09-07T03:35:49.019482+0000","last_active":"2024-09-07T03:35:49.019482+0000","last_peered":"2024-09-07T03:35:49.019482+0000","last_clean":"2024-09-07T03:35:49.019482+0000","last_became_active":"2024-09-07T03:32:12.124180+0000","last_became_peered":"2024-09-07T03:32:12.124180+0000","last_unstale":"2024-09-07T03:35:49.019482+0000","last_undegraded":"2024-09-07T03:35:49.019482+0000","last_fullsized":"2024-09-07T03:35:49.019482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:49.019399+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:49.019399+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.019399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:20.661216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:16.942491+0000","last_change":"2024-09-07T03:36:16.942491+0000","last_active":"2024-09-07T03:36:16.942491+0000","last_peered":"2024-09-07T03:36:16.942491+0000","last_clean":"2024-09-07T03:36:16.942491+0000","last_became_active":"2024-09-07T03:32:16.123695+0000","last_became_peered":"2024-09-07T03:32:16.123695+0000","last_unstale":"2024-09-07T03:36:16.942491+0000","last_undegraded":"2024-09-07T03:36:16.942491+0000","last_fullsized":"2024-09-07T03:36:16.942491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:16.942419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:16.942419+0000","last_clean_scrub_stamp":"2024-09-07T03:36:16.942419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:06.820376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'50","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:25.080440+0000","last_change":"2024-09-07T03:36:25.080440+0000","last_active":"2024-09-07T03:36:25.080440+0000","last_peered":"2024-09-07T03:36:25.080440+0000","last_clean":"2024-09-07T03:36:25.080440+0000","last_became_active":"2024-09-07T03:32:18.129502+0000","last_became_peered":"2024-09-07T03:32:18.129502+0000","last_unstale":"2024-09-07T03:36:25.080440+0000","last_undegraded":"2024-09-07T03:36:25.080440+0000","last_fullsized":"2024-09-07T03:36:25.080440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'50","last_scrub_stamp":"2024-09-07T03:36:25.080344+0000","last_deep_scrub":"36'50","last_deep_scrub_stamp":"2024-09-07T03:36:25.080344+0000","last_clean_scrub_stamp":"2024-09-07T03:36:25.080344+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:01.629331+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:25.323223+0000","last_change":"2024-09-07T03:36:25.323223+0000","last_active":"2024-09-07T03:36:25.323223+0000","last_peered":"2024-09-07T03:36:25.323223+0000","last_clean":"2024-09-07T03:36:25.323223+0000","last_became_active":"2024-09-07T03:32:20.147588+0000","last_became_peered":"2024-09-07T03:32:20.147588+0000","last_unstale":"2024-09-07T03:36:25.323223+0000","last_undegraded":"2024-09-07T03:36:25.323223+0000","last_fullsized":"2024-09-07T03:36:25.323223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:25.323139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:25.323139+0000","last_clean_scrub_stamp":"2024-09-07T03:36:25.323139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:36:51.058908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:19.433021+0000","last_change":"2024-09-07T03:32:22.146381+0000","last_active":"2024-09-07T03:34:19.433021+0000","last_peered":"2024-09-07T03:34:19.433021+0000","last_clean":"2024-09-07T03:34:19.433021+0000","last_became_active":"2024-09-07T03:32:22.146106+0000","last_became_peered":"2024-09-07T03:32:22.146106+0000","last_unstale":"2024-09-07T03:34:19.433021+0000","last_undegraded":"2024-09-07T03:34:19.433021+0000","last_fullsized":"2024-09-07T03:34:19.433021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:05:28.655126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.081325+0000","last_change":"2024-09-07T03:36:01.081325+0000","last_active":"2024-09-07T03:36:01.081325+0000","last_peered":"2024-09-07T03:36:01.081325+0000","last_clean":"2024-09-07T03:36:01.081325+0000","last_became_active":"2024-09-07T03:32:14.127334+0000","last_became_peered":"2024-09-07T03:32:14.127334+0000","last_unstale":"2024-09-07T03:36:01.081325+0000","last_undegraded":"2024-09-07T03:36:01.081325+0000","last_fullsized":"2024-09-07T03:36:01.081325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:01.081243+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:01.081243+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.081243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:05:10.149352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.177120+0000","last_change":"2024-09-07T03:35:45.177120+0000","last_active":"2024-09-07T03:35:45.177120+0000","last_peered":"2024-09-07T03:35:45.177120+0000","last_clean":"2024-09-07T03:35:45.177120+0000","last_became_active":"2024-09-07T03:32:12.134823+0000","last_became_peered":"2024-09-07T03:32:12.134823+0000","last_unstale":"2024-09-07T03:35:45.177120+0000","last_undegraded":"2024-09-07T03:35:45.177120+0000","last_fullsized":"2024-09-07T03:35:45.177120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:45.177031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:45.177031+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.177031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:35:01.639248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:14.055779+0000","last_change":"2024-09-07T03:36:14.055779+0000","last_active":"2024-09-07T03:36:14.055779+0000","last_peered":"2024-09-07T03:36:14.055779+0000","last_clean":"2024-09-07T03:36:14.055779+0000","last_became_active":"2024-09-07T03:32:16.127615+0000","last_became_peered":"2024-09-07T03:32:16.127615+0000","last_unstale":"2024-09-07T03:36:14.055779+0000","last_undegraded":"2024-09-07T03:36:14.055779+0000","last_fullsized":"2024-09-07T03:36:14.055779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:14.055698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:14.055698+0000","last_clean_scrub_stamp":"2024-09-07T03:36:14.055698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:01.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'39","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:30.834203+0000","last_change":"2024-09-07T03:36:30.834203+0000","last_active":"2024-09-07T03:36:30.834203+0000","last_peered":"2024-09-07T03:36:30.834203+0000","last_clean":"2024-09-07T03:36:30.834203+0000","last_became_active":"2024-09-07T03:32:18.129919+0000","last_became_peered":"2024-09-07T03:32:18.129919+0000","last_unstale":"2024-09-07T03:36:30.834203+0000","last_undegraded":"2024-09-07T03:36:30.834203+0000","last_fullsized":"2024-09-07T03:36:30.834203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-07T03:36:30.834114+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-07T03:36:30.834114+0000","last_clean_scrub_stamp":"2024-09-07T03:36:30.834114+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:22:40.781567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:14.188215+0000","last_change":"2024-09-07T03:36:14.188215+0000","last_active":"2024-09-07T03:36:14.188215+0000","last_peered":"2024-09-07T03:36:14.188215+0000","last_clean":"2024-09-07T03:36:14.188215+0000","last_became_active":"2024-09-07T03:32:20.143640+0000","last_became_peered":"2024-09-07T03:32:20.143640+0000","last_unstale":"2024-09-07T03:36:14.188215+0000","last_undegraded":"2024-09-07T03:36:14.188215+0000","last_fullsized":"2024-09-07T03:36:14.188215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:14.188130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:14.188130+0000","last_clean_scrub_stamp":"2024-09-07T03:36:14.188130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:19:13.420877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.013291+0000","last_change":"2024-09-07T03:36:03.013164+0000","last_active":"2024-09-07T03:36:03.013291+0000","last_peered":"2024-09-07T03:36:03.013291+0000","last_clean":"2024-09-07T03:36:03.013291+0000","last_became_active":"2024-09-07T03:32:14.123017+0000","last_became_peered":"2024-09-07T03:32:14.123017+0000","last_unstale":"2024-09-07T03:36:03.013291+0000","last_undegraded":"2024-09-07T03:36:03.013291+0000","last_fullsized":"2024-09-07T03:36:03.013291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:36:03.013063+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:36:03.013063+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.013063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:29:49.767075+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.017539+0000","last_change":"2024-09-07T03:35:41.017539+0000","last_active":"2024-09-07T03:35:41.017539+0000","last_peered":"2024-09-07T03:35:41.017539+0000","last_clean":"2024-09-07T03:35:41.017539+0000","last_became_active":"2024-09-07T03:32:12.143142+0000","last_became_peered":"2024-09-07T03:32:12.143142+0000","last_unstale":"2024-09-07T03:35:41.017539+0000","last_undegraded":"2024-09-07T03:35:41.017539+0000","last_fullsized":"2024-09-07T03:35:41.017539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.017443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.017443+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.017443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:02:36.762725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:15.278202+0000","last_change":"2024-09-07T03:36:15.278119+0000","last_active":"2024-09-07T03:36:15.278202+0000","last_peered":"2024-09-07T03:36:15.278202+0000","last_clean":"2024-09-07T03:36:15.278202+0000","last_became_active":"2024-09-07T03:32:16.124188+0000","last_became_peered":"2024-09-07T03:32:16.124188+0000","last_unstale":"2024-09-07T03:36:15.278202+0000","last_undegraded":"2024-09-07T03:36:15.278202+0000","last_fullsized":"2024-09-07T03:36:15.278202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:15.278007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:15.278007+0000","last_clean_scrub_stamp":"2024-09-07T03:36:15.278007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:45:30.630070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'72","reported_seq":151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:21.288715+0000","last_change":"2024-09-07T03:36:21.288715+0000","last_active":"2024-09-07T03:36:21.288715+0000","last_peered":"2024-09-07T03:36:21.288715+0000","last_clean":"2024-09-07T03:36:21.288715+0000","last_became_active":"2024-09-07T03:32:18.126946+0000","last_became_peered":"2024-09-07T03:32:18.126946+0000","last_unstale":"2024-09-07T03:36:21.288715+0000","last_undegraded":"2024-09-07T03:36:21.288715+0000","last_fullsized":"2024-09-07T03:36:21.288715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'72","last_scrub_stamp":"2024-09-07T03:36:21.288615+0000","last_deep_scrub":"36'72","last_deep_scrub_stamp":"2024-09-07T03:36:21.288615+0000","last_clean_scrub_stamp":"2024-09-07T03:36:21.288615+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:16.800956+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:17.109102+0000","last_change":"2024-09-07T03:36:17.109102+0000","last_active":"2024-09-07T03:36:17.109102+0000","last_peered":"2024-09-07T03:36:17.109102+0000","last_clean":"2024-09-07T03:36:17.109102+0000","last_became_active":"2024-09-07T03:32:20.144417+0000","last_became_peered":"2024-09-07T03:32:20.144417+0000","last_unstale":"2024-09-07T03:36:17.109102+0000","last_undegraded":"2024-09-07T03:36:17.109102+0000","last_fullsized":"2024-09-07T03:36:17.109102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:17.109007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:17.109007+0000","last_clean_scrub_stamp":"2024-09-07T03:36:17.109007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:33:45.335295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'16","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:23.592808+0000","last_change":"2024-09-07T03:32:22.149726+0000","last_active":"2024-09-07T03:35:23.592808+0000","last_peered":"2024-09-07T03:35:23.592808+0000","last_clean":"2024-09-07T03:35:23.592808+0000","last_became_active":"2024-09-07T03:32:22.149442+0000","last_became_peered":"2024-09-07T03:32:22.149442+0000","last_unstale":"2024-09-07T03:35:23.592808+0000","last_undegraded":"2024-09-07T03:35:23.592808+0000","last_fullsized":"2024-09-07T03:35:23.592808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:00:25.687323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.171719+0000","last_change":"2024-09-07T03:35:56.171662+0000","last_active":"2024-09-07T03:35:56.171719+0000","last_peered":"2024-09-07T03:35:56.171719+0000","last_clean":"2024-09-07T03:35:56.171719+0000","last_became_active":"2024-09-07T03:32:14.111795+0000","last_became_peered":"2024-09-07T03:32:14.111795+0000","last_unstale":"2024-09-07T03:35:56.171719+0000","last_undegraded":"2024-09-07T03:35:56.171719+0000","last_fullsized":"2024-09-07T03:35:56.171719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:56.171585+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:56.171585+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.171585+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:20.317653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.150563+0000","last_change":"2024-09-07T03:35:41.150563+0000","last_active":"2024-09-07T03:35:41.150563+0000","last_peered":"2024-09-07T03:35:41.150563+0000","last_clean":"2024-09-07T03:35:41.150563+0000","last_became_active":"2024-09-07T03:32:12.136258+0000","last_became_peered":"2024-09-07T03:32:12.136258+0000","last_unstale":"2024-09-07T03:35:41.150563+0000","last_undegraded":"2024-09-07T03:35:41.150563+0000","last_fullsized":"2024-09-07T03:35:41.150563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.150478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.150478+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.150478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.517403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:23.910441+0000","last_change":"2024-09-07T03:36:23.910382+0000","last_active":"2024-09-07T03:36:23.910441+0000","last_peered":"2024-09-07T03:36:23.910441+0000","last_clean":"2024-09-07T03:36:23.910441+0000","last_became_active":"2024-09-07T03:32:16.122316+0000","last_became_peered":"2024-09-07T03:32:16.122316+0000","last_unstale":"2024-09-07T03:36:23.910441+0000","last_undegraded":"2024-09-07T03:36:23.910441+0000","last_fullsized":"2024-09-07T03:36:23.910441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:23.910266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:23.910266+0000","last_clean_scrub_stamp":"2024-09-07T03:36:23.910266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:08:18.747248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.672169+0000","last_change":"2024-09-07T03:32:18.132401+0000","last_active":"2024-09-07T03:35:30.672169+0000","last_peered":"2024-09-07T03:35:30.672169+0000","last_clean":"2024-09-07T03:35:30.672169+0000","last_became_active":"2024-09-07T03:32:18.132084+0000","last_became_peered":"2024-09-07T03:32:18.132084+0000","last_unstale":"2024-09-07T03:35:30.672169+0000","last_undegraded":"2024-09-07T03:35:30.672169+0000","last_fullsized":"2024-09-07T03:35:30.672169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:21:08.328913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:26.371428+0000","last_change":"2024-09-07T03:36:26.371428+0000","last_active":"2024-09-07T03:36:26.371428+0000","last_peered":"2024-09-07T03:36:26.371428+0000","last_clean":"2024-09-07T03:36:26.371428+0000","last_became_active":"2024-09-07T03:32:20.143377+0000","last_became_peered":"2024-09-07T03:32:20.143377+0000","last_unstale":"2024-09-07T03:36:26.371428+0000","last_undegraded":"2024-09-07T03:36:26.371428+0000","last_fullsized":"2024-09-07T03:36:26.371428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:26.371344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:26.371344+0000","last_clean_scrub_stamp":"2024-09-07T03:36:26.371344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:28:08.210983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278297+0000","last_change":"2024-09-07T03:32:22.146527+0000","last_active":"2024-09-07T03:32:50.278297+0000","last_peered":"2024-09-07T03:32:50.278297+0000","last_clean":"2024-09-07T03:32:50.278297+0000","last_became_active":"2024-09-07T03:32:22.146237+0000","last_became_peered":"2024-09-07T03:32:22.146237+0000","last_unstale":"2024-09-07T03:32:50.278297+0000","last_undegraded":"2024-09-07T03:32:50.278297+0000","last_fullsized":"2024-09-07T03:32:50.278297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:13:05.478773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.068178+0000","last_change":"2024-09-07T03:36:07.068178+0000","last_active":"2024-09-07T03:36:07.068178+0000","last_peered":"2024-09-07T03:36:07.068178+0000","last_clean":"2024-09-07T03:36:07.068178+0000","last_became_active":"2024-09-07T03:32:14.125706+0000","last_became_peered":"2024-09-07T03:32:14.125706+0000","last_unstale":"2024-09-07T03:36:07.068178+0000","last_undegraded":"2024-09-07T03:36:07.068178+0000","last_fullsized":"2024-09-07T03:36:07.068178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:07.068080+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:07.068080+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.068080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:12:24.604557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.051788+0000","last_change":"2024-09-07T03:35:51.051788+0000","last_active":"2024-09-07T03:35:51.051788+0000","last_peered":"2024-09-07T03:35:51.051788+0000","last_clean":"2024-09-07T03:35:51.051788+0000","last_became_active":"2024-09-07T03:32:12.125261+0000","last_became_peered":"2024-09-07T03:32:12.125261+0000","last_unstale":"2024-09-07T03:35:51.051788+0000","last_undegraded":"2024-09-07T03:35:51.051788+0000","last_fullsized":"2024-09-07T03:35:51.051788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:51.051700+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:51.051700+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.051700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:26:24.675430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:20.916902+0000","last_change":"2024-09-07T03:36:20.916902+0000","last_active":"2024-09-07T03:36:20.916902+0000","last_peered":"2024-09-07T03:36:20.916902+0000","last_clean":"2024-09-07T03:36:20.916902+0000","last_became_active":"2024-09-07T03:32:16.124314+0000","last_became_peered":"2024-09-07T03:32:16.124314+0000","last_unstale":"2024-09-07T03:36:20.916902+0000","last_undegraded":"2024-09-07T03:36:20.916902+0000","last_fullsized":"2024-09-07T03:36:20.916902+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:20.916802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:20.916802+0000","last_clean_scrub_stamp":"2024-09-07T03:36:20.916802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:42:01.035736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'47","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:29.113352+0000","last_change":"2024-09-07T03:36:29.113286+0000","last_active":"2024-09-07T03:36:29.113352+0000","last_peered":"2024-09-07T03:36:29.113352+0000","last_clean":"2024-09-07T03:36:29.113352+0000","last_became_active":"2024-09-07T03:32:18.129700+0000","last_became_peered":"2024-09-07T03:32:18.129700+0000","last_unstale":"2024-09-07T03:36:29.113352+0000","last_undegraded":"2024-09-07T03:36:29.113352+0000","last_fullsized":"2024-09-07T03:36:29.113352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-07T03:36:29.113197+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-07T03:36:29.113197+0000","last_clean_scrub_stamp":"2024-09-07T03:36:29.113197+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:33:06.746327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:27.344920+0000","last_change":"2024-09-07T03:36:27.344920+0000","last_active":"2024-09-07T03:36:27.344920+0000","last_peered":"2024-09-07T03:36:27.344920+0000","last_clean":"2024-09-07T03:36:27.344920+0000","last_became_active":"2024-09-07T03:32:20.142695+0000","last_became_peered":"2024-09-07T03:32:20.142695+0000","last_unstale":"2024-09-07T03:36:27.344920+0000","last_undegraded":"2024-09-07T03:36:27.344920+0000","last_fullsized":"2024-09-07T03:36:27.344920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:27.344821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:27.344821+0000","last_clean_scrub_stamp":"2024-09-07T03:36:27.344821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:52:24.825492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:22.959036+0000","last_change":"2024-09-07T03:32:22.143270+0000","last_active":"2024-09-07T03:34:22.959036+0000","last_peered":"2024-09-07T03:34:22.959036+0000","last_clean":"2024-09-07T03:34:22.959036+0000","last_became_active":"2024-09-07T03:32:22.143053+0000","last_became_peered":"2024-09-07T03:32:22.143053+0000","last_unstale":"2024-09-07T03:34:22.959036+0000","last_undegraded":"2024-09-07T03:34:22.959036+0000","last_fullsized":"2024-09-07T03:34:22.959036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:05:14.463803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.116308+0000","last_change":"2024-09-07T03:35:49.116308+0000","last_active":"2024-09-07T03:35:49.116308+0000","last_peered":"2024-09-07T03:35:49.116308+0000","last_clean":"2024-09-07T03:35:49.116308+0000","last_became_active":"2024-09-07T03:32:14.117608+0000","last_became_peered":"2024-09-07T03:32:14.117608+0000","last_unstale":"2024-09-07T03:35:49.116308+0000","last_undegraded":"2024-09-07T03:35:49.116308+0000","last_fullsized":"2024-09-07T03:35:49.116308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:49.116226+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:49.116226+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.116226+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:26.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.931398+0000","last_change":"2024-09-07T03:35:42.931398+0000","last_active":"2024-09-07T03:35:42.931398+0000","last_peered":"2024-09-07T03:35:42.931398+0000","last_clean":"2024-09-07T03:35:42.931398+0000","last_became_active":"2024-09-07T03:32:12.135523+0000","last_became_peered":"2024-09-07T03:32:12.135523+0000","last_unstale":"2024-09-07T03:35:42.931398+0000","last_undegraded":"2024-09-07T03:35:42.931398+0000","last_fullsized":"2024-09-07T03:35:42.931398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:42.931312+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:42.931312+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.931312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:46.882774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.074094+0000","last_change":"2024-09-07T03:36:07.074094+0000","last_active":"2024-09-07T03:36:07.074094+0000","last_peered":"2024-09-07T03:36:07.074094+0000","last_clean":"2024-09-07T03:36:07.074094+0000","last_became_active":"2024-09-07T03:32:50.279004+0000","last_became_peered":"2024-09-07T03:32:50.279004+0000","last_unstale":"2024-09-07T03:36:07.074094+0000","last_undegraded":"2024-09-07T03:36:07.074094+0000","last_fullsized":"2024-09-07T03:36:07.074094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:07.074012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:07.074012+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.074012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:24.180913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"36'24","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:27.113198+0000","last_change":"2024-09-07T03:36:27.113198+0000","last_active":"2024-09-07T03:36:27.113198+0000","last_peered":"2024-09-07T03:36:27.113198+0000","last_clean":"2024-09-07T03:36:27.113198+0000","last_became_active":"2024-09-07T03:32:18.127007+0000","last_became_peered":"2024-09-07T03:32:18.127007+0000","last_unstale":"2024-09-07T03:36:27.113198+0000","last_undegraded":"2024-09-07T03:36:27.113198+0000","last_fullsized":"2024-09-07T03:36:27.113198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-07T03:36:27.113110+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-07T03:36:27.113110+0000","last_clean_scrub_stamp":"2024-09-07T03:36:27.113110+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:21:54.856422+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":371,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.696374+0000","last_change":"2024-09-07T03:32:20.147075+0000","last_active":"2024-09-07T03:35:30.696374+0000","last_peered":"2024-09-07T03:35:30.696374+0000","last_clean":"2024-09-07T03:35:30.696374+0000","last_became_active":"2024-09-07T03:32:20.146738+0000","last_became_peered":"2024-09-07T03:32:20.146738+0000","last_unstale":"2024-09-07T03:35:30.696374+0000","last_undegraded":"2024-09-07T03:35:30.696374+0000","last_fullsized":"2024-09-07T03:35:30.696374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:56.568340+0000","last_change":"2024-09-07T03:32:22.151158+0000","last_active":"2024-09-07T03:32:56.568340+0000","last_peered":"2024-09-07T03:32:56.568340+0000","last_clean":"2024-09-07T03:32:56.568340+0000","last_became_active":"2024-09-07T03:32:22.150886+0000","last_became_peered":"2024-09-07T03:32:22.150886+0000","last_unstale":"2024-09-07T03:32:56.568340+0000","last_undegraded":"2024-09-07T03:32:56.568340+0000","last_fullsized":"2024-09-07T03:32:56.568340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:57:06.666886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'18","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.057071+0000","last_change":"2024-09-07T03:35:53.057071+0000","last_active":"2024-09-07T03:35:53.057071+0000","last_peered":"2024-09-07T03:35:53.057071+0000","last_clean":"2024-09-07T03:35:53.057071+0000","last_became_active":"2024-09-07T03:32:14.126901+0000","last_became_peered":"2024-09-07T03:32:14.126901+0000","last_unstale":"2024-09-07T03:35:53.057071+0000","last_undegraded":"2024-09-07T03:35:53.057071+0000","last_fullsized":"2024-09-07T03:35:53.057071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-07T03:35:53.056989+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-07T03:35:53.056989+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.056989+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:48:19.164483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.209553+0000","last_change":"2024-09-07T03:35:44.209553+0000","last_active":"2024-09-07T03:35:44.209553+0000","last_peered":"2024-09-07T03:35:44.209553+0000","last_clean":"2024-09-07T03:35:44.209553+0000","last_became_active":"2024-09-07T03:32:12.133876+0000","last_became_peered":"2024-09-07T03:32:12.133876+0000","last_unstale":"2024-09-07T03:35:44.209553+0000","last_undegraded":"2024-09-07T03:35:44.209553+0000","last_fullsized":"2024-09-07T03:35:44.209553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.209464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.209464+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.209464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:02.025918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"36'2","reported_seq":230,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:14.257125+0000","last_change":"2024-09-07T03:36:14.257125+0000","last_active":"2024-09-07T03:36:14.257125+0000","last_peered":"2024-09-07T03:36:14.257125+0000","last_clean":"2024-09-07T03:36:14.257125+0000","last_became_active":"2024-09-07T03:32:16.120952+0000","last_became_peered":"2024-09-07T03:32:16.120952+0000","last_unstale":"2024-09-07T03:36:14.257125+0000","last_undegraded":"2024-09-07T03:36:14.257125+0000","last_fullsized":"2024-09-07T03:36:14.257125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:14.257038+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:14.257038+0000","last_clean_scrub_stamp":"2024-09-07T03:36:14.257038+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:16.827044+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'66","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.635641+0000","last_change":"2024-09-07T03:32:18.133969+0000","last_active":"2024-09-07T03:35:30.635641+0000","last_peered":"2024-09-07T03:35:30.635641+0000","last_clean":"2024-09-07T03:35:30.635641+0000","last_became_active":"2024-09-07T03:32:18.133705+0000","last_became_peered":"2024-09-07T03:32:18.133705+0000","last_unstale":"2024-09-07T03:35:30.635641+0000","last_undegraded":"2024-09-07T03:35:30.635641+0000","last_fullsized":"2024-09-07T03:35:30.635641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:02.433602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.271613+0000","last_change":"2024-09-07T03:32:20.137011+0000","last_active":"2024-09-07T03:32:50.271613+0000","last_peered":"2024-09-07T03:32:50.271613+0000","last_clean":"2024-09-07T03:32:50.271613+0000","last_became_active":"2024-09-07T03:32:20.135211+0000","last_became_peered":"2024-09-07T03:32:20.135211+0000","last_unstale":"2024-09-07T03:32:50.271613+0000","last_undegraded":"2024-09-07T03:32:50.271613+0000","last_fullsized":"2024-09-07T03:32:50.271613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:33.033993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:57.028862+0000","last_change":"2024-09-07T03:32:22.141840+0000","last_active":"2024-09-07T03:32:57.028862+0000","last_peered":"2024-09-07T03:32:57.028862+0000","last_clean":"2024-09-07T03:32:57.028862+0000","last_became_active":"2024-09-07T03:32:22.141533+0000","last_became_peered":"2024-09-07T03:32:22.141533+0000","last_unstale":"2024-09-07T03:32:57.028862+0000","last_undegraded":"2024-09-07T03:32:57.028862+0000","last_fullsized":"2024-09-07T03:32:57.028862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:32:37.743868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'20","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.044148+0000","last_change":"2024-09-07T03:36:05.044148+0000","last_active":"2024-09-07T03:36:05.044148+0000","last_peered":"2024-09-07T03:36:05.044148+0000","last_clean":"2024-09-07T03:36:05.044148+0000","last_became_active":"2024-09-07T03:32:14.122929+0000","last_became_peered":"2024-09-07T03:32:14.122929+0000","last_unstale":"2024-09-07T03:36:05.044148+0000","last_undegraded":"2024-09-07T03:36:05.044148+0000","last_fullsized":"2024-09-07T03:36:05.044148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-07T03:36:05.044058+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-07T03:36:05.044058+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.044058+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:49.195578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.018984+0000","last_change":"2024-09-07T03:35:50.018984+0000","last_active":"2024-09-07T03:35:50.018984+0000","last_peered":"2024-09-07T03:35:50.018984+0000","last_clean":"2024-09-07T03:35:50.018984+0000","last_became_active":"2024-09-07T03:32:12.124610+0000","last_became_peered":"2024-09-07T03:32:12.124610+0000","last_unstale":"2024-09-07T03:35:50.018984+0000","last_undegraded":"2024-09-07T03:35:50.018984+0000","last_fullsized":"2024-09-07T03:35:50.018984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:50.018888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:50.018888+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.018888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:55.010719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:19.903030+0000","last_change":"2024-09-07T03:36:19.903030+0000","last_active":"2024-09-07T03:36:19.903030+0000","last_peered":"2024-09-07T03:36:19.903030+0000","last_clean":"2024-09-07T03:36:19.903030+0000","last_became_active":"2024-09-07T03:32:16.116296+0000","last_became_peered":"2024-09-07T03:32:16.116296+0000","last_unstale":"2024-09-07T03:36:19.903030+0000","last_undegraded":"2024-09-07T03:36:19.903030+0000","last_fullsized":"2024-09-07T03:36:19.903030+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:19.902946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:19.902946+0000","last_clean_scrub_stamp":"2024-09-07T03:36:19.902946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:48:25.481196+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'45","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.105865+0000","last_change":"2024-09-07T03:36:09.105865+0000","last_active":"2024-09-07T03:36:09.105865+0000","last_peered":"2024-09-07T03:36:09.105865+0000","last_clean":"2024-09-07T03:36:09.105865+0000","last_became_active":"2024-09-07T03:32:18.134533+0000","last_became_peered":"2024-09-07T03:32:18.134533+0000","last_unstale":"2024-09-07T03:36:09.105865+0000","last_undegraded":"2024-09-07T03:36:09.105865+0000","last_fullsized":"2024-09-07T03:36:09.105865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-07T03:36:09.105777+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-07T03:36:09.105777+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.105777+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:52:38.222360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.278010+0000","last_change":"2024-09-07T03:32:20.146986+0000","last_active":"2024-09-07T03:32:50.278010+0000","last_peered":"2024-09-07T03:32:50.278010+0000","last_clean":"2024-09-07T03:32:50.278010+0000","last_became_active":"2024-09-07T03:32:20.146631+0000","last_became_peered":"2024-09-07T03:32:20.146631+0000","last_unstale":"2024-09-07T03:32:50.278010+0000","last_undegraded":"2024-09-07T03:32:50.278010+0000","last_fullsized":"2024-09-07T03:32:50.278010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:56.243102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.275464+0000","last_change":"2024-09-07T03:32:22.152021+0000","last_active":"2024-09-07T03:32:50.275464+0000","last_peered":"2024-09-07T03:32:50.275464+0000","last_clean":"2024-09-07T03:32:50.275464+0000","last_became_active":"2024-09-07T03:32:22.151709+0000","last_became_peered":"2024-09-07T03:32:22.151709+0000","last_unstale":"2024-09-07T03:32:50.275464+0000","last_undegraded":"2024-09-07T03:32:50.275464+0000","last_fullsized":"2024-09-07T03:32:50.275464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:01.162547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.091041+0000","last_change":"2024-09-07T03:36:05.091041+0000","last_active":"2024-09-07T03:36:05.091041+0000","last_peered":"2024-09-07T03:36:05.091041+0000","last_clean":"2024-09-07T03:36:05.091041+0000","last_became_active":"2024-09-07T03:32:14.127451+0000","last_became_peered":"2024-09-07T03:32:14.127451+0000","last_unstale":"2024-09-07T03:36:05.091041+0000","last_undegraded":"2024-09-07T03:36:05.091041+0000","last_fullsized":"2024-09-07T03:36:05.091041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:05.090946+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:05.090946+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.090946+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:25.001951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.970246+0000","last_change":"2024-09-07T03:35:41.970187+0000","last_active":"2024-09-07T03:35:41.970246+0000","last_peered":"2024-09-07T03:35:41.970246+0000","last_clean":"2024-09-07T03:35:41.970246+0000","last_became_active":"2024-09-07T03:32:12.124552+0000","last_became_peered":"2024-09-07T03:32:12.124552+0000","last_unstale":"2024-09-07T03:35:41.970246+0000","last_undegraded":"2024-09-07T03:35:41.970246+0000","last_fullsized":"2024-09-07T03:35:41.970246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.970083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.970083+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.970083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:38:37.531358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:13.303314+0000","last_change":"2024-09-07T03:36:13.303314+0000","last_active":"2024-09-07T03:36:13.303314+0000","last_peered":"2024-09-07T03:36:13.303314+0000","last_clean":"2024-09-07T03:36:13.303314+0000","last_became_active":"2024-09-07T03:32:16.123423+0000","last_became_peered":"2024-09-07T03:32:16.123423+0000","last_unstale":"2024-09-07T03:36:13.303314+0000","last_undegraded":"2024-09-07T03:36:13.303314+0000","last_fullsized":"2024-09-07T03:36:13.303314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:13.303226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:13.303226+0000","last_clean_scrub_stamp":"2024-09-07T03:36:13.303226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:43:46.932826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'38","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:28.120261+0000","last_change":"2024-09-07T03:36:28.120261+0000","last_active":"2024-09-07T03:36:28.120261+0000","last_peered":"2024-09-07T03:36:28.120261+0000","last_clean":"2024-09-07T03:36:28.120261+0000","last_became_active":"2024-09-07T03:32:18.128812+0000","last_became_peered":"2024-09-07T03:32:18.128812+0000","last_unstale":"2024-09-07T03:36:28.120261+0000","last_undegraded":"2024-09-07T03:36:28.120261+0000","last_fullsized":"2024-09-07T03:36:28.120261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-07T03:36:28.120175+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-07T03:36:28.120175+0000","last_clean_scrub_stamp":"2024-09-07T03:36:28.120175+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:12:50.806889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:32:50.279344+0000","last_change":"2024-09-07T03:32:20.132779+0000","last_active":"2024-09-07T03:32:50.279344+0000","last_peered":"2024-09-07T03:32:50.279344+0000","last_clean":"2024-09-07T03:32:50.279344+0000","last_became_active":"2024-09-07T03:32:20.132396+0000","last_became_peered":"2024-09-07T03:32:20.132396+0000","last_unstale":"2024-09-07T03:32:50.279344+0000","last_undegraded":"2024-09-07T03:32:50.279344+0000","last_fullsized":"2024-09-07T03:32:50.279344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:19.114852+0000","last_clean_scrub_stamp":"2024-09-07T03:32:19.114852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:29:30.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.210747+0000","last_change":"2024-09-07T03:32:22.152253+0000","last_active":"2024-09-07T03:34:21.210747+0000","last_peered":"2024-09-07T03:34:21.210747+0000","last_clean":"2024-09-07T03:34:21.210747+0000","last_became_active":"2024-09-07T03:32:22.151697+0000","last_became_peered":"2024-09-07T03:32:22.151697+0000","last_unstale":"2024-09-07T03:34:21.210747+0000","last_undegraded":"2024-09-07T03:34:21.210747+0000","last_fullsized":"2024-09-07T03:34:21.210747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:12:47.655977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.046264+0000","last_change":"2024-09-07T03:36:01.046264+0000","last_active":"2024-09-07T03:36:01.046264+0000","last_peered":"2024-09-07T03:36:01.046264+0000","last_clean":"2024-09-07T03:36:01.046264+0000","last_became_active":"2024-09-07T03:32:14.112336+0000","last_became_peered":"2024-09-07T03:32:14.112336+0000","last_unstale":"2024-09-07T03:36:01.046264+0000","last_undegraded":"2024-09-07T03:36:01.046264+0000","last_fullsized":"2024-09-07T03:36:01.046264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:01.046172+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:01.046172+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.046172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:13:46.940832+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.070400+0000","last_change":"2024-09-07T03:35:48.070310+0000","last_active":"2024-09-07T03:35:48.070400+0000","last_peered":"2024-09-07T03:35:48.070400+0000","last_clean":"2024-09-07T03:35:48.070400+0000","last_became_active":"2024-09-07T03:32:12.136020+0000","last_became_peered":"2024-09-07T03:32:12.136020+0000","last_unstale":"2024-09-07T03:35:48.070400+0000","last_undegraded":"2024-09-07T03:35:48.070400+0000","last_fullsized":"2024-09-07T03:35:48.070400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:48.070194+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:48.070194+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.070194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:06:09.533250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:12.289519+0000","last_change":"2024-09-07T03:36:12.289519+0000","last_active":"2024-09-07T03:36:12.289519+0000","last_peered":"2024-09-07T03:36:12.289519+0000","last_clean":"2024-09-07T03:36:12.289519+0000","last_became_active":"2024-09-07T03:32:16.129161+0000","last_became_peered":"2024-09-07T03:32:16.129161+0000","last_unstale":"2024-09-07T03:36:12.289519+0000","last_undegraded":"2024-09-07T03:36:12.289519+0000","last_fullsized":"2024-09-07T03:36:12.289519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:36:12.289436+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:36:12.289436+0000","last_clean_scrub_stamp":"2024-09-07T03:36:12.289436+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:48:15.876669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'48","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:30.619879+0000","last_change":"2024-09-07T03:32:18.132380+0000","last_active":"2024-09-07T03:35:30.619879+0000","last_peered":"2024-09-07T03:35:30.619879+0000","last_clean":"2024-09-07T03:35:30.619879+0000","last_became_active":"2024-09-07T03:32:18.132072+0000","last_became_peered":"2024-09-07T03:32:18.132072+0000","last_unstale":"2024-09-07T03:35:30.619879+0000","last_undegraded":"2024-09-07T03:35:30.619879+0000","last_fullsized":"2024-09-07T03:35:30.619879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:17.107345+0000","last_clean_scrub_stamp":"2024-09-07T03:32:17.107345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:11:37.568436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:16.120667+0000","last_change":"2024-09-07T03:36:16.120667+0000","last_active":"2024-09-07T03:36:16.120667+0000","last_peered":"2024-09-07T03:36:16.120667+0000","last_clean":"2024-09-07T03:36:16.120667+0000","last_became_active":"2024-09-07T03:32:20.144977+0000","last_became_peered":"2024-09-07T03:32:20.144977+0000","last_unstale":"2024-09-07T03:36:16.120667+0000","last_undegraded":"2024-09-07T03:36:16.120667+0000","last_fullsized":"2024-09-07T03:36:16.120667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:16.120582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:16.120582+0000","last_clean_scrub_stamp":"2024-09-07T03:36:16.120582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:51:35.245495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:34:21.213631+0000","last_change":"2024-09-07T03:32:22.141987+0000","last_active":"2024-09-07T03:34:21.213631+0000","last_peered":"2024-09-07T03:34:21.213631+0000","last_clean":"2024-09-07T03:34:21.213631+0000","last_became_active":"2024-09-07T03:32:22.141633+0000","last_became_peered":"2024-09-07T03:32:22.141633+0000","last_unstale":"2024-09-07T03:34:21.213631+0000","last_undegraded":"2024-09-07T03:34:21.213631+0000","last_fullsized":"2024-09-07T03:34:21.213631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:32:21.122430+0000","last_clean_scrub_stamp":"2024-09-07T03:32:21.122430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:34:45.392294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'8","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.132791+0000","last_change":"2024-09-07T03:36:02.132708+0000","last_active":"2024-09-07T03:36:02.132791+0000","last_peered":"2024-09-07T03:36:02.132791+0000","last_clean":"2024-09-07T03:36:02.132791+0000","last_became_active":"2024-09-07T03:32:14.111950+0000","last_became_peered":"2024-09-07T03:32:14.111950+0000","last_unstale":"2024-09-07T03:36:02.132791+0000","last_undegraded":"2024-09-07T03:36:02.132791+0000","last_fullsized":"2024-09-07T03:36:02.132791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:02.132614+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:02.132614+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.132614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:45.086077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.116076+0000","last_change":"2024-09-07T03:35:37.115987+0000","last_active":"2024-09-07T03:35:37.116076+0000","last_peered":"2024-09-07T03:35:37.116076+0000","last_clean":"2024-09-07T03:35:37.116076+0000","last_became_active":"2024-09-07T03:32:12.132814+0000","last_became_peered":"2024-09-07T03:32:12.132814+0000","last_unstale":"2024-09-07T03:35:37.116076+0000","last_undegraded":"2024-09-07T03:35:37.116076+0000","last_fullsized":"2024-09-07T03:35:37.116076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.115869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.115869+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.115869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:47:45.209898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.152783+0000","last_change":"2024-09-07T03:35:58.152698+0000","last_active":"2024-09-07T03:35:58.152783+0000","last_peered":"2024-09-07T03:35:58.152783+0000","last_clean":"2024-09-07T03:35:58.152783+0000","last_became_active":"2024-09-07T03:32:14.114966+0000","last_became_peered":"2024-09-07T03:32:14.114966+0000","last_unstale":"2024-09-07T03:35:58.152783+0000","last_undegraded":"2024-09-07T03:35:58.152783+0000","last_fullsized":"2024-09-07T03:35:58.152783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:35:58.152588+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:35:58.152588+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.152588+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:25:57.639946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.133036+0000","last_change":"2024-09-07T03:35:39.132979+0000","last_active":"2024-09-07T03:35:39.133036+0000","last_peered":"2024-09-07T03:35:39.133036+0000","last_clean":"2024-09-07T03:35:39.133036+0000","last_became_active":"2024-09-07T03:32:12.132662+0000","last_became_peered":"2024-09-07T03:32:12.132662+0000","last_unstale":"2024-09-07T03:35:39.133036+0000","last_undegraded":"2024-09-07T03:35:39.133036+0000","last_fullsized":"2024-09-07T03:35:39.133036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:39.132883+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:39.132883+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.132883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:45:43.737374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'12","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.079643+0000","last_change":"2024-09-07T03:36:06.079643+0000","last_active":"2024-09-07T03:36:06.079643+0000","last_peered":"2024-09-07T03:36:06.079643+0000","last_clean":"2024-09-07T03:36:06.079643+0000","last_became_active":"2024-09-07T03:32:14.122301+0000","last_became_peered":"2024-09-07T03:32:14.122301+0000","last_unstale":"2024-09-07T03:36:06.079643+0000","last_undegraded":"2024-09-07T03:36:06.079643+0000","last_fullsized":"2024-09-07T03:36:06.079643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:36:06.079527+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:36:06.079527+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.079527+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:10:45.982132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.860031+0000","last_change":"2024-09-07T03:35:48.859938+0000","last_active":"2024-09-07T03:35:48.860031+0000","last_peered":"2024-09-07T03:35:48.860031+0000","last_clean":"2024-09-07T03:35:48.860031+0000","last_became_active":"2024-09-07T03:32:12.137561+0000","last_became_peered":"2024-09-07T03:32:12.137561+0000","last_unstale":"2024-09-07T03:35:48.860031+0000","last_undegraded":"2024-09-07T03:35:48.860031+0000","last_fullsized":"2024-09-07T03:35:48.860031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:48.859832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:48.859832+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.859832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:48:54.026056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:59.114273+0000","last_change":"2024-09-07T03:35:59.114219+0000","last_active":"2024-09-07T03:35:59.114273+0000","last_peered":"2024-09-07T03:35:59.114273+0000","last_clean":"2024-09-07T03:35:59.114273+0000","last_became_active":"2024-09-07T03:32:14.114055+0000","last_became_peered":"2024-09-07T03:32:14.114055+0000","last_unstale":"2024-09-07T03:35:59.114273+0000","last_undegraded":"2024-09-07T03:35:59.114273+0000","last_fullsized":"2024-09-07T03:35:59.114273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:59.114136+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:59.114136+0000","last_clean_scrub_stamp":"2024-09-07T03:35:59.114136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:46.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.117649+0000","last_change":"2024-09-07T03:35:40.117553+0000","last_active":"2024-09-07T03:35:40.117649+0000","last_peered":"2024-09-07T03:35:40.117649+0000","last_clean":"2024-09-07T03:35:40.117649+0000","last_became_active":"2024-09-07T03:32:12.132471+0000","last_became_peered":"2024-09-07T03:32:12.132471+0000","last_unstale":"2024-09-07T03:35:40.117649+0000","last_undegraded":"2024-09-07T03:35:40.117649+0000","last_fullsized":"2024-09-07T03:35:40.117649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.117422+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.117422+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.117422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:29:20.922622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"36'12","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.021206+0000","last_change":"2024-09-07T03:35:55.021206+0000","last_active":"2024-09-07T03:35:55.021206+0000","last_peered":"2024-09-07T03:35:55.021206+0000","last_clean":"2024-09-07T03:35:55.021206+0000","last_became_active":"2024-09-07T03:32:50.280656+0000","last_became_peered":"2024-09-07T03:32:50.280656+0000","last_unstale":"2024-09-07T03:35:55.021206+0000","last_undegraded":"2024-09-07T03:35:55.021206+0000","last_fullsized":"2024-09-07T03:35:55.021206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:55.021115+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:55.021115+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.021115+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:26:34.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.896351+0000","last_change":"2024-09-07T03:35:43.896274+0000","last_active":"2024-09-07T03:35:43.896351+0000","last_peered":"2024-09-07T03:35:43.896351+0000","last_clean":"2024-09-07T03:35:43.896351+0000","last_became_active":"2024-09-07T03:32:12.140393+0000","last_became_peered":"2024-09-07T03:32:12.140393+0000","last_unstale":"2024-09-07T03:35:43.896351+0000","last_undegraded":"2024-09-07T03:35:43.896351+0000","last_fullsized":"2024-09-07T03:35:43.896351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.896191+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.896191+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.896191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:06:33.074408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"36'10","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.166387+0000","last_change":"2024-09-07T03:35:57.166318+0000","last_active":"2024-09-07T03:35:57.166387+0000","last_peered":"2024-09-07T03:35:57.166387+0000","last_clean":"2024-09-07T03:35:57.166387+0000","last_became_active":"2024-09-07T03:32:14.113830+0000","last_became_peered":"2024-09-07T03:32:14.113830+0000","last_unstale":"2024-09-07T03:35:57.166387+0000","last_undegraded":"2024-09-07T03:35:57.166387+0000","last_fullsized":"2024-09-07T03:35:57.166387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:57.166234+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:57.166234+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.166234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:39:08.856653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.149330+0000","last_change":"2024-09-07T03:35:42.149266+0000","last_active":"2024-09-07T03:35:42.149330+0000","last_peered":"2024-09-07T03:35:42.149330+0000","last_clean":"2024-09-07T03:35:42.149330+0000","last_became_active":"2024-09-07T03:32:12.134287+0000","last_became_peered":"2024-09-07T03:32:12.134287+0000","last_unstale":"2024-09-07T03:35:42.149330+0000","last_undegraded":"2024-09-07T03:35:42.149330+0000","last_fullsized":"2024-09-07T03:35:42.149330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:42.149177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:42.149177+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.149177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:37:52.961968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'18","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.088996+0000","last_change":"2024-09-07T03:36:08.088917+0000","last_active":"2024-09-07T03:36:08.088996+0000","last_peered":"2024-09-07T03:36:08.088996+0000","last_clean":"2024-09-07T03:36:08.088996+0000","last_became_active":"2024-09-07T03:32:14.125990+0000","last_became_peered":"2024-09-07T03:32:14.125990+0000","last_unstale":"2024-09-07T03:36:08.088996+0000","last_undegraded":"2024-09-07T03:36:08.088996+0000","last_fullsized":"2024-09-07T03:36:08.088996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-07T03:36:08.088808+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-07T03:36:08.088808+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.088808+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:29:54.842821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.081826+0000","last_change":"2024-09-07T03:35:42.081766+0000","last_active":"2024-09-07T03:35:42.081826+0000","last_peered":"2024-09-07T03:35:42.081826+0000","last_clean":"2024-09-07T03:35:42.081826+0000","last_became_active":"2024-09-07T03:32:12.128807+0000","last_became_peered":"2024-09-07T03:32:12.128807+0000","last_unstale":"2024-09-07T03:35:42.081826+0000","last_undegraded":"2024-09-07T03:35:42.081826+0000","last_fullsized":"2024-09-07T03:35:42.081826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:42.081678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:42.081678+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.081678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:31:00.820127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.022644+0000","last_change":"2024-09-07T03:36:02.022570+0000","last_active":"2024-09-07T03:36:02.022644+0000","last_peered":"2024-09-07T03:36:02.022644+0000","last_clean":"2024-09-07T03:36:02.022644+0000","last_became_active":"2024-09-07T03:32:14.109799+0000","last_became_peered":"2024-09-07T03:32:14.109799+0000","last_unstale":"2024-09-07T03:36:02.022644+0000","last_undegraded":"2024-09-07T03:36:02.022644+0000","last_fullsized":"2024-09-07T03:36:02.022644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:36:02.022470+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:36:02.022470+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.022470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:00:09.783003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.877532+0000","last_change":"2024-09-07T03:35:44.877468+0000","last_active":"2024-09-07T03:35:44.877532+0000","last_peered":"2024-09-07T03:35:44.877532+0000","last_clean":"2024-09-07T03:35:44.877532+0000","last_became_active":"2024-09-07T03:32:12.130563+0000","last_became_peered":"2024-09-07T03:32:12.130563+0000","last_unstale":"2024-09-07T03:35:44.877532+0000","last_undegraded":"2024-09-07T03:35:44.877532+0000","last_fullsized":"2024-09-07T03:35:44.877532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.877377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.877377+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.877377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:28:27.432331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'8","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.159910+0000","last_change":"2024-09-07T03:36:03.159910+0000","last_active":"2024-09-07T03:36:03.159910+0000","last_peered":"2024-09-07T03:36:03.159910+0000","last_clean":"2024-09-07T03:36:03.159910+0000","last_became_active":"2024-09-07T03:32:14.115000+0000","last_became_peered":"2024-09-07T03:32:14.115000+0000","last_unstale":"2024-09-07T03:36:03.159910+0000","last_undegraded":"2024-09-07T03:36:03.159910+0000","last_fullsized":"2024-09-07T03:36:03.159910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:03.159816+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:03.159816+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.159816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:26.711029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.890978+0000","last_change":"2024-09-07T03:35:45.890896+0000","last_active":"2024-09-07T03:35:45.890978+0000","last_peered":"2024-09-07T03:35:45.890978+0000","last_clean":"2024-09-07T03:35:45.890978+0000","last_became_active":"2024-09-07T03:32:12.142315+0000","last_became_peered":"2024-09-07T03:32:12.142315+0000","last_unstale":"2024-09-07T03:35:45.890978+0000","last_undegraded":"2024-09-07T03:35:45.890978+0000","last_fullsized":"2024-09-07T03:35:45.890978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:45.890810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:45.890810+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.890810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:29:01.485471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.094544+0000","last_change":"2024-09-07T03:36:09.094544+0000","last_active":"2024-09-07T03:36:09.094544+0000","last_peered":"2024-09-07T03:36:09.094544+0000","last_clean":"2024-09-07T03:36:09.094544+0000","last_became_active":"2024-09-07T03:32:14.127560+0000","last_became_peered":"2024-09-07T03:32:14.127560+0000","last_unstale":"2024-09-07T03:36:09.094544+0000","last_undegraded":"2024-09-07T03:36:09.094544+0000","last_fullsized":"2024-09-07T03:36:09.094544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:09.094457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:09.094457+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.094457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:55:48.663875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.873531+0000","last_change":"2024-09-07T03:35:47.873531+0000","last_active":"2024-09-07T03:35:47.873531+0000","last_peered":"2024-09-07T03:35:47.873531+0000","last_clean":"2024-09-07T03:35:47.873531+0000","last_became_active":"2024-09-07T03:32:12.138745+0000","last_became_peered":"2024-09-07T03:32:12.138745+0000","last_unstale":"2024-09-07T03:35:47.873531+0000","last_undegraded":"2024-09-07T03:35:47.873531+0000","last_fullsized":"2024-09-07T03:35:47.873531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:47.873426+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:47.873426+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.873426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:54:29.688161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.055838+0000","last_change":"2024-09-07T03:35:52.055838+0000","last_active":"2024-09-07T03:35:52.055838+0000","last_peered":"2024-09-07T03:35:52.055838+0000","last_clean":"2024-09-07T03:35:52.055838+0000","last_became_active":"2024-09-07T03:32:14.122699+0000","last_became_peered":"2024-09-07T03:32:14.122699+0000","last_unstale":"2024-09-07T03:35:52.055838+0000","last_undegraded":"2024-09-07T03:35:52.055838+0000","last_fullsized":"2024-09-07T03:35:52.055838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:52.055707+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:52.055707+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.055707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:52:43.293149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.065851+0000","last_change":"2024-09-07T03:35:52.065851+0000","last_active":"2024-09-07T03:35:52.065851+0000","last_peered":"2024-09-07T03:35:52.065851+0000","last_clean":"2024-09-07T03:35:52.065851+0000","last_became_active":"2024-09-07T03:32:12.133145+0000","last_became_peered":"2024-09-07T03:32:12.133145+0000","last_unstale":"2024-09-07T03:35:52.065851+0000","last_undegraded":"2024-09-07T03:35:52.065851+0000","last_fullsized":"2024-09-07T03:35:52.065851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:52.065764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:52.065764+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.065764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:26:56.647887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"36'16","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.140944+0000","last_change":"2024-09-07T03:36:01.140944+0000","last_active":"2024-09-07T03:36:01.140944+0000","last_peered":"2024-09-07T03:36:01.140944+0000","last_clean":"2024-09-07T03:36:01.140944+0000","last_became_active":"2024-09-07T03:32:14.111759+0000","last_became_peered":"2024-09-07T03:32:14.111759+0000","last_unstale":"2024-09-07T03:36:01.140944+0000","last_undegraded":"2024-09-07T03:36:01.140944+0000","last_fullsized":"2024-09-07T03:36:01.140944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:36:01.140835+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:36:01.140835+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.140835+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:43:12.824330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":44,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.180733+0000","last_change":"2024-09-07T03:35:43.180733+0000","last_active":"2024-09-07T03:35:43.180733+0000","last_peered":"2024-09-07T03:35:43.180733+0000","last_clean":"2024-09-07T03:35:43.180733+0000","last_became_active":"2024-09-07T03:32:12.134151+0000","last_became_peered":"2024-09-07T03:32:12.134151+0000","last_unstale":"2024-09-07T03:35:43.180733+0000","last_undegraded":"2024-09-07T03:35:43.180733+0000","last_fullsized":"2024-09-07T03:35:43.180733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.180633+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.180633+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.180633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:50:19.691547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'30","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.063680+0000","last_change":"2024-09-07T03:36:08.063680+0000","last_active":"2024-09-07T03:36:08.063680+0000","last_peered":"2024-09-07T03:36:08.063680+0000","last_clean":"2024-09-07T03:36:08.063680+0000","last_became_active":"2024-09-07T03:32:14.124258+0000","last_became_peered":"2024-09-07T03:32:14.124258+0000","last_unstale":"2024-09-07T03:36:08.063680+0000","last_undegraded":"2024-09-07T03:36:08.063680+0000","last_fullsized":"2024-09-07T03:36:08.063680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-07T03:36:08.063566+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-07T03:36:08.063566+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.063566+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:42.604250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":111,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.921691+0000","last_change":"2024-09-07T03:35:46.921691+0000","last_active":"2024-09-07T03:35:46.921691+0000","last_peered":"2024-09-07T03:35:46.921691+0000","last_clean":"2024-09-07T03:35:46.921691+0000","last_became_active":"2024-09-07T03:32:12.140243+0000","last_became_peered":"2024-09-07T03:32:12.140243+0000","last_unstale":"2024-09-07T03:35:46.921691+0000","last_undegraded":"2024-09-07T03:35:46.921691+0000","last_fullsized":"2024-09-07T03:35:46.921691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.921593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.921593+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.921593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:41:38.191780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:00.126598+0000","last_change":"2024-09-07T03:36:00.126598+0000","last_active":"2024-09-07T03:36:00.126598+0000","last_peered":"2024-09-07T03:36:00.126598+0000","last_clean":"2024-09-07T03:36:00.126598+0000","last_became_active":"2024-09-07T03:32:14.113016+0000","last_became_peered":"2024-09-07T03:32:14.113016+0000","last_unstale":"2024-09-07T03:36:00.126598+0000","last_undegraded":"2024-09-07T03:36:00.126598+0000","last_fullsized":"2024-09-07T03:36:00.126598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:36:00.126510+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:36:00.126510+0000","last_clean_scrub_stamp":"2024-09-07T03:36:00.126510+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:54:09.635230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.941687+0000","last_change":"2024-09-07T03:35:50.941687+0000","last_active":"2024-09-07T03:35:50.941687+0000","last_peered":"2024-09-07T03:35:50.941687+0000","last_clean":"2024-09-07T03:35:50.941687+0000","last_became_active":"2024-09-07T03:32:12.135936+0000","last_became_peered":"2024-09-07T03:32:12.135936+0000","last_unstale":"2024-09-07T03:35:50.941687+0000","last_undegraded":"2024-09-07T03:35:50.941687+0000","last_fullsized":"2024-09-07T03:35:50.941687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:50.941592+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:50.941592+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.941592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:06:51.841561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'12","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.076421+0000","last_change":"2024-09-07T03:36:10.076421+0000","last_active":"2024-09-07T03:36:10.076421+0000","last_peered":"2024-09-07T03:36:10.076421+0000","last_clean":"2024-09-07T03:36:10.076421+0000","last_became_active":"2024-09-07T03:32:14.127982+0000","last_became_peered":"2024-09-07T03:32:14.127982+0000","last_unstale":"2024-09-07T03:36:10.076421+0000","last_undegraded":"2024-09-07T03:36:10.076421+0000","last_fullsized":"2024-09-07T03:36:10.076421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:36:10.076339+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:36:10.076339+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.076339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:56:41.547939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.155078+0000","last_change":"2024-09-07T03:35:44.155078+0000","last_active":"2024-09-07T03:35:44.155078+0000","last_peered":"2024-09-07T03:35:44.155078+0000","last_clean":"2024-09-07T03:35:44.155078+0000","last_became_active":"2024-09-07T03:32:12.133720+0000","last_became_peered":"2024-09-07T03:32:12.133720+0000","last_unstale":"2024-09-07T03:35:44.155078+0000","last_undegraded":"2024-09-07T03:35:44.155078+0000","last_fullsized":"2024-09-07T03:35:44.155078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.154970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.154970+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.154970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:08:12.195152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.092133+0000","last_change":"2024-09-07T03:36:07.092133+0000","last_active":"2024-09-07T03:36:07.092133+0000","last_peered":"2024-09-07T03:36:07.092133+0000","last_clean":"2024-09-07T03:36:07.092133+0000","last_became_active":"2024-09-07T03:32:14.124462+0000","last_became_peered":"2024-09-07T03:32:14.124462+0000","last_unstale":"2024-09-07T03:36:07.092133+0000","last_undegraded":"2024-09-07T03:36:07.092133+0000","last_fullsized":"2024-09-07T03:36:07.092133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:07.092039+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:07.092039+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.092039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:55:55.628550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.021307+0000","last_change":"2024-09-07T03:35:54.021307+0000","last_active":"2024-09-07T03:35:54.021307+0000","last_peered":"2024-09-07T03:35:54.021307+0000","last_clean":"2024-09-07T03:35:54.021307+0000","last_became_active":"2024-09-07T03:32:12.140957+0000","last_became_peered":"2024-09-07T03:32:12.140957+0000","last_unstale":"2024-09-07T03:35:54.021307+0000","last_undegraded":"2024-09-07T03:35:54.021307+0000","last_fullsized":"2024-09-07T03:35:54.021307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:54.021157+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:54.021157+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.021157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:21:11.328839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.020195+0000","last_change":"2024-09-07T03:35:53.020195+0000","last_active":"2024-09-07T03:35:53.020195+0000","last_peered":"2024-09-07T03:35:53.020195+0000","last_clean":"2024-09-07T03:35:53.020195+0000","last_became_active":"2024-09-07T03:32:12.133460+0000","last_became_peered":"2024-09-07T03:32:12.133460+0000","last_unstale":"2024-09-07T03:35:53.020195+0000","last_undegraded":"2024-09-07T03:35:53.020195+0000","last_fullsized":"2024-09-07T03:35:53.020195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:53.020088+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:53.020088+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.020088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:50:01.451093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.052185+0000","last_change":"2024-09-07T03:35:54.052185+0000","last_active":"2024-09-07T03:35:54.052185+0000","last_peered":"2024-09-07T03:35:54.052185+0000","last_clean":"2024-09-07T03:35:54.052185+0000","last_became_active":"2024-09-07T03:32:14.123554+0000","last_became_peered":"2024-09-07T03:32:14.123554+0000","last_unstale":"2024-09-07T03:35:54.052185+0000","last_undegraded":"2024-09-07T03:35:54.052185+0000","last_fullsized":"2024-09-07T03:35:54.052185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:54.052099+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:54.052099+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.052099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:35:00.695163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.090384+0000","last_change":"2024-09-07T03:35:47.090384+0000","last_active":"2024-09-07T03:35:47.090384+0000","last_peered":"2024-09-07T03:35:47.090384+0000","last_clean":"2024-09-07T03:35:47.090384+0000","last_became_active":"2024-09-07T03:32:12.134650+0000","last_became_peered":"2024-09-07T03:32:12.134650+0000","last_unstale":"2024-09-07T03:35:47.090384+0000","last_undegraded":"2024-09-07T03:35:47.090384+0000","last_fullsized":"2024-09-07T03:35:47.090384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:47.090289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:47.090289+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.090289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:17:09.392606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.176461+0000","last_change":"2024-09-07T03:36:05.176461+0000","last_active":"2024-09-07T03:36:05.176461+0000","last_peered":"2024-09-07T03:36:05.176461+0000","last_clean":"2024-09-07T03:36:05.176461+0000","last_became_active":"2024-09-07T03:32:14.127493+0000","last_became_peered":"2024-09-07T03:32:14.127493+0000","last_unstale":"2024-09-07T03:36:05.176461+0000","last_undegraded":"2024-09-07T03:36:05.176461+0000","last_fullsized":"2024-09-07T03:36:05.176461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:05.176380+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:05.176380+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.176380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:05:49.424788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2283,"ondisk_log_size":2283,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1755,"ondisk_log_size":1755,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1666,"num_read_kb":1556,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640316,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":450560,"data_stored":155820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640316,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":744671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640316,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":158016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40560,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331280,"statfs":{"total":96636764160,"available":96595230720,"internally_reserved":0,"allocated":1081344,"data_stored":748249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:36:36.263 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.263 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.264 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.264 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.264 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.264 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.264 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.265 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.265 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.266 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.266 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.266 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.267 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.267 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.267 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.267 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.267 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.267 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.268 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.268 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.268 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.268 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.269 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.269 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.269 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.269 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.269 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.270 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.270 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.270 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.270 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.270 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.271 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.271 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.271 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.271 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.271 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.271 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-07T03:32:19.114852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=19, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.271 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.272 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-07T03:32:17.107345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=17, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.272 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-07T03:32:21.122430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=32, tm_sec=21, tm_wday=5, tm_yday=251, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=7, tm_hour=3, tm_min=35, tm_sec=32, tm_wday=5, tm_yday=251, tm_isdst=0) 2024-09-07T03:36:36.272 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-07T03:36:56.274 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-07T03:36:56.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.382+0000 7f634e918640 1 Processor -- start 2024-09-07T03:36:56.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.382+0000 7f634e918640 1 -- start start 2024-09-07T03:36:56.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f634e918640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6348113220 0x7f6348131380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:56.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f634e918640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f634806dc00 con 0x7f6348112730 2024-09-07T03:36:56.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f634e918640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7f6348113630 con 0x7f6348113220 2024-09-07T03:36:56.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f6347fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6348112730 0x7f6348112b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50958/0 (socket says 172.21.15.104:50958) 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f6347fff640 1 -- 172.21.15.104:0/4067694591 learned_addr learned my addr 172.21.15.104:0/4067694591 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f63477fe640 1 --2- 172.21.15.104:0/4067694591 >> v2:172.21.15.104:3300/0 conn(0x7f6348113220 0x7f6348131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f6346ffd640 1 -- 172.21.15.104:0/4067694591 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764244736 0 0) 0x7f634806dc00 con 0x7f6348112730 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f6346ffd640 1 -- 172.21.15.104:0/4067694591 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6330005730 con 0x7f6348112730 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f63477fe640 1 -- 172.21.15.104:0/4067694591 >> v1:172.21.15.104:6789/0 conn(0x7f6348112730 legacy=0x7f6348112b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.383+0000 7f63477fe640 1 -- 172.21.15.104:0/4067694591 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6348113c00 con 0x7f6348113220 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.384+0000 7f63477fe640 1 --2- 172.21.15.104:0/4067694591 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348113220 0x7f6348131380 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f633c009720 tx=0x7f633c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a750137857d65e server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.384+0000 7f6346ffd640 1 -- 172.21.15.104:0/4067694591 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f633c037070 con 0x7f6348113220 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.384+0000 7f6346ffd640 1 -- 172.21.15.104:0/4067694591 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c02ad90 con 0x7f6348113220 2024-09-07T03:36:56.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.384+0000 7f6346ffd640 1 -- 172.21.15.104:0/4067694591 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f633c032590 con 0x7f6348113220 2024-09-07T03:36:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.385+0000 7f634e918640 1 -- 172.21.15.104:0/4067694591 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348113220 msgr2=0x7f6348131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.385+0000 7f634e918640 1 --2- 172.21.15.104:0/4067694591 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348113220 0x7f6348131380 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f633c009720 tx=0x7f633c02a110 comp rx=0 tx=0).stop 2024-09-07T03:36:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.385+0000 7f634e918640 1 -- 172.21.15.104:0/4067694591 shutdown_connections 2024-09-07T03:36:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.385+0000 7f634e918640 1 --2- 172.21.15.104:0/4067694591 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348113220 0x7f6348131380 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.385+0000 7f634e918640 1 -- 172.21.15.104:0/4067694591 >> 172.21.15.104:0/4067694591 conn(0x7f6348070850 msgr2=0x7f6348072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:36:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.385+0000 7f634e918640 1 -- 172.21.15.104:0/4067694591 shutdown_connections 2024-09-07T03:36:56.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.385+0000 7f634e918640 1 -- 172.21.15.104:0/4067694591 wait complete. 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.386+0000 7f634e918640 1 Processor -- start 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.386+0000 7f634e918640 1 -- start start 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.386+0000 7f634e918640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348112730 0x7f63481189d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.386+0000 7f634e918640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f63481117a0 con 0x7f6348112730 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.386+0000 7f6347fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348112730 0x7f63481189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.386+0000 7f6347fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348112730 0x7f63481189d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34594/0 (socket says 172.21.15.104:34594) 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.386+0000 7f6347fff640 1 -- 172.21.15.104:0/1480623565 learned_addr learned my addr 172.21.15.104:0/1480623565 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.387+0000 7f6347fff640 1 -- 172.21.15.104:0/1480623565 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634811a0c0 con 0x7f6348112730 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.387+0000 7f6347fff640 1 --2- 172.21.15.104:0/1480623565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348112730 0x7f63481189d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f633800c480 tx=0x7f633800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.387+0000 7f6344ff9640 1 -- 172.21.15.104:0/1480623565 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6338017070 con 0x7f6348112730 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.387+0000 7f6344ff9640 1 -- 172.21.15.104:0/1480623565 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6338005cd0 con 0x7f6348112730 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.387+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634811b1f0 con 0x7f6348112730 2024-09-07T03:36:56.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.387+0000 7f6344ff9640 1 -- 172.21.15.104:0/1480623565 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6338007200 con 0x7f6348112730 2024-09-07T03:36:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.387+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63481190f0 con 0x7f6348112730 2024-09-07T03:36:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.388+0000 7f6344ff9640 1 -- 172.21.15.104:0/1480623565 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f633801a070 con 0x7f6348112730 2024-09-07T03:36:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.388+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634811ad70 con 0x7f6348112730 2024-09-07T03:36:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.388+0000 7f6344ff9640 1 --2- 172.21.15.104:0/1480623565 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f633403de90 0x7f6334040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.388+0000 7f6344ff9640 1 -- 172.21.15.104:0/1480623565 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6338051ff0 con 0x7f6348112730 2024-09-07T03:36:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.388+0000 7f63477fe640 1 --2- 172.21.15.104:0/1480623565 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f633403de90 0x7f6334040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:56.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.389+0000 7f63477fe640 1 --2- 172.21.15.104:0/1480623565 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f633403de90 0x7f6334040350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f633c034000 tx=0x7f633c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:56.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.393+0000 7f6344ff9640 1 -- 172.21.15.104:0/1480623565 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f634811ad70 con 0x7f6348112730 2024-09-07T03:36:56.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.564+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 --> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6348126540 con 0x7f633403de90 2024-09-07T03:36:56.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.574+0000 7f6344ff9640 1 -- 172.21.15.104:0/1480623565 <== mgr.4100 v2:172.21.15.120:6824/924102273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666473 (secure 0 0 0) 0x7f6348126540 con 0x7f633403de90 2024-09-07T03:36:56.583 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-07T03:36:56.588 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f633403de90 msgr2=0x7f6334040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 --2- 172.21.15.104:0/1480623565 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f633403de90 0x7f6334040350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f633c034000 tx=0x7f633c02e000 comp rx=0 tx=0).stop 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348112730 msgr2=0x7f63481189d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 --2- 172.21.15.104:0/1480623565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348112730 0x7f63481189d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f633800c480 tx=0x7f633800c940 comp rx=0 tx=0).stop 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 shutdown_connections 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 --2- 172.21.15.104:0/1480623565 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7f633403de90 0x7f6334040350 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 --2- 172.21.15.104:0/1480623565 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6348112730 0x7f63481189d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 >> 172.21.15.104:0/1480623565 conn(0x7f6348070850 msgr2=0x7f634812c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 shutdown_connections 2024-09-07T03:36:56.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.579+0000 7f634e918640 1 -- 172.21.15.104:0/1480623565 wait complete. 2024-09-07T03:36:56.592 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-07T03:36:55.290023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5430,"num_read_kb":4984,"num_write":2317,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5013,"ondisk_log_size":5013,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160992,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326368,"statfs":{"total":386547056640,"available":386382200832,"internally_reserved":0,"allocated":3047424,"data_stored":1806756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003842"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:59.050366+0000","last_change":"2024-09-07T03:35:59.050308+0000","last_active":"2024-09-07T03:35:59.050366+0000","last_peered":"2024-09-07T03:35:59.050366+0000","last_clean":"2024-09-07T03:35:59.050366+0000","last_became_active":"2024-09-07T03:32:12.133110+0000","last_became_peered":"2024-09-07T03:32:12.133110+0000","last_unstale":"2024-09-07T03:35:59.050366+0000","last_undegraded":"2024-09-07T03:35:59.050366+0000","last_fullsized":"2024-09-07T03:35:59.050366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:59.050226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:59.050226+0000","last_clean_scrub_stamp":"2024-09-07T03:35:59.050226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:16:40.480940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.974172+0000","last_change":"2024-09-07T03:36:10.974172+0000","last_active":"2024-09-07T03:36:10.974172+0000","last_peered":"2024-09-07T03:36:10.974172+0000","last_clean":"2024-09-07T03:36:10.974172+0000","last_became_active":"2024-09-07T03:32:14.109379+0000","last_became_peered":"2024-09-07T03:32:14.109379+0000","last_unstale":"2024-09-07T03:36:10.974172+0000","last_undegraded":"2024-09-07T03:36:10.974172+0000","last_fullsized":"2024-09-07T03:36:10.974172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:10.974093+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:10.974093+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.974093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:49:43.847718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.129154+0000","last_change":"2024-09-07T03:35:46.129075+0000","last_active":"2024-09-07T03:35:46.129154+0000","last_peered":"2024-09-07T03:35:46.129154+0000","last_clean":"2024-09-07T03:35:46.129154+0000","last_became_active":"2024-09-07T03:32:12.135945+0000","last_became_peered":"2024-09-07T03:32:12.135945+0000","last_unstale":"2024-09-07T03:35:46.129154+0000","last_undegraded":"2024-09-07T03:35:46.129154+0000","last_fullsized":"2024-09-07T03:35:46.129154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.128991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.128991+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.128991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:16:00.699297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'18","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.938208+0000","last_change":"2024-09-07T03:35:56.938208+0000","last_active":"2024-09-07T03:35:56.938208+0000","last_peered":"2024-09-07T03:35:56.938208+0000","last_clean":"2024-09-07T03:35:56.938208+0000","last_became_active":"2024-09-07T03:32:50.279755+0000","last_became_peered":"2024-09-07T03:32:50.279755+0000","last_unstale":"2024-09-07T03:35:56.938208+0000","last_undegraded":"2024-09-07T03:35:56.938208+0000","last_fullsized":"2024-09-07T03:35:56.938208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-07T03:35:56.938103+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-07T03:35:56.938103+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.938103+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:02:14.443754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.041544+0000","last_change":"2024-09-07T03:35:55.041470+0000","last_active":"2024-09-07T03:35:55.041544+0000","last_peered":"2024-09-07T03:35:55.041544+0000","last_clean":"2024-09-07T03:35:55.041544+0000","last_became_active":"2024-09-07T03:32:12.138176+0000","last_became_peered":"2024-09-07T03:32:12.138176+0000","last_unstale":"2024-09-07T03:35:55.041544+0000","last_undegraded":"2024-09-07T03:35:55.041544+0000","last_fullsized":"2024-09-07T03:35:55.041544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:55.041382+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:55.041382+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.041382+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:00.033213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:59.973498+0000","last_change":"2024-09-07T03:35:59.973498+0000","last_active":"2024-09-07T03:35:59.973498+0000","last_peered":"2024-09-07T03:35:59.973498+0000","last_clean":"2024-09-07T03:35:59.973498+0000","last_became_active":"2024-09-07T03:32:50.282086+0000","last_became_peered":"2024-09-07T03:32:50.282086+0000","last_unstale":"2024-09-07T03:35:59.973498+0000","last_undegraded":"2024-09-07T03:35:59.973498+0000","last_fullsized":"2024-09-07T03:35:59.973498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:59.973408+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:59.973408+0000","last_clean_scrub_stamp":"2024-09-07T03:35:59.973408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:05:23.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.102800+0000","last_change":"2024-09-07T03:35:41.102738+0000","last_active":"2024-09-07T03:35:41.102800+0000","last_peered":"2024-09-07T03:35:41.102800+0000","last_clean":"2024-09-07T03:35:41.102800+0000","last_became_active":"2024-09-07T03:32:12.128937+0000","last_became_peered":"2024-09-07T03:32:12.128937+0000","last_unstale":"2024-09-07T03:35:41.102800+0000","last_undegraded":"2024-09-07T03:35:41.102800+0000","last_fullsized":"2024-09-07T03:35:41.102800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.102653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.102653+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.102653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:22:21.638223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.029774+0000","last_change":"2024-09-07T03:36:11.029774+0000","last_active":"2024-09-07T03:36:11.029774+0000","last_peered":"2024-09-07T03:36:11.029774+0000","last_clean":"2024-09-07T03:36:11.029774+0000","last_became_active":"2024-09-07T03:32:14.122611+0000","last_became_peered":"2024-09-07T03:32:14.122611+0000","last_unstale":"2024-09-07T03:36:11.029774+0000","last_undegraded":"2024-09-07T03:36:11.029774+0000","last_fullsized":"2024-09-07T03:36:11.029774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:11.029689+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:11.029689+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.029689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:41:54.209339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.069994+0000","last_change":"2024-09-07T03:35:57.069994+0000","last_active":"2024-09-07T03:35:57.069994+0000","last_peered":"2024-09-07T03:35:57.069994+0000","last_clean":"2024-09-07T03:35:57.069994+0000","last_became_active":"2024-09-07T03:32:12.123986+0000","last_became_peered":"2024-09-07T03:32:12.123986+0000","last_unstale":"2024-09-07T03:35:57.069994+0000","last_undegraded":"2024-09-07T03:35:57.069994+0000","last_fullsized":"2024-09-07T03:35:57.069994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:57.069905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:57.069905+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.069905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:37:06.077291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.300816+0000","last_change":"2024-09-07T03:36:09.300748+0000","last_active":"2024-09-07T03:36:09.300816+0000","last_peered":"2024-09-07T03:36:09.300816+0000","last_clean":"2024-09-07T03:36:09.300816+0000","last_became_active":"2024-09-07T03:32:14.124523+0000","last_became_peered":"2024-09-07T03:32:14.124523+0000","last_unstale":"2024-09-07T03:36:09.300816+0000","last_undegraded":"2024-09-07T03:36:09.300816+0000","last_fullsized":"2024-09-07T03:36:09.300816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:09.300663+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:09.300663+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.300663+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:37:22.563920+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.021706+0000","last_change":"2024-09-07T03:35:56.021706+0000","last_active":"2024-09-07T03:35:56.021706+0000","last_peered":"2024-09-07T03:35:56.021706+0000","last_clean":"2024-09-07T03:35:56.021706+0000","last_became_active":"2024-09-07T03:32:12.133597+0000","last_became_peered":"2024-09-07T03:32:12.133597+0000","last_unstale":"2024-09-07T03:35:56.021706+0000","last_undegraded":"2024-09-07T03:35:56.021706+0000","last_fullsized":"2024-09-07T03:35:56.021706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:56.021606+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:56.021606+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.021606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:22:09.105320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.975499+0000","last_change":"2024-09-07T03:36:11.975426+0000","last_active":"2024-09-07T03:36:11.975499+0000","last_peered":"2024-09-07T03:36:11.975499+0000","last_clean":"2024-09-07T03:36:11.975499+0000","last_became_active":"2024-09-07T03:32:14.112622+0000","last_became_peered":"2024-09-07T03:32:14.112622+0000","last_unstale":"2024-09-07T03:36:11.975499+0000","last_undegraded":"2024-09-07T03:36:11.975499+0000","last_fullsized":"2024-09-07T03:36:11.975499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:11.975345+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:11.975345+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.975345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:30:26.279685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.989460+0000","last_change":"2024-09-07T03:35:51.989460+0000","last_active":"2024-09-07T03:35:51.989460+0000","last_peered":"2024-09-07T03:35:51.989460+0000","last_clean":"2024-09-07T03:35:51.989460+0000","last_became_active":"2024-09-07T03:32:12.140221+0000","last_became_peered":"2024-09-07T03:32:12.140221+0000","last_unstale":"2024-09-07T03:35:51.989460+0000","last_undegraded":"2024-09-07T03:35:51.989460+0000","last_fullsized":"2024-09-07T03:35:51.989460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:51.989364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:51.989364+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.989364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:59.350186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:15.934652+0000","last_change":"2024-09-07T03:36:15.934566+0000","last_active":"2024-09-07T03:36:15.934652+0000","last_peered":"2024-09-07T03:36:15.934652+0000","last_clean":"2024-09-07T03:36:15.934652+0000","last_became_active":"2024-09-07T03:32:14.114529+0000","last_became_peered":"2024-09-07T03:32:14.114529+0000","last_unstale":"2024-09-07T03:36:15.934652+0000","last_undegraded":"2024-09-07T03:36:15.934652+0000","last_fullsized":"2024-09-07T03:36:15.934652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:15.934434+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:15.934434+0000","last_clean_scrub_stamp":"2024-09-07T03:36:15.934434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:36:00.389538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.909080+0000","last_change":"2024-09-07T03:35:49.909080+0000","last_active":"2024-09-07T03:35:49.909080+0000","last_peered":"2024-09-07T03:35:49.909080+0000","last_clean":"2024-09-07T03:35:49.909080+0000","last_became_active":"2024-09-07T03:32:12.143209+0000","last_became_peered":"2024-09-07T03:32:12.143209+0000","last_unstale":"2024-09-07T03:35:49.909080+0000","last_undegraded":"2024-09-07T03:35:49.909080+0000","last_fullsized":"2024-09-07T03:35:49.909080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:49.908949+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:49.908949+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.908949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:33:51.713150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.019646+0000","last_change":"2024-09-07T03:36:01.019575+0000","last_active":"2024-09-07T03:36:01.019646+0000","last_peered":"2024-09-07T03:36:01.019646+0000","last_clean":"2024-09-07T03:36:01.019646+0000","last_became_active":"2024-09-07T03:32:14.124135+0000","last_became_peered":"2024-09-07T03:32:14.124135+0000","last_unstale":"2024-09-07T03:36:01.019646+0000","last_undegraded":"2024-09-07T03:36:01.019646+0000","last_fullsized":"2024-09-07T03:36:01.019646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:01.019492+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:01.019492+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.019492+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:05:20.506138+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'14","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:13.946676+0000","last_change":"2024-09-07T03:36:13.946676+0000","last_active":"2024-09-07T03:36:13.946676+0000","last_peered":"2024-09-07T03:36:13.946676+0000","last_clean":"2024-09-07T03:36:13.946676+0000","last_became_active":"2024-09-07T03:32:14.109280+0000","last_became_peered":"2024-09-07T03:32:14.109280+0000","last_unstale":"2024-09-07T03:36:13.946676+0000","last_undegraded":"2024-09-07T03:36:13.946676+0000","last_fullsized":"2024-09-07T03:36:13.946676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-07T03:36:13.946590+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-07T03:36:13.946590+0000","last_clean_scrub_stamp":"2024-09-07T03:36:13.946590+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:55:54.326418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.074893+0000","last_change":"2024-09-07T03:35:49.074893+0000","last_active":"2024-09-07T03:35:49.074893+0000","last_peered":"2024-09-07T03:35:49.074893+0000","last_clean":"2024-09-07T03:35:49.074893+0000","last_became_active":"2024-09-07T03:32:12.134379+0000","last_became_peered":"2024-09-07T03:32:12.134379+0000","last_unstale":"2024-09-07T03:35:49.074893+0000","last_undegraded":"2024-09-07T03:35:49.074893+0000","last_fullsized":"2024-09-07T03:35:49.074893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:49.074793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:49.074793+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.074793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:58:33.349796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'4","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.036322+0000","last_change":"2024-09-07T03:36:09.036322+0000","last_active":"2024-09-07T03:36:09.036322+0000","last_peered":"2024-09-07T03:36:09.036322+0000","last_clean":"2024-09-07T03:36:09.036322+0000","last_became_active":"2024-09-07T03:32:14.111769+0000","last_became_peered":"2024-09-07T03:32:14.111769+0000","last_unstale":"2024-09-07T03:36:09.036322+0000","last_undegraded":"2024-09-07T03:36:09.036322+0000","last_fullsized":"2024-09-07T03:36:09.036322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:09.036222+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:09.036222+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.036222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:29:52.053942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.132801+0000","last_change":"2024-09-07T03:35:47.132801+0000","last_active":"2024-09-07T03:35:47.132801+0000","last_peered":"2024-09-07T03:35:47.132801+0000","last_clean":"2024-09-07T03:35:47.132801+0000","last_became_active":"2024-09-07T03:32:12.129310+0000","last_became_peered":"2024-09-07T03:32:12.129310+0000","last_unstale":"2024-09-07T03:35:47.132801+0000","last_undegraded":"2024-09-07T03:35:47.132801+0000","last_fullsized":"2024-09-07T03:35:47.132801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:47.132683+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:47.132683+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.132683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:14:40.445362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.987197+0000","last_change":"2024-09-07T03:36:09.987197+0000","last_active":"2024-09-07T03:36:09.987197+0000","last_peered":"2024-09-07T03:36:09.987197+0000","last_clean":"2024-09-07T03:36:09.987197+0000","last_became_active":"2024-09-07T03:32:14.109177+0000","last_became_peered":"2024-09-07T03:32:14.109177+0000","last_unstale":"2024-09-07T03:36:09.987197+0000","last_undegraded":"2024-09-07T03:36:09.987197+0000","last_fullsized":"2024-09-07T03:36:09.987197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:09.987089+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:09.987089+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.987089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:31:02.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.057087+0000","last_change":"2024-09-07T03:35:55.057087+0000","last_active":"2024-09-07T03:35:55.057087+0000","last_peered":"2024-09-07T03:35:55.057087+0000","last_clean":"2024-09-07T03:35:55.057087+0000","last_became_active":"2024-09-07T03:32:12.120449+0000","last_became_peered":"2024-09-07T03:32:12.120449+0000","last_unstale":"2024-09-07T03:35:55.057087+0000","last_undegraded":"2024-09-07T03:35:55.057087+0000","last_fullsized":"2024-09-07T03:35:55.057087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:55.057003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:55.057003+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.057003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:23:58.048916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.917436+0000","last_change":"2024-09-07T03:35:57.917436+0000","last_active":"2024-09-07T03:35:57.917436+0000","last_peered":"2024-09-07T03:35:57.917436+0000","last_clean":"2024-09-07T03:35:57.917436+0000","last_became_active":"2024-09-07T03:32:14.125065+0000","last_became_peered":"2024-09-07T03:32:14.125065+0000","last_unstale":"2024-09-07T03:35:57.917436+0000","last_undegraded":"2024-09-07T03:35:57.917436+0000","last_fullsized":"2024-09-07T03:35:57.917436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:57.917354+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:57.917354+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.917354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:24.450901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.065046+0000","last_change":"2024-09-07T03:35:54.065046+0000","last_active":"2024-09-07T03:35:54.065046+0000","last_peered":"2024-09-07T03:35:54.065046+0000","last_clean":"2024-09-07T03:35:54.065046+0000","last_became_active":"2024-09-07T03:32:12.124516+0000","last_became_peered":"2024-09-07T03:32:12.124516+0000","last_unstale":"2024-09-07T03:35:54.065046+0000","last_undegraded":"2024-09-07T03:35:54.065046+0000","last_fullsized":"2024-09-07T03:35:54.065046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:54.064958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:54.064958+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.064958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:49:59.421840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.976481+0000","last_change":"2024-09-07T03:35:55.976481+0000","last_active":"2024-09-07T03:35:55.976481+0000","last_peered":"2024-09-07T03:35:55.976481+0000","last_clean":"2024-09-07T03:35:55.976481+0000","last_became_active":"2024-09-07T03:32:14.112477+0000","last_became_peered":"2024-09-07T03:32:14.112477+0000","last_unstale":"2024-09-07T03:35:55.976481+0000","last_undegraded":"2024-09-07T03:35:55.976481+0000","last_fullsized":"2024-09-07T03:35:55.976481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:55.976398+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:55.976398+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.976398+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:42:44.572113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.035524+0000","last_change":"2024-09-07T03:35:53.035524+0000","last_active":"2024-09-07T03:35:53.035524+0000","last_peered":"2024-09-07T03:35:53.035524+0000","last_clean":"2024-09-07T03:35:53.035524+0000","last_became_active":"2024-09-07T03:32:12.136801+0000","last_became_peered":"2024-09-07T03:32:12.136801+0000","last_unstale":"2024-09-07T03:35:53.035524+0000","last_undegraded":"2024-09-07T03:35:53.035524+0000","last_fullsized":"2024-09-07T03:35:53.035524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:53.035439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:53.035439+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.035439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:57:42.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.128171+0000","last_change":"2024-09-07T03:36:04.128171+0000","last_active":"2024-09-07T03:36:04.128171+0000","last_peered":"2024-09-07T03:36:04.128171+0000","last_clean":"2024-09-07T03:36:04.128171+0000","last_became_active":"2024-09-07T03:32:14.109167+0000","last_became_peered":"2024-09-07T03:32:14.109167+0000","last_unstale":"2024-09-07T03:36:04.128171+0000","last_undegraded":"2024-09-07T03:36:04.128171+0000","last_fullsized":"2024-09-07T03:36:04.128171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:04.128085+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:04.128085+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.128085+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:44:45.065768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.070234+0000","last_change":"2024-09-07T03:35:56.070160+0000","last_active":"2024-09-07T03:35:56.070234+0000","last_peered":"2024-09-07T03:35:56.070234+0000","last_clean":"2024-09-07T03:35:56.070234+0000","last_became_active":"2024-09-07T03:32:12.138105+0000","last_became_peered":"2024-09-07T03:32:12.138105+0000","last_unstale":"2024-09-07T03:35:56.070234+0000","last_undegraded":"2024-09-07T03:35:56.070234+0000","last_fullsized":"2024-09-07T03:35:56.070234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:56.070061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:56.070061+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.070061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:26:29.693791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'36","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:37.399632+0000","last_change":"2024-09-07T03:36:37.399632+0000","last_active":"2024-09-07T03:36:37.399632+0000","last_peered":"2024-09-07T03:36:37.399632+0000","last_clean":"2024-09-07T03:36:37.399632+0000","last_became_active":"2024-09-07T03:32:22.149337+0000","last_became_peered":"2024-09-07T03:32:22.149337+0000","last_unstale":"2024-09-07T03:36:37.399632+0000","last_undegraded":"2024-09-07T03:36:37.399632+0000","last_fullsized":"2024-09-07T03:36:37.399632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-07T03:36:37.399533+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-07T03:36:37.399533+0000","last_clean_scrub_stamp":"2024-09-07T03:36:37.399533+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:09:04.964341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.093818+0000","last_change":"2024-09-07T03:36:03.093818+0000","last_active":"2024-09-07T03:36:03.093818+0000","last_peered":"2024-09-07T03:36:03.093818+0000","last_clean":"2024-09-07T03:36:03.093818+0000","last_became_active":"2024-09-07T03:32:14.126222+0000","last_became_peered":"2024-09-07T03:32:14.126222+0000","last_unstale":"2024-09-07T03:36:03.093818+0000","last_undegraded":"2024-09-07T03:36:03.093818+0000","last_fullsized":"2024-09-07T03:36:03.093818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:03.093725+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:03.093725+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.093725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:40:44.367176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.064009+0000","last_change":"2024-09-07T03:35:40.063889+0000","last_active":"2024-09-07T03:35:40.064009+0000","last_peered":"2024-09-07T03:35:40.064009+0000","last_clean":"2024-09-07T03:35:40.064009+0000","last_became_active":"2024-09-07T03:32:12.124815+0000","last_became_peered":"2024-09-07T03:32:12.124815+0000","last_unstale":"2024-09-07T03:35:40.064009+0000","last_undegraded":"2024-09-07T03:35:40.064009+0000","last_fullsized":"2024-09-07T03:35:40.064009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:40.063781+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.063781+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.063781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:11.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:17.080488+0000","last_change":"2024-09-07T03:36:17.080488+0000","last_active":"2024-09-07T03:36:17.080488+0000","last_peered":"2024-09-07T03:36:17.080488+0000","last_clean":"2024-09-07T03:36:17.080488+0000","last_became_active":"2024-09-07T03:32:16.127430+0000","last_became_peered":"2024-09-07T03:32:16.127430+0000","last_unstale":"2024-09-07T03:36:17.080488+0000","last_undegraded":"2024-09-07T03:36:17.080488+0000","last_fullsized":"2024-09-07T03:36:17.080488+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:17.080386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:17.080386+0000","last_clean_scrub_stamp":"2024-09-07T03:36:17.080386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:30:31.384725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'51","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:26.097269+0000","last_change":"2024-09-07T03:36:26.097269+0000","last_active":"2024-09-07T03:36:26.097269+0000","last_peered":"2024-09-07T03:36:26.097269+0000","last_clean":"2024-09-07T03:36:26.097269+0000","last_became_active":"2024-09-07T03:32:18.130101+0000","last_became_peered":"2024-09-07T03:32:18.130101+0000","last_unstale":"2024-09-07T03:36:26.097269+0000","last_undegraded":"2024-09-07T03:36:26.097269+0000","last_fullsized":"2024-09-07T03:36:26.097269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-07T03:36:26.097170+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-07T03:36:26.097170+0000","last_clean_scrub_stamp":"2024-09-07T03:36:26.097170+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:48:12.217362+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:40.898926+0000","last_change":"2024-09-07T03:36:40.898926+0000","last_active":"2024-09-07T03:36:40.898926+0000","last_peered":"2024-09-07T03:36:40.898926+0000","last_clean":"2024-09-07T03:36:40.898926+0000","last_became_active":"2024-09-07T03:32:20.146716+0000","last_became_peered":"2024-09-07T03:32:20.146716+0000","last_unstale":"2024-09-07T03:36:40.898926+0000","last_undegraded":"2024-09-07T03:36:40.898926+0000","last_fullsized":"2024-09-07T03:36:40.898926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:40.898800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:40.898800+0000","last_clean_scrub_stamp":"2024-09-07T03:36:40.898800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:48:25.384354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:49.878136+0000","last_change":"2024-09-07T03:36:49.878136+0000","last_active":"2024-09-07T03:36:49.878136+0000","last_peered":"2024-09-07T03:36:49.878136+0000","last_clean":"2024-09-07T03:36:49.878136+0000","last_became_active":"2024-09-07T03:32:22.143092+0000","last_became_peered":"2024-09-07T03:32:22.143092+0000","last_unstale":"2024-09-07T03:36:49.878136+0000","last_undegraded":"2024-09-07T03:36:49.878136+0000","last_fullsized":"2024-09-07T03:36:49.878136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-07T03:36:49.878053+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-07T03:36:49.878053+0000","last_clean_scrub_stamp":"2024-09-07T03:36:49.878053+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:46:53.783437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'8","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.113532+0000","last_change":"2024-09-07T03:36:02.113532+0000","last_active":"2024-09-07T03:36:02.113532+0000","last_peered":"2024-09-07T03:36:02.113532+0000","last_clean":"2024-09-07T03:36:02.113532+0000","last_became_active":"2024-09-07T03:32:14.121998+0000","last_became_peered":"2024-09-07T03:32:14.121998+0000","last_unstale":"2024-09-07T03:36:02.113532+0000","last_undegraded":"2024-09-07T03:36:02.113532+0000","last_fullsized":"2024-09-07T03:36:02.113532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:02.113425+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:02.113425+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.113425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:18:16.347758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.037045+0000","last_change":"2024-09-07T03:35:35.036982+0000","last_active":"2024-09-07T03:35:35.037045+0000","last_peered":"2024-09-07T03:35:35.037045+0000","last_clean":"2024-09-07T03:35:35.037045+0000","last_became_active":"2024-09-07T03:32:12.129979+0000","last_became_peered":"2024-09-07T03:32:12.129979+0000","last_unstale":"2024-09-07T03:35:35.037045+0000","last_undegraded":"2024-09-07T03:35:35.037045+0000","last_fullsized":"2024-09-07T03:35:35.037045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:35.036881+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:35.036881+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.036881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:32:01.763051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:16.119034+0000","last_change":"2024-09-07T03:36:16.119034+0000","last_active":"2024-09-07T03:36:16.119034+0000","last_peered":"2024-09-07T03:36:16.119034+0000","last_clean":"2024-09-07T03:36:16.119034+0000","last_became_active":"2024-09-07T03:32:16.126116+0000","last_became_peered":"2024-09-07T03:32:16.126116+0000","last_unstale":"2024-09-07T03:36:16.119034+0000","last_undegraded":"2024-09-07T03:36:16.119034+0000","last_fullsized":"2024-09-07T03:36:16.119034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:16.118946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:16.118946+0000","last_clean_scrub_stamp":"2024-09-07T03:36:16.118946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:49:48.992571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'16","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:20.248591+0000","last_change":"2024-09-07T03:36:20.248591+0000","last_active":"2024-09-07T03:36:20.248591+0000","last_peered":"2024-09-07T03:36:20.248591+0000","last_clean":"2024-09-07T03:36:20.248591+0000","last_became_active":"2024-09-07T03:32:18.132152+0000","last_became_peered":"2024-09-07T03:32:18.132152+0000","last_unstale":"2024-09-07T03:36:20.248591+0000","last_undegraded":"2024-09-07T03:36:20.248591+0000","last_fullsized":"2024-09-07T03:36:20.248591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:36:20.248480+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:36:20.248480+0000","last_clean_scrub_stamp":"2024-09-07T03:36:20.248480+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:26.643652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:39.894658+0000","last_change":"2024-09-07T03:36:39.894658+0000","last_active":"2024-09-07T03:36:39.894658+0000","last_peered":"2024-09-07T03:36:39.894658+0000","last_clean":"2024-09-07T03:36:39.894658+0000","last_became_active":"2024-09-07T03:32:20.146457+0000","last_became_peered":"2024-09-07T03:32:20.146457+0000","last_unstale":"2024-09-07T03:36:39.894658+0000","last_undegraded":"2024-09-07T03:36:39.894658+0000","last_fullsized":"2024-09-07T03:36:39.894658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:39.894540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:39.894540+0000","last_clean_scrub_stamp":"2024-09-07T03:36:39.894540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:40:08.406641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:44.131335+0000","last_change":"2024-09-07T03:36:44.131335+0000","last_active":"2024-09-07T03:36:44.131335+0000","last_peered":"2024-09-07T03:36:44.131335+0000","last_clean":"2024-09-07T03:36:44.131335+0000","last_became_active":"2024-09-07T03:32:22.143751+0000","last_became_peered":"2024-09-07T03:32:22.143751+0000","last_unstale":"2024-09-07T03:36:44.131335+0000","last_undegraded":"2024-09-07T03:36:44.131335+0000","last_fullsized":"2024-09-07T03:36:44.131335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:36:44.131224+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:36:44.131224+0000","last_clean_scrub_stamp":"2024-09-07T03:36:44.131224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:27:39.589652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"36'20","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.105456+0000","last_change":"2024-09-07T03:36:06.105456+0000","last_active":"2024-09-07T03:36:06.105456+0000","last_peered":"2024-09-07T03:36:06.105456+0000","last_clean":"2024-09-07T03:36:06.105456+0000","last_became_active":"2024-09-07T03:32:14.130544+0000","last_became_peered":"2024-09-07T03:32:14.130544+0000","last_unstale":"2024-09-07T03:36:06.105456+0000","last_undegraded":"2024-09-07T03:36:06.105456+0000","last_fullsized":"2024-09-07T03:36:06.105456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-07T03:36:06.105376+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-07T03:36:06.105376+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.105376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:13:52.000035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":82,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.060944+0000","last_change":"2024-09-07T03:35:47.060884+0000","last_active":"2024-09-07T03:35:47.060944+0000","last_peered":"2024-09-07T03:35:47.060944+0000","last_clean":"2024-09-07T03:35:47.060944+0000","last_became_active":"2024-09-07T03:32:12.124808+0000","last_became_peered":"2024-09-07T03:32:12.124808+0000","last_unstale":"2024-09-07T03:35:47.060944+0000","last_undegraded":"2024-09-07T03:35:47.060944+0000","last_fullsized":"2024-09-07T03:35:47.060944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:47.060791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:47.060791+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.060791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:54.421614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:18.096289+0000","last_change":"2024-09-07T03:36:18.096289+0000","last_active":"2024-09-07T03:36:18.096289+0000","last_peered":"2024-09-07T03:36:18.096289+0000","last_clean":"2024-09-07T03:36:18.096289+0000","last_became_active":"2024-09-07T03:32:16.126318+0000","last_became_peered":"2024-09-07T03:32:16.126318+0000","last_unstale":"2024-09-07T03:36:18.096289+0000","last_undegraded":"2024-09-07T03:36:18.096289+0000","last_fullsized":"2024-09-07T03:36:18.096289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:18.096194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:18.096194+0000","last_clean_scrub_stamp":"2024-09-07T03:36:18.096194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:18:12.581343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'29","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.110590+0000","last_change":"2024-09-07T03:36:10.110590+0000","last_active":"2024-09-07T03:36:10.110590+0000","last_peered":"2024-09-07T03:36:10.110590+0000","last_clean":"2024-09-07T03:36:10.110590+0000","last_became_active":"2024-09-07T03:32:18.128391+0000","last_became_peered":"2024-09-07T03:32:18.128391+0000","last_unstale":"2024-09-07T03:36:10.110590+0000","last_undegraded":"2024-09-07T03:36:10.110590+0000","last_fullsized":"2024-09-07T03:36:10.110590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'29","last_scrub_stamp":"2024-09-07T03:36:10.110477+0000","last_deep_scrub":"36'29","last_deep_scrub_stamp":"2024-09-07T03:36:10.110477+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.110477+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:52:05.773456+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:38.929249+0000","last_change":"2024-09-07T03:36:38.929249+0000","last_active":"2024-09-07T03:36:38.929249+0000","last_peered":"2024-09-07T03:36:38.929249+0000","last_clean":"2024-09-07T03:36:38.929249+0000","last_became_active":"2024-09-07T03:32:20.140249+0000","last_became_peered":"2024-09-07T03:32:20.140249+0000","last_unstale":"2024-09-07T03:36:38.929249+0000","last_undegraded":"2024-09-07T03:36:38.929249+0000","last_fullsized":"2024-09-07T03:36:38.929249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:38.929163+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:38.929163+0000","last_clean_scrub_stamp":"2024-09-07T03:36:38.929163+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:51:11.049698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:24.167354+0000","last_change":"2024-09-07T03:36:24.167354+0000","last_active":"2024-09-07T03:36:24.167354+0000","last_peered":"2024-09-07T03:36:24.167354+0000","last_clean":"2024-09-07T03:36:24.167354+0000","last_became_active":"2024-09-07T03:32:22.139829+0000","last_became_peered":"2024-09-07T03:32:22.139829+0000","last_unstale":"2024-09-07T03:36:24.167354+0000","last_undegraded":"2024-09-07T03:36:24.167354+0000","last_fullsized":"2024-09-07T03:36:24.167354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:24.167258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:24.167258+0000","last_clean_scrub_stamp":"2024-09-07T03:36:24.167258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:58:17.544015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.135909+0000","last_change":"2024-09-07T03:36:04.135909+0000","last_active":"2024-09-07T03:36:04.135909+0000","last_peered":"2024-09-07T03:36:04.135909+0000","last_clean":"2024-09-07T03:36:04.135909+0000","last_became_active":"2024-09-07T03:32:14.126140+0000","last_became_peered":"2024-09-07T03:32:14.126140+0000","last_unstale":"2024-09-07T03:36:04.135909+0000","last_undegraded":"2024-09-07T03:36:04.135909+0000","last_fullsized":"2024-09-07T03:36:04.135909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:04.135822+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:04.135822+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.135822+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:04:21.287355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.015795+0000","last_change":"2024-09-07T03:35:46.015724+0000","last_active":"2024-09-07T03:35:46.015795+0000","last_peered":"2024-09-07T03:35:46.015795+0000","last_clean":"2024-09-07T03:35:46.015795+0000","last_became_active":"2024-09-07T03:32:12.133270+0000","last_became_peered":"2024-09-07T03:32:12.133270+0000","last_unstale":"2024-09-07T03:35:46.015795+0000","last_undegraded":"2024-09-07T03:35:46.015795+0000","last_fullsized":"2024-09-07T03:35:46.015795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.015616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.015616+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.015616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:06:46.915585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:17.936199+0000","last_change":"2024-09-07T03:36:17.936199+0000","last_active":"2024-09-07T03:36:17.936199+0000","last_peered":"2024-09-07T03:36:17.936199+0000","last_clean":"2024-09-07T03:36:17.936199+0000","last_became_active":"2024-09-07T03:32:16.116761+0000","last_became_peered":"2024-09-07T03:32:16.116761+0000","last_unstale":"2024-09-07T03:36:17.936199+0000","last_undegraded":"2024-09-07T03:36:17.936199+0000","last_fullsized":"2024-09-07T03:36:17.936199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:17.936114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:17.936114+0000","last_clean_scrub_stamp":"2024-09-07T03:36:17.936114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:38:09.852326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'46","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:31.860330+0000","last_change":"2024-09-07T03:36:31.860330+0000","last_active":"2024-09-07T03:36:31.860330+0000","last_peered":"2024-09-07T03:36:31.860330+0000","last_clean":"2024-09-07T03:36:31.860330+0000","last_became_active":"2024-09-07T03:32:18.128901+0000","last_became_peered":"2024-09-07T03:32:18.128901+0000","last_unstale":"2024-09-07T03:36:31.860330+0000","last_undegraded":"2024-09-07T03:36:31.860330+0000","last_fullsized":"2024-09-07T03:36:31.860330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-07T03:36:31.860199+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-07T03:36:31.860199+0000","last_clean_scrub_stamp":"2024-09-07T03:36:31.860199+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:40:20.206325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'286","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:38.162837+0000","last_change":"2024-09-07T03:36:38.162837+0000","last_active":"2024-09-07T03:36:38.162837+0000","last_peered":"2024-09-07T03:36:38.162837+0000","last_clean":"2024-09-07T03:36:38.162837+0000","last_became_active":"2024-09-07T03:32:20.142390+0000","last_became_peered":"2024-09-07T03:32:20.142390+0000","last_unstale":"2024-09-07T03:36:38.162837+0000","last_undegraded":"2024-09-07T03:36:38.162837+0000","last_fullsized":"2024-09-07T03:36:38.162837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:38.162759+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:38.162759+0000","last_clean_scrub_stamp":"2024-09-07T03:36:38.162759+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:16:58.327702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.993288+0000","last_change":"2024-09-07T03:35:58.993231+0000","last_active":"2024-09-07T03:35:58.993288+0000","last_peered":"2024-09-07T03:35:58.993288+0000","last_clean":"2024-09-07T03:35:58.993288+0000","last_became_active":"2024-09-07T03:32:14.122806+0000","last_became_peered":"2024-09-07T03:32:14.122806+0000","last_unstale":"2024-09-07T03:35:58.993288+0000","last_undegraded":"2024-09-07T03:35:58.993288+0000","last_fullsized":"2024-09-07T03:35:58.993288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:58.993132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:58.993132+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.993132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:24:01.985044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.958436+0000","last_change":"2024-09-07T03:35:43.958364+0000","last_active":"2024-09-07T03:35:43.958436+0000","last_peered":"2024-09-07T03:35:43.958436+0000","last_clean":"2024-09-07T03:35:43.958436+0000","last_became_active":"2024-09-07T03:32:12.124564+0000","last_became_peered":"2024-09-07T03:32:12.124564+0000","last_unstale":"2024-09-07T03:35:43.958436+0000","last_undegraded":"2024-09-07T03:35:43.958436+0000","last_fullsized":"2024-09-07T03:35:43.958436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.958249+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.958249+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.958249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:56:10.343804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.250828+0000","last_change":"2024-09-07T03:36:08.250760+0000","last_active":"2024-09-07T03:36:08.250828+0000","last_peered":"2024-09-07T03:36:08.250828+0000","last_clean":"2024-09-07T03:36:08.250828+0000","last_became_active":"2024-09-07T03:32:16.128519+0000","last_became_peered":"2024-09-07T03:32:16.128519+0000","last_unstale":"2024-09-07T03:36:08.250828+0000","last_undegraded":"2024-09-07T03:36:08.250828+0000","last_fullsized":"2024-09-07T03:36:08.250828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:08.250675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:08.250675+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.250675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:43.461236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'59","reported_seq":126,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:27.945414+0000","last_change":"2024-09-07T03:36:27.945347+0000","last_active":"2024-09-07T03:36:27.945414+0000","last_peered":"2024-09-07T03:36:27.945414+0000","last_clean":"2024-09-07T03:36:27.945414+0000","last_became_active":"2024-09-07T03:32:18.132867+0000","last_became_peered":"2024-09-07T03:32:18.132867+0000","last_unstale":"2024-09-07T03:36:27.945414+0000","last_undegraded":"2024-09-07T03:36:27.945414+0000","last_fullsized":"2024-09-07T03:36:27.945414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'59","last_scrub_stamp":"2024-09-07T03:36:27.945252+0000","last_deep_scrub":"36'59","last_deep_scrub_stamp":"2024-09-07T03:36:27.945252+0000","last_clean_scrub_stamp":"2024-09-07T03:36:27.945252+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:01:06.014289+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:24.298951+0000","last_change":"2024-09-07T03:36:24.298825+0000","last_active":"2024-09-07T03:36:24.298951+0000","last_peered":"2024-09-07T03:36:24.298951+0000","last_clean":"2024-09-07T03:36:24.298951+0000","last_became_active":"2024-09-07T03:32:20.139806+0000","last_became_peered":"2024-09-07T03:32:20.139806+0000","last_unstale":"2024-09-07T03:36:24.298951+0000","last_undegraded":"2024-09-07T03:36:24.298951+0000","last_fullsized":"2024-09-07T03:36:24.298951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:24.298723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:24.298723+0000","last_clean_scrub_stamp":"2024-09-07T03:36:24.298723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:09:16.113807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:19.113499+0000","last_change":"2024-09-07T03:36:19.113447+0000","last_active":"2024-09-07T03:36:19.113499+0000","last_peered":"2024-09-07T03:36:19.113499+0000","last_clean":"2024-09-07T03:36:19.113499+0000","last_became_active":"2024-09-07T03:32:22.148149+0000","last_became_peered":"2024-09-07T03:32:22.148149+0000","last_unstale":"2024-09-07T03:36:19.113499+0000","last_undegraded":"2024-09-07T03:36:19.113499+0000","last_fullsized":"2024-09-07T03:36:19.113499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-07T03:36:19.113370+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-07T03:36:19.113370+0000","last_clean_scrub_stamp":"2024-09-07T03:36:19.113370+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:29:18.830939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.127054+0000","last_change":"2024-09-07T03:35:45.127054+0000","last_active":"2024-09-07T03:35:45.127054+0000","last_peered":"2024-09-07T03:35:45.127054+0000","last_clean":"2024-09-07T03:35:45.127054+0000","last_became_active":"2024-09-07T03:32:50.279097+0000","last_became_peered":"2024-09-07T03:32:50.279097+0000","last_unstale":"2024-09-07T03:35:45.127054+0000","last_undegraded":"2024-09-07T03:35:45.127054+0000","last_fullsized":"2024-09-07T03:35:45.127054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:45.126957+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:45.126957+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.126957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:52:31.656890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.977230+0000","last_change":"2024-09-07T03:35:44.977163+0000","last_active":"2024-09-07T03:35:44.977230+0000","last_peered":"2024-09-07T03:35:44.977230+0000","last_clean":"2024-09-07T03:35:44.977230+0000","last_became_active":"2024-09-07T03:32:12.123895+0000","last_became_peered":"2024-09-07T03:32:12.123895+0000","last_unstale":"2024-09-07T03:35:44.977230+0000","last_undegraded":"2024-09-07T03:35:44.977230+0000","last_fullsized":"2024-09-07T03:35:44.977230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:44.977080+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:44.977080+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.977080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:31:52.221278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.066362+0000","last_change":"2024-09-07T03:36:03.066306+0000","last_active":"2024-09-07T03:36:03.066362+0000","last_peered":"2024-09-07T03:36:03.066362+0000","last_clean":"2024-09-07T03:36:03.066362+0000","last_became_active":"2024-09-07T03:32:16.128471+0000","last_became_peered":"2024-09-07T03:32:16.128471+0000","last_unstale":"2024-09-07T03:36:03.066362+0000","last_undegraded":"2024-09-07T03:36:03.066362+0000","last_fullsized":"2024-09-07T03:36:03.066362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:03.066219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:03.066219+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.066219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:34:00.394560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'44","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:21.065176+0000","last_change":"2024-09-07T03:36:21.065118+0000","last_active":"2024-09-07T03:36:21.065176+0000","last_peered":"2024-09-07T03:36:21.065176+0000","last_clean":"2024-09-07T03:36:21.065176+0000","last_became_active":"2024-09-07T03:32:18.127674+0000","last_became_peered":"2024-09-07T03:32:18.127674+0000","last_unstale":"2024-09-07T03:36:21.065176+0000","last_undegraded":"2024-09-07T03:36:21.065176+0000","last_fullsized":"2024-09-07T03:36:21.065176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'44","last_scrub_stamp":"2024-09-07T03:36:21.065015+0000","last_deep_scrub":"36'44","last_deep_scrub_stamp":"2024-09-07T03:36:21.065015+0000","last_clean_scrub_stamp":"2024-09-07T03:36:21.065015+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:36:05.520119+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:35.168852+0000","last_change":"2024-09-07T03:36:35.168801+0000","last_active":"2024-09-07T03:36:35.168852+0000","last_peered":"2024-09-07T03:36:35.168852+0000","last_clean":"2024-09-07T03:36:35.168852+0000","last_became_active":"2024-09-07T03:32:20.142322+0000","last_became_peered":"2024-09-07T03:32:20.142322+0000","last_unstale":"2024-09-07T03:36:35.168852+0000","last_undegraded":"2024-09-07T03:36:35.168852+0000","last_fullsized":"2024-09-07T03:36:35.168852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:35.168717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:35.168717+0000","last_clean_scrub_stamp":"2024-09-07T03:36:35.168717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:13:03.656975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:29.408557+0000","last_change":"2024-09-07T03:36:29.408498+0000","last_active":"2024-09-07T03:36:29.408557+0000","last_peered":"2024-09-07T03:36:29.408557+0000","last_clean":"2024-09-07T03:36:29.408557+0000","last_became_active":"2024-09-07T03:32:22.139771+0000","last_became_peered":"2024-09-07T03:32:22.139771+0000","last_unstale":"2024-09-07T03:36:29.408557+0000","last_undegraded":"2024-09-07T03:36:29.408557+0000","last_fullsized":"2024-09-07T03:36:29.408557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:29.408383+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:29.408383+0000","last_clean_scrub_stamp":"2024-09-07T03:36:29.408383+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:32:25.559203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:00.054689+0000","last_change":"2024-09-07T03:36:00.054612+0000","last_active":"2024-09-07T03:36:00.054689+0000","last_peered":"2024-09-07T03:36:00.054689+0000","last_clean":"2024-09-07T03:36:00.054689+0000","last_became_active":"2024-09-07T03:32:14.122182+0000","last_became_peered":"2024-09-07T03:32:14.122182+0000","last_unstale":"2024-09-07T03:36:00.054689+0000","last_undegraded":"2024-09-07T03:36:00.054689+0000","last_fullsized":"2024-09-07T03:36:00.054689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:00.054529+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:00.054529+0000","last_clean_scrub_stamp":"2024-09-07T03:36:00.054529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:19.965534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.971204+0000","last_change":"2024-09-07T03:35:42.971146+0000","last_active":"2024-09-07T03:35:42.971204+0000","last_peered":"2024-09-07T03:35:42.971204+0000","last_clean":"2024-09-07T03:35:42.971204+0000","last_became_active":"2024-09-07T03:32:12.120464+0000","last_became_peered":"2024-09-07T03:32:12.120464+0000","last_unstale":"2024-09-07T03:35:42.971204+0000","last_undegraded":"2024-09-07T03:35:42.971204+0000","last_fullsized":"2024-09-07T03:35:42.971204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:42.971064+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:42.971064+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.971064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:22:31.004500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.065220+0000","last_change":"2024-09-07T03:36:05.065138+0000","last_active":"2024-09-07T03:36:05.065220+0000","last_peered":"2024-09-07T03:36:05.065220+0000","last_clean":"2024-09-07T03:36:05.065220+0000","last_became_active":"2024-09-07T03:32:16.124297+0000","last_became_peered":"2024-09-07T03:32:16.124297+0000","last_unstale":"2024-09-07T03:36:05.065220+0000","last_undegraded":"2024-09-07T03:36:05.065220+0000","last_fullsized":"2024-09-07T03:36:05.065220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:05.065024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:05.065024+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.065024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:25:49.643840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'61","reported_seq":132,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:26.941169+0000","last_change":"2024-09-07T03:36:26.941042+0000","last_active":"2024-09-07T03:36:26.941169+0000","last_peered":"2024-09-07T03:36:26.941169+0000","last_clean":"2024-09-07T03:36:26.941169+0000","last_became_active":"2024-09-07T03:32:18.129944+0000","last_became_peered":"2024-09-07T03:32:18.129944+0000","last_unstale":"2024-09-07T03:36:26.941169+0000","last_undegraded":"2024-09-07T03:36:26.941169+0000","last_fullsized":"2024-09-07T03:36:26.941169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'61","last_scrub_stamp":"2024-09-07T03:36:26.940938+0000","last_deep_scrub":"36'61","last_deep_scrub_stamp":"2024-09-07T03:36:26.940938+0000","last_clean_scrub_stamp":"2024-09-07T03:36:26.940938+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:45:53.093731+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'286","reported_seq":362,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:13.224904+0000","last_change":"2024-09-07T03:36:13.224845+0000","last_active":"2024-09-07T03:36:13.224904+0000","last_peered":"2024-09-07T03:36:13.224904+0000","last_clean":"2024-09-07T03:36:13.224904+0000","last_became_active":"2024-09-07T03:32:20.144077+0000","last_became_peered":"2024-09-07T03:32:20.144077+0000","last_unstale":"2024-09-07T03:36:13.224904+0000","last_undegraded":"2024-09-07T03:36:13.224904+0000","last_fullsized":"2024-09-07T03:36:13.224904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:13.224759+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:13.224759+0000","last_clean_scrub_stamp":"2024-09-07T03:36:13.224759+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:36:08.999718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:31.389882+0000","last_change":"2024-09-07T03:36:31.389824+0000","last_active":"2024-09-07T03:36:31.389882+0000","last_peered":"2024-09-07T03:36:31.389882+0000","last_clean":"2024-09-07T03:36:31.389882+0000","last_became_active":"2024-09-07T03:32:22.145690+0000","last_became_peered":"2024-09-07T03:32:22.145690+0000","last_unstale":"2024-09-07T03:36:31.389882+0000","last_undegraded":"2024-09-07T03:36:31.389882+0000","last_fullsized":"2024-09-07T03:36:31.389882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:31.389724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:31.389724+0000","last_clean_scrub_stamp":"2024-09-07T03:36:31.389724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:57:07.352696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'7","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.092499+0000","last_change":"2024-09-07T03:35:50.092414+0000","last_active":"2024-09-07T03:35:50.092499+0000","last_peered":"2024-09-07T03:35:50.092499+0000","last_clean":"2024-09-07T03:35:50.092499+0000","last_became_active":"2024-09-07T03:32:14.113104+0000","last_became_peered":"2024-09-07T03:32:14.113104+0000","last_unstale":"2024-09-07T03:35:50.092499+0000","last_undegraded":"2024-09-07T03:35:50.092499+0000","last_fullsized":"2024-09-07T03:35:50.092499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-07T03:35:50.092309+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-07T03:35:50.092309+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.092309+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:22:24.668039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.984760+0000","last_change":"2024-09-07T03:35:41.984704+0000","last_active":"2024-09-07T03:35:41.984760+0000","last_peered":"2024-09-07T03:35:41.984760+0000","last_clean":"2024-09-07T03:35:41.984760+0000","last_became_active":"2024-09-07T03:32:12.125172+0000","last_became_peered":"2024-09-07T03:32:12.125172+0000","last_unstale":"2024-09-07T03:35:41.984760+0000","last_undegraded":"2024-09-07T03:35:41.984760+0000","last_fullsized":"2024-09-07T03:35:41.984760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.984625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.984625+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.984625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:03:57.662456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.044725+0000","last_change":"2024-09-07T03:36:04.044663+0000","last_active":"2024-09-07T03:36:04.044725+0000","last_peered":"2024-09-07T03:36:04.044725+0000","last_clean":"2024-09-07T03:36:04.044725+0000","last_became_active":"2024-09-07T03:32:16.125618+0000","last_became_peered":"2024-09-07T03:32:16.125618+0000","last_unstale":"2024-09-07T03:36:04.044725+0000","last_undegraded":"2024-09-07T03:36:04.044725+0000","last_fullsized":"2024-09-07T03:36:04.044725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:04.044581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:04.044581+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.044581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:31:12.541438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'79","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:22.096497+0000","last_change":"2024-09-07T03:36:22.096434+0000","last_active":"2024-09-07T03:36:22.096497+0000","last_peered":"2024-09-07T03:36:22.096497+0000","last_clean":"2024-09-07T03:36:22.096497+0000","last_became_active":"2024-09-07T03:32:18.134005+0000","last_became_peered":"2024-09-07T03:32:18.134005+0000","last_unstale":"2024-09-07T03:36:22.096497+0000","last_undegraded":"2024-09-07T03:36:22.096497+0000","last_fullsized":"2024-09-07T03:36:22.096497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'79","last_scrub_stamp":"2024-09-07T03:36:22.096345+0000","last_deep_scrub":"36'79","last_deep_scrub_stamp":"2024-09-07T03:36:22.096345+0000","last_clean_scrub_stamp":"2024-09-07T03:36:22.096345+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:11.974302+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.137611+0000","last_change":"2024-09-07T03:36:11.137535+0000","last_active":"2024-09-07T03:36:11.137611+0000","last_peered":"2024-09-07T03:36:11.137611+0000","last_clean":"2024-09-07T03:36:11.137611+0000","last_became_active":"2024-09-07T03:32:20.145119+0000","last_became_peered":"2024-09-07T03:32:20.145119+0000","last_unstale":"2024-09-07T03:36:11.137611+0000","last_undegraded":"2024-09-07T03:36:11.137611+0000","last_fullsized":"2024-09-07T03:36:11.137611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:11.137456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:11.137456+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.137456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:48:09.966265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:32.434302+0000","last_change":"2024-09-07T03:36:32.434239+0000","last_active":"2024-09-07T03:36:32.434302+0000","last_peered":"2024-09-07T03:36:32.434302+0000","last_clean":"2024-09-07T03:36:32.434302+0000","last_became_active":"2024-09-07T03:32:22.149203+0000","last_became_peered":"2024-09-07T03:32:22.149203+0000","last_unstale":"2024-09-07T03:36:32.434302+0000","last_undegraded":"2024-09-07T03:36:32.434302+0000","last_fullsized":"2024-09-07T03:36:32.434302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-07T03:36:32.434140+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-07T03:36:32.434140+0000","last_clean_scrub_stamp":"2024-09-07T03:36:32.434140+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:29:15.586564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.151272+0000","last_change":"2024-09-07T03:35:53.151181+0000","last_active":"2024-09-07T03:35:53.151272+0000","last_peered":"2024-09-07T03:35:53.151272+0000","last_clean":"2024-09-07T03:35:53.151272+0000","last_became_active":"2024-09-07T03:32:14.124120+0000","last_became_peered":"2024-09-07T03:32:14.124120+0000","last_unstale":"2024-09-07T03:35:53.151272+0000","last_undegraded":"2024-09-07T03:35:53.151272+0000","last_fullsized":"2024-09-07T03:35:53.151272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:35:53.151087+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:35:53.151087+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.151087+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:29:35.373709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.127146+0000","last_change":"2024-09-07T03:35:38.127043+0000","last_active":"2024-09-07T03:35:38.127146+0000","last_peered":"2024-09-07T03:35:38.127146+0000","last_clean":"2024-09-07T03:35:38.127146+0000","last_became_active":"2024-09-07T03:32:12.133434+0000","last_became_peered":"2024-09-07T03:32:12.133434+0000","last_unstale":"2024-09-07T03:35:38.127146+0000","last_undegraded":"2024-09-07T03:35:38.127146+0000","last_fullsized":"2024-09-07T03:35:38.127146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.126948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.126948+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.126948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:20:49.410859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.060112+0000","last_change":"2024-09-07T03:36:06.060042+0000","last_active":"2024-09-07T03:36:06.060112+0000","last_peered":"2024-09-07T03:36:06.060112+0000","last_clean":"2024-09-07T03:36:06.060112+0000","last_became_active":"2024-09-07T03:32:16.121256+0000","last_became_peered":"2024-09-07T03:32:16.121256+0000","last_unstale":"2024-09-07T03:36:06.060112+0000","last_undegraded":"2024-09-07T03:36:06.060112+0000","last_fullsized":"2024-09-07T03:36:06.060112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:06.059956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:06.059956+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.059956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:29:16.523793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'48","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:28.917711+0000","last_change":"2024-09-07T03:36:28.917647+0000","last_active":"2024-09-07T03:36:28.917711+0000","last_peered":"2024-09-07T03:36:28.917711+0000","last_clean":"2024-09-07T03:36:28.917711+0000","last_became_active":"2024-09-07T03:32:18.128470+0000","last_became_peered":"2024-09-07T03:32:18.128470+0000","last_unstale":"2024-09-07T03:36:28.917711+0000","last_undegraded":"2024-09-07T03:36:28.917711+0000","last_fullsized":"2024-09-07T03:36:28.917711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-07T03:36:28.917533+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-07T03:36:28.917533+0000","last_clean_scrub_stamp":"2024-09-07T03:36:28.917533+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:57:04.902875+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:36.166459+0000","last_change":"2024-09-07T03:36:36.166406+0000","last_active":"2024-09-07T03:36:36.166459+0000","last_peered":"2024-09-07T03:36:36.166459+0000","last_clean":"2024-09-07T03:36:36.166459+0000","last_became_active":"2024-09-07T03:32:20.134892+0000","last_became_peered":"2024-09-07T03:32:20.134892+0000","last_unstale":"2024-09-07T03:36:36.166459+0000","last_undegraded":"2024-09-07T03:36:36.166459+0000","last_fullsized":"2024-09-07T03:36:36.166459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:36.166326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:36.166326+0000","last_clean_scrub_stamp":"2024-09-07T03:36:36.166326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:57:09.487409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:40.172132+0000","last_change":"2024-09-07T03:36:40.172132+0000","last_active":"2024-09-07T03:36:40.172132+0000","last_peered":"2024-09-07T03:36:40.172132+0000","last_clean":"2024-09-07T03:36:40.172132+0000","last_became_active":"2024-09-07T03:32:22.153134+0000","last_became_peered":"2024-09-07T03:32:22.153134+0000","last_unstale":"2024-09-07T03:36:40.172132+0000","last_undegraded":"2024-09-07T03:36:40.172132+0000","last_fullsized":"2024-09-07T03:36:40.172132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:40.172035+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:40.172035+0000","last_clean_scrub_stamp":"2024-09-07T03:36:40.172035+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:08:24.174712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:04.022420+0000","last_change":"2024-09-07T03:36:04.022341+0000","last_active":"2024-09-07T03:36:04.022420+0000","last_peered":"2024-09-07T03:36:04.022420+0000","last_clean":"2024-09-07T03:36:04.022420+0000","last_became_active":"2024-09-07T03:32:14.113243+0000","last_became_peered":"2024-09-07T03:32:14.113243+0000","last_unstale":"2024-09-07T03:36:04.022420+0000","last_undegraded":"2024-09-07T03:36:04.022420+0000","last_fullsized":"2024-09-07T03:36:04.022420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:04.022255+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:04.022255+0000","last_clean_scrub_stamp":"2024-09-07T03:36:04.022255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:20:24.399977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.990088+0000","last_change":"2024-09-07T03:35:40.990026+0000","last_active":"2024-09-07T03:35:40.990088+0000","last_peered":"2024-09-07T03:35:40.990088+0000","last_clean":"2024-09-07T03:35:40.990088+0000","last_became_active":"2024-09-07T03:32:12.120531+0000","last_became_peered":"2024-09-07T03:32:12.120531+0000","last_unstale":"2024-09-07T03:35:40.990088+0000","last_undegraded":"2024-09-07T03:35:40.990088+0000","last_fullsized":"2024-09-07T03:35:40.990088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.989938+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.989938+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.989938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:58:08.481418+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:11.330613+0000","last_change":"2024-09-07T03:36:11.330556+0000","last_active":"2024-09-07T03:36:11.330613+0000","last_peered":"2024-09-07T03:36:11.330613+0000","last_clean":"2024-09-07T03:36:11.330613+0000","last_became_active":"2024-09-07T03:32:16.124100+0000","last_became_peered":"2024-09-07T03:32:16.124100+0000","last_unstale":"2024-09-07T03:36:11.330613+0000","last_undegraded":"2024-09-07T03:36:11.330613+0000","last_fullsized":"2024-09-07T03:36:11.330613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:11.330470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:11.330470+0000","last_clean_scrub_stamp":"2024-09-07T03:36:11.330470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:05:30.256377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'46","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.062198+0000","last_change":"2024-09-07T03:36:08.062144+0000","last_active":"2024-09-07T03:36:08.062198+0000","last_peered":"2024-09-07T03:36:08.062198+0000","last_clean":"2024-09-07T03:36:08.062198+0000","last_became_active":"2024-09-07T03:32:18.130120+0000","last_became_peered":"2024-09-07T03:32:18.130120+0000","last_unstale":"2024-09-07T03:36:08.062198+0000","last_undegraded":"2024-09-07T03:36:08.062198+0000","last_fullsized":"2024-09-07T03:36:08.062198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-07T03:36:08.062043+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-07T03:36:08.062043+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.062043+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:30:18.972937+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'286","reported_seq":466,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:12.184803+0000","last_change":"2024-09-07T03:36:12.184718+0000","last_active":"2024-09-07T03:36:12.184803+0000","last_peered":"2024-09-07T03:36:12.184803+0000","last_clean":"2024-09-07T03:36:12.184803+0000","last_became_active":"2024-09-07T03:32:20.146408+0000","last_became_peered":"2024-09-07T03:32:20.146408+0000","last_unstale":"2024-09-07T03:36:12.184803+0000","last_undegraded":"2024-09-07T03:36:12.184803+0000","last_fullsized":"2024-09-07T03:36:12.184803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:12.184620+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:12.184620+0000","last_clean_scrub_stamp":"2024-09-07T03:36:12.184620+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:24:53.862170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:28.360069+0000","last_change":"2024-09-07T03:36:28.360011+0000","last_active":"2024-09-07T03:36:28.360069+0000","last_peered":"2024-09-07T03:36:28.360069+0000","last_clean":"2024-09-07T03:36:28.360069+0000","last_became_active":"2024-09-07T03:32:22.145911+0000","last_became_peered":"2024-09-07T03:32:22.145911+0000","last_unstale":"2024-09-07T03:36:28.360069+0000","last_undegraded":"2024-09-07T03:36:28.360069+0000","last_fullsized":"2024-09-07T03:36:28.360069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-07T03:36:28.359908+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-07T03:36:28.359908+0000","last_clean_scrub_stamp":"2024-09-07T03:36:28.359908+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:06:23.061063+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.102042+0000","last_change":"2024-09-07T03:35:48.101986+0000","last_active":"2024-09-07T03:35:48.102042+0000","last_peered":"2024-09-07T03:35:48.102042+0000","last_clean":"2024-09-07T03:35:48.102042+0000","last_became_active":"2024-09-07T03:32:14.112499+0000","last_became_peered":"2024-09-07T03:32:14.112499+0000","last_unstale":"2024-09-07T03:35:48.102042+0000","last_undegraded":"2024-09-07T03:35:48.102042+0000","last_fullsized":"2024-09-07T03:35:48.102042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:48.101897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:48.101897+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.101897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:11:08.140746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.054699+0000","last_change":"2024-09-07T03:35:36.054642+0000","last_active":"2024-09-07T03:35:36.054699+0000","last_peered":"2024-09-07T03:35:36.054699+0000","last_clean":"2024-09-07T03:35:36.054699+0000","last_became_active":"2024-09-07T03:32:12.132462+0000","last_became_peered":"2024-09-07T03:32:12.132462+0000","last_unstale":"2024-09-07T03:35:36.054699+0000","last_undegraded":"2024-09-07T03:35:36.054699+0000","last_fullsized":"2024-09-07T03:35:36.054699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:36.054527+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:36.054527+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.054527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:13:11.473174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'10","reported_seq":629,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:21.911503+0000","last_change":"2024-09-07T03:36:21.911416+0000","last_active":"2024-09-07T03:36:21.911503+0000","last_peered":"2024-09-07T03:36:21.911503+0000","last_clean":"2024-09-07T03:36:21.911503+0000","last_became_active":"2024-09-07T03:32:16.124500+0000","last_became_peered":"2024-09-07T03:32:16.124500+0000","last_unstale":"2024-09-07T03:36:21.911503+0000","last_undegraded":"2024-09-07T03:36:21.911503+0000","last_fullsized":"2024-09-07T03:36:21.911503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:36:21.911303+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:36:21.911303+0000","last_clean_scrub_stamp":"2024-09-07T03:36:21.911303+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:17:52.572910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1085,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'16","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:23.081794+0000","last_change":"2024-09-07T03:36:23.081728+0000","last_active":"2024-09-07T03:36:23.081794+0000","last_peered":"2024-09-07T03:36:23.081794+0000","last_clean":"2024-09-07T03:36:23.081794+0000","last_became_active":"2024-09-07T03:32:50.278739+0000","last_became_peered":"2024-09-07T03:32:50.278739+0000","last_unstale":"2024-09-07T03:36:23.081794+0000","last_undegraded":"2024-09-07T03:36:23.081794+0000","last_fullsized":"2024-09-07T03:36:23.081794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:36:23.081619+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:36:23.081619+0000","last_clean_scrub_stamp":"2024-09-07T03:36:23.081619+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:38:14.997831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'286","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:36.929082+0000","last_change":"2024-09-07T03:36:36.928997+0000","last_active":"2024-09-07T03:36:36.929082+0000","last_peered":"2024-09-07T03:36:36.929082+0000","last_clean":"2024-09-07T03:36:36.929082+0000","last_became_active":"2024-09-07T03:32:20.140148+0000","last_became_peered":"2024-09-07T03:32:20.140148+0000","last_unstale":"2024-09-07T03:36:36.929082+0000","last_undegraded":"2024-09-07T03:36:36.929082+0000","last_fullsized":"2024-09-07T03:36:36.929082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:36.928904+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:36.928904+0000","last_clean_scrub_stamp":"2024-09-07T03:36:36.928904+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:51:25.691086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:18.066024+0000","last_change":"2024-09-07T03:36:18.065963+0000","last_active":"2024-09-07T03:36:18.066024+0000","last_peered":"2024-09-07T03:36:18.066024+0000","last_clean":"2024-09-07T03:36:18.066024+0000","last_became_active":"2024-09-07T03:32:22.147049+0000","last_became_peered":"2024-09-07T03:32:22.147049+0000","last_unstale":"2024-09-07T03:36:18.066024+0000","last_undegraded":"2024-09-07T03:36:18.066024+0000","last_fullsized":"2024-09-07T03:36:18.066024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:18.065859+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:18.065859+0000","last_clean_scrub_stamp":"2024-09-07T03:36:18.065859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:36:07.319592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.155647+0000","last_change":"2024-09-07T03:35:54.155584+0000","last_active":"2024-09-07T03:35:54.155647+0000","last_peered":"2024-09-07T03:35:54.155647+0000","last_clean":"2024-09-07T03:35:54.155647+0000","last_became_active":"2024-09-07T03:32:14.124083+0000","last_became_peered":"2024-09-07T03:32:14.124083+0000","last_unstale":"2024-09-07T03:35:54.155647+0000","last_undegraded":"2024-09-07T03:35:54.155647+0000","last_fullsized":"2024-09-07T03:35:54.155647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:54.155500+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:54.155500+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.155500+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:36:53.745026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.109943+0000","last_change":"2024-09-07T03:35:39.109873+0000","last_active":"2024-09-07T03:35:39.109943+0000","last_peered":"2024-09-07T03:35:39.109943+0000","last_clean":"2024-09-07T03:35:39.109943+0000","last_became_active":"2024-09-07T03:32:12.141314+0000","last_became_peered":"2024-09-07T03:32:12.141314+0000","last_unstale":"2024-09-07T03:35:39.109943+0000","last_undegraded":"2024-09-07T03:35:39.109943+0000","last_fullsized":"2024-09-07T03:35:39.109943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:39.109787+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:39.109787+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.109787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:13:50.111247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:13.021413+0000","last_change":"2024-09-07T03:36:13.021335+0000","last_active":"2024-09-07T03:36:13.021413+0000","last_peered":"2024-09-07T03:36:13.021413+0000","last_clean":"2024-09-07T03:36:13.021413+0000","last_became_active":"2024-09-07T03:32:16.128099+0000","last_became_peered":"2024-09-07T03:32:16.128099+0000","last_unstale":"2024-09-07T03:36:13.021413+0000","last_undegraded":"2024-09-07T03:36:13.021413+0000","last_fullsized":"2024-09-07T03:36:13.021413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:13.021226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:13.021226+0000","last_clean_scrub_stamp":"2024-09-07T03:36:13.021226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:38:22.592430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:29.876876+0000","last_change":"2024-09-07T03:36:29.876811+0000","last_active":"2024-09-07T03:36:29.876876+0000","last_peered":"2024-09-07T03:36:29.876876+0000","last_clean":"2024-09-07T03:36:29.876876+0000","last_became_active":"2024-09-07T03:32:18.128679+0000","last_became_peered":"2024-09-07T03:32:18.128679+0000","last_unstale":"2024-09-07T03:36:29.876876+0000","last_undegraded":"2024-09-07T03:36:29.876876+0000","last_fullsized":"2024-09-07T03:36:29.876876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-07T03:36:29.876725+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-07T03:36:29.876725+0000","last_clean_scrub_stamp":"2024-09-07T03:36:29.876725+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:12:58.364983+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:37.956531+0000","last_change":"2024-09-07T03:36:37.956438+0000","last_active":"2024-09-07T03:36:37.956531+0000","last_peered":"2024-09-07T03:36:37.956531+0000","last_clean":"2024-09-07T03:36:37.956531+0000","last_became_active":"2024-09-07T03:32:20.132479+0000","last_became_peered":"2024-09-07T03:32:20.132479+0000","last_unstale":"2024-09-07T03:36:37.956531+0000","last_undegraded":"2024-09-07T03:36:37.956531+0000","last_fullsized":"2024-09-07T03:36:37.956531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:37.956351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:37.956351+0000","last_clean_scrub_stamp":"2024-09-07T03:36:37.956351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:04:30.210720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'10","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:30.430448+0000","last_change":"2024-09-07T03:36:30.430336+0000","last_active":"2024-09-07T03:36:30.430448+0000","last_peered":"2024-09-07T03:36:30.430448+0000","last_clean":"2024-09-07T03:36:30.430448+0000","last_became_active":"2024-09-07T03:32:22.140389+0000","last_became_peered":"2024-09-07T03:32:22.140389+0000","last_unstale":"2024-09-07T03:36:30.430448+0000","last_undegraded":"2024-09-07T03:36:30.430448+0000","last_fullsized":"2024-09-07T03:36:30.430448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:36:30.430238+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:36:30.430238+0000","last_clean_scrub_stamp":"2024-09-07T03:36:30.430238+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:32:00.684293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'14","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.078269+0000","last_change":"2024-09-07T03:35:58.078213+0000","last_active":"2024-09-07T03:35:58.078269+0000","last_peered":"2024-09-07T03:35:58.078269+0000","last_clean":"2024-09-07T03:35:58.078269+0000","last_became_active":"2024-09-07T03:32:14.112612+0000","last_became_peered":"2024-09-07T03:32:14.112612+0000","last_unstale":"2024-09-07T03:35:58.078269+0000","last_undegraded":"2024-09-07T03:35:58.078269+0000","last_fullsized":"2024-09-07T03:35:58.078269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-07T03:35:58.078128+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-07T03:35:58.078128+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.078128+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:18:12.312460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"36'74","reported_seq":155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:34.263530+0000","last_change":"2024-09-07T03:35:34.263470+0000","last_active":"2024-09-07T03:35:34.263530+0000","last_peered":"2024-09-07T03:35:34.263530+0000","last_clean":"2024-09-07T03:35:34.263530+0000","last_became_active":"2024-09-07T03:31:58.567678+0000","last_became_peered":"2024-09-07T03:31:58.567678+0000","last_unstale":"2024-09-07T03:35:34.263530+0000","last_undegraded":"2024-09-07T03:35:34.263530+0000","last_fullsized":"2024-09-07T03:35:34.263530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-09-07T03:35:34.263378+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-09-07T03:35:34.263378+0000","last_clean_scrub_stamp":"2024-09-07T03:35:34.263378+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:30:23.857990+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.055044+0000","last_change":"2024-09-07T03:35:36.054987+0000","last_active":"2024-09-07T03:35:36.055044+0000","last_peered":"2024-09-07T03:35:36.055044+0000","last_clean":"2024-09-07T03:35:36.055044+0000","last_became_active":"2024-09-07T03:32:02.538300+0000","last_became_peered":"2024-09-07T03:32:02.538300+0000","last_unstale":"2024-09-07T03:35:36.055044+0000","last_undegraded":"2024-09-07T03:35:36.055044+0000","last_fullsized":"2024-09-07T03:35:36.055044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:36.054875+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:36.054875+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.054875+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:59:03.880806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000772929,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.060353+0000","last_change":"2024-09-07T03:35:35.060262+0000","last_active":"2024-09-07T03:35:35.060353+0000","last_peered":"2024-09-07T03:35:35.060353+0000","last_clean":"2024-09-07T03:35:35.060353+0000","last_became_active":"2024-09-07T03:32:12.130323+0000","last_became_peered":"2024-09-07T03:32:12.130323+0000","last_unstale":"2024-09-07T03:35:35.060353+0000","last_undegraded":"2024-09-07T03:35:35.060353+0000","last_fullsized":"2024-09-07T03:35:35.060353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:35.060153+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:35.060153+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.060153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:57:51.353906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.210182+0000","last_change":"2024-09-07T03:36:06.210120+0000","last_active":"2024-09-07T03:36:06.210182+0000","last_peered":"2024-09-07T03:36:06.210182+0000","last_clean":"2024-09-07T03:36:06.210182+0000","last_became_active":"2024-09-07T03:32:16.126915+0000","last_became_peered":"2024-09-07T03:32:16.126915+0000","last_unstale":"2024-09-07T03:36:06.210182+0000","last_undegraded":"2024-09-07T03:36:06.210182+0000","last_fullsized":"2024-09-07T03:36:06.210182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:06.210045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:06.210045+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.210045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:59:32.681075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'99","reported_seq":196,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:25.897667+0000","last_change":"2024-09-07T03:36:25.897608+0000","last_active":"2024-09-07T03:36:25.897667+0000","last_peered":"2024-09-07T03:36:25.897667+0000","last_clean":"2024-09-07T03:36:25.897667+0000","last_became_active":"2024-09-07T03:32:18.129224+0000","last_became_peered":"2024-09-07T03:32:18.129224+0000","last_unstale":"2024-09-07T03:36:25.897667+0000","last_undegraded":"2024-09-07T03:36:25.897667+0000","last_fullsized":"2024-09-07T03:36:25.897667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'99","last_scrub_stamp":"2024-09-07T03:36:25.897515+0000","last_deep_scrub":"36'99","last_deep_scrub_stamp":"2024-09-07T03:36:25.897515+0000","last_clean_scrub_stamp":"2024-09-07T03:36:25.897515+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:25:22.289081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":105,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:31.086426+0000","last_change":"2024-09-07T03:36:31.086369+0000","last_active":"2024-09-07T03:36:31.086426+0000","last_peered":"2024-09-07T03:36:31.086426+0000","last_clean":"2024-09-07T03:36:31.086426+0000","last_became_active":"2024-09-07T03:32:20.134819+0000","last_became_peered":"2024-09-07T03:32:20.134819+0000","last_unstale":"2024-09-07T03:36:31.086426+0000","last_undegraded":"2024-09-07T03:36:31.086426+0000","last_fullsized":"2024-09-07T03:36:31.086426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:31.086289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:31.086289+0000","last_clean_scrub_stamp":"2024-09-07T03:36:31.086289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:41:28.775498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'84","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:20.111706+0000","last_change":"2024-09-07T03:36:20.111631+0000","last_active":"2024-09-07T03:36:20.111706+0000","last_peered":"2024-09-07T03:36:20.111706+0000","last_clean":"2024-09-07T03:36:20.111706+0000","last_became_active":"2024-09-07T03:32:22.151817+0000","last_became_peered":"2024-09-07T03:32:22.151817+0000","last_unstale":"2024-09-07T03:36:20.111706+0000","last_undegraded":"2024-09-07T03:36:20.111706+0000","last_fullsized":"2024-09-07T03:36:20.111706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'84","last_scrub_stamp":"2024-09-07T03:36:20.111549+0000","last_deep_scrub":"36'84","last_deep_scrub_stamp":"2024-09-07T03:36:20.111549+0000","last_clean_scrub_stamp":"2024-09-07T03:36:20.111549+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:21:36.936020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'16","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.052059+0000","last_change":"2024-09-07T03:35:57.052002+0000","last_active":"2024-09-07T03:35:57.052059+0000","last_peered":"2024-09-07T03:35:57.052059+0000","last_clean":"2024-09-07T03:35:57.052059+0000","last_became_active":"2024-09-07T03:32:14.130484+0000","last_became_peered":"2024-09-07T03:32:14.130484+0000","last_unstale":"2024-09-07T03:35:57.052059+0000","last_undegraded":"2024-09-07T03:35:57.052059+0000","last_fullsized":"2024-09-07T03:35:57.052059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:35:57.051894+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:35:57.051894+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.051894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:57:19.853822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:34.143372+0000","last_change":"2024-09-07T03:35:34.143292+0000","last_active":"2024-09-07T03:35:34.143372+0000","last_peered":"2024-09-07T03:35:34.143372+0000","last_clean":"2024-09-07T03:35:34.143372+0000","last_became_active":"2024-09-07T03:32:02.538340+0000","last_became_peered":"2024-09-07T03:32:02.538340+0000","last_unstale":"2024-09-07T03:35:34.143372+0000","last_undegraded":"2024-09-07T03:35:34.143372+0000","last_fullsized":"2024-09-07T03:35:34.143372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:34.143191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:34.143191+0000","last_clean_scrub_stamp":"2024-09-07T03:35:34.143191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:36:29.075222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050369200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.175022+0000","last_change":"2024-09-07T03:35:37.174918+0000","last_active":"2024-09-07T03:35:37.175022+0000","last_peered":"2024-09-07T03:35:37.175022+0000","last_clean":"2024-09-07T03:35:37.175022+0000","last_became_active":"2024-09-07T03:32:12.124522+0000","last_became_peered":"2024-09-07T03:32:12.124522+0000","last_unstale":"2024-09-07T03:35:37.175022+0000","last_undegraded":"2024-09-07T03:35:37.175022+0000","last_fullsized":"2024-09-07T03:35:37.175022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.174806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.174806+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.174806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:06:10.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:18.932029+0000","last_change":"2024-09-07T03:36:18.931945+0000","last_active":"2024-09-07T03:36:18.932029+0000","last_peered":"2024-09-07T03:36:18.932029+0000","last_clean":"2024-09-07T03:36:18.932029+0000","last_became_active":"2024-09-07T03:32:16.124243+0000","last_became_peered":"2024-09-07T03:32:16.124243+0000","last_unstale":"2024-09-07T03:36:18.932029+0000","last_undegraded":"2024-09-07T03:36:18.932029+0000","last_fullsized":"2024-09-07T03:36:18.932029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:18.931814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:18.931814+0000","last_clean_scrub_stamp":"2024-09-07T03:36:18.931814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:26:06.944290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'301","reported_seq":533,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:18.268583+0000","last_change":"2024-09-07T03:36:18.268524+0000","last_active":"2024-09-07T03:36:18.268583+0000","last_peered":"2024-09-07T03:36:18.268583+0000","last_clean":"2024-09-07T03:36:18.268583+0000","last_became_active":"2024-09-07T03:32:18.132579+0000","last_became_peered":"2024-09-07T03:32:18.132579+0000","last_unstale":"2024-09-07T03:36:18.268583+0000","last_undegraded":"2024-09-07T03:36:18.268583+0000","last_fullsized":"2024-09-07T03:36:18.268583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'301","last_scrub_stamp":"2024-09-07T03:36:18.268410+0000","last_deep_scrub":"36'301","last_deep_scrub_stamp":"2024-09-07T03:36:18.268410+0000","last_clean_scrub_stamp":"2024-09-07T03:36:18.268410+0000","objects_scrubbed":11,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:42:45.312029+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:32.116567+0000","last_change":"2024-09-07T03:36:32.116567+0000","last_active":"2024-09-07T03:36:32.116567+0000","last_peered":"2024-09-07T03:36:32.116567+0000","last_clean":"2024-09-07T03:36:32.116567+0000","last_became_active":"2024-09-07T03:32:20.141044+0000","last_became_peered":"2024-09-07T03:32:20.141044+0000","last_unstale":"2024-09-07T03:36:32.116567+0000","last_undegraded":"2024-09-07T03:36:32.116567+0000","last_fullsized":"2024-09-07T03:36:32.116567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:32.116479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:32.116479+0000","last_clean_scrub_stamp":"2024-09-07T03:36:32.116479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:07:18.448583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'13","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:36.422287+0000","last_change":"2024-09-07T03:36:36.422223+0000","last_active":"2024-09-07T03:36:36.422287+0000","last_peered":"2024-09-07T03:36:36.422287+0000","last_clean":"2024-09-07T03:36:36.422287+0000","last_became_active":"2024-09-07T03:32:22.143337+0000","last_became_peered":"2024-09-07T03:32:22.143337+0000","last_unstale":"2024-09-07T03:36:36.422287+0000","last_undegraded":"2024-09-07T03:36:36.422287+0000","last_fullsized":"2024-09-07T03:36:36.422287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-07T03:36:36.422128+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-07T03:36:36.422128+0000","last_clean_scrub_stamp":"2024-09-07T03:36:36.422128+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:14:41.153621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":64,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.151403+0000","last_change":"2024-09-07T03:35:52.151332+0000","last_active":"2024-09-07T03:35:52.151403+0000","last_peered":"2024-09-07T03:35:52.151403+0000","last_clean":"2024-09-07T03:35:52.151403+0000","last_became_active":"2024-09-07T03:32:14.127288+0000","last_became_peered":"2024-09-07T03:32:14.127288+0000","last_unstale":"2024-09-07T03:35:52.151403+0000","last_undegraded":"2024-09-07T03:35:52.151403+0000","last_fullsized":"2024-09-07T03:35:52.151403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:52.151246+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:52.151246+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.151246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:14:33.440532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.067289+0000","last_change":"2024-09-07T03:35:36.067219+0000","last_active":"2024-09-07T03:35:36.067289+0000","last_peered":"2024-09-07T03:35:36.067289+0000","last_clean":"2024-09-07T03:35:36.067289+0000","last_became_active":"2024-09-07T03:32:03.139599+0000","last_became_peered":"2024-09-07T03:32:03.139599+0000","last_unstale":"2024-09-07T03:35:36.067289+0000","last_undegraded":"2024-09-07T03:35:36.067289+0000","last_fullsized":"2024-09-07T03:35:36.067289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:36.067138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:36.067138+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.067138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:05.511968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039931599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.155695+0000","last_change":"2024-09-07T03:35:39.155583+0000","last_active":"2024-09-07T03:35:39.155695+0000","last_peered":"2024-09-07T03:35:39.155695+0000","last_clean":"2024-09-07T03:35:39.155695+0000","last_became_active":"2024-09-07T03:32:12.139224+0000","last_became_peered":"2024-09-07T03:32:12.139224+0000","last_unstale":"2024-09-07T03:35:39.155695+0000","last_undegraded":"2024-09-07T03:35:39.155695+0000","last_fullsized":"2024-09-07T03:35:39.155695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:39.155484+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:39.155484+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.155484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:35:35.465606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.030794+0000","last_change":"2024-09-07T03:36:02.030703+0000","last_active":"2024-09-07T03:36:02.030794+0000","last_peered":"2024-09-07T03:36:02.030794+0000","last_clean":"2024-09-07T03:36:02.030794+0000","last_became_active":"2024-09-07T03:32:16.121817+0000","last_became_peered":"2024-09-07T03:32:16.121817+0000","last_unstale":"2024-09-07T03:36:02.030794+0000","last_undegraded":"2024-09-07T03:36:02.030794+0000","last_fullsized":"2024-09-07T03:36:02.030794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:02.030606+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:02.030606+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.030606+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:38:02.109551+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'24","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:24.878326+0000","last_change":"2024-09-07T03:36:24.878216+0000","last_active":"2024-09-07T03:36:24.878326+0000","last_peered":"2024-09-07T03:36:24.878326+0000","last_clean":"2024-09-07T03:36:24.878326+0000","last_became_active":"2024-09-07T03:32:18.129264+0000","last_became_peered":"2024-09-07T03:32:18.129264+0000","last_unstale":"2024-09-07T03:36:24.878326+0000","last_undegraded":"2024-09-07T03:36:24.878326+0000","last_fullsized":"2024-09-07T03:36:24.878326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-07T03:36:24.878113+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-07T03:36:24.878113+0000","last_clean_scrub_stamp":"2024-09-07T03:36:24.878113+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:04:55.841497+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:23.275876+0000","last_change":"2024-09-07T03:36:23.275764+0000","last_active":"2024-09-07T03:36:23.275876+0000","last_peered":"2024-09-07T03:36:23.275876+0000","last_clean":"2024-09-07T03:36:23.275876+0000","last_became_active":"2024-09-07T03:32:20.142764+0000","last_became_peered":"2024-09-07T03:32:20.142764+0000","last_unstale":"2024-09-07T03:36:23.275876+0000","last_undegraded":"2024-09-07T03:36:23.275876+0000","last_fullsized":"2024-09-07T03:36:23.275876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:23.275673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:23.275673+0000","last_clean_scrub_stamp":"2024-09-07T03:36:23.275673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:55.667173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:42.166553+0000","last_change":"2024-09-07T03:36:42.166470+0000","last_active":"2024-09-07T03:36:42.166553+0000","last_peered":"2024-09-07T03:36:42.166553+0000","last_clean":"2024-09-07T03:36:42.166553+0000","last_became_active":"2024-09-07T03:32:22.147510+0000","last_became_peered":"2024-09-07T03:32:22.147510+0000","last_unstale":"2024-09-07T03:36:42.166553+0000","last_undegraded":"2024-09-07T03:36:42.166553+0000","last_fullsized":"2024-09-07T03:36:42.166553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:42.166360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:42.166360+0000","last_clean_scrub_stamp":"2024-09-07T03:36:42.166360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:22:43.323511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.126616+0000","last_change":"2024-09-07T03:35:51.126506+0000","last_active":"2024-09-07T03:35:51.126616+0000","last_peered":"2024-09-07T03:35:51.126616+0000","last_clean":"2024-09-07T03:35:51.126616+0000","last_became_active":"2024-09-07T03:32:14.113700+0000","last_became_peered":"2024-09-07T03:32:14.113700+0000","last_unstale":"2024-09-07T03:35:51.126616+0000","last_undegraded":"2024-09-07T03:35:51.126616+0000","last_fullsized":"2024-09-07T03:35:51.126616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:51.126405+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:51.126405+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.126405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:05:32.898918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.101415+0000","last_change":"2024-09-07T03:35:35.101343+0000","last_active":"2024-09-07T03:35:35.101415+0000","last_peered":"2024-09-07T03:35:35.101415+0000","last_clean":"2024-09-07T03:35:35.101415+0000","last_became_active":"2024-09-07T03:32:02.538241+0000","last_became_peered":"2024-09-07T03:32:02.538241+0000","last_unstale":"2024-09-07T03:35:35.101415+0000","last_undegraded":"2024-09-07T03:35:35.101415+0000","last_fullsized":"2024-09-07T03:35:35.101415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:35:35.101255+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:35:35.101255+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.101255+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:45:10.988630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011200699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.967943+0000","last_change":"2024-09-07T03:35:38.967838+0000","last_active":"2024-09-07T03:35:38.967943+0000","last_peered":"2024-09-07T03:35:38.967943+0000","last_clean":"2024-09-07T03:35:38.967943+0000","last_became_active":"2024-09-07T03:32:12.124390+0000","last_became_peered":"2024-09-07T03:32:12.124390+0000","last_unstale":"2024-09-07T03:35:38.967943+0000","last_undegraded":"2024-09-07T03:35:38.967943+0000","last_fullsized":"2024-09-07T03:35:38.967943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:38.967736+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:38.967736+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.967736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:06:28.145953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.248709+0000","last_change":"2024-09-07T03:36:07.248619+0000","last_active":"2024-09-07T03:36:07.248709+0000","last_peered":"2024-09-07T03:36:07.248709+0000","last_clean":"2024-09-07T03:36:07.248709+0000","last_became_active":"2024-09-07T03:32:16.120933+0000","last_became_peered":"2024-09-07T03:32:16.120933+0000","last_unstale":"2024-09-07T03:36:07.248709+0000","last_undegraded":"2024-09-07T03:36:07.248709+0000","last_fullsized":"2024-09-07T03:36:07.248709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:07.248526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:07.248526+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.248526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:00:33.309102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'21","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:20.041507+0000","last_change":"2024-09-07T03:36:20.041446+0000","last_active":"2024-09-07T03:36:20.041507+0000","last_peered":"2024-09-07T03:36:20.041507+0000","last_clean":"2024-09-07T03:36:20.041507+0000","last_became_active":"2024-09-07T03:32:18.130557+0000","last_became_peered":"2024-09-07T03:32:18.130557+0000","last_unstale":"2024-09-07T03:36:20.041507+0000","last_undegraded":"2024-09-07T03:36:20.041507+0000","last_fullsized":"2024-09-07T03:36:20.041507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-07T03:36:20.041339+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-07T03:36:20.041339+0000","last_clean_scrub_stamp":"2024-09-07T03:36:20.041339+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:42:17.742410+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:34.129952+0000","last_change":"2024-09-07T03:36:34.129878+0000","last_active":"2024-09-07T03:36:34.129952+0000","last_peered":"2024-09-07T03:36:34.129952+0000","last_clean":"2024-09-07T03:36:34.129952+0000","last_became_active":"2024-09-07T03:32:20.142650+0000","last_became_peered":"2024-09-07T03:32:20.142650+0000","last_unstale":"2024-09-07T03:36:34.129952+0000","last_undegraded":"2024-09-07T03:36:34.129952+0000","last_fullsized":"2024-09-07T03:36:34.129952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:34.129789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:34.129789+0000","last_clean_scrub_stamp":"2024-09-07T03:36:34.129789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:57:10.115131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:33.425160+0000","last_change":"2024-09-07T03:36:33.425093+0000","last_active":"2024-09-07T03:36:33.425160+0000","last_peered":"2024-09-07T03:36:33.425160+0000","last_clean":"2024-09-07T03:36:33.425160+0000","last_became_active":"2024-09-07T03:32:22.150981+0000","last_became_peered":"2024-09-07T03:32:22.150981+0000","last_unstale":"2024-09-07T03:36:33.425160+0000","last_undegraded":"2024-09-07T03:36:33.425160+0000","last_fullsized":"2024-09-07T03:36:33.425160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:33.424997+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:33.424997+0000","last_clean_scrub_stamp":"2024-09-07T03:36:33.424997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:35:22.972593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'10","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.141859+0000","last_change":"2024-09-07T03:35:46.141859+0000","last_active":"2024-09-07T03:35:46.141859+0000","last_peered":"2024-09-07T03:35:46.141859+0000","last_clean":"2024-09-07T03:35:46.141859+0000","last_became_active":"2024-09-07T03:32:50.282108+0000","last_became_peered":"2024-09-07T03:32:50.282108+0000","last_unstale":"2024-09-07T03:35:46.141859+0000","last_undegraded":"2024-09-07T03:35:46.141859+0000","last_fullsized":"2024-09-07T03:35:46.141859+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:46.141737+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:46.141737+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.141737+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:43:06.335628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.985303+0000","last_change":"2024-09-07T03:35:39.985231+0000","last_active":"2024-09-07T03:35:39.985303+0000","last_peered":"2024-09-07T03:35:39.985303+0000","last_clean":"2024-09-07T03:35:39.985303+0000","last_became_active":"2024-09-07T03:32:12.121179+0000","last_became_peered":"2024-09-07T03:32:12.121179+0000","last_unstale":"2024-09-07T03:35:39.985303+0000","last_undegraded":"2024-09-07T03:35:39.985303+0000","last_fullsized":"2024-09-07T03:35:39.985303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:39.985147+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:39.985147+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.985147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:39:22.800295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:36.220713+0000","last_change":"2024-09-07T03:35:36.220654+0000","last_active":"2024-09-07T03:35:36.220713+0000","last_peered":"2024-09-07T03:35:36.220713+0000","last_clean":"2024-09-07T03:35:36.220713+0000","last_became_active":"2024-09-07T03:32:03.139681+0000","last_became_peered":"2024-09-07T03:32:03.139681+0000","last_unstale":"2024-09-07T03:35:36.220713+0000","last_undegraded":"2024-09-07T03:35:36.220713+0000","last_fullsized":"2024-09-07T03:35:36.220713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:36.220564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:36.220564+0000","last_clean_scrub_stamp":"2024-09-07T03:35:36.220564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:55:02.916343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000497789,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.967847+0000","last_change":"2024-09-07T03:35:58.967790+0000","last_active":"2024-09-07T03:35:58.967847+0000","last_peered":"2024-09-07T03:35:58.967847+0000","last_clean":"2024-09-07T03:35:58.967847+0000","last_became_active":"2024-09-07T03:32:16.126273+0000","last_became_peered":"2024-09-07T03:32:16.126273+0000","last_unstale":"2024-09-07T03:35:58.967847+0000","last_undegraded":"2024-09-07T03:35:58.967847+0000","last_fullsized":"2024-09-07T03:35:58.967847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:58.967697+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:58.967697+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.967697+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:09:06.500393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'91","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:16.279074+0000","last_change":"2024-09-07T03:36:16.278980+0000","last_active":"2024-09-07T03:36:16.279074+0000","last_peered":"2024-09-07T03:36:16.279074+0000","last_clean":"2024-09-07T03:36:16.279074+0000","last_became_active":"2024-09-07T03:32:18.132654+0000","last_became_peered":"2024-09-07T03:32:18.132654+0000","last_unstale":"2024-09-07T03:36:16.279074+0000","last_undegraded":"2024-09-07T03:36:16.279074+0000","last_fullsized":"2024-09-07T03:36:16.279074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-09-07T03:36:16.278851+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-09-07T03:36:16.278851+0000","last_clean_scrub_stamp":"2024-09-07T03:36:16.278851+0000","objects_scrubbed":11,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:17.728496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:35.888915+0000","last_change":"2024-09-07T03:36:35.888915+0000","last_active":"2024-09-07T03:36:35.888915+0000","last_peered":"2024-09-07T03:36:35.888915+0000","last_clean":"2024-09-07T03:36:35.888915+0000","last_became_active":"2024-09-07T03:32:20.140025+0000","last_became_peered":"2024-09-07T03:32:20.140025+0000","last_unstale":"2024-09-07T03:36:35.888915+0000","last_undegraded":"2024-09-07T03:36:35.888915+0000","last_fullsized":"2024-09-07T03:36:35.888915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:35.888822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:35.888822+0000","last_clean_scrub_stamp":"2024-09-07T03:36:35.888822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:46:14.359259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:22.106878+0000","last_change":"2024-09-07T03:36:22.106790+0000","last_active":"2024-09-07T03:36:22.106878+0000","last_peered":"2024-09-07T03:36:22.106878+0000","last_clean":"2024-09-07T03:36:22.106878+0000","last_became_active":"2024-09-07T03:32:22.140043+0000","last_became_peered":"2024-09-07T03:32:22.140043+0000","last_unstale":"2024-09-07T03:36:22.106878+0000","last_undegraded":"2024-09-07T03:36:22.106878+0000","last_fullsized":"2024-09-07T03:36:22.106878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-07T03:36:22.106683+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-07T03:36:22.106683+0000","last_clean_scrub_stamp":"2024-09-07T03:36:22.106683+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:30:20.991652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'12","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.099613+0000","last_change":"2024-09-07T03:35:50.099558+0000","last_active":"2024-09-07T03:35:50.099613+0000","last_peered":"2024-09-07T03:35:50.099613+0000","last_clean":"2024-09-07T03:35:50.099613+0000","last_became_active":"2024-09-07T03:32:14.126663+0000","last_became_peered":"2024-09-07T03:32:14.126663+0000","last_unstale":"2024-09-07T03:35:50.099613+0000","last_undegraded":"2024-09-07T03:35:50.099613+0000","last_fullsized":"2024-09-07T03:35:50.099613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:50.099477+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:50.099477+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.099477+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:27:04.417756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.116893+0000","last_change":"2024-09-07T03:35:40.116801+0000","last_active":"2024-09-07T03:35:40.116893+0000","last_peered":"2024-09-07T03:35:40.116893+0000","last_clean":"2024-09-07T03:35:40.116893+0000","last_became_active":"2024-09-07T03:32:12.133974+0000","last_became_peered":"2024-09-07T03:32:12.133974+0000","last_unstale":"2024-09-07T03:35:40.116893+0000","last_undegraded":"2024-09-07T03:35:40.116893+0000","last_fullsized":"2024-09-07T03:35:40.116893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.116697+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.116697+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.116697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:17:35.362673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.014439+0000","last_change":"2024-09-07T03:35:37.014367+0000","last_active":"2024-09-07T03:35:37.014439+0000","last_peered":"2024-09-07T03:35:37.014439+0000","last_clean":"2024-09-07T03:35:37.014439+0000","last_became_active":"2024-09-07T03:32:02.538249+0000","last_became_peered":"2024-09-07T03:32:02.538249+0000","last_unstale":"2024-09-07T03:35:37.014439+0000","last_undegraded":"2024-09-07T03:35:37.014439+0000","last_fullsized":"2024-09-07T03:35:37.014439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.014282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.014282+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.014282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:46:10.364315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050122600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:14.923849+0000","last_change":"2024-09-07T03:36:14.923764+0000","last_active":"2024-09-07T03:36:14.923849+0000","last_peered":"2024-09-07T03:36:14.923849+0000","last_clean":"2024-09-07T03:36:14.923849+0000","last_became_active":"2024-09-07T03:32:16.121921+0000","last_became_peered":"2024-09-07T03:32:16.121921+0000","last_unstale":"2024-09-07T03:36:14.923849+0000","last_undegraded":"2024-09-07T03:36:14.923849+0000","last_fullsized":"2024-09-07T03:36:14.923849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:14.923684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:14.923684+0000","last_clean_scrub_stamp":"2024-09-07T03:36:14.923684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:32:12.839969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'28","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:17.250488+0000","last_change":"2024-09-07T03:36:17.250399+0000","last_active":"2024-09-07T03:36:17.250488+0000","last_peered":"2024-09-07T03:36:17.250488+0000","last_clean":"2024-09-07T03:36:17.250488+0000","last_became_active":"2024-09-07T03:32:18.133689+0000","last_became_peered":"2024-09-07T03:32:18.133689+0000","last_unstale":"2024-09-07T03:36:17.250488+0000","last_undegraded":"2024-09-07T03:36:17.250488+0000","last_fullsized":"2024-09-07T03:36:17.250488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'28","last_scrub_stamp":"2024-09-07T03:36:17.250292+0000","last_deep_scrub":"36'28","last_deep_scrub_stamp":"2024-09-07T03:36:17.250292+0000","last_clean_scrub_stamp":"2024-09-07T03:36:17.250292+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:10:59.637620+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'286","reported_seq":360,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:22.315137+0000","last_change":"2024-09-07T03:36:22.315071+0000","last_active":"2024-09-07T03:36:22.315137+0000","last_peered":"2024-09-07T03:36:22.315137+0000","last_clean":"2024-09-07T03:36:22.315137+0000","last_became_active":"2024-09-07T03:32:20.143293+0000","last_became_peered":"2024-09-07T03:32:20.143293+0000","last_unstale":"2024-09-07T03:36:22.315137+0000","last_undegraded":"2024-09-07T03:36:22.315137+0000","last_fullsized":"2024-09-07T03:36:22.315137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:22.314983+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:22.314983+0000","last_clean_scrub_stamp":"2024-09-07T03:36:22.314983+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:13:19.657854+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:41.211546+0000","last_change":"2024-09-07T03:36:41.211479+0000","last_active":"2024-09-07T03:36:41.211546+0000","last_peered":"2024-09-07T03:36:41.211546+0000","last_clean":"2024-09-07T03:36:41.211546+0000","last_became_active":"2024-09-07T03:32:22.147036+0000","last_became_peered":"2024-09-07T03:32:22.147036+0000","last_unstale":"2024-09-07T03:36:41.211546+0000","last_undegraded":"2024-09-07T03:36:41.211546+0000","last_fullsized":"2024-09-07T03:36:41.211546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:41.211393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:41.211393+0000","last_clean_scrub_stamp":"2024-09-07T03:36:41.211393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:32:38.628800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'2","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.022271+0000","last_change":"2024-09-07T03:35:58.022185+0000","last_active":"2024-09-07T03:35:58.022271+0000","last_peered":"2024-09-07T03:35:58.022271+0000","last_clean":"2024-09-07T03:35:58.022271+0000","last_became_active":"2024-09-07T03:32:14.126350+0000","last_became_peered":"2024-09-07T03:32:14.126350+0000","last_unstale":"2024-09-07T03:35:58.022271+0000","last_undegraded":"2024-09-07T03:35:58.022271+0000","last_fullsized":"2024-09-07T03:35:58.022271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:58.022069+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:58.022069+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.022069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:50:03.378951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.090453+0000","last_change":"2024-09-07T03:35:37.090380+0000","last_active":"2024-09-07T03:35:37.090453+0000","last_peered":"2024-09-07T03:35:37.090453+0000","last_clean":"2024-09-07T03:35:37.090453+0000","last_became_active":"2024-09-07T03:32:12.130058+0000","last_became_peered":"2024-09-07T03:32:12.130058+0000","last_unstale":"2024-09-07T03:35:37.090453+0000","last_undegraded":"2024-09-07T03:35:37.090453+0000","last_fullsized":"2024-09-07T03:35:37.090453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.090296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.090296+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.090296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:10:30.746067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:35.254202+0000","last_change":"2024-09-07T03:35:35.254145+0000","last_active":"2024-09-07T03:35:35.254202+0000","last_peered":"2024-09-07T03:35:35.254202+0000","last_clean":"2024-09-07T03:35:35.254202+0000","last_became_active":"2024-09-07T03:32:02.535187+0000","last_became_peered":"2024-09-07T03:32:02.535187+0000","last_unstale":"2024-09-07T03:35:35.254202+0000","last_undegraded":"2024-09-07T03:35:35.254202+0000","last_fullsized":"2024-09-07T03:35:35.254202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:35.254064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:35.254064+0000","last_clean_scrub_stamp":"2024-09-07T03:35:35.254064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:11:50.660290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058748000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:12.985077+0000","last_change":"2024-09-07T03:36:12.985015+0000","last_active":"2024-09-07T03:36:12.985077+0000","last_peered":"2024-09-07T03:36:12.985077+0000","last_clean":"2024-09-07T03:36:12.985077+0000","last_became_active":"2024-09-07T03:32:16.117025+0000","last_became_peered":"2024-09-07T03:32:16.117025+0000","last_unstale":"2024-09-07T03:36:12.985077+0000","last_undegraded":"2024-09-07T03:36:12.985077+0000","last_fullsized":"2024-09-07T03:36:12.985077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:12.984919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:12.984919+0000","last_clean_scrub_stamp":"2024-09-07T03:36:12.984919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:18:07.470068+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"36'22","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:19.079059+0000","last_change":"2024-09-07T03:36:19.078996+0000","last_active":"2024-09-07T03:36:19.079059+0000","last_peered":"2024-09-07T03:36:19.079059+0000","last_clean":"2024-09-07T03:36:19.079059+0000","last_became_active":"2024-09-07T03:32:18.124641+0000","last_became_peered":"2024-09-07T03:32:18.124641+0000","last_unstale":"2024-09-07T03:36:19.079059+0000","last_undegraded":"2024-09-07T03:36:19.079059+0000","last_fullsized":"2024-09-07T03:36:19.079059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-07T03:36:19.078898+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-07T03:36:19.078898+0000","last_clean_scrub_stamp":"2024-09-07T03:36:19.078898+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:55:59.458726+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'286","reported_seq":403,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:33.134625+0000","last_change":"2024-09-07T03:36:33.134625+0000","last_active":"2024-09-07T03:36:33.134625+0000","last_peered":"2024-09-07T03:36:33.134625+0000","last_clean":"2024-09-07T03:36:33.134625+0000","last_became_active":"2024-09-07T03:32:20.148768+0000","last_became_peered":"2024-09-07T03:32:20.148768+0000","last_unstale":"2024-09-07T03:36:33.134625+0000","last_undegraded":"2024-09-07T03:36:33.134625+0000","last_fullsized":"2024-09-07T03:36:33.134625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:33.134543+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:33.134543+0000","last_clean_scrub_stamp":"2024-09-07T03:36:33.134543+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:50:42.895478+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:34.423552+0000","last_change":"2024-09-07T03:36:34.423491+0000","last_active":"2024-09-07T03:36:34.423552+0000","last_peered":"2024-09-07T03:36:34.423552+0000","last_clean":"2024-09-07T03:36:34.423552+0000","last_became_active":"2024-09-07T03:32:22.148444+0000","last_became_peered":"2024-09-07T03:32:22.148444+0000","last_unstale":"2024-09-07T03:36:34.423552+0000","last_undegraded":"2024-09-07T03:36:34.423552+0000","last_fullsized":"2024-09-07T03:36:34.423552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-07T03:36:34.423403+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-07T03:36:34.423403+0000","last_clean_scrub_stamp":"2024-09-07T03:36:34.423403+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:02:44.810951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'10","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.115464+0000","last_change":"2024-09-07T03:35:43.115335+0000","last_active":"2024-09-07T03:35:43.115464+0000","last_peered":"2024-09-07T03:35:43.115464+0000","last_clean":"2024-09-07T03:35:43.115464+0000","last_became_active":"2024-09-07T03:32:14.113077+0000","last_became_peered":"2024-09-07T03:32:14.113077+0000","last_unstale":"2024-09-07T03:35:43.115464+0000","last_undegraded":"2024-09-07T03:35:43.115464+0000","last_fullsized":"2024-09-07T03:35:43.115464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:43.115240+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:43.115240+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.115240+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:13:08.170005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.154161+0000","last_change":"2024-09-07T03:35:38.154058+0000","last_active":"2024-09-07T03:35:38.154161+0000","last_peered":"2024-09-07T03:35:38.154161+0000","last_clean":"2024-09-07T03:35:38.154161+0000","last_became_active":"2024-09-07T03:32:12.124398+0000","last_became_peered":"2024-09-07T03:32:12.124398+0000","last_unstale":"2024-09-07T03:35:38.154161+0000","last_undegraded":"2024-09-07T03:35:38.154161+0000","last_fullsized":"2024-09-07T03:35:38.154161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:38.153969+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:38.153969+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.153969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:07:56.086318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.014935+0000","last_change":"2024-09-07T03:35:38.014826+0000","last_active":"2024-09-07T03:35:38.014935+0000","last_peered":"2024-09-07T03:35:38.014935+0000","last_clean":"2024-09-07T03:35:38.014935+0000","last_became_active":"2024-09-07T03:32:02.538333+0000","last_became_peered":"2024-09-07T03:32:02.538333+0000","last_unstale":"2024-09-07T03:35:38.014935+0000","last_undegraded":"2024-09-07T03:35:38.014935+0000","last_fullsized":"2024-09-07T03:35:38.014935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.014735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.014735+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.014735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:41.966197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001158212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:12.054770+0000","last_change":"2024-09-07T03:36:12.054710+0000","last_active":"2024-09-07T03:36:12.054770+0000","last_peered":"2024-09-07T03:36:12.054770+0000","last_clean":"2024-09-07T03:36:12.054770+0000","last_became_active":"2024-09-07T03:32:16.130091+0000","last_became_peered":"2024-09-07T03:32:16.130091+0000","last_unstale":"2024-09-07T03:36:12.054770+0000","last_undegraded":"2024-09-07T03:36:12.054770+0000","last_fullsized":"2024-09-07T03:36:12.054770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:12.054602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:12.054602+0000","last_clean_scrub_stamp":"2024-09-07T03:36:12.054602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:56:00.591114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'106","reported_seq":206,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:22.953746+0000","last_change":"2024-09-07T03:36:22.953679+0000","last_active":"2024-09-07T03:36:22.953746+0000","last_peered":"2024-09-07T03:36:22.953746+0000","last_clean":"2024-09-07T03:36:22.953746+0000","last_became_active":"2024-09-07T03:32:18.132111+0000","last_became_peered":"2024-09-07T03:32:18.132111+0000","last_unstale":"2024-09-07T03:36:22.953746+0000","last_undegraded":"2024-09-07T03:36:22.953746+0000","last_fullsized":"2024-09-07T03:36:22.953746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'106","last_scrub_stamp":"2024-09-07T03:36:22.953573+0000","last_deep_scrub":"36'106","last_deep_scrub_stamp":"2024-09-07T03:36:22.953573+0000","last_clean_scrub_stamp":"2024-09-07T03:36:22.953573+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:19:27.713057+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:30.068205+0000","last_change":"2024-09-07T03:36:30.068136+0000","last_active":"2024-09-07T03:36:30.068205+0000","last_peered":"2024-09-07T03:36:30.068205+0000","last_clean":"2024-09-07T03:36:30.068205+0000","last_became_active":"2024-09-07T03:32:20.143072+0000","last_became_peered":"2024-09-07T03:32:20.143072+0000","last_unstale":"2024-09-07T03:36:30.068205+0000","last_undegraded":"2024-09-07T03:36:30.068205+0000","last_fullsized":"2024-09-07T03:36:30.068205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:30.068003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:30.068003+0000","last_clean_scrub_stamp":"2024-09-07T03:36:30.068003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:59:33.272083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:21.071641+0000","last_change":"2024-09-07T03:36:21.071587+0000","last_active":"2024-09-07T03:36:21.071641+0000","last_peered":"2024-09-07T03:36:21.071641+0000","last_clean":"2024-09-07T03:36:21.071641+0000","last_became_active":"2024-09-07T03:32:22.139150+0000","last_became_peered":"2024-09-07T03:32:22.139150+0000","last_unstale":"2024-09-07T03:36:21.071641+0000","last_undegraded":"2024-09-07T03:36:21.071641+0000","last_fullsized":"2024-09-07T03:36:21.071641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:36:21.071501+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:36:21.071501+0000","last_clean_scrub_stamp":"2024-09-07T03:36:21.071501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:35:22.556347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:23.141765+0000","last_change":"2024-09-07T03:36:23.141699+0000","last_active":"2024-09-07T03:36:23.141765+0000","last_peered":"2024-09-07T03:36:23.141765+0000","last_clean":"2024-09-07T03:36:23.141765+0000","last_became_active":"2024-09-07T03:32:22.138315+0000","last_became_peered":"2024-09-07T03:32:22.138315+0000","last_unstale":"2024-09-07T03:36:23.141765+0000","last_undegraded":"2024-09-07T03:36:23.141765+0000","last_fullsized":"2024-09-07T03:36:23.141765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:23.141621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:23.141621+0000","last_clean_scrub_stamp":"2024-09-07T03:36:23.141621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:17.689589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.048117+0000","last_change":"2024-09-07T03:35:51.048117+0000","last_active":"2024-09-07T03:35:51.048117+0000","last_peered":"2024-09-07T03:35:51.048117+0000","last_clean":"2024-09-07T03:35:51.048117+0000","last_became_active":"2024-09-07T03:32:14.112744+0000","last_became_peered":"2024-09-07T03:32:14.112744+0000","last_unstale":"2024-09-07T03:35:51.048117+0000","last_undegraded":"2024-09-07T03:35:51.048117+0000","last_fullsized":"2024-09-07T03:35:51.048117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:51.047998+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:51.047998+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.047998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:33:02.216514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'5","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.016638+0000","last_change":"2024-09-07T03:35:48.016566+0000","last_active":"2024-09-07T03:35:48.016638+0000","last_peered":"2024-09-07T03:35:48.016638+0000","last_clean":"2024-09-07T03:35:48.016638+0000","last_became_active":"2024-09-07T03:32:12.132715+0000","last_became_peered":"2024-09-07T03:32:12.132715+0000","last_unstale":"2024-09-07T03:35:48.016638+0000","last_undegraded":"2024-09-07T03:35:48.016638+0000","last_fullsized":"2024-09-07T03:35:48.016638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-07T03:35:48.016483+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-07T03:35:48.016483+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.016483+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:57:37.498255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.325231+0000","last_change":"2024-09-07T03:36:10.325231+0000","last_active":"2024-09-07T03:36:10.325231+0000","last_peered":"2024-09-07T03:36:10.325231+0000","last_clean":"2024-09-07T03:36:10.325231+0000","last_became_active":"2024-09-07T03:32:16.124681+0000","last_became_peered":"2024-09-07T03:32:16.124681+0000","last_unstale":"2024-09-07T03:36:10.325231+0000","last_undegraded":"2024-09-07T03:36:10.325231+0000","last_fullsized":"2024-09-07T03:36:10.325231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:10.325144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:10.325144+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.325144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:15:29.763693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'48","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:24.087098+0000","last_change":"2024-09-07T03:36:24.087098+0000","last_active":"2024-09-07T03:36:24.087098+0000","last_peered":"2024-09-07T03:36:24.087098+0000","last_clean":"2024-09-07T03:36:24.087098+0000","last_became_active":"2024-09-07T03:32:18.133844+0000","last_became_peered":"2024-09-07T03:32:18.133844+0000","last_unstale":"2024-09-07T03:36:24.087098+0000","last_undegraded":"2024-09-07T03:36:24.087098+0000","last_fullsized":"2024-09-07T03:36:24.087098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-07T03:36:24.086978+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-07T03:36:24.086978+0000","last_clean_scrub_stamp":"2024-09-07T03:36:24.086978+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:26:12.099454+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:37.192645+0000","last_change":"2024-09-07T03:36:37.192645+0000","last_active":"2024-09-07T03:36:37.192645+0000","last_peered":"2024-09-07T03:36:37.192645+0000","last_clean":"2024-09-07T03:36:37.192645+0000","last_became_active":"2024-09-07T03:32:20.148900+0000","last_became_peered":"2024-09-07T03:32:20.148900+0000","last_unstale":"2024-09-07T03:36:37.192645+0000","last_undegraded":"2024-09-07T03:36:37.192645+0000","last_fullsized":"2024-09-07T03:36:37.192645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:37.192563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:37.192563+0000","last_clean_scrub_stamp":"2024-09-07T03:36:37.192563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:29:21.169494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'5","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:47.962452+0000","last_change":"2024-09-07T03:36:47.962452+0000","last_active":"2024-09-07T03:36:47.962452+0000","last_peered":"2024-09-07T03:36:47.962452+0000","last_clean":"2024-09-07T03:36:47.962452+0000","last_became_active":"2024-09-07T03:32:22.150168+0000","last_became_peered":"2024-09-07T03:32:22.150168+0000","last_unstale":"2024-09-07T03:36:47.962452+0000","last_undegraded":"2024-09-07T03:36:47.962452+0000","last_fullsized":"2024-09-07T03:36:47.962452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-07T03:36:47.962371+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-07T03:36:47.962371+0000","last_clean_scrub_stamp":"2024-09-07T03:36:47.962371+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:17:55.164367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.127751+0000","last_change":"2024-09-07T03:35:55.127642+0000","last_active":"2024-09-07T03:35:55.127751+0000","last_peered":"2024-09-07T03:35:55.127751+0000","last_clean":"2024-09-07T03:35:55.127751+0000","last_became_active":"2024-09-07T03:32:14.111499+0000","last_became_peered":"2024-09-07T03:32:14.111499+0000","last_unstale":"2024-09-07T03:35:55.127751+0000","last_undegraded":"2024-09-07T03:35:55.127751+0000","last_fullsized":"2024-09-07T03:35:55.127751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:35:55.127521+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:35:55.127521+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.127521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:49:35.128217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:38.155440+0000","last_change":"2024-09-07T03:35:38.155440+0000","last_active":"2024-09-07T03:35:38.155440+0000","last_peered":"2024-09-07T03:35:38.155440+0000","last_clean":"2024-09-07T03:35:38.155440+0000","last_became_active":"2024-09-07T03:32:12.128737+0000","last_became_peered":"2024-09-07T03:32:12.128737+0000","last_unstale":"2024-09-07T03:35:38.155440+0000","last_undegraded":"2024-09-07T03:35:38.155440+0000","last_fullsized":"2024-09-07T03:35:38.155440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:38.155355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:38.155355+0000","last_clean_scrub_stamp":"2024-09-07T03:35:38.155355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:27.815801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:15.071850+0000","last_change":"2024-09-07T03:36:15.071850+0000","last_active":"2024-09-07T03:36:15.071850+0000","last_peered":"2024-09-07T03:36:15.071850+0000","last_clean":"2024-09-07T03:36:15.071850+0000","last_became_active":"2024-09-07T03:32:16.125418+0000","last_became_peered":"2024-09-07T03:32:16.125418+0000","last_unstale":"2024-09-07T03:36:15.071850+0000","last_undegraded":"2024-09-07T03:36:15.071850+0000","last_fullsized":"2024-09-07T03:36:15.071850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:15.071766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:15.071766+0000","last_clean_scrub_stamp":"2024-09-07T03:36:15.071766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:31:07.096872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:19.292949+0000","last_change":"2024-09-07T03:36:19.292949+0000","last_active":"2024-09-07T03:36:19.292949+0000","last_peered":"2024-09-07T03:36:19.292949+0000","last_clean":"2024-09-07T03:36:19.292949+0000","last_became_active":"2024-09-07T03:32:18.133770+0000","last_became_peered":"2024-09-07T03:32:18.133770+0000","last_unstale":"2024-09-07T03:36:19.292949+0000","last_undegraded":"2024-09-07T03:36:19.292949+0000","last_fullsized":"2024-09-07T03:36:19.292949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:19.292854+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:19.292854+0000","last_clean_scrub_stamp":"2024-09-07T03:36:19.292854+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:32:29.541797+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:15.147133+0000","last_change":"2024-09-07T03:36:15.147133+0000","last_active":"2024-09-07T03:36:15.147133+0000","last_peered":"2024-09-07T03:36:15.147133+0000","last_clean":"2024-09-07T03:36:15.147133+0000","last_became_active":"2024-09-07T03:32:20.140729+0000","last_became_peered":"2024-09-07T03:32:20.140729+0000","last_unstale":"2024-09-07T03:36:15.147133+0000","last_undegraded":"2024-09-07T03:36:15.147133+0000","last_fullsized":"2024-09-07T03:36:15.147133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:15.147043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:15.147043+0000","last_clean_scrub_stamp":"2024-09-07T03:36:15.147043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:53:36.943636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:35.422193+0000","last_change":"2024-09-07T03:36:35.422193+0000","last_active":"2024-09-07T03:36:35.422193+0000","last_peered":"2024-09-07T03:36:35.422193+0000","last_clean":"2024-09-07T03:36:35.422193+0000","last_became_active":"2024-09-07T03:32:22.147374+0000","last_became_peered":"2024-09-07T03:32:22.147374+0000","last_unstale":"2024-09-07T03:36:35.422193+0000","last_undegraded":"2024-09-07T03:36:35.422193+0000","last_fullsized":"2024-09-07T03:36:35.422193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:35.422108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:35.422108+0000","last_clean_scrub_stamp":"2024-09-07T03:36:35.422108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:39:43.152528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:00.038805+0000","last_change":"2024-09-07T03:36:00.038805+0000","last_active":"2024-09-07T03:36:00.038805+0000","last_peered":"2024-09-07T03:36:00.038805+0000","last_clean":"2024-09-07T03:36:00.038805+0000","last_became_active":"2024-09-07T03:32:14.123172+0000","last_became_peered":"2024-09-07T03:32:14.123172+0000","last_unstale":"2024-09-07T03:36:00.038805+0000","last_undegraded":"2024-09-07T03:36:00.038805+0000","last_fullsized":"2024-09-07T03:36:00.038805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:00.038722+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:00.038722+0000","last_clean_scrub_stamp":"2024-09-07T03:36:00.038722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:18:27.231373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.019482+0000","last_change":"2024-09-07T03:35:49.019482+0000","last_active":"2024-09-07T03:35:49.019482+0000","last_peered":"2024-09-07T03:35:49.019482+0000","last_clean":"2024-09-07T03:35:49.019482+0000","last_became_active":"2024-09-07T03:32:12.124180+0000","last_became_peered":"2024-09-07T03:32:12.124180+0000","last_unstale":"2024-09-07T03:35:49.019482+0000","last_undegraded":"2024-09-07T03:35:49.019482+0000","last_fullsized":"2024-09-07T03:35:49.019482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:49.019399+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:49.019399+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.019399+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:34:20.661216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:16.942491+0000","last_change":"2024-09-07T03:36:16.942491+0000","last_active":"2024-09-07T03:36:16.942491+0000","last_peered":"2024-09-07T03:36:16.942491+0000","last_clean":"2024-09-07T03:36:16.942491+0000","last_became_active":"2024-09-07T03:32:16.123695+0000","last_became_peered":"2024-09-07T03:32:16.123695+0000","last_unstale":"2024-09-07T03:36:16.942491+0000","last_undegraded":"2024-09-07T03:36:16.942491+0000","last_fullsized":"2024-09-07T03:36:16.942491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:16.942419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:16.942419+0000","last_clean_scrub_stamp":"2024-09-07T03:36:16.942419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:32:06.820376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'50","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:25.080440+0000","last_change":"2024-09-07T03:36:25.080440+0000","last_active":"2024-09-07T03:36:25.080440+0000","last_peered":"2024-09-07T03:36:25.080440+0000","last_clean":"2024-09-07T03:36:25.080440+0000","last_became_active":"2024-09-07T03:32:18.129502+0000","last_became_peered":"2024-09-07T03:32:18.129502+0000","last_unstale":"2024-09-07T03:36:25.080440+0000","last_undegraded":"2024-09-07T03:36:25.080440+0000","last_fullsized":"2024-09-07T03:36:25.080440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'50","last_scrub_stamp":"2024-09-07T03:36:25.080344+0000","last_deep_scrub":"36'50","last_deep_scrub_stamp":"2024-09-07T03:36:25.080344+0000","last_clean_scrub_stamp":"2024-09-07T03:36:25.080344+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:46:01.629331+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:25.323223+0000","last_change":"2024-09-07T03:36:25.323223+0000","last_active":"2024-09-07T03:36:25.323223+0000","last_peered":"2024-09-07T03:36:25.323223+0000","last_clean":"2024-09-07T03:36:25.323223+0000","last_became_active":"2024-09-07T03:32:20.147588+0000","last_became_peered":"2024-09-07T03:32:20.147588+0000","last_unstale":"2024-09-07T03:36:25.323223+0000","last_undegraded":"2024-09-07T03:36:25.323223+0000","last_fullsized":"2024-09-07T03:36:25.323223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:25.323139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:25.323139+0000","last_clean_scrub_stamp":"2024-09-07T03:36:25.323139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:36:51.058908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:46.048857+0000","last_change":"2024-09-07T03:36:46.048857+0000","last_active":"2024-09-07T03:36:46.048857+0000","last_peered":"2024-09-07T03:36:46.048857+0000","last_clean":"2024-09-07T03:36:46.048857+0000","last_became_active":"2024-09-07T03:32:22.146106+0000","last_became_peered":"2024-09-07T03:32:22.146106+0000","last_unstale":"2024-09-07T03:36:46.048857+0000","last_undegraded":"2024-09-07T03:36:46.048857+0000","last_fullsized":"2024-09-07T03:36:46.048857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:46.048779+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:46.048779+0000","last_clean_scrub_stamp":"2024-09-07T03:36:46.048779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:11:00.892964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.081325+0000","last_change":"2024-09-07T03:36:01.081325+0000","last_active":"2024-09-07T03:36:01.081325+0000","last_peered":"2024-09-07T03:36:01.081325+0000","last_clean":"2024-09-07T03:36:01.081325+0000","last_became_active":"2024-09-07T03:32:14.127334+0000","last_became_peered":"2024-09-07T03:32:14.127334+0000","last_unstale":"2024-09-07T03:36:01.081325+0000","last_undegraded":"2024-09-07T03:36:01.081325+0000","last_fullsized":"2024-09-07T03:36:01.081325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:01.081243+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:01.081243+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.081243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:05:10.149352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.177120+0000","last_change":"2024-09-07T03:35:45.177120+0000","last_active":"2024-09-07T03:35:45.177120+0000","last_peered":"2024-09-07T03:35:45.177120+0000","last_clean":"2024-09-07T03:35:45.177120+0000","last_became_active":"2024-09-07T03:32:12.134823+0000","last_became_peered":"2024-09-07T03:32:12.134823+0000","last_unstale":"2024-09-07T03:35:45.177120+0000","last_undegraded":"2024-09-07T03:35:45.177120+0000","last_fullsized":"2024-09-07T03:35:45.177120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:45.177031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:45.177031+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.177031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:35:01.639248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:14.055779+0000","last_change":"2024-09-07T03:36:14.055779+0000","last_active":"2024-09-07T03:36:14.055779+0000","last_peered":"2024-09-07T03:36:14.055779+0000","last_clean":"2024-09-07T03:36:14.055779+0000","last_became_active":"2024-09-07T03:32:16.127615+0000","last_became_peered":"2024-09-07T03:32:16.127615+0000","last_unstale":"2024-09-07T03:36:14.055779+0000","last_undegraded":"2024-09-07T03:36:14.055779+0000","last_fullsized":"2024-09-07T03:36:14.055779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:14.055698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:14.055698+0000","last_clean_scrub_stamp":"2024-09-07T03:36:14.055698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:16:01.680097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'39","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:30.834203+0000","last_change":"2024-09-07T03:36:30.834203+0000","last_active":"2024-09-07T03:36:30.834203+0000","last_peered":"2024-09-07T03:36:30.834203+0000","last_clean":"2024-09-07T03:36:30.834203+0000","last_became_active":"2024-09-07T03:32:18.129919+0000","last_became_peered":"2024-09-07T03:32:18.129919+0000","last_unstale":"2024-09-07T03:36:30.834203+0000","last_undegraded":"2024-09-07T03:36:30.834203+0000","last_fullsized":"2024-09-07T03:36:30.834203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-07T03:36:30.834114+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-07T03:36:30.834114+0000","last_clean_scrub_stamp":"2024-09-07T03:36:30.834114+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:22:40.781567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:14.188215+0000","last_change":"2024-09-07T03:36:14.188215+0000","last_active":"2024-09-07T03:36:14.188215+0000","last_peered":"2024-09-07T03:36:14.188215+0000","last_clean":"2024-09-07T03:36:14.188215+0000","last_became_active":"2024-09-07T03:32:20.143640+0000","last_became_peered":"2024-09-07T03:32:20.143640+0000","last_unstale":"2024-09-07T03:36:14.188215+0000","last_undegraded":"2024-09-07T03:36:14.188215+0000","last_fullsized":"2024-09-07T03:36:14.188215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:14.188130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:14.188130+0000","last_clean_scrub_stamp":"2024-09-07T03:36:14.188130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:19:13.420877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.013291+0000","last_change":"2024-09-07T03:36:03.013164+0000","last_active":"2024-09-07T03:36:03.013291+0000","last_peered":"2024-09-07T03:36:03.013291+0000","last_clean":"2024-09-07T03:36:03.013291+0000","last_became_active":"2024-09-07T03:32:14.123017+0000","last_became_peered":"2024-09-07T03:32:14.123017+0000","last_unstale":"2024-09-07T03:36:03.013291+0000","last_undegraded":"2024-09-07T03:36:03.013291+0000","last_fullsized":"2024-09-07T03:36:03.013291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:36:03.013063+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:36:03.013063+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.013063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:29:49.767075+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.017539+0000","last_change":"2024-09-07T03:35:41.017539+0000","last_active":"2024-09-07T03:35:41.017539+0000","last_peered":"2024-09-07T03:35:41.017539+0000","last_clean":"2024-09-07T03:35:41.017539+0000","last_became_active":"2024-09-07T03:32:12.143142+0000","last_became_peered":"2024-09-07T03:32:12.143142+0000","last_unstale":"2024-09-07T03:35:41.017539+0000","last_undegraded":"2024-09-07T03:35:41.017539+0000","last_fullsized":"2024-09-07T03:35:41.017539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.017443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.017443+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.017443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:02:36.762725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:15.278202+0000","last_change":"2024-09-07T03:36:15.278119+0000","last_active":"2024-09-07T03:36:15.278202+0000","last_peered":"2024-09-07T03:36:15.278202+0000","last_clean":"2024-09-07T03:36:15.278202+0000","last_became_active":"2024-09-07T03:32:16.124188+0000","last_became_peered":"2024-09-07T03:32:16.124188+0000","last_unstale":"2024-09-07T03:36:15.278202+0000","last_undegraded":"2024-09-07T03:36:15.278202+0000","last_fullsized":"2024-09-07T03:36:15.278202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:15.278007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:15.278007+0000","last_clean_scrub_stamp":"2024-09-07T03:36:15.278007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:45:30.630070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'72","reported_seq":151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:21.288715+0000","last_change":"2024-09-07T03:36:21.288715+0000","last_active":"2024-09-07T03:36:21.288715+0000","last_peered":"2024-09-07T03:36:21.288715+0000","last_clean":"2024-09-07T03:36:21.288715+0000","last_became_active":"2024-09-07T03:32:18.126946+0000","last_became_peered":"2024-09-07T03:32:18.126946+0000","last_unstale":"2024-09-07T03:36:21.288715+0000","last_undegraded":"2024-09-07T03:36:21.288715+0000","last_fullsized":"2024-09-07T03:36:21.288715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'72","last_scrub_stamp":"2024-09-07T03:36:21.288615+0000","last_deep_scrub":"36'72","last_deep_scrub_stamp":"2024-09-07T03:36:21.288615+0000","last_clean_scrub_stamp":"2024-09-07T03:36:21.288615+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:45:16.800956+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:17.109102+0000","last_change":"2024-09-07T03:36:17.109102+0000","last_active":"2024-09-07T03:36:17.109102+0000","last_peered":"2024-09-07T03:36:17.109102+0000","last_clean":"2024-09-07T03:36:17.109102+0000","last_became_active":"2024-09-07T03:32:20.144417+0000","last_became_peered":"2024-09-07T03:32:20.144417+0000","last_unstale":"2024-09-07T03:36:17.109102+0000","last_undegraded":"2024-09-07T03:36:17.109102+0000","last_fullsized":"2024-09-07T03:36:17.109102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:17.109007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:17.109007+0000","last_clean_scrub_stamp":"2024-09-07T03:36:17.109007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:33:45.335295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'16","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:45.092180+0000","last_change":"2024-09-07T03:36:45.092180+0000","last_active":"2024-09-07T03:36:45.092180+0000","last_peered":"2024-09-07T03:36:45.092180+0000","last_clean":"2024-09-07T03:36:45.092180+0000","last_became_active":"2024-09-07T03:32:22.149442+0000","last_became_peered":"2024-09-07T03:32:22.149442+0000","last_unstale":"2024-09-07T03:36:45.092180+0000","last_undegraded":"2024-09-07T03:36:45.092180+0000","last_fullsized":"2024-09-07T03:36:45.092180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:36:45.092079+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:36:45.092079+0000","last_clean_scrub_stamp":"2024-09-07T03:36:45.092079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:40:13.604180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:56.171719+0000","last_change":"2024-09-07T03:35:56.171662+0000","last_active":"2024-09-07T03:35:56.171719+0000","last_peered":"2024-09-07T03:35:56.171719+0000","last_clean":"2024-09-07T03:35:56.171719+0000","last_became_active":"2024-09-07T03:32:14.111795+0000","last_became_peered":"2024-09-07T03:32:14.111795+0000","last_unstale":"2024-09-07T03:35:56.171719+0000","last_undegraded":"2024-09-07T03:35:56.171719+0000","last_fullsized":"2024-09-07T03:35:56.171719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:56.171585+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:56.171585+0000","last_clean_scrub_stamp":"2024-09-07T03:35:56.171585+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:34:20.317653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.150563+0000","last_change":"2024-09-07T03:35:41.150563+0000","last_active":"2024-09-07T03:35:41.150563+0000","last_peered":"2024-09-07T03:35:41.150563+0000","last_clean":"2024-09-07T03:35:41.150563+0000","last_became_active":"2024-09-07T03:32:12.136258+0000","last_became_peered":"2024-09-07T03:32:12.136258+0000","last_unstale":"2024-09-07T03:35:41.150563+0000","last_undegraded":"2024-09-07T03:35:41.150563+0000","last_fullsized":"2024-09-07T03:35:41.150563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.150478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.150478+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.150478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:42:58.517403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:23.910441+0000","last_change":"2024-09-07T03:36:23.910382+0000","last_active":"2024-09-07T03:36:23.910441+0000","last_peered":"2024-09-07T03:36:23.910441+0000","last_clean":"2024-09-07T03:36:23.910441+0000","last_became_active":"2024-09-07T03:32:16.122316+0000","last_became_peered":"2024-09-07T03:32:16.122316+0000","last_unstale":"2024-09-07T03:36:23.910441+0000","last_undegraded":"2024-09-07T03:36:23.910441+0000","last_fullsized":"2024-09-07T03:36:23.910441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:23.910266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:23.910266+0000","last_clean_scrub_stamp":"2024-09-07T03:36:23.910266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:08:18.747248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:34.861233+0000","last_change":"2024-09-07T03:36:34.861233+0000","last_active":"2024-09-07T03:36:34.861233+0000","last_peered":"2024-09-07T03:36:34.861233+0000","last_clean":"2024-09-07T03:36:34.861233+0000","last_became_active":"2024-09-07T03:32:18.132084+0000","last_became_peered":"2024-09-07T03:32:18.132084+0000","last_unstale":"2024-09-07T03:36:34.861233+0000","last_undegraded":"2024-09-07T03:36:34.861233+0000","last_fullsized":"2024-09-07T03:36:34.861233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-07T03:36:34.861135+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-07T03:36:34.861135+0000","last_clean_scrub_stamp":"2024-09-07T03:36:34.861135+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:47:04.535230+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:26.371428+0000","last_change":"2024-09-07T03:36:26.371428+0000","last_active":"2024-09-07T03:36:26.371428+0000","last_peered":"2024-09-07T03:36:26.371428+0000","last_clean":"2024-09-07T03:36:26.371428+0000","last_became_active":"2024-09-07T03:32:20.143377+0000","last_became_peered":"2024-09-07T03:32:20.143377+0000","last_unstale":"2024-09-07T03:36:26.371428+0000","last_undegraded":"2024-09-07T03:36:26.371428+0000","last_fullsized":"2024-09-07T03:36:26.371428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:26.371344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:26.371344+0000","last_clean_scrub_stamp":"2024-09-07T03:36:26.371344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:28:08.210983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:46.895669+0000","last_change":"2024-09-07T03:36:46.895669+0000","last_active":"2024-09-07T03:36:46.895669+0000","last_peered":"2024-09-07T03:36:46.895669+0000","last_clean":"2024-09-07T03:36:46.895669+0000","last_became_active":"2024-09-07T03:32:22.146237+0000","last_became_peered":"2024-09-07T03:32:22.146237+0000","last_unstale":"2024-09-07T03:36:46.895669+0000","last_undegraded":"2024-09-07T03:36:46.895669+0000","last_fullsized":"2024-09-07T03:36:46.895669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:46.895569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:46.895569+0000","last_clean_scrub_stamp":"2024-09-07T03:36:46.895569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:55:08.915769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.068178+0000","last_change":"2024-09-07T03:36:07.068178+0000","last_active":"2024-09-07T03:36:07.068178+0000","last_peered":"2024-09-07T03:36:07.068178+0000","last_clean":"2024-09-07T03:36:07.068178+0000","last_became_active":"2024-09-07T03:32:14.125706+0000","last_became_peered":"2024-09-07T03:32:14.125706+0000","last_unstale":"2024-09-07T03:36:07.068178+0000","last_undegraded":"2024-09-07T03:36:07.068178+0000","last_fullsized":"2024-09-07T03:36:07.068178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:07.068080+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:07.068080+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.068080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:12:24.604557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:51.051788+0000","last_change":"2024-09-07T03:35:51.051788+0000","last_active":"2024-09-07T03:35:51.051788+0000","last_peered":"2024-09-07T03:35:51.051788+0000","last_clean":"2024-09-07T03:35:51.051788+0000","last_became_active":"2024-09-07T03:32:12.125261+0000","last_became_peered":"2024-09-07T03:32:12.125261+0000","last_unstale":"2024-09-07T03:35:51.051788+0000","last_undegraded":"2024-09-07T03:35:51.051788+0000","last_fullsized":"2024-09-07T03:35:51.051788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:51.051700+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:51.051700+0000","last_clean_scrub_stamp":"2024-09-07T03:35:51.051700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:26:24.675430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:20.916902+0000","last_change":"2024-09-07T03:36:20.916902+0000","last_active":"2024-09-07T03:36:20.916902+0000","last_peered":"2024-09-07T03:36:20.916902+0000","last_clean":"2024-09-07T03:36:20.916902+0000","last_became_active":"2024-09-07T03:32:16.124314+0000","last_became_peered":"2024-09-07T03:32:16.124314+0000","last_unstale":"2024-09-07T03:36:20.916902+0000","last_undegraded":"2024-09-07T03:36:20.916902+0000","last_fullsized":"2024-09-07T03:36:20.916902+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:20.916802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:20.916802+0000","last_clean_scrub_stamp":"2024-09-07T03:36:20.916802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:42:01.035736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'47","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:29.113352+0000","last_change":"2024-09-07T03:36:29.113286+0000","last_active":"2024-09-07T03:36:29.113352+0000","last_peered":"2024-09-07T03:36:29.113352+0000","last_clean":"2024-09-07T03:36:29.113352+0000","last_became_active":"2024-09-07T03:32:18.129700+0000","last_became_peered":"2024-09-07T03:32:18.129700+0000","last_unstale":"2024-09-07T03:36:29.113352+0000","last_undegraded":"2024-09-07T03:36:29.113352+0000","last_fullsized":"2024-09-07T03:36:29.113352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-07T03:36:29.113197+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-07T03:36:29.113197+0000","last_clean_scrub_stamp":"2024-09-07T03:36:29.113197+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:33:06.746327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:27.344920+0000","last_change":"2024-09-07T03:36:27.344920+0000","last_active":"2024-09-07T03:36:27.344920+0000","last_peered":"2024-09-07T03:36:27.344920+0000","last_clean":"2024-09-07T03:36:27.344920+0000","last_became_active":"2024-09-07T03:32:20.142695+0000","last_became_peered":"2024-09-07T03:32:20.142695+0000","last_unstale":"2024-09-07T03:36:27.344920+0000","last_undegraded":"2024-09-07T03:36:27.344920+0000","last_fullsized":"2024-09-07T03:36:27.344920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:27.344821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:27.344821+0000","last_clean_scrub_stamp":"2024-09-07T03:36:27.344821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:52:24.825492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:45.884203+0000","last_change":"2024-09-07T03:36:45.884203+0000","last_active":"2024-09-07T03:36:45.884203+0000","last_peered":"2024-09-07T03:36:45.884203+0000","last_clean":"2024-09-07T03:36:45.884203+0000","last_became_active":"2024-09-07T03:32:22.143053+0000","last_became_peered":"2024-09-07T03:32:22.143053+0000","last_unstale":"2024-09-07T03:36:45.884203+0000","last_undegraded":"2024-09-07T03:36:45.884203+0000","last_fullsized":"2024-09-07T03:36:45.884203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:36:45.884068+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:36:45.884068+0000","last_clean_scrub_stamp":"2024-09-07T03:36:45.884068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:23:37.862125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:49.116308+0000","last_change":"2024-09-07T03:35:49.116308+0000","last_active":"2024-09-07T03:35:49.116308+0000","last_peered":"2024-09-07T03:35:49.116308+0000","last_clean":"2024-09-07T03:35:49.116308+0000","last_became_active":"2024-09-07T03:32:14.117608+0000","last_became_peered":"2024-09-07T03:32:14.117608+0000","last_unstale":"2024-09-07T03:35:49.116308+0000","last_undegraded":"2024-09-07T03:35:49.116308+0000","last_fullsized":"2024-09-07T03:35:49.116308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:49.116226+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:49.116226+0000","last_clean_scrub_stamp":"2024-09-07T03:35:49.116226+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:01:26.244476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.931398+0000","last_change":"2024-09-07T03:35:42.931398+0000","last_active":"2024-09-07T03:35:42.931398+0000","last_peered":"2024-09-07T03:35:42.931398+0000","last_clean":"2024-09-07T03:35:42.931398+0000","last_became_active":"2024-09-07T03:32:12.135523+0000","last_became_peered":"2024-09-07T03:32:12.135523+0000","last_unstale":"2024-09-07T03:35:42.931398+0000","last_undegraded":"2024-09-07T03:35:42.931398+0000","last_fullsized":"2024-09-07T03:35:42.931398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:42.931312+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:42.931312+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.931312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:01:46.882774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.074094+0000","last_change":"2024-09-07T03:36:07.074094+0000","last_active":"2024-09-07T03:36:07.074094+0000","last_peered":"2024-09-07T03:36:07.074094+0000","last_clean":"2024-09-07T03:36:07.074094+0000","last_became_active":"2024-09-07T03:32:50.279004+0000","last_became_peered":"2024-09-07T03:32:50.279004+0000","last_unstale":"2024-09-07T03:36:07.074094+0000","last_undegraded":"2024-09-07T03:36:07.074094+0000","last_fullsized":"2024-09-07T03:36:07.074094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:07.074012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:07.074012+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.074012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:24.180913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1e","version":"36'24","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:27.113198+0000","last_change":"2024-09-07T03:36:27.113198+0000","last_active":"2024-09-07T03:36:27.113198+0000","last_peered":"2024-09-07T03:36:27.113198+0000","last_clean":"2024-09-07T03:36:27.113198+0000","last_became_active":"2024-09-07T03:32:18.127007+0000","last_became_peered":"2024-09-07T03:32:18.127007+0000","last_unstale":"2024-09-07T03:36:27.113198+0000","last_undegraded":"2024-09-07T03:36:27.113198+0000","last_fullsized":"2024-09-07T03:36:27.113198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-07T03:36:27.113110+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-07T03:36:27.113110+0000","last_clean_scrub_stamp":"2024-09-07T03:36:27.113110+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:21:54.856422+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'286","reported_seq":380,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:43.918452+0000","last_change":"2024-09-07T03:36:43.918452+0000","last_active":"2024-09-07T03:36:43.918452+0000","last_peered":"2024-09-07T03:36:43.918452+0000","last_clean":"2024-09-07T03:36:43.918452+0000","last_became_active":"2024-09-07T03:32:20.146738+0000","last_became_peered":"2024-09-07T03:32:20.146738+0000","last_unstale":"2024-09-07T03:36:43.918452+0000","last_undegraded":"2024-09-07T03:36:43.918452+0000","last_fullsized":"2024-09-07T03:36:43.918452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-07T03:36:43.918344+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-07T03:36:43.918344+0000","last_clean_scrub_stamp":"2024-09-07T03:36:43.918344+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:52:58.234288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:44.917511+0000","last_change":"2024-09-07T03:36:44.917511+0000","last_active":"2024-09-07T03:36:44.917511+0000","last_peered":"2024-09-07T03:36:44.917511+0000","last_clean":"2024-09-07T03:36:44.917511+0000","last_became_active":"2024-09-07T03:32:22.150886+0000","last_became_peered":"2024-09-07T03:32:22.150886+0000","last_unstale":"2024-09-07T03:36:44.917511+0000","last_undegraded":"2024-09-07T03:36:44.917511+0000","last_fullsized":"2024-09-07T03:36:44.917511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:44.917396+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:44.917396+0000","last_clean_scrub_stamp":"2024-09-07T03:36:44.917396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:19:48.549326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'18","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.057071+0000","last_change":"2024-09-07T03:35:53.057071+0000","last_active":"2024-09-07T03:35:53.057071+0000","last_peered":"2024-09-07T03:35:53.057071+0000","last_clean":"2024-09-07T03:35:53.057071+0000","last_became_active":"2024-09-07T03:32:14.126901+0000","last_became_peered":"2024-09-07T03:32:14.126901+0000","last_unstale":"2024-09-07T03:35:53.057071+0000","last_undegraded":"2024-09-07T03:35:53.057071+0000","last_fullsized":"2024-09-07T03:35:53.057071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-07T03:35:53.056989+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-07T03:35:53.056989+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.056989+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:48:19.164483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.209553+0000","last_change":"2024-09-07T03:35:44.209553+0000","last_active":"2024-09-07T03:35:44.209553+0000","last_peered":"2024-09-07T03:35:44.209553+0000","last_clean":"2024-09-07T03:35:44.209553+0000","last_became_active":"2024-09-07T03:32:12.133876+0000","last_became_peered":"2024-09-07T03:32:12.133876+0000","last_unstale":"2024-09-07T03:35:44.209553+0000","last_undegraded":"2024-09-07T03:35:44.209553+0000","last_fullsized":"2024-09-07T03:35:44.209553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.209464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.209464+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.209464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:02.025918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"36'2","reported_seq":230,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:14.257125+0000","last_change":"2024-09-07T03:36:14.257125+0000","last_active":"2024-09-07T03:36:14.257125+0000","last_peered":"2024-09-07T03:36:14.257125+0000","last_clean":"2024-09-07T03:36:14.257125+0000","last_became_active":"2024-09-07T03:32:16.120952+0000","last_became_peered":"2024-09-07T03:32:16.120952+0000","last_unstale":"2024-09-07T03:36:14.257125+0000","last_undegraded":"2024-09-07T03:36:14.257125+0000","last_fullsized":"2024-09-07T03:36:14.257125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:14.257038+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:14.257038+0000","last_clean_scrub_stamp":"2024-09-07T03:36:14.257038+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:28:16.827044+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'77","reported_seq":159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:32.880544+0000","last_change":"2024-09-07T03:36:32.880544+0000","last_active":"2024-09-07T03:36:32.880544+0000","last_peered":"2024-09-07T03:36:32.880544+0000","last_clean":"2024-09-07T03:36:32.880544+0000","last_became_active":"2024-09-07T03:32:18.133705+0000","last_became_peered":"2024-09-07T03:32:18.133705+0000","last_unstale":"2024-09-07T03:36:32.880544+0000","last_undegraded":"2024-09-07T03:36:32.880544+0000","last_fullsized":"2024-09-07T03:36:32.880544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'77","last_scrub_stamp":"2024-09-07T03:36:32.880429+0000","last_deep_scrub":"36'77","last_deep_scrub_stamp":"2024-09-07T03:36:32.880429+0000","last_clean_scrub_stamp":"2024-09-07T03:36:32.880429+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:54.213968+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:39.145007+0000","last_change":"2024-09-07T03:36:39.145007+0000","last_active":"2024-09-07T03:36:39.145007+0000","last_peered":"2024-09-07T03:36:39.145007+0000","last_clean":"2024-09-07T03:36:39.145007+0000","last_became_active":"2024-09-07T03:32:20.135211+0000","last_became_peered":"2024-09-07T03:32:20.135211+0000","last_unstale":"2024-09-07T03:36:39.145007+0000","last_undegraded":"2024-09-07T03:36:39.145007+0000","last_fullsized":"2024-09-07T03:36:39.145007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:39.144897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:39.144897+0000","last_clean_scrub_stamp":"2024-09-07T03:36:39.144897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:56:37.027403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:48.851235+0000","last_change":"2024-09-07T03:36:48.851235+0000","last_active":"2024-09-07T03:36:48.851235+0000","last_peered":"2024-09-07T03:36:48.851235+0000","last_clean":"2024-09-07T03:36:48.851235+0000","last_became_active":"2024-09-07T03:32:22.141533+0000","last_became_peered":"2024-09-07T03:32:22.141533+0000","last_unstale":"2024-09-07T03:36:48.851235+0000","last_undegraded":"2024-09-07T03:36:48.851235+0000","last_fullsized":"2024-09-07T03:36:48.851235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:48.851120+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:48.851120+0000","last_clean_scrub_stamp":"2024-09-07T03:36:48.851120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:32:08.802951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'20","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.044148+0000","last_change":"2024-09-07T03:36:05.044148+0000","last_active":"2024-09-07T03:36:05.044148+0000","last_peered":"2024-09-07T03:36:05.044148+0000","last_clean":"2024-09-07T03:36:05.044148+0000","last_became_active":"2024-09-07T03:32:14.122929+0000","last_became_peered":"2024-09-07T03:32:14.122929+0000","last_unstale":"2024-09-07T03:36:05.044148+0000","last_undegraded":"2024-09-07T03:36:05.044148+0000","last_fullsized":"2024-09-07T03:36:05.044148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-07T03:36:05.044058+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-07T03:36:05.044058+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.044058+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:46:49.195578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.018984+0000","last_change":"2024-09-07T03:35:50.018984+0000","last_active":"2024-09-07T03:35:50.018984+0000","last_peered":"2024-09-07T03:35:50.018984+0000","last_clean":"2024-09-07T03:35:50.018984+0000","last_became_active":"2024-09-07T03:32:12.124610+0000","last_became_peered":"2024-09-07T03:32:12.124610+0000","last_unstale":"2024-09-07T03:35:50.018984+0000","last_undegraded":"2024-09-07T03:35:50.018984+0000","last_fullsized":"2024-09-07T03:35:50.018984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:50.018888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:50.018888+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.018888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:44:55.010719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:19.903030+0000","last_change":"2024-09-07T03:36:19.903030+0000","last_active":"2024-09-07T03:36:19.903030+0000","last_peered":"2024-09-07T03:36:19.903030+0000","last_clean":"2024-09-07T03:36:19.903030+0000","last_became_active":"2024-09-07T03:32:16.116296+0000","last_became_peered":"2024-09-07T03:32:16.116296+0000","last_unstale":"2024-09-07T03:36:19.903030+0000","last_undegraded":"2024-09-07T03:36:19.903030+0000","last_fullsized":"2024-09-07T03:36:19.903030+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:19.902946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:19.902946+0000","last_clean_scrub_stamp":"2024-09-07T03:36:19.902946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:48:25.481196+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'45","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.105865+0000","last_change":"2024-09-07T03:36:09.105865+0000","last_active":"2024-09-07T03:36:09.105865+0000","last_peered":"2024-09-07T03:36:09.105865+0000","last_clean":"2024-09-07T03:36:09.105865+0000","last_became_active":"2024-09-07T03:32:18.134533+0000","last_became_peered":"2024-09-07T03:32:18.134533+0000","last_unstale":"2024-09-07T03:36:09.105865+0000","last_undegraded":"2024-09-07T03:36:09.105865+0000","last_fullsized":"2024-09-07T03:36:09.105865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-07T03:36:09.105777+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-07T03:36:09.105777+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.105777+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:52:38.222360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:41.921956+0000","last_change":"2024-09-07T03:36:41.921956+0000","last_active":"2024-09-07T03:36:41.921956+0000","last_peered":"2024-09-07T03:36:41.921956+0000","last_clean":"2024-09-07T03:36:41.921956+0000","last_became_active":"2024-09-07T03:32:20.146631+0000","last_became_peered":"2024-09-07T03:32:20.146631+0000","last_unstale":"2024-09-07T03:36:41.921956+0000","last_undegraded":"2024-09-07T03:36:41.921956+0000","last_fullsized":"2024-09-07T03:36:41.921956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:41.921823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:41.921823+0000","last_clean_scrub_stamp":"2024-09-07T03:36:41.921823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:57:13.138497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:47.009705+0000","last_change":"2024-09-07T03:36:47.009705+0000","last_active":"2024-09-07T03:36:47.009705+0000","last_peered":"2024-09-07T03:36:47.009705+0000","last_clean":"2024-09-07T03:36:47.009705+0000","last_became_active":"2024-09-07T03:32:22.151709+0000","last_became_peered":"2024-09-07T03:32:22.151709+0000","last_unstale":"2024-09-07T03:36:47.009705+0000","last_undegraded":"2024-09-07T03:36:47.009705+0000","last_fullsized":"2024-09-07T03:36:47.009705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:47.009618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:47.009618+0000","last_clean_scrub_stamp":"2024-09-07T03:36:47.009618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:02:41.256087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.091041+0000","last_change":"2024-09-07T03:36:05.091041+0000","last_active":"2024-09-07T03:36:05.091041+0000","last_peered":"2024-09-07T03:36:05.091041+0000","last_clean":"2024-09-07T03:36:05.091041+0000","last_became_active":"2024-09-07T03:32:14.127451+0000","last_became_peered":"2024-09-07T03:32:14.127451+0000","last_unstale":"2024-09-07T03:36:05.091041+0000","last_undegraded":"2024-09-07T03:36:05.091041+0000","last_fullsized":"2024-09-07T03:36:05.091041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:05.090946+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:05.090946+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.090946+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:00:25.001951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:41.970246+0000","last_change":"2024-09-07T03:35:41.970187+0000","last_active":"2024-09-07T03:35:41.970246+0000","last_peered":"2024-09-07T03:35:41.970246+0000","last_clean":"2024-09-07T03:35:41.970246+0000","last_became_active":"2024-09-07T03:32:12.124552+0000","last_became_peered":"2024-09-07T03:32:12.124552+0000","last_unstale":"2024-09-07T03:35:41.970246+0000","last_undegraded":"2024-09-07T03:35:41.970246+0000","last_fullsized":"2024-09-07T03:35:41.970246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:41.970083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:41.970083+0000","last_clean_scrub_stamp":"2024-09-07T03:35:41.970083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:38:37.531358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:13.303314+0000","last_change":"2024-09-07T03:36:13.303314+0000","last_active":"2024-09-07T03:36:13.303314+0000","last_peered":"2024-09-07T03:36:13.303314+0000","last_clean":"2024-09-07T03:36:13.303314+0000","last_became_active":"2024-09-07T03:32:16.123423+0000","last_became_peered":"2024-09-07T03:32:16.123423+0000","last_unstale":"2024-09-07T03:36:13.303314+0000","last_undegraded":"2024-09-07T03:36:13.303314+0000","last_fullsized":"2024-09-07T03:36:13.303314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:13.303226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:13.303226+0000","last_clean_scrub_stamp":"2024-09-07T03:36:13.303226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:43:46.932826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'38","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:28.120261+0000","last_change":"2024-09-07T03:36:28.120261+0000","last_active":"2024-09-07T03:36:28.120261+0000","last_peered":"2024-09-07T03:36:28.120261+0000","last_clean":"2024-09-07T03:36:28.120261+0000","last_became_active":"2024-09-07T03:32:18.128812+0000","last_became_peered":"2024-09-07T03:32:18.128812+0000","last_unstale":"2024-09-07T03:36:28.120261+0000","last_undegraded":"2024-09-07T03:36:28.120261+0000","last_fullsized":"2024-09-07T03:36:28.120261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-07T03:36:28.120175+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-07T03:36:28.120175+0000","last_clean_scrub_stamp":"2024-09-07T03:36:28.120175+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:12:50.806889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:42.883707+0000","last_change":"2024-09-07T03:36:42.883707+0000","last_active":"2024-09-07T03:36:42.883707+0000","last_peered":"2024-09-07T03:36:42.883707+0000","last_clean":"2024-09-07T03:36:42.883707+0000","last_became_active":"2024-09-07T03:32:20.132396+0000","last_became_peered":"2024-09-07T03:32:20.132396+0000","last_unstale":"2024-09-07T03:36:42.883707+0000","last_undegraded":"2024-09-07T03:36:42.883707+0000","last_fullsized":"2024-09-07T03:36:42.883707+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:42.883621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:42.883621+0000","last_clean_scrub_stamp":"2024-09-07T03:36:42.883621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:47:41.761000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:43.175374+0000","last_change":"2024-09-07T03:36:43.175374+0000","last_active":"2024-09-07T03:36:43.175374+0000","last_peered":"2024-09-07T03:36:43.175374+0000","last_clean":"2024-09-07T03:36:43.175374+0000","last_became_active":"2024-09-07T03:32:22.151697+0000","last_became_peered":"2024-09-07T03:32:22.151697+0000","last_unstale":"2024-09-07T03:36:43.175374+0000","last_undegraded":"2024-09-07T03:36:43.175374+0000","last_fullsized":"2024-09-07T03:36:43.175374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:43.175276+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:43.175276+0000","last_clean_scrub_stamp":"2024-09-07T03:36:43.175276+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:48:09.570567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.046264+0000","last_change":"2024-09-07T03:36:01.046264+0000","last_active":"2024-09-07T03:36:01.046264+0000","last_peered":"2024-09-07T03:36:01.046264+0000","last_clean":"2024-09-07T03:36:01.046264+0000","last_became_active":"2024-09-07T03:32:14.112336+0000","last_became_peered":"2024-09-07T03:32:14.112336+0000","last_unstale":"2024-09-07T03:36:01.046264+0000","last_undegraded":"2024-09-07T03:36:01.046264+0000","last_fullsized":"2024-09-07T03:36:01.046264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:01.046172+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:01.046172+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.046172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:13:46.940832+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.070400+0000","last_change":"2024-09-07T03:35:48.070310+0000","last_active":"2024-09-07T03:35:48.070400+0000","last_peered":"2024-09-07T03:35:48.070400+0000","last_clean":"2024-09-07T03:35:48.070400+0000","last_became_active":"2024-09-07T03:32:12.136020+0000","last_became_peered":"2024-09-07T03:32:12.136020+0000","last_unstale":"2024-09-07T03:35:48.070400+0000","last_undegraded":"2024-09-07T03:35:48.070400+0000","last_fullsized":"2024-09-07T03:35:48.070400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:48.070194+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:48.070194+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.070194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:06:09.533250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:12.289519+0000","last_change":"2024-09-07T03:36:12.289519+0000","last_active":"2024-09-07T03:36:12.289519+0000","last_peered":"2024-09-07T03:36:12.289519+0000","last_clean":"2024-09-07T03:36:12.289519+0000","last_became_active":"2024-09-07T03:32:16.129161+0000","last_became_peered":"2024-09-07T03:32:16.129161+0000","last_unstale":"2024-09-07T03:36:12.289519+0000","last_undegraded":"2024-09-07T03:36:12.289519+0000","last_fullsized":"2024-09-07T03:36:12.289519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-07T03:36:12.289436+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-07T03:36:12.289436+0000","last_clean_scrub_stamp":"2024-09-07T03:36:12.289436+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:48:15.876669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'55","reported_seq":124,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:33.847334+0000","last_change":"2024-09-07T03:36:33.847334+0000","last_active":"2024-09-07T03:36:33.847334+0000","last_peered":"2024-09-07T03:36:33.847334+0000","last_clean":"2024-09-07T03:36:33.847334+0000","last_became_active":"2024-09-07T03:32:18.132072+0000","last_became_peered":"2024-09-07T03:32:18.132072+0000","last_unstale":"2024-09-07T03:36:33.847334+0000","last_undegraded":"2024-09-07T03:36:33.847334+0000","last_fullsized":"2024-09-07T03:36:33.847334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'55","last_scrub_stamp":"2024-09-07T03:36:33.847251+0000","last_deep_scrub":"36'55","last_deep_scrub_stamp":"2024-09-07T03:36:33.847251+0000","last_clean_scrub_stamp":"2024-09-07T03:36:33.847251+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:56:31.729757+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:16.120667+0000","last_change":"2024-09-07T03:36:16.120667+0000","last_active":"2024-09-07T03:36:16.120667+0000","last_peered":"2024-09-07T03:36:16.120667+0000","last_clean":"2024-09-07T03:36:16.120667+0000","last_became_active":"2024-09-07T03:32:20.144977+0000","last_became_peered":"2024-09-07T03:32:20.144977+0000","last_unstale":"2024-09-07T03:36:16.120667+0000","last_undegraded":"2024-09-07T03:36:16.120667+0000","last_fullsized":"2024-09-07T03:36:16.120667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:16.120582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:16.120582+0000","last_clean_scrub_stamp":"2024-09-07T03:36:16.120582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:51:35.245495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:47.901044+0000","last_change":"2024-09-07T03:36:47.901044+0000","last_active":"2024-09-07T03:36:47.901044+0000","last_peered":"2024-09-07T03:36:47.901044+0000","last_clean":"2024-09-07T03:36:47.901044+0000","last_became_active":"2024-09-07T03:32:22.141633+0000","last_became_peered":"2024-09-07T03:32:22.141633+0000","last_unstale":"2024-09-07T03:36:47.901044+0000","last_undegraded":"2024-09-07T03:36:47.901044+0000","last_fullsized":"2024-09-07T03:36:47.901044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:36:47.900951+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:36:47.900951+0000","last_clean_scrub_stamp":"2024-09-07T03:36:47.900951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:36:45.696438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'8","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.132791+0000","last_change":"2024-09-07T03:36:02.132708+0000","last_active":"2024-09-07T03:36:02.132791+0000","last_peered":"2024-09-07T03:36:02.132791+0000","last_clean":"2024-09-07T03:36:02.132791+0000","last_became_active":"2024-09-07T03:32:14.111950+0000","last_became_peered":"2024-09-07T03:32:14.111950+0000","last_unstale":"2024-09-07T03:36:02.132791+0000","last_undegraded":"2024-09-07T03:36:02.132791+0000","last_fullsized":"2024-09-07T03:36:02.132791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:02.132614+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:02.132614+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.132614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:02:45.086077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:37.116076+0000","last_change":"2024-09-07T03:35:37.115987+0000","last_active":"2024-09-07T03:35:37.116076+0000","last_peered":"2024-09-07T03:35:37.116076+0000","last_clean":"2024-09-07T03:35:37.116076+0000","last_became_active":"2024-09-07T03:32:12.132814+0000","last_became_peered":"2024-09-07T03:32:12.132814+0000","last_unstale":"2024-09-07T03:35:37.116076+0000","last_undegraded":"2024-09-07T03:35:37.116076+0000","last_fullsized":"2024-09-07T03:35:37.116076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:37.115869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:37.115869+0000","last_clean_scrub_stamp":"2024-09-07T03:35:37.115869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:47:45.209898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:58.152783+0000","last_change":"2024-09-07T03:35:58.152698+0000","last_active":"2024-09-07T03:35:58.152783+0000","last_peered":"2024-09-07T03:35:58.152783+0000","last_clean":"2024-09-07T03:35:58.152783+0000","last_became_active":"2024-09-07T03:32:14.114966+0000","last_became_peered":"2024-09-07T03:32:14.114966+0000","last_unstale":"2024-09-07T03:35:58.152783+0000","last_undegraded":"2024-09-07T03:35:58.152783+0000","last_fullsized":"2024-09-07T03:35:58.152783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:35:58.152588+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:35:58.152588+0000","last_clean_scrub_stamp":"2024-09-07T03:35:58.152588+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:25:57.639946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:39.133036+0000","last_change":"2024-09-07T03:35:39.132979+0000","last_active":"2024-09-07T03:35:39.133036+0000","last_peered":"2024-09-07T03:35:39.133036+0000","last_clean":"2024-09-07T03:35:39.133036+0000","last_became_active":"2024-09-07T03:32:12.132662+0000","last_became_peered":"2024-09-07T03:32:12.132662+0000","last_unstale":"2024-09-07T03:35:39.133036+0000","last_undegraded":"2024-09-07T03:35:39.133036+0000","last_fullsized":"2024-09-07T03:35:39.133036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:39.132883+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:39.132883+0000","last_clean_scrub_stamp":"2024-09-07T03:35:39.132883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:45:43.737374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'12","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:06.079711+0000","last_change":"2024-09-07T03:36:06.079643+0000","last_active":"2024-09-07T03:36:06.079711+0000","last_peered":"2024-09-07T03:36:06.079711+0000","last_clean":"2024-09-07T03:36:06.079711+0000","last_became_active":"2024-09-07T03:32:14.122301+0000","last_became_peered":"2024-09-07T03:32:14.122301+0000","last_unstale":"2024-09-07T03:36:06.079711+0000","last_undegraded":"2024-09-07T03:36:06.079711+0000","last_fullsized":"2024-09-07T03:36:06.079711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:36:06.079527+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:36:06.079527+0000","last_clean_scrub_stamp":"2024-09-07T03:36:06.079527+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:10:45.982132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:48.860031+0000","last_change":"2024-09-07T03:35:48.859938+0000","last_active":"2024-09-07T03:35:48.860031+0000","last_peered":"2024-09-07T03:35:48.860031+0000","last_clean":"2024-09-07T03:35:48.860031+0000","last_became_active":"2024-09-07T03:32:12.137561+0000","last_became_peered":"2024-09-07T03:32:12.137561+0000","last_unstale":"2024-09-07T03:35:48.860031+0000","last_undegraded":"2024-09-07T03:35:48.860031+0000","last_fullsized":"2024-09-07T03:35:48.860031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:48.859832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:48.859832+0000","last_clean_scrub_stamp":"2024-09-07T03:35:48.859832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:48:54.026056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:59.114273+0000","last_change":"2024-09-07T03:35:59.114219+0000","last_active":"2024-09-07T03:35:59.114273+0000","last_peered":"2024-09-07T03:35:59.114273+0000","last_clean":"2024-09-07T03:35:59.114273+0000","last_became_active":"2024-09-07T03:32:14.114055+0000","last_became_peered":"2024-09-07T03:32:14.114055+0000","last_unstale":"2024-09-07T03:35:59.114273+0000","last_undegraded":"2024-09-07T03:35:59.114273+0000","last_fullsized":"2024-09-07T03:35:59.114273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:59.114136+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:59.114136+0000","last_clean_scrub_stamp":"2024-09-07T03:35:59.114136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:12:46.320540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:40.117649+0000","last_change":"2024-09-07T03:35:40.117553+0000","last_active":"2024-09-07T03:35:40.117649+0000","last_peered":"2024-09-07T03:35:40.117649+0000","last_clean":"2024-09-07T03:35:40.117649+0000","last_became_active":"2024-09-07T03:32:12.132471+0000","last_became_peered":"2024-09-07T03:32:12.132471+0000","last_unstale":"2024-09-07T03:35:40.117649+0000","last_undegraded":"2024-09-07T03:35:40.117649+0000","last_fullsized":"2024-09-07T03:35:40.117649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:40.117422+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:40.117422+0000","last_clean_scrub_stamp":"2024-09-07T03:35:40.117422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:29:20.922622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"36'12","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:55.021206+0000","last_change":"2024-09-07T03:35:55.021206+0000","last_active":"2024-09-07T03:35:55.021206+0000","last_peered":"2024-09-07T03:35:55.021206+0000","last_clean":"2024-09-07T03:35:55.021206+0000","last_became_active":"2024-09-07T03:32:50.280656+0000","last_became_peered":"2024-09-07T03:32:50.280656+0000","last_unstale":"2024-09-07T03:35:55.021206+0000","last_undegraded":"2024-09-07T03:35:55.021206+0000","last_fullsized":"2024-09-07T03:35:55.021206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:35:55.021115+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:35:55.021115+0000","last_clean_scrub_stamp":"2024-09-07T03:35:55.021115+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:26:34.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.896351+0000","last_change":"2024-09-07T03:35:43.896274+0000","last_active":"2024-09-07T03:35:43.896351+0000","last_peered":"2024-09-07T03:35:43.896351+0000","last_clean":"2024-09-07T03:35:43.896351+0000","last_became_active":"2024-09-07T03:32:12.140393+0000","last_became_peered":"2024-09-07T03:32:12.140393+0000","last_unstale":"2024-09-07T03:35:43.896351+0000","last_undegraded":"2024-09-07T03:35:43.896351+0000","last_fullsized":"2024-09-07T03:35:43.896351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.896191+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.896191+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.896191+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T13:06:33.074408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"36'10","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:57.166387+0000","last_change":"2024-09-07T03:35:57.166318+0000","last_active":"2024-09-07T03:35:57.166387+0000","last_peered":"2024-09-07T03:35:57.166387+0000","last_clean":"2024-09-07T03:35:57.166387+0000","last_became_active":"2024-09-07T03:32:14.113830+0000","last_became_peered":"2024-09-07T03:32:14.113830+0000","last_unstale":"2024-09-07T03:35:57.166387+0000","last_undegraded":"2024-09-07T03:35:57.166387+0000","last_fullsized":"2024-09-07T03:35:57.166387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:35:57.166234+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:35:57.166234+0000","last_clean_scrub_stamp":"2024-09-07T03:35:57.166234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:39:08.856653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.149330+0000","last_change":"2024-09-07T03:35:42.149266+0000","last_active":"2024-09-07T03:35:42.149330+0000","last_peered":"2024-09-07T03:35:42.149330+0000","last_clean":"2024-09-07T03:35:42.149330+0000","last_became_active":"2024-09-07T03:32:12.134287+0000","last_became_peered":"2024-09-07T03:32:12.134287+0000","last_unstale":"2024-09-07T03:35:42.149330+0000","last_undegraded":"2024-09-07T03:35:42.149330+0000","last_fullsized":"2024-09-07T03:35:42.149330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:42.149177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:42.149177+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.149177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:37:52.961968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'18","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.088996+0000","last_change":"2024-09-07T03:36:08.088917+0000","last_active":"2024-09-07T03:36:08.088996+0000","last_peered":"2024-09-07T03:36:08.088996+0000","last_clean":"2024-09-07T03:36:08.088996+0000","last_became_active":"2024-09-07T03:32:14.125990+0000","last_became_peered":"2024-09-07T03:32:14.125990+0000","last_unstale":"2024-09-07T03:36:08.088996+0000","last_undegraded":"2024-09-07T03:36:08.088996+0000","last_fullsized":"2024-09-07T03:36:08.088996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-07T03:36:08.088808+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-07T03:36:08.088808+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.088808+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:29:54.842821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:42.081826+0000","last_change":"2024-09-07T03:35:42.081766+0000","last_active":"2024-09-07T03:35:42.081826+0000","last_peered":"2024-09-07T03:35:42.081826+0000","last_clean":"2024-09-07T03:35:42.081826+0000","last_became_active":"2024-09-07T03:32:12.128807+0000","last_became_peered":"2024-09-07T03:32:12.128807+0000","last_unstale":"2024-09-07T03:35:42.081826+0000","last_undegraded":"2024-09-07T03:35:42.081826+0000","last_fullsized":"2024-09-07T03:35:42.081826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:42.081678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:42.081678+0000","last_clean_scrub_stamp":"2024-09-07T03:35:42.081678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:31:00.820127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'12","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:02.022644+0000","last_change":"2024-09-07T03:36:02.022570+0000","last_active":"2024-09-07T03:36:02.022644+0000","last_peered":"2024-09-07T03:36:02.022644+0000","last_clean":"2024-09-07T03:36:02.022644+0000","last_became_active":"2024-09-07T03:32:14.109799+0000","last_became_peered":"2024-09-07T03:32:14.109799+0000","last_unstale":"2024-09-07T03:36:02.022644+0000","last_undegraded":"2024-09-07T03:36:02.022644+0000","last_fullsized":"2024-09-07T03:36:02.022644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:36:02.022470+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:36:02.022470+0000","last_clean_scrub_stamp":"2024-09-07T03:36:02.022470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:00:09.783003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.877532+0000","last_change":"2024-09-07T03:35:44.877468+0000","last_active":"2024-09-07T03:35:44.877532+0000","last_peered":"2024-09-07T03:35:44.877532+0000","last_clean":"2024-09-07T03:35:44.877532+0000","last_became_active":"2024-09-07T03:32:12.130563+0000","last_became_peered":"2024-09-07T03:32:12.130563+0000","last_unstale":"2024-09-07T03:35:44.877532+0000","last_undegraded":"2024-09-07T03:35:44.877532+0000","last_fullsized":"2024-09-07T03:35:44.877532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.877377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.877377+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.877377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:28:27.432331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'8","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:03.159976+0000","last_change":"2024-09-07T03:36:03.159910+0000","last_active":"2024-09-07T03:36:03.159976+0000","last_peered":"2024-09-07T03:36:03.159976+0000","last_clean":"2024-09-07T03:36:03.159976+0000","last_became_active":"2024-09-07T03:32:14.115000+0000","last_became_peered":"2024-09-07T03:32:14.115000+0000","last_unstale":"2024-09-07T03:36:03.159976+0000","last_undegraded":"2024-09-07T03:36:03.159976+0000","last_fullsized":"2024-09-07T03:36:03.159976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-07T03:36:03.159816+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-07T03:36:03.159816+0000","last_clean_scrub_stamp":"2024-09-07T03:36:03.159816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:18:26.711029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:45.890978+0000","last_change":"2024-09-07T03:35:45.890896+0000","last_active":"2024-09-07T03:35:45.890978+0000","last_peered":"2024-09-07T03:35:45.890978+0000","last_clean":"2024-09-07T03:35:45.890978+0000","last_became_active":"2024-09-07T03:32:12.142315+0000","last_became_peered":"2024-09-07T03:32:12.142315+0000","last_unstale":"2024-09-07T03:35:45.890978+0000","last_undegraded":"2024-09-07T03:35:45.890978+0000","last_fullsized":"2024-09-07T03:35:45.890978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:45.890810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:45.890810+0000","last_clean_scrub_stamp":"2024-09-07T03:35:45.890810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:29:01.485471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:09.094544+0000","last_change":"2024-09-07T03:36:09.094544+0000","last_active":"2024-09-07T03:36:09.094544+0000","last_peered":"2024-09-07T03:36:09.094544+0000","last_clean":"2024-09-07T03:36:09.094544+0000","last_became_active":"2024-09-07T03:32:14.127560+0000","last_became_peered":"2024-09-07T03:32:14.127560+0000","last_unstale":"2024-09-07T03:36:09.094544+0000","last_undegraded":"2024-09-07T03:36:09.094544+0000","last_fullsized":"2024-09-07T03:36:09.094544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:36:09.094457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:36:09.094457+0000","last_clean_scrub_stamp":"2024-09-07T03:36:09.094457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T12:55:48.663875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.873637+0000","last_change":"2024-09-07T03:35:47.873531+0000","last_active":"2024-09-07T03:35:47.873637+0000","last_peered":"2024-09-07T03:35:47.873637+0000","last_clean":"2024-09-07T03:35:47.873637+0000","last_became_active":"2024-09-07T03:32:12.138745+0000","last_became_peered":"2024-09-07T03:32:12.138745+0000","last_unstale":"2024-09-07T03:35:47.873637+0000","last_undegraded":"2024-09-07T03:35:47.873637+0000","last_fullsized":"2024-09-07T03:35:47.873637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:47.873426+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:47.873426+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.873426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:54:29.688161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.055969+0000","last_change":"2024-09-07T03:35:52.055838+0000","last_active":"2024-09-07T03:35:52.055969+0000","last_peered":"2024-09-07T03:35:52.055969+0000","last_clean":"2024-09-07T03:35:52.055969+0000","last_became_active":"2024-09-07T03:32:14.122699+0000","last_became_peered":"2024-09-07T03:32:14.122699+0000","last_unstale":"2024-09-07T03:35:52.055969+0000","last_undegraded":"2024-09-07T03:35:52.055969+0000","last_fullsized":"2024-09-07T03:35:52.055969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:35:52.055707+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:35:52.055707+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.055707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:52:43.293149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:52.065906+0000","last_change":"2024-09-07T03:35:52.065851+0000","last_active":"2024-09-07T03:35:52.065906+0000","last_peered":"2024-09-07T03:35:52.065906+0000","last_clean":"2024-09-07T03:35:52.065906+0000","last_became_active":"2024-09-07T03:32:12.133145+0000","last_became_peered":"2024-09-07T03:32:12.133145+0000","last_unstale":"2024-09-07T03:35:52.065906+0000","last_undegraded":"2024-09-07T03:35:52.065906+0000","last_fullsized":"2024-09-07T03:35:52.065906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:52.065764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:52.065764+0000","last_clean_scrub_stamp":"2024-09-07T03:35:52.065764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T15:26:56.647887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"36'16","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:01.141019+0000","last_change":"2024-09-07T03:36:01.140944+0000","last_active":"2024-09-07T03:36:01.141019+0000","last_peered":"2024-09-07T03:36:01.141019+0000","last_clean":"2024-09-07T03:36:01.141019+0000","last_became_active":"2024-09-07T03:32:14.111759+0000","last_became_peered":"2024-09-07T03:32:14.111759+0000","last_unstale":"2024-09-07T03:36:01.141019+0000","last_undegraded":"2024-09-07T03:36:01.141019+0000","last_fullsized":"2024-09-07T03:36:01.141019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-07T03:36:01.140835+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-07T03:36:01.140835+0000","last_clean_scrub_stamp":"2024-09-07T03:36:01.140835+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:43:12.824330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":44,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:43.180833+0000","last_change":"2024-09-07T03:35:43.180733+0000","last_active":"2024-09-07T03:35:43.180833+0000","last_peered":"2024-09-07T03:35:43.180833+0000","last_clean":"2024-09-07T03:35:43.180833+0000","last_became_active":"2024-09-07T03:32:12.134151+0000","last_became_peered":"2024-09-07T03:32:12.134151+0000","last_unstale":"2024-09-07T03:35:43.180833+0000","last_undegraded":"2024-09-07T03:35:43.180833+0000","last_fullsized":"2024-09-07T03:35:43.180833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:43.180633+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:43.180633+0000","last_clean_scrub_stamp":"2024-09-07T03:35:43.180633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:50:19.691547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,3],"acting":[1,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'30","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:08.063754+0000","last_change":"2024-09-07T03:36:08.063680+0000","last_active":"2024-09-07T03:36:08.063754+0000","last_peered":"2024-09-07T03:36:08.063754+0000","last_clean":"2024-09-07T03:36:08.063754+0000","last_became_active":"2024-09-07T03:32:14.124258+0000","last_became_peered":"2024-09-07T03:32:14.124258+0000","last_unstale":"2024-09-07T03:36:08.063754+0000","last_undegraded":"2024-09-07T03:36:08.063754+0000","last_fullsized":"2024-09-07T03:36:08.063754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-07T03:36:08.063566+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-07T03:36:08.063566+0000","last_clean_scrub_stamp":"2024-09-07T03:36:08.063566+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T09:29:42.604250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":111,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:46.921753+0000","last_change":"2024-09-07T03:35:46.921691+0000","last_active":"2024-09-07T03:35:46.921753+0000","last_peered":"2024-09-07T03:35:46.921753+0000","last_clean":"2024-09-07T03:35:46.921753+0000","last_became_active":"2024-09-07T03:32:12.140243+0000","last_became_peered":"2024-09-07T03:32:12.140243+0000","last_unstale":"2024-09-07T03:35:46.921753+0000","last_undegraded":"2024-09-07T03:35:46.921753+0000","last_fullsized":"2024-09-07T03:35:46.921753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:46.921593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:46.921593+0000","last_clean_scrub_stamp":"2024-09-07T03:35:46.921593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T07:41:38.191780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:00.126656+0000","last_change":"2024-09-07T03:36:00.126598+0000","last_active":"2024-09-07T03:36:00.126656+0000","last_peered":"2024-09-07T03:36:00.126656+0000","last_clean":"2024-09-07T03:36:00.126656+0000","last_became_active":"2024-09-07T03:32:14.113016+0000","last_became_peered":"2024-09-07T03:32:14.113016+0000","last_unstale":"2024-09-07T03:36:00.126656+0000","last_undegraded":"2024-09-07T03:36:00.126656+0000","last_fullsized":"2024-09-07T03:36:00.126656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-07T03:36:00.126510+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-07T03:36:00.126510+0000","last_clean_scrub_stamp":"2024-09-07T03:36:00.126510+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:54:09.635230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:50.941767+0000","last_change":"2024-09-07T03:35:50.941687+0000","last_active":"2024-09-07T03:35:50.941767+0000","last_peered":"2024-09-07T03:35:50.941767+0000","last_clean":"2024-09-07T03:35:50.941767+0000","last_became_active":"2024-09-07T03:32:12.135936+0000","last_became_peered":"2024-09-07T03:32:12.135936+0000","last_unstale":"2024-09-07T03:35:50.941767+0000","last_undegraded":"2024-09-07T03:35:50.941767+0000","last_fullsized":"2024-09-07T03:35:50.941767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:50.941592+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:50.941592+0000","last_clean_scrub_stamp":"2024-09-07T03:35:50.941592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T14:06:51.841561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:10.076490+0000","last_change":"2024-09-07T03:36:10.076421+0000","last_active":"2024-09-07T03:36:10.076490+0000","last_peered":"2024-09-07T03:36:10.076490+0000","last_clean":"2024-09-07T03:36:10.076490+0000","last_became_active":"2024-09-07T03:32:14.127982+0000","last_became_peered":"2024-09-07T03:32:14.127982+0000","last_unstale":"2024-09-07T03:36:10.076490+0000","last_undegraded":"2024-09-07T03:36:10.076490+0000","last_fullsized":"2024-09-07T03:36:10.076490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-07T03:36:10.076339+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-07T03:36:10.076339+0000","last_clean_scrub_stamp":"2024-09-07T03:36:10.076339+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T06:56:41.547939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:44.155182+0000","last_change":"2024-09-07T03:35:44.155078+0000","last_active":"2024-09-07T03:35:44.155182+0000","last_peered":"2024-09-07T03:35:44.155182+0000","last_clean":"2024-09-07T03:35:44.155182+0000","last_became_active":"2024-09-07T03:32:12.133720+0000","last_became_peered":"2024-09-07T03:32:12.133720+0000","last_unstale":"2024-09-07T03:35:44.155182+0000","last_undegraded":"2024-09-07T03:35:44.155182+0000","last_fullsized":"2024-09-07T03:35:44.155182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:44.154970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:44.154970+0000","last_clean_scrub_stamp":"2024-09-07T03:35:44.154970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T08:08:12.195152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:07.092198+0000","last_change":"2024-09-07T03:36:07.092133+0000","last_active":"2024-09-07T03:36:07.092198+0000","last_peered":"2024-09-07T03:36:07.092198+0000","last_clean":"2024-09-07T03:36:07.092198+0000","last_became_active":"2024-09-07T03:32:14.124462+0000","last_became_peered":"2024-09-07T03:32:14.124462+0000","last_unstale":"2024-09-07T03:36:07.092198+0000","last_undegraded":"2024-09-07T03:36:07.092198+0000","last_fullsized":"2024-09-07T03:36:07.092198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-07T03:36:07.092039+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-07T03:36:07.092039+0000","last_clean_scrub_stamp":"2024-09-07T03:36:07.092039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T04:55:55.628550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.021401+0000","last_change":"2024-09-07T03:35:54.021307+0000","last_active":"2024-09-07T03:35:54.021401+0000","last_peered":"2024-09-07T03:35:54.021401+0000","last_clean":"2024-09-07T03:35:54.021401+0000","last_became_active":"2024-09-07T03:32:12.140957+0000","last_became_peered":"2024-09-07T03:32:12.140957+0000","last_unstale":"2024-09-07T03:35:54.021401+0000","last_undegraded":"2024-09-07T03:35:54.021401+0000","last_fullsized":"2024-09-07T03:35:54.021401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:54.021157+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:54.021157+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.021157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T10:21:11.328839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:53.020263+0000","last_change":"2024-09-07T03:35:53.020195+0000","last_active":"2024-09-07T03:35:53.020263+0000","last_peered":"2024-09-07T03:35:53.020263+0000","last_clean":"2024-09-07T03:35:53.020263+0000","last_became_active":"2024-09-07T03:32:12.133460+0000","last_became_peered":"2024-09-07T03:32:12.133460+0000","last_unstale":"2024-09-07T03:35:53.020263+0000","last_undegraded":"2024-09-07T03:35:53.020263+0000","last_fullsized":"2024-09-07T03:35:53.020263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-07T03:35:53.020088+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-07T03:35:53.020088+0000","last_clean_scrub_stamp":"2024-09-07T03:35:53.020088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T03:50:01.451093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:54.052185+0000","last_change":"2024-09-07T03:35:54.052185+0000","last_active":"2024-09-07T03:35:54.052185+0000","last_peered":"2024-09-07T03:35:54.052185+0000","last_clean":"2024-09-07T03:35:54.052185+0000","last_became_active":"2024-09-07T03:32:14.123554+0000","last_became_peered":"2024-09-07T03:32:14.123554+0000","last_unstale":"2024-09-07T03:35:54.052185+0000","last_undegraded":"2024-09-07T03:35:54.052185+0000","last_fullsized":"2024-09-07T03:35:54.052185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-07T03:35:54.052099+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-07T03:35:54.052099+0000","last_clean_scrub_stamp":"2024-09-07T03:35:54.052099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T11:35:00.695163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:35:47.090479+0000","last_change":"2024-09-07T03:35:47.090384+0000","last_active":"2024-09-07T03:35:47.090479+0000","last_peered":"2024-09-07T03:35:47.090479+0000","last_clean":"2024-09-07T03:35:47.090479+0000","last_became_active":"2024-09-07T03:32:12.134650+0000","last_became_peered":"2024-09-07T03:32:12.134650+0000","last_unstale":"2024-09-07T03:35:47.090479+0000","last_undegraded":"2024-09-07T03:35:47.090479+0000","last_fullsized":"2024-09-07T03:35:47.090479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-07T03:35:47.090289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-07T03:35:47.090289+0000","last_clean_scrub_stamp":"2024-09-07T03:35:47.090289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:17:09.392606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-07T03:36:05.176461+0000","last_change":"2024-09-07T03:36:05.176461+0000","last_active":"2024-09-07T03:36:05.176461+0000","last_peered":"2024-09-07T03:36:05.176461+0000","last_clean":"2024-09-07T03:36:05.176461+0000","last_became_active":"2024-09-07T03:32:14.127493+0000","last_became_peered":"2024-09-07T03:32:14.127493+0000","last_unstale":"2024-09-07T03:36:05.176461+0000","last_undegraded":"2024-09-07T03:36:05.176461+0000","last_fullsized":"2024-09-07T03:36:05.176461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-07T03:36:05.176380+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-07T03:36:05.176380+0000","last_clean_scrub_stamp":"2024-09-07T03:36:05.176380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T05:05:49.424788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1785,"ondisk_log_size":1785,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1666,"num_read_kb":1556,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640320,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":450560,"data_stored":155820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640320,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":744671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640320,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":158016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705727,"num_pgs":164,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40560,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331280,"statfs":{"total":96636764160,"available":96595230720,"internally_reserved":0,"allocated":1081344,"data_stored":748249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-07T03:36:56.606 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-07T03:36:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.727+0000 7fe720cdd640 1 Processor -- start 2024-09-07T03:36:56.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.727+0000 7fe720cdd640 1 -- start start 2024-09-07T03:36:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.728+0000 7fe720cdd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe71c12ca00 0x7fe71c1314b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:56.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.728+0000 7fe720cdd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71c09a160 con 0x7fe71c12bf10 2024-09-07T03:36:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.728+0000 7fe720cdd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 -- 0x7fe71c06def0 con 0x7fe71c12ca00 2024-09-07T03:36:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.728+0000 7fe719d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe71c12ca00 0x7fe71c1314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.728+0000 7fe71a59c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe71c12bf10 0x7fe71c12c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50962/0 (socket says 172.21.15.104:50962) 2024-09-07T03:36:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.728+0000 7fe71a59c640 1 -- 172.21.15.104:0/2119254349 learned_addr learned my addr 172.21.15.104:0/2119254349 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-09-07T03:36:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.728+0000 7fe719d9b640 1 -- 172.21.15.104:0/2119254349 >> v1:172.21.15.104:6789/0 conn(0x7fe71c12bf10 legacy=0x7fe71c12c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.728+0000 7fe719d9b640 1 -- 172.21.15.104:0/2119254349 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c099b10 con 0x7fe71c12ca00 2024-09-07T03:36:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe719d9b640 1 --2- 172.21.15.104:0/2119254349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12ca00 0x7fe71c1314b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe710009720 tx=0x7fe71002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908f8bdd3e13265b server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe71959a640 1 -- 172.21.15.104:0/2119254349 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe710037070 con 0x7fe71c12ca00 2024-09-07T03:36:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe71959a640 1 -- 172.21.15.104:0/2119254349 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71002ad90 con 0x7fe71c12ca00 2024-09-07T03:36:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe71959a640 1 -- 172.21.15.104:0/2119254349 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe710032590 con 0x7fe71c12ca00 2024-09-07T03:36:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe720cdd640 1 -- 172.21.15.104:0/2119254349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12ca00 msgr2=0x7fe71c1314b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:56.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe720cdd640 1 --2- 172.21.15.104:0/2119254349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12ca00 0x7fe71c1314b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe710009720 tx=0x7fe71002a110 comp rx=0 tx=0).stop 2024-09-07T03:36:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe720cdd640 1 -- 172.21.15.104:0/2119254349 shutdown_connections 2024-09-07T03:36:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe720cdd640 1 --2- 172.21.15.104:0/2119254349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12ca00 0x7fe71c1314b0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe720cdd640 1 -- 172.21.15.104:0/2119254349 >> 172.21.15.104:0/2119254349 conn(0x7fe71c09a930 msgr2=0x7fe71c09ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:36:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.729+0000 7fe720cdd640 1 -- 172.21.15.104:0/2119254349 shutdown_connections 2024-09-07T03:36:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.730+0000 7fe720cdd640 1 -- 172.21.15.104:0/2119254349 wait complete. 2024-09-07T03:36:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.730+0000 7fe720cdd640 1 Processor -- start 2024-09-07T03:36:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.730+0000 7fe720cdd640 1 -- start start 2024-09-07T03:36:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe720cdd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12bf10 0x7fe71c08e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe720cdd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c095150 con 0x7fe71c12bf10 2024-09-07T03:36:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe71a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12bf10 0x7fe71c08e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:56.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe71a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12bf10 0x7fe71c08e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34598/0 (socket says 172.21.15.104:34598) 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe71a59c640 1 -- 172.21.15.104:0/3459372568 learned_addr learned my addr 172.21.15.104:0/3459372568 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe71a59c640 1 -- 172.21.15.104:0/3459372568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c08fcc0 con 0x7fe71c12bf10 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe71a59c640 1 --2- 172.21.15.104:0/3459372568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12bf10 0x7fe71c08e680 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c480 tx=0x7fe70c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe70affd640 1 -- 172.21.15.104:0/3459372568 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe70c017070 con 0x7fe71c12bf10 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe70affd640 1 -- 172.21.15.104:0/3459372568 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c005c10 con 0x7fe71c12bf10 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c0919a0 con 0x7fe71c12bf10 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe70affd640 1 -- 172.21.15.104:0/3459372568 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe70c007070 con 0x7fe71c12bf10 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.731+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71c08eda0 con 0x7fe71c12bf10 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.732+0000 7fe70affd640 1 -- 172.21.15.104:0/3459372568 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe70c01a070 con 0x7fe71c12bf10 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.732+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe71c090450 con 0x7fe71c12bf10 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.732+0000 7fe70affd640 1 --2- 172.21.15.104:0/3459372568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe6fc03de90 0x7fe6fc040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.733+0000 7fe70affd640 1 -- 172.21.15.104:0/3459372568 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe70c051f30 con 0x7fe71c12bf10 2024-09-07T03:36:56.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.733+0000 7fe719d9b640 1 --2- 172.21.15.104:0/3459372568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe6fc03de90 0x7fe6fc040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-07T03:36:56.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.733+0000 7fe719d9b640 1 --2- 172.21.15.104:0/3459372568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe6fc03de90 0x7fe6fc040350 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe710034000 tx=0x7fe71002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-07T03:36:56.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.737+0000 7fe70affd640 1 -- 172.21.15.104:0/3459372568 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fe70c01ac60 con 0x7fe71c12bf10 2024-09-07T03:36:56.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.909+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe71c12c2f0 con 0x7fe71c12bf10 2024-09-07T03:36:56.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.913+0000 7fe70affd640 1 -- 172.21.15.104:0/3459372568 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fe70c019cd0 con 0x7fe71c12bf10 2024-09-07T03:36:56.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.913+0000 7fe70affd640 1 -- 172.21.15.104:0/3459372568 <== mon.0 v2:172.21.15.104:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe70c019840 con 0x7fe71c12bf10 2024-09-07T03:36:56.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe6fc03de90 msgr2=0x7fe6fc040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:56.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 --2- 172.21.15.104:0/3459372568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe6fc03de90 0x7fe6fc040350 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe710034000 tx=0x7fe71002e000 comp rx=0 tx=0).stop 2024-09-07T03:36:56.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12bf10 msgr2=0x7fe71c08e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-07T03:36:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 --2- 172.21.15.104:0/3459372568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12bf10 0x7fe71c08e680 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c480 tx=0x7fe70c00c940 comp rx=0 tx=0).stop 2024-09-07T03:36:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 shutdown_connections 2024-09-07T03:36:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 --2- 172.21.15.104:0/3459372568 >> [v2:172.21.15.120:6824/924102273,v1:172.21.15.120:6825/924102273] conn(0x7fe6fc03de90 0x7fe6fc040350 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 --2- 172.21.15.104:0/3459372568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe71c12bf10 0x7fe71c08e680 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-07T03:36:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 >> 172.21.15.104:0/3459372568 conn(0x7fe71c09a930 msgr2=0x7fe71c09bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-07T03:36:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 shutdown_connections 2024-09-07T03:36:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-07T03:36:56.915+0000 7fe720cdd640 1 -- 172.21.15.104:0/3459372568 wait complete. 2024-09-07T03:36:56.926 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-07T03:36:56.927 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-07T03:36:56.927 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-07T03:36:56.927 INFO:teuthology.orchestra.run:waiting for 300 2024-09-07T03:36:56.963 INFO:tasks.ceph.osd.0:Stopped 2024-09-07T03:36:56.964 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-07T03:36:56.964 INFO:teuthology.orchestra.run:waiting for 300 2024-09-07T03:36:57.002 INFO:tasks.ceph.osd.1:Stopped 2024-09-07T03:36:57.003 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-07T03:36:57.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-07T03:36:57.073 INFO:tasks.ceph.osd.2:Stopped 2024-09-07T03:36:57.073 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-07T03:36:57.073 INFO:teuthology.orchestra.run:waiting for 300 2024-09-07T03:36:57.142 INFO:tasks.ceph.osd.3:Stopped 2024-09-07T03:36:57.142 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-07T03:36:57.142 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-07T03:36:57.143 INFO:teuthology.orchestra.run:waiting for 300 2024-09-07T03:36:57.211 INFO:tasks.ceph.mgr.x:Stopped 2024-09-07T03:36:57.212 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-07T03:36:57.212 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-07T03:36:57.212 INFO:teuthology.orchestra.run:waiting for 300 2024-09-07T03:36:57.222 INFO:tasks.ceph.mon.a:Stopped 2024-09-07T03:36:57.223 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-07T03:36:57.223 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-07T03:36:57.296 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-07T03:36:57.296 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-07T03:36:57.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-07T03:36:57.462 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-07T03:36:57.739 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-07T03:36:57.739 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-07T03:36:57.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-07T03:36:57.793 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-07T03:36:57.842 INFO:tasks.ceph:Archiving mon data... 2024-09-07T03:36:57.844 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412/data/mon.a.tgz 2024-09-07T03:36:57.844 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-09-07T03:36:57.861 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.dUbpaN52C9 2024-09-07T03:36:57.862 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dUbpaN52C9 2024-09-07T03:36:57.999 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.dUbpaN52C9 2024-09-07T03:36:58.083 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.dUbpaN52C9 is 277KB 2024-09-07T03:36:58.178 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.dUbpaN52C9 2024-09-07T03:36:58.192 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-07T03:36:58.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-07T03:36:58.234 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-07T03:36:58.311 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-07T03:36:58.328 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-07T03:36:58.328 INFO:tasks.ceph:Archiving crash dumps... 2024-09-07T03:36:58.330 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412/remote/smithi104/crash 2024-09-07T03:36:58.331 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-07T03:36:58.376 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412/remote/smithi120/crash 2024-09-07T03:36:58.377 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-07T03:36:58.415 INFO:tasks.ceph:Compressing logs... 2024-09-07T03:36:58.416 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-07T03:36:58.420 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-07T03:36:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-07T03:36:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32051.log 2024-09-07T03:36:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32217.log 2024-09-07T03:36:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33306.log 2024-09-07T03:36:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32217.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32051.log.gz 2024-09-07T03:36:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32388.log 2024-09-07T03:36:58.473 INFO:teuthology.orchestra.run.smithi104.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32217.log.gz 2024-09-07T03:36:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32634.log 2024-09-07T03:36:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33306.log: /var/log/ceph/ceph-client.admin.32388.log: gzip 85.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.33306.log.gz --verbose 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.32970.log 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32388.log.gz 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29625.log 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32970.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32634.log.gz 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31866.log 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32970.log.gz 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32328.log 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.29625.log.gz 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33138.log 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32328.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31866.log.gz 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-07T03:36:58.474 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32328.log.gz 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31692.log 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.33138.log.gz 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32387.log 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31824.log 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31692.log.gz 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32049.log 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32387.log.gz 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32760.log 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31824.log: /var/log/ceph/ceph-client.admin.32049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32219.log 2024-09-07T03:36:58.475 INFO:teuthology.orchestra.run.smithi104.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31824.log.gz 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32049.log.gz 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33012.log 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32219.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32760.log.gz 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31908.log 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32219.log.gz 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30817.log 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.33012.log.gz 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33096.log 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.30817.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31908.log.gz 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32220.log 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30817.log.gz 2024-09-07T03:36:58.476 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32538.log 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.33096.log.gz 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32718.log 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32538.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32220.log.gz 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31773.log 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32538.log.gz 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32718.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32718.log.gz 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33346.log 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32580.log 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.31773.log.gz 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33264.log 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.33346.log.gz 2024-09-07T03:36:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32844.log 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32580.log.gz 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.33264.log.gz 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29663.log 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32844.log: /var/log/ceph/ceph-client.admin.32676.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32844.log.gz 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32496.log 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29663.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33222.log 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.29663.log.gz 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33054.log 2024-09-07T03:36:58.478 INFO:teuthology.orchestra.run.smithi104.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32496.log.gz 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32928.log 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.33222.log.gz 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32802.log 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33054.log.gz 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32928.log: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33180.log 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32928.log.gz 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32802.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27807.log 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32886.log 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32802.log.gz 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.33180.log.gz 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.tmp-client.admin.27807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31748.log 2024-09-07T03:36:58.479 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27807.log.gz 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31950.log 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32886.log: /var/log/ceph/ceph-client.admin.31748.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32886.log.gz 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32050.log 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31748.log.gz 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29507.log 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.31950.log: /var/log/ceph/ceph-client.admin.32050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32052.log 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31950.log.gz 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.29507.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32050.log.gz 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32386.log 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.29507.log.gz 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32218.log 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32052.log.gz 2024-09-07T03:36:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32386.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32386.log.gz 2024-09-07T03:36:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32218.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32218.log.gz 2024-09-07T03:36:58.539 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59522.log 2024-09-07T03:36:58.539 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76462.log 2024-09-07T03:36:58.539 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.59522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54682.log 2024-09-07T03:36:58.539 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.76462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75857.log 2024-09-07T03:36:58.539 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.54682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49237.log 2024-09-07T03:36:58.539 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.75857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53472.log 2024-09-07T03:36:58.539 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59522.log.gz 2024-09-07T03:36:58.539 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.0.49237.log: -5 --verbose -- /var/log/ceph/ceph-client.0.84327.log 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76462.log.gz 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.53472.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54682.log.gz 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71622.log 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.84327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81907.log 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75857.log.gz 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.49237.log.gz 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.71622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46212.log 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.81907.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53472.log.gz 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40168.log 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57102.log 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.46212.log: /var/log/ceph/ceph-client.0.40168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66177.log 2024-09-07T03:36:58.540 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71622.log.gz 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.57102.log: gzip -5 90.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.40168.log.gz /var/log/ceph/ceph-client.0.46817.log 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.66177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94582.log 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.84327.log.gz 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.46817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92767.log 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46212.log.gz 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81907.log.gz 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31910.log 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.94582.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.57102.log.gz/var/log/ceph/ceph-client.0.92767.log: 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31910.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46817.log.gz 2024-09-07T03:36:58.541 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90347.log 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.66177.log.gz 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.31910.log.gz 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log/var/log/ceph/ceph-osd.1.log: 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94582.log.gz 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.90347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69202.log 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.92767.log.gz 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41977.log 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.69202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70412.log 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.41977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60127.log 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.70412.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90347.log.gz 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63757.log 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87933.log 2024-09-07T03:36:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.60127.log: /var/log/ceph/ceph-client.0.63757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77067.log 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43187.log 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.87933.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41977.log.gz 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69202.log.gz/var/log/ceph/ceph-client.0.77067.log: 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 90.5% -- replaced with /var/log/ceph/ceph-client.0.87933.log.gz 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.0.96397.log 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% 92.6% -- replaced with /var/log/ceph/ceph-client.0.70412.log.gz 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.0.60127.log.gz 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.43187.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63757.log.gz 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47422.log 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.96397.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77067.log.gz 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90952.log 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.47422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78882.log 2024-09-07T03:36:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.90952.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43187.log.gz 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37748.log 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80697.log 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.78882.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.96397.log.gz 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.37748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39563.log 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.80697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38353.log 91.1% -- replaced with /var/log/ceph/ceph-client.0.47422.log.gz 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90952.log.gz 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.39563.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78882.log.gz 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73437.log 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.38353.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37748.log.gz 2024-09-07T03:36:58.544 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49842.log 2024-09-07T03:36:58.545 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95792.log 2024-09-07T03:36:58.545 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.73437.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80697.log.gz 2024-09-07T03:36:58.545 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.49842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45002.log 2024-09-07T03:36:58.545 INFO:teuthology.orchestra.run.smithi120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39563.log.gz 2024-09-07T03:36:58.545 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.95792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92162.log 2024-09-07T03:36:58.545 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.45002.log: gzip -5 91.1% -- replaced with /var/log/ceph/ceph-client.0.73437.log.gz 2024-09-07T03:36:58.545 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.0.64362.log 2024-09-07T03:36:58.545 INFO:teuthology.orchestra.run.smithi120.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38353.log.gz 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.92162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65572.log 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.49842.log.gz 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.64362.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95792.log.gz 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37143.log 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43792.log 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.65572.log: 91.1%/var/log/ceph/ceph-client.0.37143.log: -- replaced with /var/log/ceph/ceph-client.0.45002.log.gz 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58917.log 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92162.log.gz 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.43792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44397.log 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64362.log.gz 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.58917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87334.log 2024-09-07T03:36:58.546 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.44397.log: 92.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36309.log 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.0.37143.log.gz 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65572.log.gz 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.87334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68597.log 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43792.log.gz 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.36309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60732.log 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.87334.log.gz 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% 86.3% -- replaced with /var/log/ceph/ceph-client.0.58917.log.gz -- replaced with /var/log/ceph/ceph-client.admin.36309.log.gz 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.68597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74647.log 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44397.log.gz 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.60732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67387.log 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.74647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63152.log 2024-09-07T03:36:58.547 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.67387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56497.log 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.68597.log.gz 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.63152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57707.log 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.60732.log.gz 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.56497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79487.log 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5/var/log/ceph/ceph-client.0.57707.log: --verbose -- /var/log/ceph/ceph-client.0.55287.log 91.4% -- replaced with /var/log/ceph/ceph-client.0.74647.log.gz 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.79487.log: gzip -5 91.7% -- replaced with /var/log/ceph/ceph-client.0.67387.log.gz 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.0.45607.log 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63152.log.gz 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.55287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72832.log 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56497.log.gz 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.45607.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57707.log.gz 2024-09-07T03:36:58.548 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95187.log 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79487.log.gz 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42582.log 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.72832.log: /var/log/ceph/ceph-client.0.95187.log: gzip -5 --verbose 92.0% -- replaced with /var/log/ceph/ceph-client.0.55287.log.gz 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.0.75252.log 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.42582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36229.log 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45607.log.gz 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.75252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80092.log 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41372.log 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95187.log.gz/var/log/ceph/ceph-client.0.80092.log: /var/log/ceph/ceph-client.admin.36229.log: 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3%gzip -- replaced with /var/log/ceph/ceph-client.0.42582.log.gz -5 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31830.log 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72832.log.gz 2024-09-07T03:36:58.549 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.41372.log: /var/log/ceph/ceph-client.0.50447.log 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36229.log.gz 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31830.log: gzip -5 --verbose 91.7% -- /var/log/ceph/ceph-client.0.66782.log -- replaced with /var/log/ceph/ceph-client.0.75252.log.gz 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.31830.log.gz 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78277.log 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.50447.log: /var/log/ceph/ceph-client.0.66782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52262.log 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.78277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85537.log 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% 91.4% -- replaced with /var/log/ceph/ceph-client.0.80092.log.gz -- replaced with /var/log/ceph/ceph-client.0.41372.log.gz 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.52262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51657.log 2024-09-07T03:36:58.550 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50447.log.gz/var/log/ceph/ceph-client.0.85537.log: 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81302.log 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.51657.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66782.log.gz 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr:gzip 91.2% -- replaced with /var/log/ceph/ceph-client.0.78277.log.gz 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose 90.3% -- replaced with /var/log/ceph/ceph-client.0.85537.log.gz 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.0.71017.log 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.81302.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52262.log.gz 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58312.log 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.71017.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.58312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48632.log 2024-09-07T03:36:58.551 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.2.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51657.log.gz 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61337.log 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81302.log.gz 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.48632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83117.log 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71017.log.gz 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.61337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61942.log 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.83117.log: gzip -5 --verbose -- 91.0% /var/log/ceph/ceph-client.0.40767.log 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.0.58312.log.gz 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.61942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51052.log 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48632.log.gz 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64967.log 2024-09-07T03:36:58.552 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.40767.log: /var/log/ceph/ceph-client.0.51052.log: 90.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48027.log 2024-09-07T03:36:58.553 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.0.61337.log.gz 2024-09-07T03:36:58.553 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.83117.log.gz 2024-09-07T03:36:58.553 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.64967.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61942.log.gz 2024-09-07T03:36:58.553 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 91.3% -- replaced with /var/log/ceph/ceph-client.0.51052.log.gz 2024-09-07T03:36:58.553 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:58.553 INFO:teuthology.orchestra.run.smithi120.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.40767.log.gz 2024-09-07T03:36:58.553 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.48027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86735.log 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mgr.x.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64967.log.gz 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74042.log 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.86735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67992.log 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.74042.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48027.log.gz 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89137.log 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86735.log.gz 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36349.log 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.67992.log: /var/log/ceph/ceph-client.0.89137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82512.log 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.36349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55892.log 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.74042.log.gz 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36349.log.gz 2024-09-07T03:36:58.554 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.82512.log: /var/log/ceph/ceph-client.0.91557.log 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr: 91.0%/var/log/ceph/ceph-client.0.55892.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.89137.log.gz 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.0.67992.log.gz 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36269.log 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97054.log 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.91557.log: /var/log/ceph/ceph-client.admin.36269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83722.log 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr: 86.2%/var/log/ceph/ceph-client.0.97054.log: -- replaced with /var/log/ceph/ceph-client.admin.36269.log.gz 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.55892.log.gz 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36189.log 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.83722.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.82512.log.gz 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.36189.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.91557.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.93977.log 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:58.555 INFO:teuthology.orchestra.run.smithi120.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36189.log.gz 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83722.log.gz 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93372.log 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.0.93977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31950.log 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.93372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77672.log 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31950.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.97054.log.gz 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31950.log.gz 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72227.log 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93977.log.gz 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.77672.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.93372.log.gz 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.69807.log 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.72227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88532.log 2024-09-07T03:36:58.556 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.69807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62547.log 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77672.log.gz 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.88532.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72227.log.gz 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38958.log 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.62547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84932.log 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.38958.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88532.log.gz 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86136.log 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.84932.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.69807.log.gz 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62547.log.gz 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54077.log 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38958.log.gz 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.86136.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.54077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31870.log 2024-09-07T03:36:58.557 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.3.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.86136.log.gz 91.3% -- replaced with /var/log/ceph/ceph-client.0.84932.log.gz 2024-09-07T03:36:58.558 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:58.558 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89742.log 2024-09-07T03:36:58.558 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31870.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54077.log.gzgzip 2024-09-07T03:36:58.558 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.52867.log 2024-09-07T03:36:58.558 INFO:teuthology.orchestra.run.smithi120.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.31870.log.gz 2024-09-07T03:36:58.558 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.89742.log: /var/log/ceph/ceph-client.0.52867.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89742.log.gz 2024-09-07T03:36:58.558 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52867.log.gz 2024-09-07T03:36:58.577 INFO:teuthology.orchestra.run.smithi120.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-07T03:36:58.579 INFO:teuthology.orchestra.run.smithi120.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-07T03:36:58.615 INFO:teuthology.orchestra.run.smithi104.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-07T03:36:59.322 INFO:teuthology.orchestra.run.smithi120.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-07T03:36:59.516 INFO:teuthology.orchestra.run.smithi120.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-07T03:36:59.523 INFO:teuthology.orchestra.run.smithi120.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-07T03:36:59.525 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-07T03:36:59.525 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m1.049s 2024-09-07T03:36:59.525 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m2.985s 2024-09-07T03:36:59.526 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m0.193s 2024-09-07T03:36:59.528 INFO:teuthology.orchestra.run.smithi104.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-07T03:36:59.530 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-07T03:36:59.530 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m1.098s 2024-09-07T03:36:59.530 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m1.231s 2024-09-07T03:36:59.531 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.082s 2024-09-07T03:36:59.531 INFO:tasks.ceph:Archiving logs... 2024-09-07T03:36:59.531 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412/remote/smithi104/log 2024-09-07T03:36:59.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-07T03:36:59.812 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412/remote/smithi120/log 2024-09-07T03:36:59.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-07T03:37:00.350 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-07T03:37:00.359 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-07T03:37:00.359 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-07T03:37:00.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-07T03:37:00.454 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-07T03:37:00.463 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-07T03:37:00.464 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-07T03:37:00.466 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-07T03:37:00.479 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-09-07T03:37:00.480 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-07T03:37:00.483 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-07T03:37:00.483 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-09-07T03:37:00.483 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +161us[ +161us] +/- 65ms 2024-09-07T03:37:00.483 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 +32us[ +32us] +/- 55ms 2024-09-07T03:37:00.483 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -181us[ -181us] +/- 62ms 2024-09-07T03:37:00.484 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:37:00.485 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-07T03:37:00.485 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-07T03:37:00.485 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +180us[ +197us] +/- 65ms 2024-09-07T03:37:00.485 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 +37us[ +37us] +/- 55ms 2024-09-07T03:37:00.485 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -175us[ -158us] +/- 62ms 2024-09-07T03:37:00.485 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-07T03:37:00.486 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-07T03:37:00.496 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-07T03:37:00.497 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-07T03:37:00.504 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-07T03:37:00.585 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-07T03:37:00.645 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-07T03:37:00.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-07T03:37:00.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-07T03:37:00.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-07T03:37:00.702 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-07T03:37:00.711 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-07T03:37:00.719 INFO:teuthology.task.internal:Duration was 690.510355 seconds 2024-09-07T03:37:00.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-07T03:37:00.728 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-07T03:37:00.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-07T03:37:00.731 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-07T03:37:00.767 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-07T03:37:00.780 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-07T03:37:01.205 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-07T03:37:01.205 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-09-07T03:37:01.205 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-07T03:37:01.266 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-09-07T03:37:01.266 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-07T03:37:01.290 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-07T03:37:01.291 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-07T03:37:01.308 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-07T03:37:01.356 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-07T03:37:01.356 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-07T03:37:01.375 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-07T03:37:01.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-07T03:37:01.503 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-07T03:37:01.504 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-07T03:37:01.529 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-07T03:37:01.554 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-07T03:37:01.564 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-07T03:37:01.571 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-07T03:37:01.592 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-09-07T03:37:01.617 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-09-07T03:37:01.644 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-07T03:37:01.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-07T03:37:01.667 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-07T03:37:01.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-07T03:37:01.699 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-07T03:37:01.709 INFO:teuthology.task.internal:Transferring archived files... 2024-09-07T03:37:01.710 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412/remote/smithi104 2024-09-07T03:37:01.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-07T03:37:01.744 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-07_03:10:16-rgw-wip-rgw-meta-handlers-distro-default-smithi/7893412/remote/smithi120 2024-09-07T03:37:01.744 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-07T03:37:01.777 INFO:teuthology.task.internal:Removing archive directory... 2024-09-07T03:37:01.777 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-07T03:37:01.780 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-07T03:37:01.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-07T03:37:01.838 INFO:teuthology.task.internal:Not uploading archives. 2024-09-07T03:37:01.838 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-07T03:37:01.847 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-07T03:37:01.848 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-07T03:37:01.850 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-07T03:37:01.862 INFO:teuthology.orchestra.run.smithi104.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 7 03:37 /home/ubuntu/cephtest 2024-09-07T03:37:01.881 INFO:teuthology.orchestra.run.smithi120.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 7 03:37 /home/ubuntu/cephtest 2024-09-07T03:37:01.883 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-07T03:37:01.893 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-07T03:37:01.921 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 690.5103554725647 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-07T03:37:01.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-07T03:37:02.024 INFO:teuthology.run:pass